2024-09-12T00:32:35.823 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:32:35.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:32:35.960 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901503' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHAxt14MemA+diLwcRglTm+/65uuiWXgxaJXUJAd4wId5gBNRiFPJ66cR4deLILuk3z88pkBeIBreJE/+3EEO+M= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEdlGUjIYXKM5n7p/dMfxx1nP0/R8lkTt9tSWgagia9saCUPGM0oiuvsL/IFF9pWURni5ojDhz4DMkbJlpHPUjo= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKmQJkWfknV/lHANQT08ba3Y0mfK9MTPq9W9sKCIl371zPYQHncTB1TjAhapHGWgMPTdesuwN116JAg9p6azDi0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:32:35.961 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T00:32:35.961 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T00:32:35.962 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:32:35.963 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:32:35.988 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T00:32:35.988 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:32:35.989 INFO:teuthology.packaging:ref: None 2024-09-12T00:32:35.989 INFO:teuthology.packaging:tag: None 2024-09-12T00:32:35.989 INFO:teuthology.packaging:branch: squid 2024-09-12T00:32:35.989 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:32:35.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T00:32:36.219 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T00:32:36.221 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:32:36.228 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:32:36.228 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:32:36.309 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:32:36.333 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:32:36.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:32:36.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:27:29.952191', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHAxt14MemA+diLwcRglTm+/65uuiWXgxaJXUJAd4wId5gBNRiFPJ66cR4deLILuk3z88pkBeIBreJE/+3EEO+M='} 2024-09-12T00:32:36.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:27:29.950535', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEdlGUjIYXKM5n7p/dMfxx1nP0/R8lkTt9tSWgagia9saCUPGM0oiuvsL/IFF9pWURni5ojDhz4DMkbJlpHPUjo='} 2024-09-12T00:32:36.474 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:27:29.948587', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKmQJkWfknV/lHANQT08ba3Y0mfK9MTPq9W9sKCIl371zPYQHncTB1TjAhapHGWgMPTdesuwN116JAg9p6azDi0='} 2024-09-12T00:32:36.475 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:32:36.481 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T00:32:36.481 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T00:32:36.481 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T00:32:36.481 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:32:36.618 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc0ea263520>, signals=[15]) 2024-09-12T00:32:36.618 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:32:36.625 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:32:36.625 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T00:32:36.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:32:36.711 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-12T00:32:36.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:32:36.798 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-12T00:32:36.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:32:36.886 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:32:36.892 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-12T00:32:36.911 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-12T00:32:36.911 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-12T00:32:36.969 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-12T00:32:36.969 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-12T00:32:36.969 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-12T00:32:36.969 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:32:36.969 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-12T00:32:36.969 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:32:36.971 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-12T00:32:36.998 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-12T00:32:37.017 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-12T00:32:37.017 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-12T00:32:37.075 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:32:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:32:37.077 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:32:37.077 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:32:37.077 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:32:37.077 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-12T00:32:37.107 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-12T00:32:37.126 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-12T00:32:37.126 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-12T00:32:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-09-12T00:32:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-09-12T00:32:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-09-12T00:32:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:32:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-09-12T00:32:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:32:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:32:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-09-12T00:32:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:32:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:32:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:32:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:32:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:32:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:32:37.185 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-12T00:32:37.215 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:32:37.230 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:32:37.249 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:32:37.249 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:32:37.251 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:32:37.254 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:32:37.270 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:32:37.276 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:32:37.276 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:32:37.309 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:32:37.311 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:32:37.338 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:32:37.438 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:32:37.452 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:32:37.452 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-12T00:32:37.452 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-12T00:32:37.453 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:32:37.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:32:37.470 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-12T00:32:37.528 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:32:37.529 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-12T00:32:37.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-12T00:32:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.2 MB 00:00 2024-09-12T00:32:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-12T00:32:47.826 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T00:32:49.277 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-12T00:32:50.098 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-12T00:32:55.737 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-12T00:32:57.843 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:32:57.843 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:32:57.934 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:32:57.941 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:32:57.942 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:32:57.942 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-12T00:32:57.942 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-12T00:32:57.942 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-12T00:32:57.942 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:32:57.942 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-12T00:32:57.942 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-12T00:32:57.943 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-12T00:32:58.071 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 283 kB/s | 23 kB 00:00 2024-09-12T00:33:00.813 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-12T00:33:02.830 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.0 MB/s | 29 MB 00:04 2024-09-12T00:33:03.522 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.2 MB/s | 35 MB 00:05 2024-09-12T00:33:03.522 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:33:03.522 INFO:teuthology.orchestra.run.smithi002.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-12T00:33:04.229 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-12T00:33:04.615 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-12T00:33:04.615 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-12T00:33:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-12T00:33:05.585 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-12T00:33:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-12T00:33:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:33:08.938 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:33:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:33:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:33:16.988 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:33:17.034 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:33:22.166 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:34:00.886 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:34:00.928 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:34:01.264 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:34:01.264 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:34:01.265 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:34:01.265 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:34:02.098 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:34:02.099 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:34:02.099 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-12T00:34:02.099 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:34:02.099 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:34:02.099 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:34:02.099 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:34:02.099 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:34:02.099 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-12T00:34:02.425 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:34:02.518 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:34:02.518 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:34:02.518 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:34:02.518 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:34:02.519 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:34:02.519 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T00:34:02.519 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:34:02.519 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:34:02.578 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:34:02.578 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:34:02.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-12T00:34:02.609 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-12T00:34:02.609 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-12T00:34:02.610 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:34:02.611 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:34:02.612 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:34:02.612 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:34:02.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:34:03.273 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-12T00:34:04.575 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:34:04.589 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-12T00:34:04.592 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-12T00:34:04.607 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.b1SCphvNsf 2024-09-12T00:34:04.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.b1SCphvNsf 2024-09-12T00:34:04.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.b1SCphvNsf 2024-09-12T00:34:04.815 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.b1SCphvNsf is 6KB 2024-09-12T00:34:04.865 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.b1SCphvNsf 2024-09-12T00:34:04.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:34:04.942 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:34:04.942 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:34:04.942 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:34:04.942 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:34:04.943 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:34:05.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-12T00:34:35.094 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T00:34:35.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-12T00:34:35.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:35:35.106 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T00:35:44.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-12T00:35:44.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:35:45.667 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-12T00:35:46.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-12T00:35:46.085 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:35:46.085 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-12T00:35:46.100 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:35:46.101 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:35:46.101 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:35:46.101 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:35:47.101 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:47.102 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:35:47.110 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:35:47.110 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:35:47.113 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:35:47.116 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:35:47.135 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:35:47.143 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:35:47.177 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:35:47.177 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:35:47.179 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:35:47.181 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:35:47.309 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:35:47.315 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:35:47.316 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:35:47.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:35:47.333 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:35:47.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:35:47.350 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:35:47.352 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:35:47.375 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:35:47.421 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:35:47.432 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:35:47.450 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:35:47.461 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:35:47.468 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:35:47.484 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:35:47.485 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:35:47.492 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:35:47.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:35:47.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:35:47.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:35:47.526 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:35:47.535 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:35:47.535 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:35:47.561 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:35:47.565 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:35:47.583 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:35:47.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:35:47.708 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:35:47.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:35:47.833 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:35:47.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:35:47.912 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:35:47.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:35:48.008 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:35:48.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:35:48.135 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:35:48.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:35:48.202 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:35:48.254 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:35:48.301 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:35:48.393 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:35:48.428 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:35:48.429 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:35:48.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-12T00:35:48.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-12T00:35:48.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-12T00:35:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:35:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:35:48.574 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:35:49.072 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:35:49.079 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:35:49.079 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:35:49.119 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:35:49.151 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T00:35:49.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-12T00:35:49.216 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-12T00:35:49.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-12T00:35:49.275 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-12T00:35:49.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-09-12T00:35:49.330 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-09-12T00:35:49.331 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:35:49.331 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-12T00:35:49.357 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-12T00:35:49.357 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-12T00:35:49.390 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-12T00:35:49.390 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-09-12T00:35:49.412 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-09-12T00:35:49.412 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-09-12T00:35:49.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:35:49.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:35:49.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:35:49.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:35:49.468 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:35:49.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:35:49.498 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:35:49.498 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:35:49.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:35:49.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:35:49.599 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:35:49.608 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:35:49.620 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:35:49.621 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi071.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:39:51.402 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-09-12T00:39:51.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-12T00:39:51.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:39:51.533 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-12T00:39:51.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-12T00:39:51.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-12T00:39:51.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:39:51.704 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-12T00:39:51.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-12T00:39:51.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-12T00:39:51.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:39:51.877 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-12T00:39:51.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-12T00:39:51.967 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:39:51.979 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:39:51.980 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:39:51.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:39:51.982 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:39:51.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:39:51.985 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:39:51.985 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:39:52.011 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:39:52.012 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:39:52.027 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:39:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:39:52.041 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:39:52.051 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-12T00:39:52.053 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-12T00:39:52.056 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:39:52.063 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-12T00:39:52.065 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-12T00:39:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:39:52.079 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:39:52.082 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-09-12T00:39:52.091 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:39:52.094 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-09-12T00:39:52.094 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:39:52.109 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:39:52.125 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:39:52.152 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:39:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:39:52.155 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:39:52.156 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-12T00:39:52.156 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.156 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.156 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.156 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.158 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:39:52.158 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-12T00:39:52.158 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.158 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.158 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.158 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.179 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:39:52.183 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:39:52.183 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-12T00:39:52.183 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.183 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.183 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.183 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:39:52.184 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:39:52.192 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:39:52.192 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T00:39:52.192 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T00:39:52.192 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:39:52.199 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:39:52.199 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T00:39:52.199 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T00:39:52.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:39:52.203 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T00:39:52.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:39:52.204 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T00:39:52.205 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:39:52.357 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T00:39:52.357 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T00:39:52.368 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T00:39:52.368 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T00:39:52.381 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T00:39:52.381 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T00:39:52.478 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:39:52.478 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:39:52.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:39:52.487 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:39:52.487 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:39:52.488 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:39:52.495 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:39:52.495 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:39:52.495 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:39:52.505 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T00:39:52.505 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:39:52.514 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T00:39:52.514 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:39:52.521 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T00:39:52.521 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:39:52.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:39:52.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:39:52.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:39:52.649 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:39:52.655 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:39:52.662 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:39:52.715 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-12T00:39:52.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-12T00:39:52.719 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-12T00:39:52.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-12T00:39:52.727 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-09-12T00:39:52.729 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-09-12T00:39:52.945 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-12T00:39:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-12T00:39:52.954 INFO:teuthology.orchestra.run.smithi167.stdout:45 files removed 2024-09-12T00:39:52.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T00:39:52.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T00:39:52.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T00:39:53.517 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-12T00:39:53.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-12T00:39:53.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 282 kB/s | 84 kB 00:00 2024-09-12T00:39:53.809 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T00:39:53.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T00:39:53.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-12T00:39:54.076 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T00:39:54.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-12T00:39:54.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T00:39:54.843 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T00:39:54.851 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T00:39:56.811 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T00:39:57.252 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-09-12T00:39:59.044 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-12T00:40:00.601 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-12T00:40:01.362 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.5 MB 00:00 2024-09-12T00:40:02.855 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-12T00:40:03.570 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T00:40:03.717 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-12T00:40:04.994 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T00:40:05.038 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-12T00:40:05.902 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-12T00:40:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-12T00:40:07.373 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-12T00:40:09.090 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-12T00:40:11.384 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:40:11.385 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:40:11.397 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T00:40:11.397 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T00:40:11.398 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T00:40:11.399 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T00:40:11.401 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T00:40:11.403 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T00:40:11.404 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T00:40:11.468 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-12T00:40:11.488 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-12T00:40:11.488 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-12T00:40:11.488 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-12T00:40:11.488 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-12T00:40:11.488 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T00:40:11.488 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T00:40:11.488 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T00:40:11.488 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T00:40:11.489 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T00:40:11.490 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T00:40:11.491 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T00:40:11.492 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:40:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T00:40:11.494 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T00:40:11.495 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:40:11.496 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:40:11.497 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:40:11.498 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:40:11.499 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:40:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout:Install 148 Packages 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 8 Packages 2024-09-12T00:40:11.501 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:40:11.502 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 226 M 2024-09-12T00:40:11.502 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-12T00:40:11.625 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T00:40:11.967 INFO:teuthology.orchestra.run.smithi167.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-12T00:40:12.159 INFO:teuthology.orchestra.run.smithi167.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 897 kB 00:00 2024-09-12T00:40:12.226 INFO:teuthology.orchestra.run.smithi167.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-12T00:40:12.376 INFO:teuthology.orchestra.run.smithi167.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-12T00:40:12.435 INFO:teuthology.orchestra.run.smithi167.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-12T00:40:12.501 INFO:teuthology.orchestra.run.smithi167.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-12T00:40:12.794 INFO:teuthology.orchestra.run.smithi167.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-12T00:40:12.812 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T00:40:13.086 INFO:teuthology.orchestra.run.smithi167.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T00:40:13.127 INFO:teuthology.orchestra.run.smithi167.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 606 kB/s | 25 kB 00:00 2024-09-12T00:40:13.469 INFO:teuthology.orchestra.run.smithi167.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 17 MB/s | 17 MB 00:00 2024-09-12T00:40:13.595 INFO:teuthology.orchestra.run.smithi167.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 13 MB/s | 11 MB 00:00 2024-09-12T00:40:13.620 INFO:teuthology.orchestra.run.smithi167.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.5 MB/s | 228 kB 00:00 2024-09-12T00:40:13.637 INFO:teuthology.orchestra.run.smithi167.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 647 kB/s | 27 kB 00:00 2024-09-12T00:40:13.654 INFO:teuthology.orchestra.run.smithi167.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 946 kB/s | 32 kB 00:00 2024-09-12T00:40:13.688 INFO:teuthology.orchestra.run.smithi167.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 752 kB 00:00 2024-09-12T00:40:13.713 INFO:teuthology.orchestra.run.smithi167.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T00:40:13.738 INFO:teuthology.orchestra.run.smithi167.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T00:40:13.781 INFO:teuthology.orchestra.run.smithi167.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T00:40:13.839 INFO:teuthology.orchestra.run.smithi167.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 776 kB/s | 45 kB 00:00 2024-09-12T00:40:13.923 INFO:teuthology.orchestra.run.smithi167.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-12T00:40:14.040 INFO:teuthology.orchestra.run.smithi167.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-12T00:40:14.044 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:40:14.045 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:40:14.058 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T00:40:14.058 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T00:40:14.059 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T00:40:14.060 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T00:40:14.062 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T00:40:14.064 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T00:40:14.065 INFO:teuthology.orchestra.run.smithi167.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.1 MB/s | 162 kB 00:00 2024-09-12T00:40:14.066 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T00:40:14.090 INFO:teuthology.orchestra.run.smithi167.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.2 MB/s | 321 kB 00:00 2024-09-12T00:40:14.116 INFO:teuthology.orchestra.run.smithi167.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T00:40:14.132 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-12T00:40:14.141 INFO:teuthology.orchestra.run.smithi167.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T00:40:14.160 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T00:40:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T00:40:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T00:40:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T00:40:14.164 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:40:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:40:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T00:40:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:40:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:40:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:40:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:40:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-12T00:40:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:40:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:40:14.173 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-12T00:40:14.173 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-12T00:40:14.173 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-09-12T00:40:14.173 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 8 Packages 2024-09-12T00:40:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:40:14.174 INFO:teuthology.orchestra.run.smithi167.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T00:40:14.174 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 226 M 2024-09-12T00:40:14.174 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-12T00:40:14.217 INFO:teuthology.orchestra.run.smithi167.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T00:40:14.301 INFO:teuthology.orchestra.run.smithi167.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-12T00:40:14.326 INFO:teuthology.orchestra.run.smithi167.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 293 kB/s | 32 kB 00:00 2024-09-12T00:40:14.351 INFO:teuthology.orchestra.run.smithi167.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T00:40:14.718 INFO:teuthology.orchestra.run.smithi167.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 20 MB/s | 7.4 MB 00:00 2024-09-12T00:40:14.793 INFO:teuthology.orchestra.run.smithi167.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-12T00:40:14.852 INFO:teuthology.orchestra.run.smithi167.stdout:(33/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.8 MB/s | 3.6 MB 00:00 2024-09-12T00:40:14.877 INFO:teuthology.orchestra.run.smithi167.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 589 kB/s | 49 kB 00:00 2024-09-12T00:40:14.903 INFO:teuthology.orchestra.run.smithi167.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 327 kB/s | 16 kB 00:00 2024-09-12T00:40:14.928 INFO:teuthology.orchestra.run.smithi167.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 285 kB 00:00 2024-09-12T00:40:14.970 INFO:teuthology.orchestra.run.smithi167.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-12T00:40:14.976 INFO:teuthology.orchestra.run.smithi002.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-12T00:40:14.996 INFO:teuthology.orchestra.run.smithi167.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 272 kB/s | 18 kB 00:00 2024-09-12T00:40:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:40:15.156 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:40:15.167 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T00:40:15.168 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T00:40:15.169 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T00:40:15.170 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T00:40:15.171 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T00:40:15.174 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T00:40:15.174 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T00:40:15.226 INFO:teuthology.orchestra.run.smithi002.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.5 MB/s | 897 kB 00:00 2024-09-12T00:40:15.237 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T00:40:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T00:40:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T00:40:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T00:40:15.259 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:40:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T00:40:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:40:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T00:40:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:40:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:40:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:40:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:40:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:40:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:40:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:40:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:40:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T00:40:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:40:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:40:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:40:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-12T00:40:15.269 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-12T00:40:15.270 INFO:teuthology.orchestra.run.smithi071.stdout:Install 148 Packages 2024-09-12T00:40:15.270 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 8 Packages 2024-09-12T00:40:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:40:15.270 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 226 M 2024-09-12T00:40:15.270 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-12T00:40:15.276 INFO:teuthology.orchestra.run.smithi002.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-12T00:40:15.571 INFO:teuthology.orchestra.run.smithi167.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 20 MB/s | 49 MB 00:02 2024-09-12T00:40:15.585 INFO:teuthology.orchestra.run.smithi002.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 7.7 MB/s | 2.4 MB 00:00 2024-09-12T00:40:15.596 INFO:teuthology.orchestra.run.smithi167.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 127 kB/s | 80 kB 00:00 2024-09-12T00:40:15.719 INFO:teuthology.orchestra.run.smithi002.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 6.2 MB/s | 5.4 MB 00:00 2024-09-12T00:40:15.721 INFO:teuthology.orchestra.run.smithi071.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-12T00:40:15.768 INFO:teuthology.orchestra.run.smithi002.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 8.3 MB/s | 1.5 MB 00:00 2024-09-12T00:40:15.972 INFO:teuthology.orchestra.run.smithi167.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 675 kB/s | 253 kB 00:00 2024-09-12T00:40:16.004 INFO:teuthology.orchestra.run.smithi071.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.1 MB/s | 897 kB 00:00 2024-09-12T00:40:16.035 INFO:teuthology.orchestra.run.smithi167.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 771 kB/s | 801 kB 00:01 2024-09-12T00:40:16.080 INFO:teuthology.orchestra.run.smithi071.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-12T00:40:16.119 INFO:teuthology.orchestra.run.smithi167.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 349 kB/s | 191 kB 00:00 2024-09-12T00:40:16.153 INFO:teuthology.orchestra.run.smithi167.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 911 kB/s | 106 kB 00:00 2024-09-12T00:40:16.236 INFO:teuthology.orchestra.run.smithi002.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 9.1 MB/s | 4.7 MB 00:00 2024-09-12T00:40:16.236 INFO:teuthology.orchestra.run.smithi167.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T00:40:16.261 INFO:teuthology.orchestra.run.smithi167.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-12T00:40:16.295 INFO:teuthology.orchestra.run.smithi167.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-12T00:40:16.345 INFO:teuthology.orchestra.run.smithi167.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-12T00:40:16.471 INFO:teuthology.orchestra.run.smithi167.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-12T00:40:16.497 INFO:teuthology.orchestra.run.smithi167.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 709 kB/s | 107 kB 00:00 2024-09-12T00:40:16.514 INFO:teuthology.orchestra.run.smithi167.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 514 kB/s | 22 kB 00:00 2024-09-12T00:40:16.547 INFO:teuthology.orchestra.run.smithi167.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-12T00:40:16.572 INFO:teuthology.orchestra.run.smithi167.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-12T00:40:16.623 INFO:teuthology.orchestra.run.smithi167.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-09-12T00:40:16.648 INFO:teuthology.orchestra.run.smithi167.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-12T00:40:16.673 INFO:teuthology.orchestra.run.smithi167.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-12T00:40:16.680 INFO:teuthology.orchestra.run.smithi071.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 4.0 MB/s | 2.4 MB 00:00 2024-09-12T00:40:16.698 INFO:teuthology.orchestra.run.smithi167.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T00:40:16.724 INFO:teuthology.orchestra.run.smithi167.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-12T00:40:16.766 INFO:teuthology.orchestra.run.smithi167.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-12T00:40:16.808 INFO:teuthology.orchestra.run.smithi167.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-12T00:40:16.833 INFO:teuthology.orchestra.run.smithi167.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-12T00:40:16.858 INFO:teuthology.orchestra.run.smithi167.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-12T00:40:16.880 INFO:teuthology.orchestra.run.smithi071.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.2 MB/s | 5.4 MB 00:01 2024-09-12T00:40:16.892 INFO:teuthology.orchestra.run.smithi167.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T00:40:16.942 INFO:teuthology.orchestra.run.smithi167.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-09-12T00:40:16.968 INFO:teuthology.orchestra.run.smithi167.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-12T00:40:16.993 INFO:teuthology.orchestra.run.smithi167.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-12T00:40:17.077 INFO:teuthology.orchestra.run.smithi002.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 9.5 MB/s | 21 MB 00:02 2024-09-12T00:40:17.102 INFO:teuthology.orchestra.run.smithi167.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-12T00:40:17.114 INFO:teuthology.orchestra.run.smithi071.stdout:(6/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 21 MB 00:01 2024-09-12T00:40:17.127 INFO:teuthology.orchestra.run.smithi002.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-12T00:40:17.156 INFO:teuthology.orchestra.run.smithi071.stdout:(7/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 3.2 MB/s | 1.5 MB 00:00 2024-09-12T00:40:17.169 INFO:teuthology.orchestra.run.smithi167.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-12T00:40:17.219 INFO:teuthology.orchestra.run.smithi167.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-09-12T00:40:17.244 INFO:teuthology.orchestra.run.smithi167.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-12T00:40:17.303 INFO:teuthology.orchestra.run.smithi167.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-12T00:40:17.345 INFO:teuthology.orchestra.run.smithi002.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 9.6 MB/s | 11 MB 00:01 2024-09-12T00:40:17.345 INFO:teuthology.orchestra.run.smithi167.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-12T00:40:17.370 INFO:teuthology.orchestra.run.smithi167.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T00:40:17.412 INFO:teuthology.orchestra.run.smithi167.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T00:40:17.422 INFO:teuthology.orchestra.run.smithi071.stdout:(8/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 8.7 MB/s | 4.7 MB 00:00 2024-09-12T00:40:17.436 INFO:teuthology.orchestra.run.smithi002.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 228 kB 00:00 2024-09-12T00:40:17.487 INFO:teuthology.orchestra.run.smithi167.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-12T00:40:17.489 INFO:teuthology.orchestra.run.smithi071.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 378 kB/s | 25 kB 00:00 2024-09-12T00:40:17.511 INFO:teuthology.orchestra.run.smithi002.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 361 kB/s | 27 kB 00:00 2024-09-12T00:40:17.521 INFO:teuthology.orchestra.run.smithi167.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-12T00:40:17.547 INFO:teuthology.orchestra.run.smithi167.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-12T00:40:17.572 INFO:teuthology.orchestra.run.smithi167.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-09-12T00:40:17.597 INFO:teuthology.orchestra.run.smithi167.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-12T00:40:17.622 INFO:teuthology.orchestra.run.smithi167.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T00:40:17.648 INFO:teuthology.orchestra.run.smithi167.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-12T00:40:17.670 INFO:teuthology.orchestra.run.smithi002.stdout:(13/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 8.9 MB/s | 17 MB 00:01 2024-09-12T00:40:17.695 INFO:teuthology.orchestra.run.smithi002.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 172 kB/s | 32 kB 00:00 2024-09-12T00:40:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T00:40:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T00:40:17.787 INFO:teuthology.orchestra.run.smithi002.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.7 MB/s | 163 kB 00:00 2024-09-12T00:40:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T00:40:17.821 INFO:teuthology.orchestra.run.smithi002.stdout:(16/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.9 MB/s | 752 kB 00:00 2024-09-12T00:40:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T00:40:17.841 INFO:teuthology.orchestra.run.smithi167.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-12T00:40:17.866 INFO:teuthology.orchestra.run.smithi167.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-12T00:40:17.871 INFO:teuthology.orchestra.run.smithi002.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-12T00:40:17.891 INFO:teuthology.orchestra.run.smithi167.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T00:40:17.913 INFO:teuthology.orchestra.run.smithi002.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.4 MB/s | 506 kB 00:00 2024-09-12T00:40:17.917 INFO:teuthology.orchestra.run.smithi167.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T00:40:17.942 INFO:teuthology.orchestra.run.smithi167.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T00:40:17.963 INFO:teuthology.orchestra.run.smithi002.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 903 kB/s | 45 kB 00:00 2024-09-12T00:40:17.967 INFO:teuthology.orchestra.run.smithi167.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T00:40:18.039 INFO:teuthology.orchestra.run.smithi002.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T00:40:18.052 INFO:teuthology.orchestra.run.smithi167.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T00:40:18.077 INFO:teuthology.orchestra.run.smithi167.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-12T00:40:18.089 INFO:teuthology.orchestra.run.smithi071.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 17 MB/s | 17 MB 00:00 2024-09-12T00:40:18.102 INFO:teuthology.orchestra.run.smithi167.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-12T00:40:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-12T00:40:18.127 INFO:teuthology.orchestra.run.smithi167.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T00:40:18.140 INFO:teuthology.orchestra.run.smithi071.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T00:40:18.152 INFO:teuthology.orchestra.run.smithi167.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-12T00:40:18.177 INFO:teuthology.orchestra.run.smithi167.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T00:40:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 321 kB 00:00 2024-09-12T00:40:18.203 INFO:teuthology.orchestra.run.smithi167.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T00:40:18.223 INFO:teuthology.orchestra.run.smithi071.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 324 kB/s | 27 kB 00:00 2024-09-12T00:40:18.228 INFO:teuthology.orchestra.run.smithi167.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T00:40:18.253 INFO:teuthology.orchestra.run.smithi167.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T00:40:18.279 INFO:teuthology.orchestra.run.smithi167.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T00:40:18.281 INFO:teuthology.orchestra.run.smithi002.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T00:40:18.304 INFO:teuthology.orchestra.run.smithi167.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-12T00:40:18.307 INFO:teuthology.orchestra.run.smithi071.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 380 kB/s | 32 kB 00:00 2024-09-12T00:40:18.407 INFO:teuthology.orchestra.run.smithi002.stdout:(24/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-12T00:40:18.423 INFO:teuthology.orchestra.run.smithi002.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 701 kB/s | 100 kB 00:00 2024-09-12T00:40:18.482 INFO:teuthology.orchestra.run.smithi002.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T00:40:18.482 INFO:teuthology.orchestra.run.smithi071.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.2 MB/s | 752 kB 00:00 2024-09-12T00:40:18.530 INFO:teuthology.orchestra.run.smithi167.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-12T00:40:18.555 INFO:teuthology.orchestra.run.smithi167.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-09-12T00:40:18.557 INFO:teuthology.orchestra.run.smithi002.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T00:40:18.582 INFO:teuthology.orchestra.run.smithi071.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.6 MB/s | 163 kB 00:00 2024-09-12T00:40:18.614 INFO:teuthology.orchestra.run.smithi167.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-12T00:40:18.639 INFO:teuthology.orchestra.run.smithi167.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 787 kB/s | 19 kB 00:00 2024-09-12T00:40:18.641 INFO:teuthology.orchestra.run.smithi002.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 382 kB/s | 32 kB 00:00 2024-09-12T00:40:18.664 INFO:teuthology.orchestra.run.smithi167.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-12T00:40:18.674 INFO:teuthology.orchestra.run.smithi071.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.3 MB/s | 127 kB 00:00 2024-09-12T00:40:18.689 INFO:teuthology.orchestra.run.smithi167.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T00:40:18.715 INFO:teuthology.orchestra.run.smithi167.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T00:40:18.725 INFO:teuthology.orchestra.run.smithi002.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.7 MB/s | 146 kB 00:00 2024-09-12T00:40:18.740 INFO:teuthology.orchestra.run.smithi167.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T00:40:18.766 INFO:teuthology.orchestra.run.smithi167.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T00:40:18.783 INFO:teuthology.orchestra.run.smithi071.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.6 MB/s | 506 kB 00:00 2024-09-12T00:40:18.799 INFO:teuthology.orchestra.run.smithi167.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-12T00:40:18.842 INFO:teuthology.orchestra.run.smithi002.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 7.4 MB/s | 3.1 MB 00:00 2024-09-12T00:40:18.858 INFO:teuthology.orchestra.run.smithi167.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-12T00:40:18.883 INFO:teuthology.orchestra.run.smithi167.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:40:18.908 INFO:teuthology.orchestra.run.smithi167.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T00:40:18.934 INFO:teuthology.orchestra.run.smithi167.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-12T00:40:18.967 INFO:teuthology.orchestra.run.smithi167.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-12T00:40:19.001 INFO:teuthology.orchestra.run.smithi167.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-09-12T00:40:19.035 INFO:teuthology.orchestra.run.smithi167.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T00:40:19.060 INFO:teuthology.orchestra.run.smithi167.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T00:40:19.094 INFO:teuthology.orchestra.run.smithi167.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T00:40:19.119 INFO:teuthology.orchestra.run.smithi167.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-12T00:40:19.136 INFO:teuthology.orchestra.run.smithi167.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 652 kB/s | 11 kB 00:00 2024-09-12T00:40:19.153 INFO:teuthology.orchestra.run.smithi167.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-12T00:40:19.178 INFO:teuthology.orchestra.run.smithi167.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-12T00:40:19.203 INFO:teuthology.orchestra.run.smithi167.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-12T00:40:19.229 INFO:teuthology.orchestra.run.smithi167.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-12T00:40:19.284 INFO:teuthology.orchestra.run.smithi002.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.4 MB/s | 3.6 MB 00:00 2024-09-12T00:40:19.313 INFO:teuthology.orchestra.run.smithi167.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-12T00:40:19.338 INFO:teuthology.orchestra.run.smithi167.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:40:19.350 INFO:teuthology.orchestra.run.smithi071.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 9.4 MB/s | 5.3 MB 00:00 2024-09-12T00:40:19.359 INFO:teuthology.orchestra.run.smithi002.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-12T00:40:19.372 INFO:teuthology.orchestra.run.smithi167.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-12T00:40:19.397 INFO:teuthology.orchestra.run.smithi167.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-12T00:40:19.400 INFO:teuthology.orchestra.run.smithi071.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 904 kB/s | 45 kB 00:00 2024-09-12T00:40:19.422 INFO:teuthology.orchestra.run.smithi167.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T00:40:19.451 INFO:teuthology.orchestra.run.smithi002.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 537 kB/s | 49 kB 00:00 2024-09-12T00:40:19.472 INFO:teuthology.orchestra.run.smithi167.stdout:(133/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-09-12T00:40:19.475 INFO:teuthology.orchestra.run.smithi071.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T00:40:19.498 INFO:teuthology.orchestra.run.smithi167.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-09-12T00:40:19.523 INFO:teuthology.orchestra.run.smithi167.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T00:40:19.534 INFO:teuthology.orchestra.run.smithi002.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 197 kB/s | 16 kB 00:00 2024-09-12T00:40:19.548 INFO:teuthology.orchestra.run.smithi167.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-12T00:40:19.559 INFO:teuthology.orchestra.run.smithi071.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 162 kB 00:00 2024-09-12T00:40:19.574 INFO:teuthology.orchestra.run.smithi167.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-12T00:40:19.599 INFO:teuthology.orchestra.run.smithi167.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-12T00:40:19.609 INFO:teuthology.orchestra.run.smithi002.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-12T00:40:19.624 INFO:teuthology.orchestra.run.smithi167.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T00:40:19.650 INFO:teuthology.orchestra.run.smithi167.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T00:40:19.683 INFO:teuthology.orchestra.run.smithi167.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-12T00:40:19.684 INFO:teuthology.orchestra.run.smithi071.stdout:(22/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 4.2 MB/s | 11 MB 00:02 2024-09-12T00:40:19.693 INFO:teuthology.orchestra.run.smithi002.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-12T00:40:19.709 INFO:teuthology.orchestra.run.smithi167.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 888 kB/s | 74 kB 00:00 2024-09-12T00:40:19.709 INFO:teuthology.orchestra.run.smithi071.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 321 kB 00:00 2024-09-12T00:40:19.734 INFO:teuthology.orchestra.run.smithi167.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T00:40:19.752 INFO:teuthology.orchestra.run.smithi002.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 313 kB/s | 18 kB 00:00 2024-09-12T00:40:19.759 INFO:teuthology.orchestra.run.smithi167.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-12T00:40:19.793 INFO:teuthology.orchestra.run.smithi167.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-12T00:40:19.818 INFO:teuthology.orchestra.run.smithi167.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T00:40:19.852 INFO:teuthology.orchestra.run.smithi167.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T00:40:19.885 INFO:teuthology.orchestra.run.smithi002.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 7.1 MB/s | 7.4 MB 00:01 2024-09-12T00:40:19.910 INFO:teuthology.orchestra.run.smithi167.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-12T00:40:19.919 INFO:teuthology.orchestra.run.smithi002.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-12T00:40:20.045 INFO:teuthology.orchestra.run.smithi002.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-12T00:40:20.128 INFO:teuthology.orchestra.run.smithi002.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-12T00:40:20.135 INFO:teuthology.orchestra.run.smithi071.stdout:(24/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 18 MB/s | 49 MB 00:02 2024-09-12T00:40:20.153 INFO:teuthology.orchestra.run.smithi167.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 3.4 MB 00:00 2024-09-12T00:40:20.160 INFO:teuthology.orchestra.run.smithi071.stdout:(25/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 634 kB/s | 301 kB 00:00 2024-09-12T00:40:20.178 INFO:teuthology.orchestra.run.smithi002.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-12T00:40:20.186 INFO:teuthology.orchestra.run.smithi071.stdout:(26/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 209 kB/s | 100 kB 00:00 2024-09-12T00:40:20.211 INFO:teuthology.orchestra.run.smithi071.stdout:(27/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T00:40:20.229 INFO:teuthology.orchestra.run.smithi002.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T00:40:20.236 INFO:teuthology.orchestra.run.smithi071.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T00:40:20.261 INFO:teuthology.orchestra.run.smithi071.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 637 kB/s | 32 kB 00:00 2024-09-12T00:40:20.279 INFO:teuthology.orchestra.run.smithi002.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T00:40:20.303 INFO:teuthology.orchestra.run.smithi071.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.1 MB/s | 146 kB 00:00 2024-09-12T00:40:20.329 INFO:teuthology.orchestra.run.smithi002.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T00:40:20.361 INFO:teuthology.orchestra.run.smithi167.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 6.2 MB/s | 3.2 MB 00:00 2024-09-12T00:40:20.487 INFO:teuthology.orchestra.run.smithi071.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 16 MB/s | 3.6 MB 00:00 2024-09-12T00:40:20.537 INFO:teuthology.orchestra.run.smithi071.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T00:40:20.595 INFO:teuthology.orchestra.run.smithi071.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 849 kB/s | 49 kB 00:00 2024-09-12T00:40:20.670 INFO:teuthology.orchestra.run.smithi167.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 3.1 MB/s | 2.3 MB 00:00 2024-09-12T00:40:20.670 INFO:teuthology.orchestra.run.smithi071.stdout:(34/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 6.1 MB/s | 3.1 MB 00:00 2024-09-12T00:40:20.687 INFO:teuthology.orchestra.run.smithi167.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 125 kB/s | 41 kB 00:00 2024-09-12T00:40:20.696 INFO:teuthology.orchestra.run.smithi071.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 164 kB/s | 16 kB 00:00 2024-09-12T00:40:20.754 INFO:teuthology.orchestra.run.smithi002.stdout:(46/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 13 MB/s | 49 MB 00:03 2024-09-12T00:40:20.787 INFO:teuthology.orchestra.run.smithi167.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-12T00:40:20.788 INFO:teuthology.orchestra.run.smithi071.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-12T00:40:20.788 INFO:teuthology.orchestra.run.smithi002.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-09-12T00:40:20.813 INFO:teuthology.orchestra.run.smithi071.stdout:(37/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.0 MB/s | 285 kB 00:00 2024-09-12T00:40:20.813 INFO:teuthology.orchestra.run.smithi002.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 444 kB/s | 215 kB 00:00 2024-09-12T00:40:20.838 INFO:teuthology.orchestra.run.smithi071.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 365 kB/s | 18 kB 00:00 2024-09-12T00:40:20.872 INFO:teuthology.orchestra.run.smithi071.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-12T00:40:20.971 INFO:teuthology.orchestra.run.smithi167.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 2.2 MB/s | 1.8 MB 00:00 2024-09-12T00:40:20.972 INFO:teuthology.orchestra.run.smithi071.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 503 kB/s | 80 kB 00:00 2024-09-12T00:40:21.013 INFO:teuthology.orchestra.run.smithi167.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-12T00:40:21.014 INFO:teuthology.orchestra.run.smithi071.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-12T00:40:21.048 INFO:teuthology.orchestra.run.smithi071.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-12T00:40:21.090 INFO:teuthology.orchestra.run.smithi071.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-12T00:40:21.107 INFO:teuthology.orchestra.run.smithi071.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T00:40:21.132 INFO:teuthology.orchestra.run.smithi071.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-12T00:40:21.157 INFO:teuthology.orchestra.run.smithi071.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T00:40:21.183 INFO:teuthology.orchestra.run.smithi071.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T00:40:21.216 INFO:teuthology.orchestra.run.smithi071.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-12T00:40:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 1.4 MB 00:00 2024-09-12T00:40:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:40:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-12T00:40:21.366 INFO:teuthology.orchestra.run.smithi071.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 713 kB/s | 107 kB 00:00 2024-09-12T00:40:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-12T00:40:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-12T00:40:21.505 INFO:teuthology.orchestra.run.smithi002.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 154 kB/s | 107 kB 00:00 2024-09-12T00:40:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-09-12T00:40:21.543 INFO:teuthology.orchestra.run.smithi071.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-12T00:40:21.568 INFO:teuthology.orchestra.run.smithi071.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-12T00:40:21.593 INFO:teuthology.orchestra.run.smithi071.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-12T00:40:21.618 INFO:teuthology.orchestra.run.smithi071.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T00:40:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T00:40:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-12T00:40:21.764 INFO:teuthology.orchestra.run.smithi002.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 683 kB/s | 689 kB 00:01 2024-09-12T00:40:21.794 INFO:teuthology.orchestra.run.smithi071.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-12T00:40:21.814 INFO:teuthology.orchestra.run.smithi002.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 919 kB/s | 943 kB 00:01 2024-09-12T00:40:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-12T00:40:21.978 INFO:teuthology.orchestra.run.smithi071.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 133 kB/s | 24 kB 00:00 2024-09-12T00:40:22.011 INFO:teuthology.orchestra.run.smithi071.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-12T00:40:22.089 INFO:teuthology.orchestra.run.smithi002.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 37 kB/s | 22 kB 00:00 2024-09-12T00:40:22.095 INFO:teuthology.orchestra.run.smithi071.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.1 MB/s | 3.0 MB 00:00 2024-09-12T00:40:22.128 INFO:teuthology.orchestra.run.smithi071.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T00:40:22.153 INFO:teuthology.orchestra.run.smithi071.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 664 kB/s | 38 kB 00:00 2024-09-12T00:40:22.203 INFO:teuthology.orchestra.run.smithi071.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2024-09-12T00:40:22.406 INFO:teuthology.orchestra.run.smithi002.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-09-12T00:40:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-12T00:40:22.528 INFO:teuthology.orchestra.run.smithi071.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-09-12T00:40:22.573 INFO:teuthology.orchestra.run.smithi002.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 392 kB/s | 313 kB 00:00 2024-09-12T00:40:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-12T00:40:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-12T00:40:22.796 INFO:teuthology.orchestra.run.smithi071.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-09-12T00:40:22.879 INFO:teuthology.orchestra.run.smithi071.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-12T00:40:22.940 INFO:teuthology.orchestra.run.smithi002.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 34 kB/s | 18 kB 00:00 2024-09-12T00:40:23.065 INFO:teuthology.orchestra.run.smithi002.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-12T00:40:23.149 INFO:teuthology.orchestra.run.smithi002.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-12T00:40:23.396 INFO:teuthology.orchestra.run.smithi071.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-09-12T00:40:23.563 INFO:teuthology.orchestra.run.smithi071.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.4 MB/s | 4.9 MB 00:01 2024-09-12T00:40:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-12T00:40:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-12T00:40:23.805 INFO:teuthology.orchestra.run.smithi071.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-09-12T00:40:23.841 INFO:teuthology.orchestra.run.smithi002.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 178 kB/s | 160 kB 00:00 2024-09-12T00:40:23.897 INFO:teuthology.orchestra.run.smithi071.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 669 kB/s | 61 kB 00:00 2024-09-12T00:40:24.064 INFO:teuthology.orchestra.run.smithi071.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-12T00:40:24.108 INFO:teuthology.orchestra.run.smithi002.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 691 kB/s | 662 kB 00:00 2024-09-12T00:40:24.222 INFO:teuthology.orchestra.run.smithi071.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-12T00:40:24.306 INFO:teuthology.orchestra.run.smithi071.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 308 kB/s | 26 kB 00:00 2024-09-12T00:40:24.389 INFO:teuthology.orchestra.run.smithi071.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 230 kB/s | 19 kB 00:00 2024-09-12T00:40:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-12T00:40:24.465 INFO:teuthology.orchestra.run.smithi071.stdout:(79/156): postgresql-server-13.16-1.el9.x86_64. 3.6 MB/s | 5.8 MB 00:01 2024-09-12T00:40:24.487 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-12T00:40:24.487 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-12T00:40:24.490 INFO:teuthology.orchestra.run.smithi071.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-12T00:40:24.548 INFO:teuthology.orchestra.run.smithi071.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 416 kB/s | 35 kB 00:00 2024-09-12T00:40:24.550 INFO:teuthology.orchestra.run.smithi002.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 651 kB/s | 581 kB 00:00 2024-09-12T00:40:24.641 INFO:teuthology.orchestra.run.smithi071.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-12T00:40:24.684 INFO:teuthology.orchestra.run.smithi002.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-12T00:40:24.733 INFO:teuthology.orchestra.run.smithi071.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-12T00:40:24.824 INFO:teuthology.orchestra.run.smithi071.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 843 kB/s | 77 kB 00:00 2024-09-12T00:40:24.900 INFO:teuthology.orchestra.run.smithi071.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 563 kB/s | 42 kB 00:00 2024-09-12T00:40:24.983 INFO:teuthology.orchestra.run.smithi071.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-12T00:40:25.059 INFO:teuthology.orchestra.run.smithi071.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T00:40:25.142 INFO:teuthology.orchestra.run.smithi071.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-12T00:40:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-12T00:40:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 334 kB/s | 292 kB 00:00 2024-09-12T00:40:25.284 INFO:teuthology.orchestra.run.smithi071.stdout:(89/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.6 MB/s | 6.0 MB 00:01 2024-09-12T00:40:25.309 INFO:teuthology.orchestra.run.smithi071.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 305 kB/s | 51 kB 00:00 2024-09-12T00:40:25.359 INFO:teuthology.orchestra.run.smithi002.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 233 kB/s | 188 kB 00:00 2024-09-12T00:40:25.368 INFO:teuthology.orchestra.run.smithi071.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 644 kB/s | 54 kB 00:00 2024-09-12T00:40:25.460 INFO:teuthology.orchestra.run.smithi071.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 455 kB/s | 42 kB 00:00 2024-09-12T00:40:25.552 INFO:teuthology.orchestra.run.smithi071.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-12T00:40:25.652 INFO:teuthology.orchestra.run.smithi071.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-12T00:40:25.677 INFO:teuthology.orchestra.run.smithi071.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-12T00:40:25.736 INFO:teuthology.orchestra.run.smithi071.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 430 kB/s | 36 kB 00:00 2024-09-12T00:40:25.769 INFO:teuthology.orchestra.run.smithi071.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-12T00:40:25.861 INFO:teuthology.orchestra.run.smithi071.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 631 kB/s | 58 kB 00:00 2024-09-12T00:40:25.895 INFO:teuthology.orchestra.run.smithi071.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-12T00:40:25.954 INFO:teuthology.orchestra.run.smithi071.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-12T00:40:25.987 INFO:teuthology.orchestra.run.smithi071.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 694 kB/s | 64 kB 00:00 2024-09-12T00:40:26.046 INFO:teuthology.orchestra.run.smithi071.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 487 kB/s | 45 kB 00:00 2024-09-12T00:40:26.213 INFO:teuthology.orchestra.run.smithi071.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 99 kB/s | 22 kB 00:00 2024-09-12T00:40:26.263 INFO:teuthology.orchestra.run.smithi071.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T00:40:26.305 INFO:teuthology.orchestra.run.smithi071.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-12T00:40:26.330 INFO:teuthology.orchestra.run.smithi071.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-12T00:40:26.334 INFO:teuthology.orchestra.run.smithi002.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-12T00:40:26.418 INFO:teuthology.orchestra.run.smithi002.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-12T00:40:26.439 INFO:teuthology.orchestra.run.smithi071.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-12T00:40:26.464 INFO:teuthology.orchestra.run.smithi071.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T00:40:26.489 INFO:teuthology.orchestra.run.smithi071.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T00:40:26.501 INFO:teuthology.orchestra.run.smithi002.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-12T00:40:26.514 INFO:teuthology.orchestra.run.smithi071.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T00:40:26.540 INFO:teuthology.orchestra.run.smithi071.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T00:40:26.573 INFO:teuthology.orchestra.run.smithi071.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-12T00:40:26.607 INFO:teuthology.orchestra.run.smithi071.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T00:40:26.633 INFO:teuthology.orchestra.run.smithi071.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:40:26.658 INFO:teuthology.orchestra.run.smithi071.stdout:(115/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-09-12T00:40:26.683 INFO:teuthology.orchestra.run.smithi071.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-12T00:40:26.716 INFO:teuthology.orchestra.run.smithi071.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.4 MB/s | 172 kB 00:00 2024-09-12T00:40:26.750 INFO:teuthology.orchestra.run.smithi071.stdout:(118/156): python3-certifi-2023.05.07-4.el9.noa 153 kB/s | 14 kB 00:00 2024-09-12T00:40:26.805 INFO:teuthology.orchestra.run.smithi071.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.1 MB/s | 358 kB 00:00 2024-09-12T00:40:26.834 INFO:teuthology.orchestra.run.smithi071.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 7.4 MB/s | 220 kB 00:00 2024-09-12T00:40:26.859 INFO:teuthology.orchestra.run.smithi071.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-12T00:40:26.893 INFO:teuthology.orchestra.run.smithi071.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T00:40:26.910 INFO:teuthology.orchestra.run.smithi071.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 644 kB/s | 11 kB 00:00 2024-09-12T00:40:26.926 INFO:teuthology.orchestra.run.smithi071.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-12T00:40:26.943 INFO:teuthology.orchestra.run.smithi071.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-12T00:40:26.960 INFO:teuthology.orchestra.run.smithi071.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-12T00:40:26.977 INFO:teuthology.orchestra.run.smithi071.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.1 MB/s | 20 kB 00:00 2024-09-12T00:40:27.028 INFO:teuthology.orchestra.run.smithi071.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-12T00:40:27.045 INFO:teuthology.orchestra.run.smithi071.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-12T00:40:27.070 INFO:teuthology.orchestra.run.smithi071.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T00:40:27.095 INFO:teuthology.orchestra.run.smithi071.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-12T00:40:27.127 INFO:teuthology.orchestra.run.smithi002.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 194 kB/s | 137 kB 00:00 2024-09-12T00:40:27.129 INFO:teuthology.orchestra.run.smithi071.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-12T00:40:27.154 INFO:teuthology.orchestra.run.smithi071.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T00:40:27.180 INFO:teuthology.orchestra.run.smithi071.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T00:40:27.205 INFO:teuthology.orchestra.run.smithi071.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T00:40:27.230 INFO:teuthology.orchestra.run.smithi071.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T00:40:27.255 INFO:teuthology.orchestra.run.smithi071.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 618 kB/s | 31 kB 00:00 2024-09-12T00:40:27.277 INFO:teuthology.orchestra.run.smithi002.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 966 kB/s | 910 kB 00:00 2024-09-12T00:40:27.280 INFO:teuthology.orchestra.run.smithi071.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:40:27.314 INFO:teuthology.orchestra.run.smithi071.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-12T00:40:27.339 INFO:teuthology.orchestra.run.smithi071.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 614 kB/s | 36 kB 00:00 2024-09-12T00:40:27.364 INFO:teuthology.orchestra.run.smithi071.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-12T00:40:27.390 INFO:teuthology.orchestra.run.smithi071.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-12T00:40:27.415 INFO:teuthology.orchestra.run.smithi071.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T00:40:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-12T00:40:27.482 INFO:teuthology.orchestra.run.smithi071.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-12T00:40:27.508 INFO:teuthology.orchestra.run.smithi071.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T00:40:27.558 INFO:teuthology.orchestra.run.smithi071.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T00:40:27.652 INFO:teuthology.orchestra.run.smithi002.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-12T00:40:27.791 INFO:teuthology.orchestra.run.smithi071.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 14 MB/s | 3.2 MB 00:00 2024-09-12T00:40:27.975 INFO:teuthology.orchestra.run.smithi071.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 3.4 MB 00:00 2024-09-12T00:40:28.044 INFO:teuthology.orchestra.run.smithi002.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 114 kB/s | 87 kB 00:00 2024-09-12T00:40:28.094 INFO:teuthology.orchestra.run.smithi002.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-12T00:40:28.283 INFO:teuthology.orchestra.run.smithi071.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 4.7 MB/s | 2.3 MB 00:00 2024-09-12T00:40:28.384 INFO:teuthology.orchestra.run.smithi071.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 407 kB/s | 41 kB 00:00 2024-09-12T00:40:28.484 INFO:teuthology.orchestra.run.smithi071.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 3.5 MB/s | 1.8 MB 00:00 2024-09-12T00:40:28.509 INFO:teuthology.orchestra.run.smithi071.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.9 MB/s | 249 kB 00:00 2024-09-12T00:40:28.618 INFO:teuthology.orchestra.run.smithi071.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-12T00:40:28.736 INFO:teuthology.orchestra.run.smithi002.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 88 kB/s | 61 kB 00:00 2024-09-12T00:40:28.743 INFO:teuthology.orchestra.run.smithi071.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-09-12T00:40:28.928 INFO:teuthology.orchestra.run.smithi002.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-12T00:40:28.953 INFO:teuthology.orchestra.run.smithi002.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 285 kB/s | 245 kB 00:00 2024-09-12T00:40:29.462 INFO:teuthology.orchestra.run.smithi002.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 48 kB/s | 26 kB 00:00 2024-09-12T00:40:29.487 INFO:teuthology.orchestra.run.smithi002.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-09-12T00:40:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 281 kB/s | 248 kB 00:00 2024-09-12T00:40:30.055 INFO:teuthology.orchestra.run.smithi002.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 61 kB/s | 35 kB 00:00 2024-09-12T00:40:30.205 INFO:teuthology.orchestra.run.smithi002.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 232 kB/s | 172 kB 00:00 2024-09-12T00:40:30.626 INFO:teuthology.orchestra.run.smithi071.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:05 2024-09-12T00:40:30.633 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:40:30.633 INFO:teuthology.orchestra.run.smithi071.stdout:Total 15 MB/s | 226 MB 00:15 2024-09-12T00:40:30.776 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-12T00:40:30.864 INFO:teuthology.orchestra.run.smithi002.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-12T00:40:30.889 INFO:teuthology.orchestra.run.smithi002.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 301 kB/s | 250 kB 00:00 2024-09-12T00:40:30.917 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T00:40:31.041 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T00:40:31.047 INFO:teuthology.orchestra.run.smithi002.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 264 kB/s | 222 kB 00:00 2024-09-12T00:40:31.186 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T00:40:31.227 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T00:40:31.260 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T00:40:31.305 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T00:40:31.489 INFO:teuthology.orchestra.run.smithi002.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 70 kB/s | 42 kB 00:00 2024-09-12T00:40:31.539 INFO:teuthology.orchestra.run.smithi002.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 114 kB/s | 77 kB 00:00 2024-09-12T00:40:31.634 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T00:40:31.753 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:40:31.831 INFO:teuthology.orchestra.run.smithi002.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 344 kB/s | 269 kB 00:00 2024-09-12T00:40:31.859 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-12T00:40:31.876 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:40:31.904 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:40:31.995 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:40:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-12T00:40:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-12T00:40:32.025 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T00:40:32.186 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T00:40:32.239 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T00:40:32.267 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:40:32.298 INFO:teuthology.orchestra.run.smithi002.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 196 kB/s | 159 kB 00:00 2024-09-12T00:40:32.372 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:40:32.402 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T00:40:32.432 INFO:teuthology.orchestra.run.smithi002.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 313 kB/s | 279 kB 00:00 2024-09-12T00:40:32.457 INFO:teuthology.orchestra.run.smithi002.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 82 kB/s | 51 kB 00:00 2024-09-12T00:40:32.464 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T00:40:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T00:40:32.521 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T00:40:32.722 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T00:40:32.870 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T00:40:32.966 INFO:teuthology.orchestra.run.smithi002.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 80 kB/s | 54 kB 00:00 2024-09-12T00:40:32.999 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T00:40:33.024 INFO:teuthology.orchestra.run.smithi002.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-09-12T00:40:33.098 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:33.187 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:33.416 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:33.542 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T00:40:33.638 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T00:40:33.657 INFO:teuthology.orchestra.run.smithi002.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 64 kB/s | 44 kB 00:00 2024-09-12T00:40:33.667 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T00:40:33.702 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T00:40:33.767 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T00:40:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-12T00:40:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-12T00:40:33.811 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T00:40:33.868 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T00:40:33.891 INFO:teuthology.orchestra.run.smithi002.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 255 kB/s | 221 kB 00:00 2024-09-12T00:40:33.917 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T00:40:33.949 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T00:40:33.977 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T00:40:34.047 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T00:40:34.099 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T00:40:34.130 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T00:40:34.173 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T00:40:34.183 INFO:teuthology.orchestra.run.smithi002.stdout:(96/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.3 MB/s | 16 MB 00:01 2024-09-12T00:40:34.259 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T00:40:34.293 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T00:40:34.336 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T00:40:34.365 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T00:40:34.400 INFO:teuthology.orchestra.run.smithi002.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 48 kB/s | 36 kB 00:00 2024-09-12T00:40:34.435 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T00:40:34.480 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T00:40:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T00:40:34.625 INFO:teuthology.orchestra.run.smithi002.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 65 kB/s | 47 kB 00:00 2024-09-12T00:40:34.690 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T00:40:34.750 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T00:40:34.967 INFO:teuthology.orchestra.run.smithi002.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-09-12T00:40:35.068 INFO:teuthology.orchestra.run.smithi002.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 87 kB/s | 58 kB 00:00 2024-09-12T00:40:35.284 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T00:40:35.370 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T00:40:35.393 INFO:teuthology.orchestra.run.smithi002.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 126 kB/s | 96 kB 00:00 2024-09-12T00:40:35.408 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T00:40:35.450 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T00:40:35.491 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T00:40:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T00:40:35.651 INFO:teuthology.orchestra.run.smithi002.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-09-12T00:40:35.692 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T00:40:35.710 INFO:teuthology.orchestra.run.smithi002.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-09-12T00:40:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T00:40:35.760 INFO:teuthology.orchestra.run.smithi002.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T00:40:35.785 INFO:teuthology.orchestra.run.smithi002.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T00:40:35.808 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T00:40:35.810 INFO:teuthology.orchestra.run.smithi002.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 791 kB/s | 19 kB 00:00 2024-09-12T00:40:35.886 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T00:40:35.926 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T00:40:35.927 INFO:teuthology.orchestra.run.smithi002.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T00:40:35.961 INFO:teuthology.orchestra.run.smithi002.stdout:(108/156): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-09-12T00:40:35.961 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T00:40:35.986 INFO:teuthology.orchestra.run.smithi002.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 513 kB/s | 26 kB 00:00 2024-09-12T00:40:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T00:40:36.020 INFO:teuthology.orchestra.run.smithi002.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T00:40:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T00:40:36.054 INFO:teuthology.orchestra.run.smithi002.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.8 MB/s | 151 kB 00:00 2024-09-12T00:40:36.071 INFO:teuthology.orchestra.run.smithi002.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 444 kB/s | 49 kB 00:00 2024-09-12T00:40:36.088 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T00:40:36.112 INFO:teuthology.orchestra.run.smithi002.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-12T00:40:36.130 INFO:teuthology.orchestra.run.smithi002.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T00:40:36.130 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T00:40:36.155 INFO:teuthology.orchestra.run.smithi002.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-12T00:40:36.180 INFO:teuthology.orchestra.run.smithi002.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-12T00:40:36.197 INFO:teuthology.orchestra.run.smithi002.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-12T00:40:36.222 INFO:teuthology.orchestra.run.smithi002.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T00:40:36.247 INFO:teuthology.orchestra.run.smithi002.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T00:40:36.267 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T00:40:36.272 INFO:teuthology.orchestra.run.smithi002.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-12T00:40:36.298 INFO:teuthology.orchestra.run.smithi002.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T00:40:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T00:40:36.331 INFO:teuthology.orchestra.run.smithi002.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T00:40:36.357 INFO:teuthology.orchestra.run.smithi002.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-12T00:40:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T00:40:36.382 INFO:teuthology.orchestra.run.smithi002.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-12T00:40:36.407 INFO:teuthology.orchestra.run.smithi002.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-12T00:40:36.433 INFO:teuthology.orchestra.run.smithi002.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-12T00:40:36.458 INFO:teuthology.orchestra.run.smithi002.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-12T00:40:36.517 INFO:teuthology.orchestra.run.smithi002.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-12T00:40:36.558 INFO:teuthology.orchestra.run.smithi002.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-09-12T00:40:36.562 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T00:40:36.584 INFO:teuthology.orchestra.run.smithi002.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 693 kB/s | 46 kB 00:00 2024-09-12T00:40:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T00:40:36.618 INFO:teuthology.orchestra.run.smithi002.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-12T00:40:36.638 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T00:40:36.643 INFO:teuthology.orchestra.run.smithi002.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 983 kB/s | 58 kB 00:00 2024-09-12T00:40:36.664 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T00:40:36.668 INFO:teuthology.orchestra.run.smithi002.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-12T00:40:36.689 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T00:40:36.693 INFO:teuthology.orchestra.run.smithi002.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T00:40:36.719 INFO:teuthology.orchestra.run.smithi002.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T00:40:36.744 INFO:teuthology.orchestra.run.smithi002.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-12T00:40:36.764 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T00:40:36.769 INFO:teuthology.orchestra.run.smithi002.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-12T00:40:36.803 INFO:teuthology.orchestra.run.smithi002.stdout:(138/156): protobuf-compiler-3.14.0-13.el9.x86_ 750 kB/s | 863 kB 00:01 2024-09-12T00:40:36.837 INFO:teuthology.orchestra.run.smithi002.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 899 kB/s | 59 kB 00:00 2024-09-12T00:40:36.862 INFO:teuthology.orchestra.run.smithi002.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-12T00:40:36.887 INFO:teuthology.orchestra.run.smithi002.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T00:40:36.892 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T00:40:36.912 INFO:teuthology.orchestra.run.smithi002.stdout:(142/156): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-09-12T00:40:36.922 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T00:40:36.938 INFO:teuthology.orchestra.run.smithi002.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T00:40:36.950 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T00:40:36.971 INFO:teuthology.orchestra.run.smithi002.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 605 kB/s | 20 kB 00:00 2024-09-12T00:40:36.992 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T00:40:36.997 INFO:teuthology.orchestra.run.smithi002.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-12T00:40:37.022 INFO:teuthology.orchestra.run.smithi002.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:40:37.032 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T00:40:37.047 INFO:teuthology.orchestra.run.smithi002.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T00:40:37.063 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T00:40:37.089 INFO:teuthology.orchestra.run.smithi002.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T00:40:37.093 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T00:40:37.128 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T00:40:37.161 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T00:40:37.203 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T00:40:37.237 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T00:40:37.324 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T00:40:37.376 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T00:40:37.406 INFO:teuthology.orchestra.run.smithi002.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-09-12T00:40:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T00:40:37.511 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T00:40:37.559 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T00:40:37.581 INFO:teuthology.orchestra.run.smithi002.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-09-12T00:40:37.623 INFO:teuthology.orchestra.run.smithi002.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 983 kB/s | 41 kB 00:00 2024-09-12T00:40:37.690 INFO:teuthology.orchestra.run.smithi002.stdout:(152/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 4.9 MB/s | 3.2 MB 00:00 2024-09-12T00:40:37.749 INFO:teuthology.orchestra.run.smithi002.stdout:(153/156): librados2-19.1.1-298.gb53b6d3e.el9.x 4.7 MB/s | 3.4 MB 00:00 2024-09-12T00:40:37.774 INFO:teuthology.orchestra.run.smithi002.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 1.6 MB/s | 249 kB 00:00 2024-09-12T00:40:37.924 INFO:teuthology.orchestra.run.smithi002.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-12T00:40:37.974 INFO:teuthology.orchestra.run.smithi002.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-12T00:40:37.981 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:40:37.981 INFO:teuthology.orchestra.run.smithi002.stdout:Total 9.5 MB/s | 226 MB 00:23 2024-09-12T00:40:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T00:40:38.340 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T00:40:38.382 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T00:40:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T00:40:38.538 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T00:40:38.583 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T00:40:38.672 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T00:40:38.719 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T00:40:38.902 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T00:40:38.932 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T00:40:39.010 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T00:40:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-12T00:40:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-12T00:40:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-12T00:40:39.669 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T00:40:39.791 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T00:40:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-12T00:40:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T00:40:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T00:40:40.422 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T00:40:40.455 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T00:40:40.480 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T00:40:40.532 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T00:40:40.863 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T00:40:40.973 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:40:41.043 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T00:40:41.077 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:40:41.107 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:40:41.130 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T00:40:41.158 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T00:40:41.181 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:40:41.191 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T00:40:41.211 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T00:40:41.362 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T00:40:41.408 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T00:40:41.436 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:40:41.540 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:40:41.570 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T00:40:41.572 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T00:40:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T00:40:41.655 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T00:40:41.676 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T00:40:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-12T00:40:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-12T00:40:41.763 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T00:40:41.856 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T00:40:41.864 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T00:40:41.885 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T00:40:41.922 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T00:40:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T00:40:42.121 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T00:40:42.225 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:42.295 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:42.409 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T00:40:42.449 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T00:40:42.504 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T00:40:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:42.535 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T00:40:42.623 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T00:40:42.712 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T00:40:42.751 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T00:40:42.785 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T00:40:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T00:40:42.902 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T00:40:42.934 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T00:40:42.986 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T00:40:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T00:40:43.047 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T00:40:43.115 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T00:40:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T00:40:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T00:40:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T00:40:43.311 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T00:40:43.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T00:40:43.389 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T00:40:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T00:40:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T00:40:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T00:40:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T00:40:43.743 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T00:40:43.796 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T00:40:44.322 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T00:40:44.399 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T00:40:44.429 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T00:40:44.471 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T00:40:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T00:40:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T00:40:44.709 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T00:40:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T00:40:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T00:40:44.898 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T00:40:44.930 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T00:40:44.966 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T00:40:45.012 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T00:40:45.048 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T00:40:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T00:40:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T00:40:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:40:45.265 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:40:45.276 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T00:40:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T00:40:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T00:40:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T00:40:45.509 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T00:40:45.549 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T00:40:45.575 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T00:40:45.600 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T00:40:45.674 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T00:40:45.813 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:40:45.852 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T00:40:45.895 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T00:40:45.955 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T00:40:45.955 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:40:45.956 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:40:45.956 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:40:45.965 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T00:40:45.993 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T00:40:45.995 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T00:40:46.027 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T00:40:46.066 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T00:40:46.097 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T00:40:46.127 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T00:40:46.171 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T00:40:46.204 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T00:40:46.237 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T00:40:46.272 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T00:40:46.357 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T00:40:46.401 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T00:40:46.433 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T00:40:46.535 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T00:40:46.583 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T00:40:47.296 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T00:40:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T00:40:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T00:40:47.472 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T00:40:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T00:40:47.564 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T00:40:47.643 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T00:40:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T00:40:47.866 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T00:40:47.898 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T00:40:47.974 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T00:40:48.387 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-12T00:40:48.512 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T00:40:48.563 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T00:40:48.608 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T00:40:48.621 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T00:40:48.654 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T00:40:48.679 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T00:40:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T00:40:48.731 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T00:40:49.200 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T00:40:49.314 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:40:49.439 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:40:49.589 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:40:49.674 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:40:49.703 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T00:40:49.871 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T00:40:49.916 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T00:40:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T00:40:49.943 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:40:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T00:40:50.033 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:40:50.036 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T00:40:50.069 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T00:40:50.070 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T00:40:50.132 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T00:40:50.171 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T00:40:50.196 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T00:40:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T00:40:50.382 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T00:40:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T00:40:50.492 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T00:40:50.522 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T00:40:50.548 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T00:40:50.558 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T00:40:50.686 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T00:40:50.797 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:50.878 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:51.029 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T00:40:51.062 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T00:40:51.108 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T00:40:51.133 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T00:40:51.155 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T00:40:51.222 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T00:40:51.333 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T00:40:51.367 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T00:40:51.402 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T00:40:51.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T00:40:51.529 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T00:40:51.569 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T00:40:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T00:40:51.644 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T00:40:51.672 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T00:40:51.743 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T00:40:51.920 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T00:40:51.951 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T00:40:51.994 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T00:40:52.080 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T00:40:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T00:40:52.165 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T00:40:52.193 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T00:40:52.266 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T00:40:52.308 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T00:40:52.386 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T00:40:52.530 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T00:40:52.586 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T00:40:53.144 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T00:40:53.234 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T00:40:53.269 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T00:40:53.320 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T00:40:53.367 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T00:40:53.409 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T00:40:53.454 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:40:53.585 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T00:40:53.644 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T00:40:53.700 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T00:40:53.711 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:40:53.784 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T00:40:53.821 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T00:40:53.857 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T00:40:53.913 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T00:40:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T00:40:54.008 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T00:40:54.051 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T00:40:54.193 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T00:40:54.238 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T00:40:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:40:54.280 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T00:40:54.297 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T00:40:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T00:40:54.387 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T00:40:54.387 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:40:54.388 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:40:54.388 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:40:54.422 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T00:40:54.439 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T00:40:54.462 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T00:40:54.495 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T00:40:54.520 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T00:40:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T00:40:54.753 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T00:40:54.794 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T00:40:54.823 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T00:40:54.866 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T00:40:54.904 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T00:40:54.944 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T00:40:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T00:40:55.008 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T00:40:55.041 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T00:40:55.084 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T00:40:55.117 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T00:40:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T00:40:55.265 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T00:40:55.296 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T00:40:55.412 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T00:40:55.473 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T00:40:56.236 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T00:40:56.286 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T00:40:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T00:40:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T00:40:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T00:40:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T00:40:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T00:40:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T00:40:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T00:40:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T00:40:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T00:40:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T00:40:57.764 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-09-12T00:40:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:40:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T00:40:58.021 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T00:40:58.021 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:40:58.021 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:40:58.021 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:40:59.084 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T00:40:59.157 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T00:40:59.185 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T00:40:59.218 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T00:40:59.526 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T00:40:59.550 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T00:40:59.550 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:40:59.550 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:40:59.550 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:40:59.551 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:40:59.551 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:40:59.552 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T00:40:59.589 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T00:40:59.689 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T00:40:59.719 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T00:40:59.764 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T00:40:59.782 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T00:40:59.806 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T00:40:59.806 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:40:59.806 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:40:59.806 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:40:59.806 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:40:59.806 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:00.241 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T00:41:00.265 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T00:41:00.265 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:00.265 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:41:00.265 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:41:00.265 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:41:00.265 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T00:41:00.300 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T00:41:00.371 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T00:41:00.380 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T00:41:00.402 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T00:41:00.438 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T00:41:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T00:41:00.708 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T00:41:00.759 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T00:41:00.839 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T00:41:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T00:41:01.078 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T00:41:01.126 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T00:41:01.158 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T00:41:01.186 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T00:41:01.612 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T00:41:01.652 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T00:41:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T00:41:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T00:41:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T00:41:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T00:41:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T00:41:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:41:03.156 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:41:03.732 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T00:41:03.768 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T00:41:03.851 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T00:41:03.862 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T00:41:03.862 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:41:03.862 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:41:03.862 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:03.881 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T00:41:03.902 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T00:41:03.988 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T00:41:04.149 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T00:41:04.180 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T00:41:04.204 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T00:41:04.204 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:04.204 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:41:04.204 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:41:04.204 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:41:04.204 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:04.264 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T00:41:04.276 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T00:41:04.382 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T00:41:04.438 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T00:41:05.361 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T00:41:05.392 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T00:41:05.416 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T00:41:05.416 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:05.416 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:41:05.416 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:41:05.417 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:41:05.417 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:05.459 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T00:41:05.483 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T00:41:05.483 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:05.483 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:41:05.483 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:05.535 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T00:41:05.559 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T00:41:05.559 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:05.559 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T00:41:05.559 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T00:41:05.560 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T00:41:05.560 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:05.877 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T00:41:05.901 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T00:41:05.901 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:05.901 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:41:05.901 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:41:05.902 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:41:05.902 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:06.181 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T00:41:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-12T00:41:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-12T00:41:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-12T00:41:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-12T00:41:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-12T00:41:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-12T00:41:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-12T00:41:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T00:41:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T00:41:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:41:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T00:41:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T00:41:07.887 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:07.887 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:41:07.887 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:41:07.887 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:41:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:08.110 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T00:41:08.134 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T00:41:08.134 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:08.134 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:41:08.134 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:41:08.135 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:41:08.135 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:08.578 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T00:41:08.601 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T00:41:08.602 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:08.602 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:41:08.602 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:41:08.602 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:41:08.602 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:08.708 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T00:41:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T00:41:08.820 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T00:41:09.015 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T00:41:09.062 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T00:41:09.140 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T00:41:09.228 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T00:41:09.368 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T00:41:09.420 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T00:41:09.451 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T00:41:09.479 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T00:41:09.890 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T00:41:09.920 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T00:41:09.951 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T00:41:10.014 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T00:41:10.042 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T00:41:10.490 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T00:41:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T00:41:10.573 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T00:41:10.605 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T00:41:10.640 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T00:41:10.828 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T00:41:10.879 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T00:41:10.909 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T00:41:10.939 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T00:41:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T00:41:11.089 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T00:41:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T00:41:11.585 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:11.625 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:11.647 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:12.084 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T00:41:12.111 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T00:41:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T00:41:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T00:41:12.396 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T00:41:12.420 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T00:41:12.420 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:12.420 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:41:12.420 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:41:12.420 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:41:12.420 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:12.471 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T00:41:12.484 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T00:41:12.513 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T00:41:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T00:41:12.606 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T00:41:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T00:41:12.648 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T00:41:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T00:41:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T00:41:12.810 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T00:41:12.837 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T00:41:12.837 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T00:41:12.929 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T00:41:12.929 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T00:41:13.013 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T00:41:13.038 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T00:41:13.044 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:13.044 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T00:41:13.324 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T00:41:13.388 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:13.561 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T00:41:13.591 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T00:41:13.614 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T00:41:13.615 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:13.615 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:41:13.615 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:41:13.615 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:41:13.615 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:13.658 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T00:41:13.681 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T00:41:13.681 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:13.681 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:41:13.681 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:13.725 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T00:41:13.749 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T00:41:13.749 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:13.749 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T00:41:13.749 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T00:41:13.749 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T00:41:13.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T00:41:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T00:41:14.075 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:14.075 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:41:14.075 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:41:14.075 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:41:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-12T00:41:16.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:16.591 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T00:41:16.607 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T00:41:16.607 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:16.607 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:41:16.608 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:18.152 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T00:41:18.180 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T00:41:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:41:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:41:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:41:18.181 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:18.419 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T00:41:18.444 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T00:41:18.444 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:18.444 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:41:18.444 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:41:18.444 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:41:18.444 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T00:41:18.670 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T00:41:18.711 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T00:41:18.743 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T00:41:18.770 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T00:41:18.903 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T00:41:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T00:41:18.928 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:18.928 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:41:18.928 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:41:18.928 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:41:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:18.953 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T00:41:18.992 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T00:41:19.022 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T00:41:19.034 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T00:41:19.051 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T00:41:19.092 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T00:41:19.106 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T00:41:19.155 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T00:41:19.225 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:19.225 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T00:41:19.225 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T00:41:19.225 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T00:41:19.225 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T00:41:19.226 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T00:41:19.227 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T00:41:19.239 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T00:41:19.239 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T00:41:19.239 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T00:41:19.239 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T00:41:19.239 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T00:41:19.239 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T00:41:19.239 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T00:41:19.239 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T00:41:19.240 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T00:41:19.242 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T00:41:19.243 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T00:41:19.244 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T00:41:19.245 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T00:41:19.246 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T00:41:19.247 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T00:41:19.248 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T00:41:19.249 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T00:41:19.249 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T00:41:19.249 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T00:41:19.249 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T00:41:19.249 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T00:41:19.249 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T00:41:19.249 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T00:41:19.360 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T00:41:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T00:41:19.493 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T00:41:19.583 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T00:41:19.683 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:19.721 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:19.736 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T00:41:19.741 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:19.780 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T00:41:19.811 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T00:41:19.839 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T00:41:20.250 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T00:41:20.279 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T00:41:20.311 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T00:41:20.376 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T00:41:20.410 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T00:41:20.582 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T00:41:20.675 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T00:41:20.716 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T00:41:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T00:41:20.827 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T00:41:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T00:41:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T00:41:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T00:41:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T00:41:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T00:41:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T00:41:21.080 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T00:41:21.085 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:21.085 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T00:41:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T00:41:21.413 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:21.514 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T00:41:21.562 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T00:41:21.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:21.740 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:41:21.741 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.743 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.744 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:21.744 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T00:41:21.744 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T00:41:21.744 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:41:21.744 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:41:21.744 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:41:21.744 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:41:21.744 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:41:21.745 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:41:21.745 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T00:41:21.745 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:41:21.745 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:41:21.745 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.745 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.745 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.745 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T00:41:21.746 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:41:21.747 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:41:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:41:21.749 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:41:21.750 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:41:21.751 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:41:21.751 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:41:21.751 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:41:21.751 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:41:21.751 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:41:21.751 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:41:21.751 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T00:41:21.751 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:41:21.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:41:21.753 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:41:21.754 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T00:41:21.755 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:41:21.755 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-12T00:41:22.208 DEBUG:teuthology.parallel:result is None 2024-09-12T00:41:22.578 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T00:41:22.612 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T00:41:22.720 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T00:41:22.881 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T00:41:22.906 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T00:41:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T00:41:22.931 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:22.931 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:41:22.931 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:41:22.931 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:41:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:22.990 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T00:41:23.002 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T00:41:23.112 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T00:41:23.175 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T00:41:24.156 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T00:41:24.184 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T00:41:24.209 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T00:41:24.209 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:24.209 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:41:24.209 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:41:24.209 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:41:24.209 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:24.251 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T00:41:24.275 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T00:41:24.276 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:24.276 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:41:24.276 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:24.327 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T00:41:24.351 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T00:41:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T00:41:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T00:41:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T00:41:24.352 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:24.669 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T00:41:24.694 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T00:41:24.694 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:41:24.694 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:41:24.694 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:41:24.695 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:41:24.695 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:41:27.063 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T00:41:27.064 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T00:41:27.065 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T00:41:27.066 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T00:41:27.067 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T00:41:27.068 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T00:41:27.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T00:41:27.070 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T00:41:27.071 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T00:41:27.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T00:41:27.073 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T00:41:27.074 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T00:41:27.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T00:41:27.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T00:41:27.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T00:41:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T00:41:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T00:41:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T00:41:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T00:41:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T00:41:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:29.775 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-12T00:41:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T00:41:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T00:41:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:41:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:41:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:41:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:41:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T00:41:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:41:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:41:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:41:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:41:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:41:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:41:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T00:41:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:41:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:41:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:41:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:41:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:41:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T00:41:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:41:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T00:41:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T00:41:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:41:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T00:41:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:41:29.793 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-12T00:41:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T00:41:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T00:41:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T00:41:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T00:41:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T00:41:30.205 DEBUG:teuthology.parallel:result is None 2024-09-12T00:41:30.618 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:30.656 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:30.677 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T00:41:31.586 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T00:41:31.677 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T00:41:31.729 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T00:41:31.827 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T00:41:31.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T00:41:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T00:41:31.924 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T00:41:31.924 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T00:41:32.024 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T00:41:32.024 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T00:41:32.117 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T00:41:32.147 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:32.148 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:32.335 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T00:41:32.336 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T00:41:32.403 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T00:41:32.471 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:37.992 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:37.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T00:41:37.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T00:41:37.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T00:41:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T00:41:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T00:41:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T00:41:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T00:41:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T00:41:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T00:41:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T00:41:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T00:41:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T00:41:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T00:41:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T00:41:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T00:41:38.005 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T00:41:38.005 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T00:41:41.011 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T00:41:41.011 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.013 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.014 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.015 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:41:41.016 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:41:41.017 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T00:41:41.018 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.019 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:41:41.020 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:41:41.021 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:41:41.022 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:41:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:41:41.024 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:41:41.025 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:41:41.025 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T00:41:41.025 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T00:41:41.025 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:41:41.025 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T00:41:41.025 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:41:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-12T00:41:41.564 DEBUG:teuthology.parallel:result is None 2024-09-12T00:41:41.565 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:41:41.725 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:41:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T00:41:41.749 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T00:41:41.749 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T00:41:41.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:41:41.905 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:41:41.932 INFO:teuthology.orchestra.run.smithi071.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T00:41:41.932 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T00:41:41.932 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T00:41:41.934 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:41:42.105 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:41:42.134 INFO:teuthology.orchestra.run.smithi167.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T00:41:42.134 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T00:41:42.134 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T00:41:42.136 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:41:42.136 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:41:42.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:41:42.171 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:41:42.171 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:41:42.209 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:41:42.209 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:41:42.261 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:41:42.261 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:41:42.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:41:42.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:41:42.365 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:41:42.365 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:41:42.398 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:41:42.466 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:41:42.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:41:42.493 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:41:42.558 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:41:42.558 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:41:42.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:41:42.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:41:42.661 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:41:42.661 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:41:42.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:41:42.751 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:41:42.752 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:41:42.777 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:41:42.857 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:41:42.857 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:41:42.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:41:42.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:41:42.958 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:41:42.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:41:42.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:41:43.049 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:41:43.049 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:41:43.074 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:41:43.140 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T00:41:43.255 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T00:41:43.255 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:41:43.256 INFO:tasks.cephadm:Cluster fsid is c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:41:43.256 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T00:41:43.256 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.b': '172.21.15.71', 'mon.c': '172.21.15.167'} 2024-09-12T00:41:43.257 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-09-12T00:41:43.257 INFO:tasks.cephadm:First mgr is x 2024-09-12T00:41:43.257 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T00:41:43.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-09-12T00:41:43.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-09-12T00:41:43.313 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname $(hostname -s) 2024-09-12T00:41:43.338 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T00:41:43.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:41:43.489 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T00:41:43.639 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:41:43.641 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T00:41:43.641 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T00:41:43.641 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 00:41 /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.012 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.352 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 00:41 /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.353 DEBUG:teuthology.orchestra.run.smithi167:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 00:41 /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.785 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.806 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.826 DEBUG:teuthology.orchestra.run.smithi167:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T00:41:44.860 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T00:41:44.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T00:41:44.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T00:41:44.868 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T00:41:46.427 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T00:41:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T00:41:46.466 INFO:teuthology.orchestra.run.smithi167.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T00:42:16.381 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-12T00:42:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T00:42:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T00:42:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "repo_digests": [ 2024-09-12T00:42:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T00:42:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-12T00:42:16.382 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-12T00:42:57.438 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:42:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T00:42:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T00:42:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-09-12T00:42:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T00:42:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T00:42:57.438 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:43:13.077 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T00:43:13.077 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T00:43:13.078 INFO:teuthology.orchestra.run.smithi071.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T00:43:13.078 INFO:teuthology.orchestra.run.smithi071.stdout: "repo_digests": [ 2024-09-12T00:43:13.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T00:43:13.078 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-12T00:43:13.078 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T00:43:13.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-09-12T00:43:13.138 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-09-12T00:43:13.165 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph 2024-09-12T00:43:13.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-09-12T00:43:13.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-09-12T00:43:13.254 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /etc/ceph 2024-09-12T00:43:13.283 INFO:tasks.cephadm:Writing seed config... 2024-09-12T00:43:13.300 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T00:43:13.301 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T00:43:13.302 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T00:43:13.303 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T00:43:13.304 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-12T00:43:13.305 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:43:13.306 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T00:43:13.324 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c8315cee-709f-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T00:43:13.325 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T00:43:13.367 DEBUG:teuthology.orchestra.run.smithi002:mgr.x> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T00:43:13.411 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T00:43:13.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid c8315cee-709f-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:43:13.625 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:43:13.625 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'c8315cee-709f-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-09-12T00:43:13.626 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T00:43:13.626 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-09-12T00:43:13.652 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-12T00:43:13.652 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-09-12T00:43:13.652 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-09-12T00:43:13.660 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T00:43:13.660 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T00:43:13.666 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T00:43:13.667 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-12T00:43:13.673 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-12T00:43:13.680 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-12T00:43:13.680 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-12T00:43:13.680 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-09-12T00:43:13.704 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-12T00:43:13.704 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T00:43:13.704 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-09-12T00:43:13.704 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-09-12T00:43:13.711 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T00:43:13.711 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T00:43:13.717 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T00:43:13.717 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-12T00:43:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-12T00:43:13.731 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-12T00:43:13.731 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-12T00:43:13.731 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-09-12T00:43:13.731 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:13.731 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140604932125696 on /run/cephadm/c8315cee-709f-11ef-bcea-c7b262605968.lock 2024-09-12T00:43:13.731 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140604932125696 acquired on /run/cephadm/c8315cee-709f-11ef-bcea-c7b262605968.lock 2024-09-12T00:43:13.732 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-09-12T00:43:13.732 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-09-12T00:43:13.732 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-12T00:43:13.735 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-09-12T00:43:13.735 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-09-12T00:43:13.738 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T00:43:13.738 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-12T00:43:13.738 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1787sec hoplimit 64 pref medium 2024-09-12T00:43:13.741 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T00:43:13.741 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T00:43:13.741 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T00:43:13.741 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-12T00:43:13.741 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-12T00:43:13.741 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T00:43:13.742 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-12T00:43:13.742 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-12T00:43:13.742 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T00:43:13.742 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T00:43:13.743 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T00:43:14.222 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T00:43:14.222 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T00:43:14.222 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T00:43:14.222 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T00:43:14.222 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T00:43:14.222 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T00:43:14.222 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T00:43:15.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T00:43:15.151 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T00:43:15.151 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T00:43:16.014 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-09-12T00:43:16.014 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-09-12T00:43:23.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAkOeJmnbrmHBAA2TIuS5fUOgiRD76d9RfX5w== 2024-09-12T00:43:28.096 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAuOeJmAc21DhAAwod1GO3qbykWojrE+G9ONQ== 2024-09-12T00:43:29.127 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAwOeJmTRshGhAA1qcXVAnDNEgT9S3UymbUiw== 2024-09-12T00:43:29.128 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:43:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-09-12T00:43:31.121 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-09-12T00:43:31.434 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T00:43:31.585 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T00:43:31.764 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c8315cee-709f-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c8315cee-709f-11ef-bcea-c7b262605968.target. 2024-09-12T00:43:31.765 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c8315cee-709f-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c8315cee-709f-11ef-bcea-c7b262605968.target. 2024-09-12T00:43:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a 2024-09-12T00:43:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T00:43:32.177 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c8315cee-709f-11ef-bcea-c7b262605968.target.wants/ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c8315cee-709f-11ef-bcea-c7b262605968@.service. 2024-09-12T00:43:32.674 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:32 smithi002 podman[30821]: 2024-09-12 00:43:32.636010219 +0000 UTC m=+0.325848541 container start 31aac83c24cfaad5b56e0d44d5c83cfe826cc4018806abe42de19679778d2431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T00:43:32.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:32 smithi002 ceph-mon[30840]: mkfs c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:32.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:32 smithi002 ceph-mon[30840]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T00:43:33.015 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T00:43:33.015 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-12T00:43:33.024 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T00:43:33.024 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-12T00:43:33.025 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-12T00:43:33.025 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T00:43:33.030 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-09-12T00:43:33.031 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-09-12T00:43:33.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:32 smithi002 bash[30821]: 31aac83c24cfaad5b56e0d44d5c83cfe826cc4018806abe42de19679778d2431 2024-09-12T00:43:33.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 systemd[1]: Started Ceph mon.a for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:43:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T00:43:33.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: monmap epoch 1 2024-09-12T00:43:33.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:33.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: last_changed 2024-09-12T00:43:29.460356+0000 2024-09-12T00:43:33.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:43:33.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: min_mon_release 19 (squid) 2024-09-12T00:43:33.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: election_strategy: 1 2024-09-12T00:43:33.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:43:33.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: fsmap 2024-09-12T00:43:33.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T00:43:33.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:33 smithi002 ceph-mon[30840]: mgrmap e1: no daemons active 2024-09-12T00:43:34.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 1.40406s) 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-09-12T00:43:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T00:43:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T00:43:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T00:43:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T00:43:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.003+0000 7f38ffd9e640 1 Processor -- start 2024-09-12T00:43:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.004+0000 7f38ffd9e640 1 -- start start 2024-09-12T00:43:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.004+0000 7f38ffd9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f8106570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:34.681 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.004+0000 7f38ffd9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38f807be30 con 0x7f38f8106170 2024-09-12T00:43:34.681 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.004+0000 7f38fdb3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f8106570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:34.681 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.004+0000 7f38fdb3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f8106570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53804/0 (socket says 172.21.15.2:53804) 2024-09-12T00:43:34.681 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.004+0000 7f38fdb3a640 1 -- 172.21.15.2:0/709214268 learned_addr learned my addr 172.21.15.2:0/709214268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:34.681 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.005+0000 7f38fdb3a640 1 -- 172.21.15.2:0/709214268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f8106ab0 con 0x7f38f8106170 2024-09-12T00:43:34.681 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.006+0000 7f38fdb3a640 1 --2- 172.21.15.2:0/709214268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f8106570 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009820 tx=0x7f38f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45e8defe5fa521d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.007+0000 7f38fcb38640 1 -- 172.21.15.2:0/709214268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38f4037070 con 0x7f38f8106170 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.007+0000 7f38fcb38640 1 -- 172.21.15.2:0/709214268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f4032440 con 0x7f38f8106170 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.007+0000 7f38fcb38640 1 -- 172.21.15.2:0/709214268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38f4032740 con 0x7f38f8106170 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.007+0000 7f38ffd9e640 1 -- 172.21.15.2:0/709214268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 msgr2=0x7f38f8106570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.007+0000 7f38ffd9e640 1 --2- 172.21.15.2:0/709214268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f8106570 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009820 tx=0x7f38f402a270 comp rx=0 tx=0).stop 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.007+0000 7f38ffd9e640 1 -- 172.21.15.2:0/709214268 shutdown_connections 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.007+0000 7f38ffd9e640 1 --2- 172.21.15.2:0/709214268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f8106570 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.007+0000 7f38ffd9e640 1 -- 172.21.15.2:0/709214268 >> 172.21.15.2:0/709214268 conn(0x7f38f8101f40 msgr2=0x7f38f8104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.008+0000 7f38ffd9e640 1 -- 172.21.15.2:0/709214268 shutdown_connections 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.008+0000 7f38ffd9e640 1 -- 172.21.15.2:0/709214268 wait complete. 2024-09-12T00:43:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.008+0000 7f38ffd9e640 1 Processor -- start 2024-09-12T00:43:34.683 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.008+0000 7f38ffd9e640 1 -- start start 2024-09-12T00:43:34.683 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.008+0000 7f38ffd9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:34.683 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.008+0000 7f38ffd9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8106fe0 con 0x7f38f8106170 2024-09-12T00:43:34.683 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38fdb3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:34.683 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38fdb3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f819d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53818/0 (socket says 172.21.15.2:53818) 2024-09-12T00:43:34.683 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38fdb3a640 1 -- 172.21.15.2:0/2360192733 learned_addr learned my addr 172.21.15.2:0/2360192733 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38fdb3a640 1 -- 172.21.15.2:0/2360192733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f819d7b0 con 0x7f38f8106170 2024-09-12T00:43:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38fdb3a640 1 --2- 172.21.15.2:0/2360192733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f819d270 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f38f40090b0 tx=0x7f38f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38eeffd640 1 -- 172.21.15.2:0/2360192733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38f4041070 con 0x7f38f8106170 2024-09-12T00:43:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38eeffd640 1 -- 172.21.15.2:0/2360192733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f403c7a0 con 0x7f38f8106170 2024-09-12T00:43:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f819da40 con 0x7f38f8106170 2024-09-12T00:43:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38eeffd640 1 -- 172.21.15.2:0/2360192733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38f4037040 con 0x7f38f8106170 2024-09-12T00:43:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.009+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f81a0730 con 0x7f38f8106170 2024-09-12T00:43:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.010+0000 7f38eeffd640 1 -- 172.21.15.2:0/2360192733 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38f4044070 con 0x7f38f8106170 2024-09-12T00:43:34.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.010+0000 7f38eeffd640 1 -- 172.21.15.2:0/2360192733 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f38f403d3f0 con 0x7f38f8106170 2024-09-12T00:43:34.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.010+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38f8106570 con 0x7f38f8106170 2024-09-12T00:43:34.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.013+0000 7f38eeffd640 1 -- 172.21.15.2:0/2360192733 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f38f4046450 con 0x7f38f8106170 2024-09-12T00:43:34.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.075+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f38f81a0c80 con 0x7f38f8106170 2024-09-12T00:43:34.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.075+0000 7f38eeffd640 1 -- 172.21.15.2:0/2360192733 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f38f4046630 con 0x7f38f8106170 2024-09-12T00:43:34.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.076+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 msgr2=0x7f38f819d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:34.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.076+0000 7f38ffd9e640 1 --2- 172.21.15.2:0/2360192733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f819d270 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f38f40090b0 tx=0x7f38f40046c0 comp rx=0 tx=0).stop 2024-09-12T00:43:34.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.076+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 shutdown_connections 2024-09-12T00:43:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.076+0000 7f38ffd9e640 1 --2- 172.21.15.2:0/2360192733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f8106170 0x7f38f819d270 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.076+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 >> 172.21.15.2:0/2360192733 conn(0x7f38f8101f40 msgr2=0x7f38f8193850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.076+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 shutdown_connections 2024-09-12T00:43:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:34.076+0000 7f38ffd9e640 1 -- 172.21.15.2:0/2360192733 wait complete. 2024-09-12T00:43:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-09-12T00:43:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T00:43:34.961 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:34 smithi002 ceph-mon[30840]: from='client.? 172.21.15.2:0/2360192733' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T00:43:35.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:35.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T00:43:35.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T00:43:35.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.139+0000 7fbd5f97c640 1 Processor -- start 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.139+0000 7fbd5f97c640 1 -- start start 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.139+0000 7fbd5f97c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5810a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.140+0000 7fbd5f97c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5807be10 con 0x7fbd581083a0 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.140+0000 7fbd5d718640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5810a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.140+0000 7fbd5d718640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5810a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53822/0 (socket says 172.21.15.2:53822) 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.140+0000 7fbd5d718640 1 -- 172.21.15.2:0/1935442955 learned_addr learned my addr 172.21.15.2:0/1935442955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.140+0000 7fbd5d718640 1 -- 172.21.15.2:0/1935442955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5810acd0 con 0x7fbd581083a0 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.141+0000 7fbd5d718640 1 --2- 172.21.15.2:0/1935442955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5810a790 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009820 tx=0x7fbd5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23441f098d937cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.141+0000 7fbd57fff640 1 -- 172.21.15.2:0/1935442955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd50037070 con 0x7fbd581083a0 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.141+0000 7fbd57fff640 1 -- 172.21.15.2:0/1935442955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd50032440 con 0x7fbd581083a0 2024-09-12T00:43:35.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.141+0000 7fbd57fff640 1 -- 172.21.15.2:0/1935442955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd50032740 con 0x7fbd581083a0 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.141+0000 7fbd5f97c640 1 -- 172.21.15.2:0/1935442955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 msgr2=0x7fbd5810a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.141+0000 7fbd5f97c640 1 --2- 172.21.15.2:0/1935442955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5810a790 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009820 tx=0x7fbd5002a270 comp rx=0 tx=0).stop 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 -- 172.21.15.2:0/1935442955 shutdown_connections 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 --2- 172.21.15.2:0/1935442955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5810a790 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 -- 172.21.15.2:0/1935442955 >> 172.21.15.2:0/1935442955 conn(0x7fbd58101f40 msgr2=0x7fbd58104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 -- 172.21.15.2:0/1935442955 shutdown_connections 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 -- 172.21.15.2:0/1935442955 wait complete. 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 Processor -- start 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 -- start start 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5819b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.142+0000 7fbd5f97c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5810b140 con 0x7fbd581083a0 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd5d718640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5819b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:35.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd5d718640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5819b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53834/0 (socket says 172.21.15.2:53834) 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd5d718640 1 -- 172.21.15.2:0/2660003988 learned_addr learned my addr 172.21.15.2:0/2660003988 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd5d718640 1 -- 172.21.15.2:0/2660003988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5819b5b0 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd5d718640 1 --2- 172.21.15.2:0/2660003988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5819b070 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbd500090b0 tx=0x7fbd500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd567fc640 1 -- 172.21.15.2:0/2660003988 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd50041070 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd567fc640 1 -- 172.21.15.2:0/2660003988 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5003c7a0 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5819b840 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd567fc640 1 -- 172.21.15.2:0/2660003988 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd50037040 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.143+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5819e530 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.144+0000 7fbd567fc640 1 -- 172.21.15.2:0/2660003988 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbd50044070 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.144+0000 7fbd567fc640 1 -- 172.21.15.2:0/2660003988 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbd5003d3f0 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.144+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd58108800 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.146+0000 7fbd567fc640 1 -- 172.21.15.2:0/2660003988 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbd50046450 con 0x7fbd581083a0 2024-09-12T00:43:35.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.206+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fbd5802d940 con 0x7fbd581083a0 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.209+0000 7fbd567fc640 1 -- 172.21.15.2:0/2660003988 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7fbd50046630 con 0x7fbd581083a0 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.210+0000 7fbd567fc640 1 -- 172.21.15.2:0/2660003988 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd5003d5f0 con 0x7fbd581083a0 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.211+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 msgr2=0x7fbd5819b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.211+0000 7fbd5f97c640 1 --2- 172.21.15.2:0/2660003988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5819b070 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbd500090b0 tx=0x7fbd500046c0 comp rx=0 tx=0).stop 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.211+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 shutdown_connections 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.211+0000 7fbd5f97c640 1 --2- 172.21.15.2:0/2660003988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd581083a0 0x7fbd5819b070 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.211+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 >> 172.21.15.2:0/2660003988 conn(0x7fbd58101f40 msgr2=0x7fbd58103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.211+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 shutdown_connections 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:35.211+0000 7fbd5f97c640 1 -- 172.21.15.2:0/2660003988 wait complete. 2024-09-12T00:43:35.773 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-09-12T00:43:35.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:35 smithi002 ceph-mon[30840]: from='client.? 172.21.15.2:0/2660003988' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T00:43:35.965 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:35 smithi002 ceph-mon[30840]: from='client.? 172.21.15.2:0/2660003988' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T00:43:36.847 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:36 smithi002 ceph-mon[30840]: from='client.? 172.21.15.2:0/2738178866' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:43:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.177+0000 7f8655637640 1 Processor -- start 2024-09-12T00:43:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.177+0000 7f8655637640 1 -- start start 2024-09-12T00:43:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.177+0000 7f8655637640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f8650107cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.177+0000 7f8655637640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f86501082c0 con 0x7f86501078f0 2024-09-12T00:43:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.178+0000 7f864effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f8650107cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.178+0000 7f864effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f8650107cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55422/0 (socket says 172.21.15.2:55422) 2024-09-12T00:43:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.178+0000 7f864effd640 1 -- 172.21.15.2:0/771389303 learned_addr learned my addr 172.21.15.2:0/771389303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.178+0000 7f864effd640 1 -- 172.21.15.2:0/771389303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8650108af0 con 0x7f86501078f0 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f864effd640 1 --2- 172.21.15.2:0/771389303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f8650107cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8648009820 tx=0x7f864802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae375565acb45fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f864dffb640 1 -- 172.21.15.2:0/771389303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8648037070 con 0x7f86501078f0 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f864dffb640 1 -- 172.21.15.2:0/771389303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8648032900 con 0x7f86501078f0 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f864dffb640 1 -- 172.21.15.2:0/771389303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8648030850 con 0x7f86501078f0 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f8655637640 1 -- 172.21.15.2:0/771389303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 msgr2=0x7f8650107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f8655637640 1 --2- 172.21.15.2:0/771389303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f8650107cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8648009820 tx=0x7f864802a270 comp rx=0 tx=0).stop 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f8655637640 1 -- 172.21.15.2:0/771389303 shutdown_connections 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f8655637640 1 --2- 172.21.15.2:0/771389303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f8650107cf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.179+0000 7f8655637640 1 -- 172.21.15.2:0/771389303 >> 172.21.15.2:0/771389303 conn(0x7f86501030c0 msgr2=0x7f86501054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.180+0000 7f8655637640 1 -- 172.21.15.2:0/771389303 shutdown_connections 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.180+0000 7f8655637640 1 -- 172.21.15.2:0/771389303 wait complete. 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.180+0000 7f8655637640 1 Processor -- start 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.180+0000 7f8655637640 1 -- start start 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.180+0000 7f8655637640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f865007db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.180+0000 7f8655637640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f865010bea0 con 0x7f86501078f0 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f864effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f865007db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f864effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f865007db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55438/0 (socket says 172.21.15.2:55438) 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f864effd640 1 -- 172.21.15.2:0/2738178866 learned_addr learned my addr 172.21.15.2:0/2738178866 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f864effd640 1 -- 172.21.15.2:0/2738178866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865007e090 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f864effd640 1 --2- 172.21.15.2:0/2738178866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f865007db50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f86480097f0 tx=0x7f8648030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f8647fff640 1 -- 172.21.15.2:0/2738178866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8648042070 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865007c280 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f8647fff640 1 -- 172.21.15.2:0/2738178866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8648032ca0 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f8647fff640 1 -- 172.21.15.2:0/2738178866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8648037040 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.181+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865007c7c0 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.182+0000 7f8647fff640 1 -- 172.21.15.2:0/2738178866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8648045070 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.182+0000 7f8647fff640 1 -- 172.21.15.2:0/2738178866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8648047780 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.182+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8650107d70 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.185+0000 7f8647fff640 1 -- 172.21.15.2:0/2738178866 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f864803da60 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.244+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f865007cb00 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.244+0000 7f8647fff640 1 -- 172.21.15.2:0/2738178866 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f864803c740 con 0x7f86501078f0 2024-09-12T00:43:36.859 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.245+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 msgr2=0x7f865007db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:36.860 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.245+0000 7f8655637640 1 --2- 172.21.15.2:0/2738178866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f865007db50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f86480097f0 tx=0x7f8648030ec0 comp rx=0 tx=0).stop 2024-09-12T00:43:36.860 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.245+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 shutdown_connections 2024-09-12T00:43:36.860 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.245+0000 7f8655637640 1 --2- 172.21.15.2:0/2738178866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86501078f0 0x7f865007db50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:36.860 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.245+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 >> 172.21.15.2:0/2738178866 conn(0x7f86501030c0 msgr2=0x7f8650103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:36.860 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.246+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 shutdown_connections 2024-09-12T00:43:36.860 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:36.246+0000 7f8655637640 1 -- 172.21.15.2:0/2738178866 wait complete. 2024-09-12T00:43:36.860 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-09-12T00:43:37.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:36 smithi002 systemd[1]: Stopping Ceph mon.a for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:43:37.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a[30836]: 2024-09-12T00:43:37.110+0000 7fddf85b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:43:37.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a[30836]: 2024-09-12T00:43:37.110+0000 7fddf85b2640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T00:43:37.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 podman[31082]: 2024-09-12 00:43:37.22353073 +0000 UTC m=+0.205237037 container died 31aac83c24cfaad5b56e0d44d5c83cfe826cc4018806abe42de19679778d2431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T00:43:37.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 podman[31082]: 2024-09-12 00:43:37.577229808 +0000 UTC m=+0.558936119 container cleanup 31aac83c24cfaad5b56e0d44d5c83cfe826cc4018806abe42de19679778d2431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T00:43:37.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 bash[31082]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a 2024-09-12T00:43:37.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 podman[31094]: 2024-09-12 00:43:37.711551808 +0000 UTC m=+0.486075441 container remove 31aac83c24cfaad5b56e0d44d5c83cfe826cc4018806abe42de19679778d2431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T00:43:38.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 systemd[1]: ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T00:43:38.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 systemd[1]: Stopped Ceph mon.a for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:43:38.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:37 smithi002 systemd[1]: Starting Ceph mon.a for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:43:38.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 podman[31191]: 2024-09-12 00:43:38.128940174 +0000 UTC m=+0.103807796 container create d0b1da0b7a44889e0725620949f78bcb5084f6d52037e72b5091539afe7d0b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T00:43:38.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 podman[31191]: 2024-09-12 00:43:38.041608559 +0000 UTC m=+0.016476191 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:43:38.409 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T00:43:38.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 podman[31191]: 2024-09-12 00:43:38.331081659 +0000 UTC m=+0.305949280 container init d0b1da0b7a44889e0725620949f78bcb5084f6d52037e72b5091539afe7d0b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T00:43:38.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 podman[31191]: 2024-09-12 00:43:38.33434966 +0000 UTC m=+0.309217284 container start d0b1da0b7a44889e0725620949f78bcb5084f6d52037e72b5091539afe7d0b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T00:43:38.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T00:43:38.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T00:43:38.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: pidfile_write: ignore empty --pid-file 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: load: jerasure load: lrc 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: RocksDB version: 7.9.2 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Git sha 0 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: DB SUMMARY 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: DB Session ID: 49LV02TTIYF3QNSJ9ZE5 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: CURRENT file: CURRENT 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T00:43:38.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 107489 ; 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.error_if_exists: 0 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.create_if_missing: 0 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.paranoid_checks: 1 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.env: 0x563ba9f7c940 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.info_log: 0x563bac3a36e0 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T00:43:38.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.statistics: (nil) 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.use_fsync: 0 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_log_file_size: 0 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.allow_fallocate: 1 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T00:43:38.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.use_direct_reads: 0 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.db_log_dir: 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.wal_dir: 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T00:43:38.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.write_buffer_manager: 0x563bac3b2dc0 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T00:43:38.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.unordered_write: 0 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.row_cache: None 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.wal_filter: None 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T00:43:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.two_write_queues: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.wal_compression: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.atomic_flush: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.log_readahead_size: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T00:43:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_background_jobs: 2 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_background_compactions: -1 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_subcompactions: 1 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T00:43:38.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T00:43:38.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T00:43:38.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T00:43:38.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T00:43:38.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T00:43:38.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_open_files: -1 2024-09-12T00:43:38.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T00:43:38.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T00:43:38.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_background_flushes: -1 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Compression algorithms supported: 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: kZSTD supported: 0 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: kXpressCompression supported: 0 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: kBZip2Compression supported: 0 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: kLZ4Compression supported: 1 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: kZlibCompression supported: 1 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: kSnappyCompression supported: 1 2024-09-12T00:43:38.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.merge_operator: 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_filter: None 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563bac3a3320) 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T00:43:38.635 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x563bac397350 2024-09-12T00:43:38.636 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-09-12T00:43:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-12T00:43:38.638 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression: NoCompression 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.num_levels: 7 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T00:43:38.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T00:43:38.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T00:43:38.641 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T00:43:38.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T00:43:38.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T00:43:38.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T00:43:38.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T00:43:38.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T00:43:38.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T00:43:38.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T00:43:38.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T00:43:38.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T00:43:38.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.inplace_update_support: 0 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.bloom_locality: 0 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.max_successive_merges: 0 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T00:43:38.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.ttl: 2592000 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.enable_blob_files: false 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.min_blob_size: 0 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T00:43:38.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dd1c3523-8406-4b8f-9f1c-25c370aa2654 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726101818360802, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T00:43:38.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726101818361946, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 102224, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 342, "table_properties": {"data_size": 100112, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14812, "raw_average_key_size": 49, "raw_value_size": 92088, "raw_average_value_size": 310, "num_data_blocks": 12, "num_entries": 297, "num_filter_entries": 297, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726101818, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dd1c3523-8406-4b8f-9f1c-25c370aa2654", "db_session_id": "49LV02TTIYF3QNSJ9ZE5", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T00:43:38.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726101818362045, "job": 1, "event": "recovery_finished"} 2024-09-12T00:43:38.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T00:43:38.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T00:43:38.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563bac3c4e00 2024-09-12T00:43:38.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: DB pointer 0x563bac4c0000 2024-09-12T00:43:38.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T00:43:38.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T00:43:38.648 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T00:43:38.649 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 101.69 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 101.69 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T00:43:38.650 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 28.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 28.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x563bac397350#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T00:43:38.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: mon.a@-1(???) e1 preinit fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: mon.a@-1(???).mds e1 new map 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: mon.a@-1(???).mds e1 print_map 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout: btime 2024-09-12T00:43:32:673188+0000 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T00:43:38.652 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T00:43:38.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T00:43:38.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 ceph-mon[31210]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T00:43:38.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 bash[31191]: d0b1da0b7a44889e0725620949f78bcb5084f6d52037e72b5091539afe7d0b86 2024-09-12T00:43:38.653 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:38 smithi002 systemd[1]: Started Ceph mon.a for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:43:39.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T00:43:39.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: monmap epoch 1 2024-09-12T00:43:39.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:39.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: last_changed 2024-09-12T00:43:29.460356+0000 2024-09-12T00:43:39.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:43:39.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: min_mon_release 19 (squid) 2024-09-12T00:43:39.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: election_strategy: 1 2024-09-12T00:43:39.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:43:39.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: fsmap 2024-09-12T00:43:39.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T00:43:39.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: mgrmap e1: no daemons active 2024-09-12T00:43:39.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:39 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3540222726' entity='client.admin' 2024-09-12T00:43:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.799+0000 7f5462d8d640 1 Processor -- start 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.799+0000 7f5462d8d640 1 -- start start 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.799+0000 7f5462d8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.799+0000 7f5462d8d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1082d0 con 0x7f545c107900 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.800+0000 7f5460b29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.800+0000 7f5460b29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55452/0 (socket says 172.21.15.2:55452) 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.800+0000 7f5460b29640 1 -- 172.21.15.2:0/739764076 learned_addr learned my addr 172.21.15.2:0/739764076 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.800+0000 7f5460b29640 1 -- 172.21.15.2:0/739764076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c108b00 con 0x7f545c107900 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.802+0000 7f5460b29640 1 --2- 172.21.15.2:0/739764076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c107d00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5450009820 tx=0x7f545002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71dd8d254946ba62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.802+0000 7f545b7fe640 1 -- 172.21.15.2:0/739764076 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5450037070 con 0x7f545c107900 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.802+0000 7f545b7fe640 1 -- 172.21.15.2:0/739764076 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5450032900 con 0x7f545c107900 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.802+0000 7f545b7fe640 1 -- 172.21.15.2:0/739764076 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5450030850 con 0x7f545c107900 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 -- 172.21.15.2:0/739764076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 msgr2=0x7f545c107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 --2- 172.21.15.2:0/739764076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c107d00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5450009820 tx=0x7f545002a270 comp rx=0 tx=0).stop 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 -- 172.21.15.2:0/739764076 shutdown_connections 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 --2- 172.21.15.2:0/739764076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c107d00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 -- 172.21.15.2:0/739764076 >> 172.21.15.2:0/739764076 conn(0x7f545c1030b0 msgr2=0x7f545c1054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 -- 172.21.15.2:0/739764076 shutdown_connections 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 -- 172.21.15.2:0/739764076 wait complete. 2024-09-12T00:43:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 Processor -- start 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 -- start start 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.803+0000 7f5462d8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5462d8d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f545c10beb0 con 0x7f545c107900 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5460b29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5460b29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c19b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55458/0 (socket says 172.21.15.2:55458) 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5460b29640 1 -- 172.21.15.2:0/3540222726 learned_addr learned my addr 172.21.15.2:0/3540222726 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5460b29640 1 -- 172.21.15.2:0/3540222726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c19be70 con 0x7f545c107900 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5460b29640 1 --2- 172.21.15.2:0/3540222726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c19b930 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5450009940 tx=0x7f54500326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5459ffb640 1 -- 172.21.15.2:0/3540222726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5450042070 con 0x7f545c107900 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5459ffb640 1 -- 172.21.15.2:0/3540222726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5450032be0 con 0x7f545c107900 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c19c100 con 0x7f545c107900 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.804+0000 7f5459ffb640 1 -- 172.21.15.2:0/3540222726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5450037040 con 0x7f545c107900 2024-09-12T00:43:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.805+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c19edf0 con 0x7f545c107900 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.805+0000 7f5459ffb640 1 -- 172.21.15.2:0/3540222726 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5450045070 con 0x7f545c107900 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.805+0000 7f5459ffb640 1 -- 172.21.15.2:0/3540222726 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5450047a80 con 0x7f545c107900 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.806+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c107d80 con 0x7f545c107900 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.808+0000 7f5459ffb640 1 -- 172.21.15.2:0/3540222726 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5450032d90 con 0x7f545c107900 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.867+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f545c19f010 con 0x7f545c107900 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.869+0000 7f5459ffb640 1 -- 172.21.15.2:0/3540222726 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f545003d430 con 0x7f545c107900 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.870+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 msgr2=0x7f545c19b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.870+0000 7f5462d8d640 1 --2- 172.21.15.2:0/3540222726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c19b930 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5450009940 tx=0x7f54500326e0 comp rx=0 tx=0).stop 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.870+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 shutdown_connections 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.870+0000 7f5462d8d640 1 --2- 172.21.15.2:0/3540222726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c107900 0x7f545c19b930 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.870+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 >> 172.21.15.2:0/3540222726 conn(0x7f545c1030b0 msgr2=0x7f545c103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.870+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 shutdown_connections 2024-09-12T00:43:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:38.870+0000 7f5462d8d640 1 -- 172.21.15.2:0/3540222726 wait complete. 2024-09-12T00:43:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T00:43:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:43:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-09-12T00:43:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T00:43:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T00:43:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.x 2024-09-12T00:43:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T00:43:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c8315cee-709f-11ef-bcea-c7b262605968.target.wants/ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c8315cee-709f-11ef-bcea-c7b262605968@.service. 2024-09-12T00:43:40.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 systemd[1]: Starting Ceph mgr.x for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:43:40.665 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 podman[31422]: 2024-09-12 00:43:40.299641866 +0000 UTC m=+0.016282103 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T00:43:40.665 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 podman[31422]: 2024-09-12 00:43:40.414500388 +0000 UTC m=+0.131140614 container create ef1c39039cff0cd1f31e51687e60ad5930734f894e1fe7e6097168b692318f56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T00:43:40.665 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 podman[31422]: 2024-09-12 00:43:40.608358805 +0000 UTC m=+0.324999031 container init ef1c39039cff0cd1f31e51687e60ad5930734f894e1fe7e6097168b692318f56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T00:43:40.665 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 podman[31422]: 2024-09-12 00:43:40.611284364 +0000 UTC m=+0.327924592 container start ef1c39039cff0cd1f31e51687e60ad5930734f894e1fe7e6097168b692318f56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T00:43:40.666 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 bash[31422]: ef1c39039cff0cd1f31e51687e60ad5930734f894e1fe7e6097168b692318f56 2024-09-12T00:43:40.679 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T00:43:40.679 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-12T00:43:40.687 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T00:43:40.687 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-12T00:43:40.687 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-12T00:43:40.687 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T00:43:40.696 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T00:43:40.696 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-12T00:43:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T00:43:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-12T00:43:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-12T00:43:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T00:43:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-09-12T00:43:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-09-12T00:43:40.947 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 systemd[1]: Started Ceph mgr.x for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:43:40.948 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:40.746+0000 7fe4ddd1b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T00:43:40.948 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:40.805+0000 7fe4ddd1b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T00:43:41.220 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:40 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:40.964+0000 7fe4ddd1b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T00:43:41.220 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:41 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:41.033+0000 7fe4ddd1b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T00:43:41.220 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:41 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:41.192+0000 7fe4ddd1b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:43:41.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:41 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2447630305' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T00:43:41.473 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:41 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:41.344+0000 7fe4ddd1b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T00:43:41.744 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:41 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:41.680+0000 7fe4ddd1b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T00:43:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T00:43:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T00:43:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T00:43:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T00:43:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T00:43:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T00:43:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T00:43:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T00:43:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T00:43:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T00:43:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T00:43:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T00:43:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T00:43:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T00:43:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T00:43:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T00:43:32:673188+0000", 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T00:43:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T00:43:32.673875+0000", 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-12T00:43:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.150+0000 7f4e8a29c640 1 Processor -- start 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.150+0000 7f4e8a29c640 1 -- start start 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.150+0000 7f4e8a29c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e841065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.150+0000 7f4e8a29c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8407bdf0 con 0x7f4e841061b0 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.150+0000 7f4e83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e841065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.150+0000 7f4e83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e841065b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55476/0 (socket says 172.21.15.2:55476) 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.150+0000 7f4e83fff640 1 -- 172.21.15.2:0/3059907152 learned_addr learned my addr 172.21.15.2:0/3059907152 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.151+0000 7f4e83fff640 1 -- 172.21.15.2:0/3059907152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e84106af0 con 0x7f4e841061b0 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.151+0000 7f4e83fff640 1 --2- 172.21.15.2:0/3059907152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e841065b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009820 tx=0x7f4e7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e9696334686f64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.152+0000 7f4e837fe640 1 -- 172.21.15.2:0/3059907152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74037070 con 0x7f4e841061b0 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.152+0000 7f4e837fe640 1 -- 172.21.15.2:0/3059907152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e74032900 con 0x7f4e841061b0 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.152+0000 7f4e837fe640 1 -- 172.21.15.2:0/3059907152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74030850 con 0x7f4e841061b0 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 -- 172.21.15.2:0/3059907152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 msgr2=0x7f4e841065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 --2- 172.21.15.2:0/3059907152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e841065b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009820 tx=0x7f4e7402a270 comp rx=0 tx=0).stop 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 -- 172.21.15.2:0/3059907152 shutdown_connections 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 --2- 172.21.15.2:0/3059907152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e841065b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 -- 172.21.15.2:0/3059907152 >> 172.21.15.2:0/3059907152 conn(0x7f4e84101f40 msgr2=0x7f4e84104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 -- 172.21.15.2:0/3059907152 shutdown_connections 2024-09-12T00:43:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 -- 172.21.15.2:0/3059907152 wait complete. 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 Processor -- start 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.153+0000 7f4e8a29c640 1 -- start start 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.154+0000 7f4e8a29c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e8419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.154+0000 7f4e8a29c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e84107b80 con 0x7f4e841061b0 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.154+0000 7f4e83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e8419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.154+0000 7f4e83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e8419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55490/0 (socket says 172.21.15.2:55490) 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.154+0000 7f4e83fff640 1 -- 172.21.15.2:0/2447630305 learned_addr learned my addr 172.21.15.2:0/2447630305 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.154+0000 7f4e83fff640 1 -- 172.21.15.2:0/2447630305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8419dfc0 con 0x7f4e841061b0 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.154+0000 7f4e83fff640 1 --2- 172.21.15.2:0/2447630305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e8419da80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4e74032ce0 tx=0x7f4e74032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.154+0000 7f4e81ffb640 1 -- 172.21.15.2:0/2447630305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74042070 con 0x7f4e841061b0 2024-09-12T00:43:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.155+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8419e250 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.155+0000 7f4e81ffb640 1 -- 172.21.15.2:0/2447630305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e740308c0 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.155+0000 7f4e81ffb640 1 -- 172.21.15.2:0/2447630305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74037040 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.155+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e841a0f40 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.155+0000 7f4e81ffb640 1 -- 172.21.15.2:0/2447630305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e74045070 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.155+0000 7f4e81ffb640 1 -- 172.21.15.2:0/2447630305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4e74047bd0 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.156+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e841065b0 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.158+0000 7f4e81ffb640 1 -- 172.21.15.2:0/2447630305 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4e7403c830 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.220+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4e84197590 con 0x7f4e841061b0 2024-09-12T00:43:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.220+0000 7f4e81ffb640 1 -- 172.21.15.2:0/2447630305 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4e7403ca10 con 0x7f4e841061b0 2024-09-12T00:43:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.221+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 msgr2=0x7f4e8419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.221+0000 7f4e8a29c640 1 --2- 172.21.15.2:0/2447630305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e8419da80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4e74032ce0 tx=0x7f4e74032d10 comp rx=0 tx=0).stop 2024-09-12T00:43:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.221+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 shutdown_connections 2024-09-12T00:43:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.221+0000 7f4e8a29c640 1 --2- 172.21.15.2:0/2447630305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e841061b0 0x7f4e8419da80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.221+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 >> 172.21.15.2:0/2447630305 conn(0x7f4e84101f40 msgr2=0x7f4e84194760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.221+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 shutdown_connections 2024-09-12T00:43:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:41.221+0000 7f4e8a29c640 1 -- 172.21.15.2:0/2447630305 wait complete. 2024-09-12T00:43:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-09-12T00:43:41.994 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:41 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:41.744+0000 7fe4ddd1b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T00:43:41.994 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:41 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:41.939+0000 7fe4ddd1b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T00:43:43.244 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:42 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:42.864+0000 7fe4ddd1b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T00:43:43.245 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:42 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:42.935+0000 7fe4ddd1b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T00:43:43.963 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:43 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:43.692+0000 7fe4ddd1b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T00:43:43.964 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:43 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:43.812+0000 7fe4ddd1b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T00:43:43.964 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:43 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:43.963+0000 7fe4ddd1b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:43:44.244 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.029+0000 7fe4ddd1b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T00:43:44.245 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.187+0000 7fe4ddd1b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T00:43:44.571 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4191660881' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T00:43:44.571 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.260+0000 7fe4ddd1b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T00:43:44.571 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.325+0000 7fe4ddd1b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T00:43:44.571 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.502+0000 7fe4ddd1b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T00:43:44.571 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.571+0000 7fe4ddd1b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T00:43:44.853 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.641+0000 7fe4ddd1b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T00:43:44.853 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.728+0000 7fe4ddd1b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T00:43:44.853 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.791+0000 7fe4ddd1b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T00:43:44.853 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:44 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:44.853+0000 7fe4ddd1b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T00:43:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T00:43:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T00:43:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T00:43:32:673188+0000", 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T00:43:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T00:43:32.673875+0000", 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.262+0000 7f4748c7e640 1 Processor -- start 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.262+0000 7f4748c7e640 1 -- start start 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.262+0000 7f4748c7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f474410a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.262+0000 7f4748c7e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f474407be10 con 0x7f47441083a0 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.262+0000 7f474259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f474410a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.262+0000 7f474259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f474410a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55498/0 (socket says 172.21.15.2:55498) 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.262+0000 7f474259c640 1 -- 172.21.15.2:0/3588548007 learned_addr learned my addr 172.21.15.2:0/3588548007 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.262+0000 7f474259c640 1 -- 172.21.15.2:0/3588548007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474410acd0 con 0x7f47441083a0 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.263+0000 7f474259c640 1 --2- 172.21.15.2:0/3588548007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f474410a790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4734009820 tx=0x7f473402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0f19ac80820701 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.263+0000 7f4741d9b640 1 -- 172.21.15.2:0/3588548007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4734037070 con 0x7f47441083a0 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.263+0000 7f4741d9b640 1 -- 172.21.15.2:0/3588548007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4734032900 con 0x7f47441083a0 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.263+0000 7f4741d9b640 1 -- 172.21.15.2:0/3588548007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4734030850 con 0x7f47441083a0 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.264+0000 7f4748c7e640 1 -- 172.21.15.2:0/3588548007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 msgr2=0x7f474410a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.264+0000 7f4748c7e640 1 --2- 172.21.15.2:0/3588548007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f474410a790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4734009820 tx=0x7f473402a270 comp rx=0 tx=0).stop 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.264+0000 7f4748c7e640 1 -- 172.21.15.2:0/3588548007 shutdown_connections 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.264+0000 7f4748c7e640 1 --2- 172.21.15.2:0/3588548007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f474410a790 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.264+0000 7f4748c7e640 1 -- 172.21.15.2:0/3588548007 >> 172.21.15.2:0/3588548007 conn(0x7f4744101f40 msgr2=0x7f4744104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.264+0000 7f4748c7e640 1 -- 172.21.15.2:0/3588548007 shutdown_connections 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.264+0000 7f4748c7e640 1 -- 172.21.15.2:0/3588548007 wait complete. 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.265+0000 7f4748c7e640 1 Processor -- start 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.265+0000 7f4748c7e640 1 -- start start 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.265+0000 7f4748c7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f4744107c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.265+0000 7f4748c7e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f474410bc40 con 0x7f47441083a0 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.265+0000 7f474259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f4744107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.265+0000 7f474259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f4744107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55506/0 (socket says 172.21.15.2:55506) 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.265+0000 7f474259c640 1 -- 172.21.15.2:0/4191660881 learned_addr learned my addr 172.21.15.2:0/4191660881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.265+0000 7f474259c640 1 -- 172.21.15.2:0/4191660881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4744108160 con 0x7f47441083a0 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.266+0000 7f474259c640 1 --2- 172.21.15.2:0/4191660881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f4744107c20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f47340097f0 tx=0x7f4734030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.266+0000 7f473b7fe640 1 -- 172.21.15.2:0/4191660881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4734037040 con 0x7f47441083a0 2024-09-12T00:43:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.266+0000 7f473b7fe640 1 -- 172.21.15.2:0/4191660881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4734040070 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.266+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4744106350 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.266+0000 7f473b7fe640 1 -- 172.21.15.2:0/4191660881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f473403a390 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.266+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4744106830 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.266+0000 7f473b7fe640 1 -- 172.21.15.2:0/4191660881 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f473403a5e0 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.266+0000 7f473b7fe640 1 -- 172.21.15.2:0/4191660881 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4734045950 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.267+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4744108800 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.269+0000 7f473b7fe640 1 -- 172.21.15.2:0/4191660881 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4734045460 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.331+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4744106d60 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.332+0000 7f473b7fe640 1 -- 172.21.15.2:0/4191660881 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f473403b430 con 0x7f47441083a0 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.333+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 msgr2=0x7f4744107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.333+0000 7f4748c7e640 1 --2- 172.21.15.2:0/4191660881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f4744107c20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f47340097f0 tx=0x7f4734030d80 comp rx=0 tx=0).stop 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.333+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 shutdown_connections 2024-09-12T00:43:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.333+0000 7f4748c7e640 1 --2- 172.21.15.2:0/4191660881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47441083a0 0x7f4744107c20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.333+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 >> 172.21.15.2:0/4191660881 conn(0x7f4744101f40 msgr2=0x7f4744102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.333+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 shutdown_connections 2024-09-12T00:43:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:44.333+0000 7f4748c7e640 1 -- 172.21.15.2:0/4191660881 wait complete. 2024-09-12T00:43:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-09-12T00:43:45.994 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:45.682+0000 7fe4ddd1b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: Activating manager daemon x 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: mgrmap e2: x(active, starting, since 0.00319293s) 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: Manager daemon x is now available 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T00:43:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' 2024-09-12T00:43:45.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' 2024-09-12T00:43:45.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:45 smithi002 ceph-mon[31210]: from='mgr.14100 172.21.15.2:0/1693834442' entity='mgr.x' 2024-09-12T00:43:47.925 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:47 smithi002 ceph-mon[31210]: mgrmap e3: x(active, since 1.00727s) 2024-09-12T00:43:47.928 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:47 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2509029790' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T00:43:48.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:48.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-12T00:43:48.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:43:48.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T00:43:48.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T00:43:48.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T00:43:48.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T00:43:48.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T00:43:48.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:48.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T00:43:48.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:48.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T00:43:48.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T00:43:48.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T00:43:48.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T00:43:48.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T00:43:48.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T00:43:48.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:48.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T00:43:48.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T00:43:32:673188+0000", 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T00:43:48.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T00:43:32.673875+0000", 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-12T00:43:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.370+0000 7f968e75f640 1 Processor -- start 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.370+0000 7f968e75f640 1 -- start start 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.371+0000 7f968e75f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f9688107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.371+0000 7f968e75f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96881082d0 con 0x7f9688107900 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.371+0000 7f9687fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f9688107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.371+0000 7f9687fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f9688107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56382/0 (socket says 172.21.15.2:56382) 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.371+0000 7f9687fff640 1 -- 172.21.15.2:0/4145197881 learned_addr learned my addr 172.21.15.2:0/4145197881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.371+0000 7f9687fff640 1 -- 172.21.15.2:0/4145197881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688108b00 con 0x7f9688107900 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.372+0000 7f9687fff640 1 --2- 172.21.15.2:0/4145197881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f9688107d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9678009820 tx=0x7f967802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9becbe61b7dd99d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.372+0000 7f9686ffd640 1 -- 172.21.15.2:0/4145197881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9678037070 con 0x7f9688107900 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.372+0000 7f9686ffd640 1 -- 172.21.15.2:0/4145197881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9678032900 con 0x7f9688107900 2024-09-12T00:43:48.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.372+0000 7f9686ffd640 1 -- 172.21.15.2:0/4145197881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9678030850 con 0x7f9688107900 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.373+0000 7f968e75f640 1 -- 172.21.15.2:0/4145197881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 msgr2=0x7f9688107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.373+0000 7f968e75f640 1 --2- 172.21.15.2:0/4145197881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f9688107d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9678009820 tx=0x7f967802a270 comp rx=0 tx=0).stop 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.373+0000 7f968e75f640 1 -- 172.21.15.2:0/4145197881 shutdown_connections 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.373+0000 7f968e75f640 1 --2- 172.21.15.2:0/4145197881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f9688107d00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.373+0000 7f968e75f640 1 -- 172.21.15.2:0/4145197881 >> 172.21.15.2:0/4145197881 conn(0x7f96881030b0 msgr2=0x7f96881054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.373+0000 7f968e75f640 1 -- 172.21.15.2:0/4145197881 shutdown_connections 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.373+0000 7f968e75f640 1 -- 172.21.15.2:0/4145197881 wait complete. 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.373+0000 7f968e75f640 1 Processor -- start 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.374+0000 7f968e75f640 1 -- start start 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.374+0000 7f968e75f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f968807db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.374+0000 7f968e75f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f968810beb0 con 0x7f9688107900 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.374+0000 7f9687fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f968807db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.374+0000 7f9687fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f968807db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56386/0 (socket says 172.21.15.2:56386) 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.374+0000 7f9687fff640 1 -- 172.21.15.2:0/2509029790 learned_addr learned my addr 172.21.15.2:0/2509029790 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.374+0000 7f9687fff640 1 -- 172.21.15.2:0/2509029790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968807e090 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.375+0000 7f9687fff640 1 --2- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f968807db50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9678009940 tx=0x7f96780326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.375+0000 7f96857fa640 1 -- 172.21.15.2:0/2509029790 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9678042070 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.375+0000 7f96857fa640 1 -- 172.21.15.2:0/2509029790 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9678032be0 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.375+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968807c280 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.375+0000 7f96857fa640 1 -- 172.21.15.2:0/2509029790 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9678037040 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.375+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968807c7c0 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.376+0000 7f96857fa640 1 -- 172.21.15.2:0/2509029790 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f9678045070 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.376+0000 7f96857fa640 1 --2- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9670038e60 0x7f967003b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.376+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9688107d80 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.376+0000 7f96857fa640 1 -- 172.21.15.2:0/2509029790 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f967806bc80 con 0x7f9688107900 2024-09-12T00:43:48.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.376+0000 7f96877fe640 1 --2- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9670038e60 0x7f967003b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.376+0000 7f96877fe640 1 --2- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9670038e60 0x7f967003b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f967c0098c0 tx=0x7f967c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.381+0000 7f96857fa640 1 -- 172.21.15.2:0/2509029790 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9678045360 con 0x7f9688107900 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.626+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f968807cb00 con 0x7f9688107900 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.626+0000 7f96857fa640 1 -- 172.21.15.2:0/2509029790 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f9678032d90 con 0x7f9688107900 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.628+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9670038e60 msgr2=0x7f967003b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.628+0000 7f968e75f640 1 --2- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9670038e60 0x7f967003b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f967c0098c0 tx=0x7f967c006db0 comp rx=0 tx=0).stop 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.628+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 msgr2=0x7f968807db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.628+0000 7f968e75f640 1 --2- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f968807db50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9678009940 tx=0x7f96780326e0 comp rx=0 tx=0).stop 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.628+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 shutdown_connections 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.628+0000 7f968e75f640 1 --2- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9670038e60 0x7f967003b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.628+0000 7f968e75f640 1 --2- 172.21.15.2:0/2509029790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9688107900 0x7f968807db50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.628+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 >> 172.21.15.2:0/2509029790 conn(0x7f96881030b0 msgr2=0x7f9688103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.629+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 shutdown_connections 2024-09-12T00:43:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:47.629+0000 7f968e75f640 1 -- 172.21.15.2:0/2509029790 wait complete. 2024-09-12T00:43:48.208 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-09-12T00:43:48.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:48 smithi002 ceph-mon[31210]: mgrmap e4: x(active, since 2s) 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T00:43:49.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.564+0000 7fd2915db640 1 Processor -- start 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.564+0000 7fd2915db640 1 -- start start 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.564+0000 7fd2915db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c109f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:49.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.564+0000 7fd2915db640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c10a4f0 con 0x7fd28c109b20 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.564+0000 7fd28affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c109f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.564+0000 7fd28affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c109f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56394/0 (socket says 172.21.15.2:56394) 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.564+0000 7fd28affd640 1 -- 172.21.15.2:0/2705043665 learned_addr learned my addr 172.21.15.2:0/2705043665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.565+0000 7fd28affd640 1 -- 172.21.15.2:0/2705043665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c10ad20 con 0x7fd28c109b20 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.565+0000 7fd28affd640 1 --2- 172.21.15.2:0/2705043665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c109f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009820 tx=0x7fd27c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b434f95d350faa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd289ffb640 1 -- 172.21.15.2:0/2705043665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd27c037070 con 0x7fd28c109b20 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd289ffb640 1 -- 172.21.15.2:0/2705043665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd27c032900 con 0x7fd28c109b20 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd289ffb640 1 -- 172.21.15.2:0/2705043665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd27c030850 con 0x7fd28c109b20 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd2915db640 1 -- 172.21.15.2:0/2705043665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 msgr2=0x7fd28c109f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd2915db640 1 --2- 172.21.15.2:0/2705043665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c109f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009820 tx=0x7fd27c02a270 comp rx=0 tx=0).stop 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd2915db640 1 -- 172.21.15.2:0/2705043665 shutdown_connections 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd2915db640 1 --2- 172.21.15.2:0/2705043665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c109f20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:49.301 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd2915db640 1 -- 172.21.15.2:0/2705043665 >> 172.21.15.2:0/2705043665 conn(0x7fd28c07d130 msgr2=0x7fd28c07d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd2915db640 1 -- 172.21.15.2:0/2705043665 shutdown_connections 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.566+0000 7fd2915db640 1 -- 172.21.15.2:0/2705043665 wait complete. 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.567+0000 7fd2915db640 1 Processor -- start 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.567+0000 7fd2915db640 1 -- start start 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.567+0000 7fd2915db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.567+0000 7fd2915db640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c10e0d0 con 0x7fd28c109b20 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.567+0000 7fd28affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.567+0000 7fd28affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c19dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56408/0 (socket says 172.21.15.2:56408) 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.567+0000 7fd28affd640 1 -- 172.21.15.2:0/3291551026 learned_addr learned my addr 172.21.15.2:0/3291551026 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.568+0000 7fd28affd640 1 -- 172.21.15.2:0/3291551026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c19e010 con 0x7fd28c109b20 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.568+0000 7fd28affd640 1 --2- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c19dad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0097f0 tx=0x7fd27c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.568+0000 7fd273fff640 1 -- 172.21.15.2:0/3291551026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd27c042070 con 0x7fd28c109b20 2024-09-12T00:43:49.302 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.568+0000 7fd273fff640 1 -- 172.21.15.2:0/3291551026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd27c032ca0 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.568+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c19e2a0 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.568+0000 7fd273fff640 1 -- 172.21.15.2:0/3291551026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd27c037040 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.568+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c1a0f90 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.569+0000 7fd273fff640 1 -- 172.21.15.2:0/3291551026 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fd27c045070 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.569+0000 7fd273fff640 1 --2- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fd274038f20 0x7fd27403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.569+0000 7fd273fff640 1 -- 172.21.15.2:0/3291551026 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd27c06be90 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.569+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c109fa0 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.569+0000 7fd28a7fc640 1 --2- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fd274038f20 0x7fd27403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.570+0000 7fd28a7fc640 1 --2- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fd274038f20 0x7fd27403b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd28000ad30 tx=0x7fd2800093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.574+0000 7fd273fff640 1 -- 172.21.15.2:0/3291551026 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd27c06b8b0 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.751+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fd28c1a1160 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.752+0000 7fd273fff640 1 -- 172.21.15.2:0/3291551026 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7fd27c03d430 con 0x7fd28c109b20 2024-09-12T00:43:49.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fd274038f20 msgr2=0x7fd27403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 --2- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fd274038f20 0x7fd27403b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd28000ad30 tx=0x7fd2800093f0 comp rx=0 tx=0).stop 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 msgr2=0x7fd28c19dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 --2- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c19dad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0097f0 tx=0x7fd27c030ec0 comp rx=0 tx=0).stop 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 shutdown_connections 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 --2- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fd274038f20 0x7fd27403b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 --2- 172.21.15.2:0/3291551026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c109b20 0x7fd28c19dad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 >> 172.21.15.2:0/3291551026 conn(0x7fd28c07d130 msgr2=0x7fd28c107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 shutdown_connections 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:48.754+0000 7fd2915db640 1 -- 172.21.15.2:0/3291551026 wait complete. 2024-09-12T00:43:49.304 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-09-12T00:43:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:49 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3291551026' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T00:43:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:50 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2076871462' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T00:43:50.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ignoring --setuser ceph since I am not root 2024-09-12T00:43:50.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ignoring --setgroup ceph since I am not root 2024-09-12T00:43:50.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:50.842+0000 7f0732890040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T00:43:50.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:50.901+0000 7f0732890040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T00:43:51.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.761+0000 7fef8c19e640 1 Processor -- start 2024-09-12T00:43:51.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.761+0000 7fef8c19e640 1 -- start start 2024-09-12T00:43:51.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.761+0000 7fef8c19e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8410a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:51.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.761+0000 7fef8c19e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef8407bdf0 con 0x7fef84108390 2024-09-12T00:43:51.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.761+0000 7fef89f3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8410a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:51.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.761+0000 7fef89f3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8410a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56420/0 (socket says 172.21.15.2:56420) 2024-09-12T00:43:51.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.761+0000 7fef89f3a640 1 -- 172.21.15.2:0/3551447148 learned_addr learned my addr 172.21.15.2:0/3551447148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:51.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.762+0000 7fef89f3a640 1 -- 172.21.15.2:0/3551447148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8410acc0 con 0x7fef84108390 2024-09-12T00:43:51.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.762+0000 7fef89f3a640 1 --2- 172.21.15.2:0/3551447148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8410a780 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fef80009820 tx=0x7fef8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e79ef03d48ed621 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:51.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.763+0000 7fef88f38640 1 -- 172.21.15.2:0/3551447148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef80037070 con 0x7fef84108390 2024-09-12T00:43:51.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.763+0000 7fef88f38640 1 -- 172.21.15.2:0/3551447148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef80032900 con 0x7fef84108390 2024-09-12T00:43:51.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.763+0000 7fef88f38640 1 -- 172.21.15.2:0/3551447148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef80030850 con 0x7fef84108390 2024-09-12T00:43:51.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.763+0000 7fef8c19e640 1 -- 172.21.15.2:0/3551447148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 msgr2=0x7fef8410a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:51.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.763+0000 7fef8c19e640 1 --2- 172.21.15.2:0/3551447148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8410a780 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fef80009820 tx=0x7fef8002a270 comp rx=0 tx=0).stop 2024-09-12T00:43:51.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.763+0000 7fef8c19e640 1 -- 172.21.15.2:0/3551447148 shutdown_connections 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.763+0000 7fef8c19e640 1 --2- 172.21.15.2:0/3551447148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8410a780 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.763+0000 7fef8c19e640 1 -- 172.21.15.2:0/3551447148 >> 172.21.15.2:0/3551447148 conn(0x7fef84101f10 msgr2=0x7fef84104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.764+0000 7fef8c19e640 1 -- 172.21.15.2:0/3551447148 shutdown_connections 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.764+0000 7fef8c19e640 1 -- 172.21.15.2:0/3551447148 wait complete. 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.764+0000 7fef8c19e640 1 Processor -- start 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.764+0000 7fef8c19e640 1 -- start start 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.764+0000 7fef8c19e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.764+0000 7fef8c19e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef8410bc30 con 0x7fef84108390 2024-09-12T00:43:51.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef89f3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef89f3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56430/0 (socket says 172.21.15.2:56430) 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef89f3a640 1 -- 172.21.15.2:0/2076871462 learned_addr learned my addr 172.21.15.2:0/2076871462 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef89f3a640 1 -- 172.21.15.2:0/2076871462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8419dfc0 con 0x7fef84108390 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef89f3a640 1 --2- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8419da80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef800097f0 tx=0x7fef80030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef7affd640 1 -- 172.21.15.2:0/2076871462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef80037040 con 0x7fef84108390 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef7affd640 1 -- 172.21.15.2:0/2076871462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef80040070 con 0x7fef84108390 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8419e250 con 0x7fef84108390 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef7affd640 1 -- 172.21.15.2:0/2076871462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8003a390 con 0x7fef84108390 2024-09-12T00:43:51.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.765+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef841a0f40 con 0x7fef84108390 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.766+0000 7fef7affd640 1 -- 172.21.15.2:0/2076871462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fef8003b430 con 0x7fef84108390 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.766+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef841087f0 con 0x7fef84108390 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.767+0000 7fef7affd640 1 --2- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fef70038fc0 0x7fef7003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.767+0000 7fef7affd640 1 -- 172.21.15.2:0/2076871462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fef8006c0c0 con 0x7fef84108390 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.767+0000 7fef89739640 1 --2- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fef70038fc0 0x7fef7003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.767+0000 7fef89739640 1 --2- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fef70038fc0 0x7fef7003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fef740098c0 tx=0x7fef74006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.771+0000 7fef7affd640 1 -- 172.21.15.2:0/2076871462 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef80032900 con 0x7fef84108390 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:49.993+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fef841a1110 con 0x7fef84108390 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.696+0000 7fef7affd640 1 -- 172.21.15.2:0/2076871462 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fef80040ca0 con 0x7fef84108390 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.697+0000 7fef7affd640 1 -- 172.21.15.2:0/2076871462 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fef80043c60 con 0x7fef84108390 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fef70038fc0 msgr2=0x7fef7003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 --2- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fef70038fc0 0x7fef7003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fef740098c0 tx=0x7fef74006db0 comp rx=0 tx=0).stop 2024-09-12T00:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 msgr2=0x7fef8419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:51.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 --2- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8419da80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef800097f0 tx=0x7fef80030d80 comp rx=0 tx=0).stop 2024-09-12T00:43:51.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 shutdown_connections 2024-09-12T00:43:51.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 --2- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fef70038fc0 0x7fef7003b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:51.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 --2- 172.21.15.2:0/2076871462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84108390 0x7fef8419da80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:51.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 >> 172.21.15.2:0/2076871462 conn(0x7fef84101f10 msgr2=0x7fef84102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:51.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 shutdown_connections 2024-09-12T00:43:51.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:50.699+0000 7fef8c19e640 1 -- 172.21.15.2:0/2076871462 wait complete. 2024-09-12T00:43:51.282 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:51.057+0000 7f0732890040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T00:43:51.282 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:51.126+0000 7f0732890040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T00:43:51.282 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:51.283+0000 7f0732890040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:43:51.581 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:51.430+0000 7f0732890040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T00:43:51.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:51 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2076871462' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T00:43:51.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:51 smithi002 ceph-mon[31210]: mgrmap e5: x(active, since 5s) 2024-09-12T00:43:51.867 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:51.766+0000 7f0732890040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T00:43:51.867 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:51.829+0000 7f0732890040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T00:43:52.243 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:52 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:52.029+0000 7f0732890040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T00:43:52.511 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.662+0000 7fadc9efe640 1 Processor -- start 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.662+0000 7fadc9efe640 1 -- start start 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.662+0000 7fadc9efe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc410a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.662+0000 7fadc9efe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fadc407be90 con 0x7fadc4108320 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.662+0000 7fadc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc410a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.662+0000 7fadc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc410a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56450/0 (socket says 172.21.15.2:56450) 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.662+0000 7fadc37fe640 1 -- 172.21.15.2:0/3574417894 learned_addr learned my addr 172.21.15.2:0/3574417894 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.662+0000 7fadc37fe640 1 -- 172.21.15.2:0/3574417894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc410ac50 con 0x7fadc4108320 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.663+0000 7fadc37fe640 1 --2- 172.21.15.2:0/3574417894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc410a710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009820 tx=0x7fadb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fbbe7cdb3f6a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.663+0000 7fadc27fc640 1 -- 172.21.15.2:0/3574417894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb4037070 con 0x7fadc4108320 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.663+0000 7fadc27fc640 1 -- 172.21.15.2:0/3574417894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fadb4032900 con 0x7fadc4108320 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.663+0000 7fadc27fc640 1 -- 172.21.15.2:0/3574417894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb4030850 con 0x7fadc4108320 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.664+0000 7fadc9efe640 1 -- 172.21.15.2:0/3574417894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 msgr2=0x7fadc410a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.664+0000 7fadc9efe640 1 --2- 172.21.15.2:0/3574417894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc410a710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009820 tx=0x7fadb402a270 comp rx=0 tx=0).stop 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.664+0000 7fadc9efe640 1 -- 172.21.15.2:0/3574417894 shutdown_connections 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.664+0000 7fadc9efe640 1 --2- 172.21.15.2:0/3574417894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc410a710 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.664+0000 7fadc9efe640 1 -- 172.21.15.2:0/3574417894 >> 172.21.15.2:0/3574417894 conn(0x7fadc4101f40 msgr2=0x7fadc4104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:52.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.664+0000 7fadc9efe640 1 -- 172.21.15.2:0/3574417894 shutdown_connections 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.664+0000 7fadc9efe640 1 -- 172.21.15.2:0/3574417894 wait complete. 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.665+0000 7fadc9efe640 1 Processor -- start 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.665+0000 7fadc9efe640 1 -- start start 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.665+0000 7fadc9efe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.665+0000 7fadc9efe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fadc410bc80 con 0x7fadc4108320 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.665+0000 7fadc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.665+0000 7fadc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56464/0 (socket says 172.21.15.2:56464) 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.665+0000 7fadc37fe640 1 -- 172.21.15.2:0/2504663591 learned_addr learned my addr 172.21.15.2:0/2504663591 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.665+0000 7fadc37fe640 1 -- 172.21.15.2:0/2504663591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc419bdb0 con 0x7fadc4108320 2024-09-12T00:43:52.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.666+0000 7fadc37fe640 1 --2- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc419b870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fadb40097f0 tx=0x7fadb4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.666+0000 7fadc0ff9640 1 -- 172.21.15.2:0/2504663591 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb4037040 con 0x7fadc4108320 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.666+0000 7fadc0ff9640 1 -- 172.21.15.2:0/2504663591 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fadb4040070 con 0x7fadc4108320 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.666+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc419c040 con 0x7fadc4108320 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.666+0000 7fadc0ff9640 1 -- 172.21.15.2:0/2504663591 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb403a390 con 0x7fadc4108320 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.666+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc419ed30 con 0x7fadc4108320 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.667+0000 7fadc0ff9640 1 -- 172.21.15.2:0/2504663591 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fadb403a5e0 con 0x7fadc4108320 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.667+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc4108780 con 0x7fadc4108320 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.667+0000 7fadc0ff9640 1 --2- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fadac038fc0 0x7fadac03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.667+0000 7fadc0ff9640 1 -- 172.21.15.2:0/2504663591 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fadb406c250 con 0x7fadc4108320 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.667+0000 7fadc2ffd640 1 -- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fadac038fc0 msgr2=0x7fadac03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1101153984 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.667+0000 7fadc2ffd640 1 --2- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fadac038fc0 0x7fadac03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:43:52.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.672+0000 7fadc0ff9640 1 -- 172.21.15.2:0/2504663591 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadb4043360 con 0x7fadc4108320 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.868+0000 7fadc2ffd640 1 -- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fadac038fc0 msgr2=0x7fadac03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1101153984 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.868+0000 7fadc2ffd640 1 --2- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fadac038fc0 0x7fadac03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.900+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fadc419f420 con 0x7fadc4108320 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.901+0000 7fadc0ff9640 1 -- 172.21.15.2:0/2504663591 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fadb403a9d0 con 0x7fadc4108320 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fadac038fc0 msgr2=0x7fadac03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 --2- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fadac038fc0 0x7fadac03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 msgr2=0x7fadc419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 --2- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc419b870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fadb40097f0 tx=0x7fadb4030d80 comp rx=0 tx=0).stop 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 shutdown_connections 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 --2- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7fadac038fc0 0x7fadac03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 --2- 172.21.15.2:0/2504663591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc4108320 0x7fadc419b870 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 >> 172.21.15.2:0/2504663591 conn(0x7fadc4101f40 msgr2=0x7fadc4102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 shutdown_connections 2024-09-12T00:43:52.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:51.903+0000 7fadc9efe640 1 -- 172.21.15.2:0/2504663591 wait complete. 2024-09-12T00:43:52.517 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-12T00:43:52.517 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-09-12T00:43:52.769 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:52 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2504663591' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T00:43:53.034 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:52 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:52.965+0000 7f0732890040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T00:43:53.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:53.035+0000 7f0732890040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T00:43:53.899 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:53.779+0000 7f0732890040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T00:43:53.899 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:53.900+0000 7f0732890040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T00:43:54.244 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.049+0000 7f0732890040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:43:54.245 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.112+0000 7f0732890040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T00:43:54.566 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.268+0000 7f0732890040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T00:43:54.566 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.339+0000 7f0732890040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T00:43:54.566 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.402+0000 7f0732890040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T00:43:54.566 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.567+0000 7f0732890040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T00:43:54.851 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.635+0000 7f0732890040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T00:43:54.851 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.704+0000 7f0732890040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T00:43:54.851 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.790+0000 7f0732890040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T00:43:54.851 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.852+0000 7f0732890040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T00:43:55.244 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:54.914+0000 7f0732890040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T00:43:55.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:55.739+0000 7f0732890040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T00:43:55.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: Active manager daemon x restarted 2024-09-12T00:43:55.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: Activating manager daemon x 2024-09-12T00:43:55.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T00:43:55.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: mgrmap e6: x(active, starting, since 0.00334797s) 2024-09-12T00:43:55.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:43:55.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T00:43:55.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T00:43:55.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T00:43:55.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T00:43:55.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: Manager daemon x is now available 2024-09-12T00:43:55.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:43:55.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:43:55.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:43:55.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:43:55.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T00:43:55.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:55 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.945+0000 7f9470ec9640 1 Processor -- start 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.945+0000 7f9470ec9640 1 -- start start 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.945+0000 7f9470ec9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c10a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.945+0000 7f9470ec9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f946c07be50 con 0x7f946c108360 2024-09-12T00:43:57.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.945+0000 7f946a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c10a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.945+0000 7f946a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c10a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56480/0 (socket says 172.21.15.2:56480) 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.945+0000 7f946a59c640 1 -- 172.21.15.2:0/1857399709 learned_addr learned my addr 172.21.15.2:0/1857399709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.945+0000 7f946a59c640 1 -- 172.21.15.2:0/1857399709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c10ac90 con 0x7f946c108360 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.946+0000 7f946a59c640 1 --2- 172.21.15.2:0/1857399709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c10a750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f945c009820 tx=0x7f945c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e5ce2280ecab6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.946+0000 7f9469d9b640 1 -- 172.21.15.2:0/1857399709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f945c037070 con 0x7f946c108360 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.946+0000 7f9469d9b640 1 -- 172.21.15.2:0/1857399709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f945c032900 con 0x7f946c108360 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.946+0000 7f9469d9b640 1 -- 172.21.15.2:0/1857399709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f945c030850 con 0x7f946c108360 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.947+0000 7f9470ec9640 1 -- 172.21.15.2:0/1857399709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 msgr2=0x7f946c10a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.947+0000 7f9470ec9640 1 --2- 172.21.15.2:0/1857399709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c10a750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f945c009820 tx=0x7f945c02a270 comp rx=0 tx=0).stop 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.947+0000 7f9470ec9640 1 -- 172.21.15.2:0/1857399709 shutdown_connections 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.947+0000 7f9470ec9640 1 --2- 172.21.15.2:0/1857399709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c10a750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.947+0000 7f9470ec9640 1 -- 172.21.15.2:0/1857399709 >> 172.21.15.2:0/1857399709 conn(0x7f946c101f40 msgr2=0x7f946c104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:57.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.947+0000 7f9470ec9640 1 -- 172.21.15.2:0/1857399709 shutdown_connections 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.947+0000 7f9470ec9640 1 -- 172.21.15.2:0/1857399709 wait complete. 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.948+0000 7f9470ec9640 1 Processor -- start 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.948+0000 7f9470ec9640 1 -- start start 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.948+0000 7f9470ec9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c107be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.948+0000 7f9470ec9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f946c10bc60 con 0x7f946c108360 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.948+0000 7f946a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c107be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.948+0000 7f946a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c107be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56484/0 (socket says 172.21.15.2:56484) 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.948+0000 7f946a59c640 1 -- 172.21.15.2:0/2164347278 learned_addr learned my addr 172.21.15.2:0/2164347278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.949+0000 7f946a59c640 1 -- 172.21.15.2:0/2164347278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c108120 con 0x7f946c108360 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.949+0000 7f946a59c640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c107be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f945c032ce0 tx=0x7f945c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.949+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f945c042070 con 0x7f946c108360 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.949+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f945c0308c0 con 0x7f946c108360 2024-09-12T00:43:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.949+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946c106310 con 0x7f946c108360 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.949+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f945c037040 con 0x7f946c108360 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.949+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946c106850 con 0x7f946c108360 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.950+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f945c045070 con 0x7f946c108360 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.950+0000 7f94637fe640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 0x7f945803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.950+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 --> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f945803bb90 con 0x7f9458038fc0 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.950+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f945c06bfb0 con 0x7f946c108360 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.950+0000 7f9463fff640 1 -- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 msgr2=0x7f945803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1101153984 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:52.950+0000 7f9463fff640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 0x7f945803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:53.151+0000 7f9463fff640 1 -- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 msgr2=0x7f945803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1101153984 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:53.151+0000 7f9463fff640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 0x7f945803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:53.552+0000 7f9463fff640 1 -- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 msgr2=0x7f945803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1101153984 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:53.552+0000 7f9463fff640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 0x7f945803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T00:43:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:54.353+0000 7f9463fff640 1 -- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 msgr2=0x7f945803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1101153984 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:54.353+0000 7f9463fff640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 0x7f945803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:55.743+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f945c06aa70 con 0x7f946c108360 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:55.743+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 msgr2=0x7f945803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:55.743+0000 7f94637fe640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 0x7f945803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.744+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f945c0670f0 con 0x7f946c108360 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.744+0000 7f94637fe640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f945803c8f0 0x7f945803ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.744+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f945803bb90 con 0x7f945803c8f0 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.745+0000 7f9463fff640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f945803c8f0 0x7f945803ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.745+0000 7f9463fff640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f945803c8f0 0x7f945803ece0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9454003980 tx=0x7f94540092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.746+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mgr.14118 v2:172.21.15.2:6800/975752128 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f945803bb90 con 0x7f945803c8f0 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.753+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f946c1087c0 con 0x7f945803c8f0 2024-09-12T00:43:57.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.753+0000 7f94637fe640 1 -- 172.21.15.2:0/2164347278 <== mgr.14118 v2:172.21.15.2:6800/975752128 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f946c1087c0 con 0x7f945803c8f0 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.753+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f945803c8f0 msgr2=0x7f945803ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.753+0000 7f9470ec9640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f945803c8f0 0x7f945803ece0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9454003980 tx=0x7f94540092b0 comp rx=0 tx=0).stop 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.753+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 msgr2=0x7f946c107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.753+0000 7f9470ec9640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c107be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f945c032ce0 tx=0x7f945c032d10 comp rx=0 tx=0).stop 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.754+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 shutdown_connections 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.754+0000 7f9470ec9640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/1101153984,v1:172.21.15.2:6801/1101153984] conn(0x7f9458038fc0 0x7f945803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.754+0000 7f9470ec9640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f945803c8f0 0x7f945803ece0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.754+0000 7f9470ec9640 1 --2- 172.21.15.2:0/2164347278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f946c108360 0x7f946c107be0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.754+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 >> 172.21.15.2:0/2164347278 conn(0x7f946c101f40 msgr2=0x7f946c102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.754+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 shutdown_connections 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:56.754+0000 7f9470ec9640 1 -- 172.21.15.2:0/2164347278 wait complete. 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-09-12T00:43:57.314 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-09-12T00:43:57.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:57 smithi002 ceph-mon[31210]: Found migration_current of "None". Setting to last migration. 2024-09-12T00:43:57.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:57 smithi002 ceph-mon[31210]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T00:43:57.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:57 smithi002 ceph-mon[31210]: mgrmap e7: x(active, since 1.00562s) 2024-09-12T00:43:57.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:57 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:43:57.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:57 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:43:58.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.683+0000 7f51c4c3f640 1 Processor -- start 2024-09-12T00:43:58.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.683+0000 7f51c4c3f640 1 -- start start 2024-09-12T00:43:58.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.683+0000 7f51c4c3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c0107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:58.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.683+0000 7f51c4c3f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51c01082d0 con 0x7f51c0107900 2024-09-12T00:43:58.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.684+0000 7f51be59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c0107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.684+0000 7f51be59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c0107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49864/0 (socket says 172.21.15.2:49864) 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.684+0000 7f51be59c640 1 -- 172.21.15.2:0/1642826160 learned_addr learned my addr 172.21.15.2:0/1642826160 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.684+0000 7f51be59c640 1 -- 172.21.15.2:0/1642826160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c0108ab0 con 0x7f51c0107900 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51be59c640 1 --2- 172.21.15.2:0/1642826160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c0107d00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009820 tx=0x7f51b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fa064d237f8d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51bdd9b640 1 -- 172.21.15.2:0/1642826160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b0037070 con 0x7f51c0107900 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51bdd9b640 1 -- 172.21.15.2:0/1642826160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51b0032900 con 0x7f51c0107900 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51bdd9b640 1 -- 172.21.15.2:0/1642826160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b0030850 con 0x7f51c0107900 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51c4c3f640 1 -- 172.21.15.2:0/1642826160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 msgr2=0x7f51c0107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51c4c3f640 1 --2- 172.21.15.2:0/1642826160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c0107d00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009820 tx=0x7f51b002a270 comp rx=0 tx=0).stop 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51c4c3f640 1 -- 172.21.15.2:0/1642826160 shutdown_connections 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51c4c3f640 1 --2- 172.21.15.2:0/1642826160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c0107d00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51c4c3f640 1 -- 172.21.15.2:0/1642826160 >> 172.21.15.2:0/1642826160 conn(0x7f51c0103090 msgr2=0x7f51c01054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:58.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.685+0000 7f51c4c3f640 1 -- 172.21.15.2:0/1642826160 shutdown_connections 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.686+0000 7f51c4c3f640 1 -- 172.21.15.2:0/1642826160 wait complete. 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.686+0000 7f51c4c3f640 1 Processor -- start 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.686+0000 7f51c4c3f640 1 -- start start 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.686+0000 7f51c4c3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.686+0000 7f51c4c3f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51c010be60 con 0x7f51c0107900 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51be59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51be59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49868/0 (socket says 172.21.15.2:49868) 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51be59c640 1 -- 172.21.15.2:0/3442737077 learned_addr learned my addr 172.21.15.2:0/3442737077 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51be59c640 1 -- 172.21.15.2:0/3442737077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c019bdb0 con 0x7f51c0107900 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51be59c640 1 --2- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c019b870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009940 tx=0x7f51b0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51b77fe640 1 -- 172.21.15.2:0/3442737077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b0042070 con 0x7f51c0107900 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51b77fe640 1 -- 172.21.15.2:0/3442737077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51b00308c0 con 0x7f51c0107900 2024-09-12T00:43:58.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c019c040 con 0x7f51c0107900 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51b77fe640 1 -- 172.21.15.2:0/3442737077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b0037040 con 0x7f51c0107900 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.687+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c019ed30 con 0x7f51c0107900 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.688+0000 7f51b77fe640 1 -- 172.21.15.2:0/3442737077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f51b0045070 con 0x7f51c0107900 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.688+0000 7f51b77fe640 1 --2- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f51ac038e60 0x7f51ac03b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.688+0000 7f51b77fe640 1 -- 172.21.15.2:0/3442737077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f51b006bec0 con 0x7f51c0107900 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.688+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c0107d80 con 0x7f51c0107900 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.688+0000 7f51b7fff640 1 --2- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f51ac038e60 0x7f51ac03b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.689+0000 7f51b7fff640 1 --2- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f51ac038e60 0x7f51ac03b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f51a80098c0 tx=0x7f51a8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.694+0000 7f51b77fe640 1 -- 172.21.15.2:0/3442737077 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51b003cd90 con 0x7f51c0107900 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.883+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f51c01043a0 con 0x7f51ac038e60 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.888+0000 7f51b77fe640 1 -- 172.21.15.2:0/3442737077 <== mgr.14118 v2:172.21.15.2:6800/975752128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f51c01043a0 con 0x7f51ac038e60 2024-09-12T00:43:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f51ac038e60 msgr2=0x7f51ac03b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 --2- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f51ac038e60 0x7f51ac03b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f51a80098c0 tx=0x7f51a8006db0 comp rx=0 tx=0).stop 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 msgr2=0x7f51c019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 --2- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c019b870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009940 tx=0x7f51b0032ce0 comp rx=0 tx=0).stop 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 shutdown_connections 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 --2- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f51ac038e60 0x7f51ac03b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 --2- 172.21.15.2:0/3442737077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c0107900 0x7f51c019b870 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 >> 172.21.15.2:0/3442737077 conn(0x7f51c0103090 msgr2=0x7f51c0103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 shutdown_connections 2024-09-12T00:43:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:57.890+0000 7f51c4c3f640 1 -- 172.21.15.2:0/3442737077 wait complete. 2024-09-12T00:43:58.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:58 smithi002 ceph-mon[31210]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T00:43:58.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:58 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:43:58.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:58 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:43:58.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:58 smithi002 ceph-mon[31210]: mgrmap e8: x(active, since 2s) 2024-09-12T00:43:59.388 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:59.103+0000 7f069f3b5640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:00:43:59] ENGINE Error in HTTPServer.serve 2024-09-12T00:43:59.388 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: Traceback (most recent call last): 2024-09-12T00:43:59.388 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._connections.run(self.expiration_interval) 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._run(expiration_interval) 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: s = self.context.wrap_socket( 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: return self.sslsocket_class._create( 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T00:43:59.389 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self.do_handshake() 2024-09-12T00:43:59.390 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T00:43:59.390 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._sslobj.do_handshake() 2024-09-12T00:43:59.390 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T00:43:59.390 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:43:59.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T00:43:59.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.882+0000 7face7e3a640 1 Processor -- start 2024-09-12T00:43:59.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.882+0000 7face7e3a640 1 -- start start 2024-09-12T00:43:59.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.882+0000 7face7e3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face010a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:59.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.882+0000 7face7e3a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7face007be90 con 0x7face0108320 2024-09-12T00:43:59.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.883+0000 7face5bd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face010a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:59.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.883+0000 7face5bd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face010a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49882/0 (socket says 172.21.15.2:49882) 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.883+0000 7face5bd6640 1 -- 172.21.15.2:0/3745548181 learned_addr learned my addr 172.21.15.2:0/3745548181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.883+0000 7face5bd6640 1 -- 172.21.15.2:0/3745548181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face010ac50 con 0x7face0108320 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.884+0000 7face5bd6640 1 --2- 172.21.15.2:0/3745548181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face010a710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7facdc009820 tx=0x7facdc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa04f8b6b0b803d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.884+0000 7face4bd4640 1 -- 172.21.15.2:0/3745548181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facdc037070 con 0x7face0108320 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.884+0000 7face4bd4640 1 -- 172.21.15.2:0/3745548181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facdc032900 con 0x7face0108320 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.884+0000 7face4bd4640 1 -- 172.21.15.2:0/3745548181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facdc030850 con 0x7face0108320 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.884+0000 7face7e3a640 1 -- 172.21.15.2:0/3745548181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 msgr2=0x7face010a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.884+0000 7face7e3a640 1 --2- 172.21.15.2:0/3745548181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face010a710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7facdc009820 tx=0x7facdc02a270 comp rx=0 tx=0).stop 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 -- 172.21.15.2:0/3745548181 shutdown_connections 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 --2- 172.21.15.2:0/3745548181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face010a710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 -- 172.21.15.2:0/3745548181 >> 172.21.15.2:0/3745548181 conn(0x7face0101f40 msgr2=0x7face0104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 -- 172.21.15.2:0/3745548181 shutdown_connections 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 -- 172.21.15.2:0/3745548181 wait complete. 2024-09-12T00:43:59.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 Processor -- start 2024-09-12T00:43:59.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 -- start start 2024-09-12T00:43:59.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:59.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.885+0000 7face7e3a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7face010bc80 con 0x7face0108320 2024-09-12T00:43:59.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7face5bd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:59.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7face5bd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49886/0 (socket says 172.21.15.2:49886) 2024-09-12T00:43:59.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7face5bd6640 1 -- 172.21.15.2:0/1696226659 learned_addr learned my addr 172.21.15.2:0/1696226659 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:43:59.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7face5bd6640 1 -- 172.21.15.2:0/1696226659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face019bdb0 con 0x7face0108320 2024-09-12T00:43:59.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7face5bd6640 1 --2- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face019b870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7facdc0097f0 tx=0x7facdc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:59.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7facd6ffd640 1 -- 172.21.15.2:0/1696226659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facdc037040 con 0x7face0108320 2024-09-12T00:43:59.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face019c040 con 0x7face0108320 2024-09-12T00:43:59.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face019ed30 con 0x7face0108320 2024-09-12T00:43:59.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7facd6ffd640 1 -- 172.21.15.2:0/1696226659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facdc040070 con 0x7face0108320 2024-09-12T00:43:59.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.886+0000 7facd6ffd640 1 -- 172.21.15.2:0/1696226659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facdc03a390 con 0x7face0108320 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.887+0000 7facd6ffd640 1 -- 172.21.15.2:0/1696226659 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7facdc03a660 con 0x7face0108320 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.887+0000 7facd6ffd640 1 --2- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7faccc038fc0 0x7faccc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.887+0000 7facd6ffd640 1 -- 172.21.15.2:0/1696226659 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7facdc06d8f0 con 0x7face0108320 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.888+0000 7face53d5640 1 --2- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7faccc038fc0 0x7faccc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.888+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face0108780 con 0x7face0108320 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.888+0000 7face53d5640 1 --2- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7faccc038fc0 0x7faccc03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7facd00098c0 tx=0x7facd0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:58.893+0000 7facd6ffd640 1 -- 172.21.15.2:0/1696226659 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facdc04a200 con 0x7face0108320 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.095+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7face0103270 con 0x7faccc038fc0 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.096+0000 7facd6ffd640 1 -- 172.21.15.2:0/1696226659 <== mgr.14118 v2:172.21.15.2:6800/975752128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7face0103270 con 0x7faccc038fc0 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7faccc038fc0 msgr2=0x7faccc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 --2- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7faccc038fc0 0x7faccc03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7facd00098c0 tx=0x7facd0006db0 comp rx=0 tx=0).stop 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 msgr2=0x7face019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 --2- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face019b870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7facdc0097f0 tx=0x7facdc030d80 comp rx=0 tx=0).stop 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 shutdown_connections 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 --2- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7faccc038fc0 0x7faccc03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 --2- 172.21.15.2:0/1696226659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0108320 0x7face019b870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 >> 172.21.15.2:0/1696226659 conn(0x7face0101f40 msgr2=0x7face0102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 shutdown_connections 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:43:59.098+0000 7face7e3a640 1 -- 172.21.15.2:0/1696226659 wait complete. 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-09-12T00:43:59.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-mon[31210]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:43:59.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:43:59 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:44:00.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-mon[31210]: [12/Sep/2024:00:43:58] ENGINE Bus STARTING 2024-09-12T00:44:00.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-mon[31210]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:00.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-mon[31210]: [12/Sep/2024:00:43:59] ENGINE Serving on https://172.21.15.2:7150 2024-09-12T00:44:00.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-mon[31210]: [12/Sep/2024:00:43:59] ENGINE Error in HTTPServer.serve 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T00:44:00.902 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-mon[31210]: [12/Sep/2024:00:43:59] ENGINE Serving on http://172.21.15.2:8765 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-mon[31210]: [12/Sep/2024:00:43:59] ENGINE Bus STARTED 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: Generating public/private rsa key pair. 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: Your identification has been saved in /tmp/tmpt2y8o5lj/key 2024-09-12T00:44:00.903 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: Your public key has been saved in /tmp/tmpt2y8o5lj/key.pub 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: The key fingerprint is: 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: SHA256:XHE5VgFras7YtnVTJ5kBc5yedD/tvNkVfVNBdTV4WDk ceph-c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: The key's randomart image is: 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: +---[RSA 3072]----+ 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | . ==OBO| 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | o+B+E=| 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | ..o+oo*| 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | . . o oB=| 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | S o +oB| 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | * o=| 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | . = . o =| 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | . o . +.| 2024-09-12T00:44:00.904 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: | . | 2024-09-12T00:44:00.905 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: +----[SHA256]-----+ 2024-09-12T00:44:01.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.022+0000 7fb71bf65640 1 Processor -- start 2024-09-12T00:44:01.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.022+0000 7fb71bf65640 1 -- start start 2024-09-12T00:44:01.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.022+0000 7fb71bf65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb714106bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:01.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.022+0000 7fb71bf65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb714107180 con 0x7fb7141067b0 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.022+0000 7fb719d01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb714106bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.022+0000 7fb719d01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb714106bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49900/0 (socket says 172.21.15.2:49900) 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.022+0000 7fb719d01640 1 -- 172.21.15.2:0/2016374988 learned_addr learned my addr 172.21.15.2:0/2016374988 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.023+0000 7fb719d01640 1 -- 172.21.15.2:0/2016374988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7141079b0 con 0x7fb7141067b0 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.023+0000 7fb719d01640 1 --2- 172.21.15.2:0/2016374988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb714106bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb710009820 tx=0x7fb71002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c7cbf9c723fa77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb718cff640 1 -- 172.21.15.2:0/2016374988 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb710037070 con 0x7fb7141067b0 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb718cff640 1 -- 172.21.15.2:0/2016374988 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb710032900 con 0x7fb7141067b0 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb718cff640 1 -- 172.21.15.2:0/2016374988 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb710030850 con 0x7fb7141067b0 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb71bf65640 1 -- 172.21.15.2:0/2016374988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 msgr2=0x7fb714106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb71bf65640 1 --2- 172.21.15.2:0/2016374988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb714106bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb710009820 tx=0x7fb71002a270 comp rx=0 tx=0).stop 2024-09-12T00:44:01.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb71bf65640 1 -- 172.21.15.2:0/2016374988 shutdown_connections 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb71bf65640 1 --2- 172.21.15.2:0/2016374988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb714106bb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb71bf65640 1 -- 172.21.15.2:0/2016374988 >> 172.21.15.2:0/2016374988 conn(0x7fb714101f40 msgr2=0x7fb714104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb71bf65640 1 -- 172.21.15.2:0/2016374988 shutdown_connections 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.024+0000 7fb71bf65640 1 -- 172.21.15.2:0/2016374988 wait complete. 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.025+0000 7fb71bf65640 1 Processor -- start 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.025+0000 7fb71bf65640 1 -- start start 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.025+0000 7fb71bf65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb71419b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.025+0000 7fb71bf65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb71410ad60 con 0x7fb7141067b0 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.025+0000 7fb719d01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb71419b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.025+0000 7fb719d01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb71419b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49904/0 (socket says 172.21.15.2:49904) 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.025+0000 7fb719d01640 1 -- 172.21.15.2:0/3189044451 learned_addr learned my addr 172.21.15.2:0/3189044451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.025+0000 7fb719d01640 1 -- 172.21.15.2:0/3189044451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71419be40 con 0x7fb7141067b0 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.026+0000 7fb719d01640 1 --2- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb71419b900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb710009940 tx=0x7fb710032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:01.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.026+0000 7fb70affd640 1 -- 172.21.15.2:0/3189044451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb710042070 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.026+0000 7fb70affd640 1 -- 172.21.15.2:0/3189044451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7100308c0 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.026+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71419c0d0 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.026+0000 7fb70affd640 1 -- 172.21.15.2:0/3189044451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb710037040 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.026+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb71419edc0 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.027+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb714106c30 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.027+0000 7fb70affd640 1 -- 172.21.15.2:0/3189044451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb710045070 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.027+0000 7fb70affd640 1 --2- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb700038fc0 0x7fb70003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.028+0000 7fb70affd640 1 -- 172.21.15.2:0/3189044451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb71006c030 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.028+0000 7fb719500640 1 --2- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb700038fc0 0x7fb70003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.028+0000 7fb719500640 1 --2- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb700038fc0 0x7fb70003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb7040098c0 tx=0x7fb704006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.032+0000 7fb70affd640 1 -- 172.21.15.2:0/3189044451 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb71004b170 con 0x7fb7141067b0 2024-09-12T00:44:01.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.208+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fb71402db70 con 0x7fb700038fc0 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.606+0000 7fb70affd640 1 -- 172.21.15.2:0/3189044451 <== mgr.14118 v2:172.21.15.2:6800/975752128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb71402db70 con 0x7fb700038fc0 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb700038fc0 msgr2=0x7fb70003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 --2- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb700038fc0 0x7fb70003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb7040098c0 tx=0x7fb704006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 msgr2=0x7fb71419b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 --2- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb71419b900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb710009940 tx=0x7fb710032ce0 comp rx=0 tx=0).stop 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 shutdown_connections 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 --2- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb700038fc0 0x7fb70003b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 --2- 172.21.15.2:0/3189044451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7141067b0 0x7fb71419b900 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 >> 172.21.15.2:0/3189044451 conn(0x7fb714101f40 msgr2=0x7fb714102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 shutdown_connections 2024-09-12T00:44:01.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:00.608+0000 7fb71bf65640 1 -- 172.21.15.2:0/3189044451 wait complete. 2024-09-12T00:44:01.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:01 smithi002 ceph-mon[31210]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:01.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:01 smithi002 ceph-mon[31210]: Generating ssh key... 2024-09-12T00:44:02.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgtOlD4oXnyr089VXyV3Kkusltgnjy7s9UQKcuTVBPbLSwPAC1c+kGJ9QSdRj5U21UZH1WdtP5hb5aKiIV0gLoy4XAQBOhLaxiA5iTGWuygKthIz6nmX2lEfXNLhiHQkK6pYMyoK4uUgxLc0UqAqL5iQ58ANSFbVIVgSnbIl2LTceHodFhiyDvpT3IPsEkP9i3ruFk3O9tJRifjqbTvBqDS6/zr52bnq8nLEcC2UDCEyeUGPGqRKCACuKiSjvBYj+Ims5YLHKXTM1jYgTqpvHrL/EcseNBSJvV9vA31KyBflT1BTGUQN5ed9eIM/RfQjUMRX+vzk3odSZpw7pm8mR5YTzcjqDy98vFn0Hf3nvn6r2dSMnM+J7+eglIyyad1I1l+GYA5PPdjU+XlOmRZ1fVExDKhP/pUQAB9HJZO4dqZ2LdDwdZZjRObvBuSLtikfbiP76XOEB5BX5fPKaeBWab0AfnfKLcwNvIx59ykH96Ztto1FmwKUgn49ggzxFQiFU= ceph-c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:44:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.561+0000 7fee7fd92640 1 Processor -- start 2024-09-12T00:44:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.562+0000 7fee7fd92640 1 -- start start 2024-09-12T00:44:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.562+0000 7fee7fd92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee78106610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.562+0000 7fee7fd92640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee7807be10 con 0x7fee78106210 2024-09-12T00:44:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.562+0000 7fee7db2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee78106610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.562+0000 7fee7db2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee78106610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49906/0 (socket says 172.21.15.2:49906) 2024-09-12T00:44:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.562+0000 7fee7db2e640 1 -- 172.21.15.2:0/3311957753 learned_addr learned my addr 172.21.15.2:0/3311957753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.563+0000 7fee7db2e640 1 -- 172.21.15.2:0/3311957753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee78106b50 con 0x7fee78106210 2024-09-12T00:44:02.253 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.563+0000 7fee7db2e640 1 --2- 172.21.15.2:0/3311957753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee78106610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fee74009820 tx=0x7fee7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4335388da9540cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:02.253 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.563+0000 7fee7cb2c640 1 -- 172.21.15.2:0/3311957753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74037070 con 0x7fee78106210 2024-09-12T00:44:02.253 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.563+0000 7fee7cb2c640 1 -- 172.21.15.2:0/3311957753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee74032900 con 0x7fee78106210 2024-09-12T00:44:02.253 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.563+0000 7fee7cb2c640 1 -- 172.21.15.2:0/3311957753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74030850 con 0x7fee78106210 2024-09-12T00:44:02.253 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.564+0000 7fee7fd92640 1 -- 172.21.15.2:0/3311957753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 msgr2=0x7fee78106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:02.253 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.564+0000 7fee7fd92640 1 --2- 172.21.15.2:0/3311957753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee78106610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fee74009820 tx=0x7fee7402a270 comp rx=0 tx=0).stop 2024-09-12T00:44:02.253 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.564+0000 7fee7fd92640 1 -- 172.21.15.2:0/3311957753 shutdown_connections 2024-09-12T00:44:02.253 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.564+0000 7fee7fd92640 1 --2- 172.21.15.2:0/3311957753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee78106610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.564+0000 7fee7fd92640 1 -- 172.21.15.2:0/3311957753 >> 172.21.15.2:0/3311957753 conn(0x7fee78102020 msgr2=0x7fee78104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.564+0000 7fee7fd92640 1 -- 172.21.15.2:0/3311957753 shutdown_connections 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.564+0000 7fee7fd92640 1 -- 172.21.15.2:0/3311957753 wait complete. 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7fd92640 1 Processor -- start 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7fd92640 1 -- start start 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7fd92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee7819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7fd92640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee78107be0 con 0x7fee78106210 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7db2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee7819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7db2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee7819dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49922/0 (socket says 172.21.15.2:49922) 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7db2e640 1 -- 172.21.15.2:0/3833445807 learned_addr learned my addr 172.21.15.2:0/3833445807 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7db2e640 1 -- 172.21.15.2:0/3833445807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7819e010 con 0x7fee78106210 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.565+0000 7fee7db2e640 1 --2- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee7819dad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee74031000 tx=0x7fee740326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:02.254 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.566+0000 7fee6effd640 1 -- 172.21.15.2:0/3833445807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74042070 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.566+0000 7fee6effd640 1 -- 172.21.15.2:0/3833445807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee74032be0 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.566+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7819e2a0 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.566+0000 7fee6effd640 1 -- 172.21.15.2:0/3833445807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74037040 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.566+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee781a0f90 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.567+0000 7fee6effd640 1 -- 172.21.15.2:0/3833445807 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fee74045070 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.567+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee78106610 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.567+0000 7fee6effd640 1 --2- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fee64038fc0 0x7fee6403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.567+0000 7fee6effd640 1 -- 172.21.15.2:0/3833445807 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fee7406c110 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.567+0000 7fee7d32d640 1 --2- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fee64038fc0 0x7fee6403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.567+0000 7fee7d32d640 1 --2- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fee64038fc0 0x7fee6403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee680098c0 tx=0x7fee68006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.572+0000 7fee6effd640 1 -- 172.21.15.2:0/3833445807 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee74047440 con 0x7fee78106210 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.748+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fee7802da60 con 0x7fee64038fc0 2024-09-12T00:44:02.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.748+0000 7fee6effd640 1 -- 172.21.15.2:0/3833445807 <== mgr.14118 v2:172.21.15.2:6800/975752128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fee7802da60 con 0x7fee64038fc0 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.750+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fee64038fc0 msgr2=0x7fee6403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.750+0000 7fee7fd92640 1 --2- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fee64038fc0 0x7fee6403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee680098c0 tx=0x7fee68006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.750+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 msgr2=0x7fee7819dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.750+0000 7fee7fd92640 1 --2- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee7819dad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee74031000 tx=0x7fee740326e0 comp rx=0 tx=0).stop 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.750+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 shutdown_connections 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.750+0000 7fee7fd92640 1 --2- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fee64038fc0 0x7fee6403b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.750+0000 7fee7fd92640 1 --2- 172.21.15.2:0/3833445807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee78106210 0x7fee7819dad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.750+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 >> 172.21.15.2:0/3833445807 conn(0x7fee78102020 msgr2=0x7fee78194710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.751+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 shutdown_connections 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:01.751+0000 7fee7fd92640 1 -- 172.21.15.2:0/3833445807 wait complete. 2024-09-12T00:44:02.256 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T00:44:02.257 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T00:44:02.257 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-09-12T00:44:03.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:02 smithi002 ceph-mon[31210]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:03.948 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:03 smithi002 ceph-mon[31210]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:04.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:04 smithi002 ceph-mon[31210]: Deploying cephadm binary to smithi002 2024-09-12T00:44:07.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-09-12T00:44:07.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.713+0000 7f5e7c934640 1 Processor -- start 2024-09-12T00:44:07.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.713+0000 7f5e7c934640 1 -- start start 2024-09-12T00:44:07.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.713+0000 7f5e7c934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e78105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:07.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.713+0000 7f5e7c934640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5e781065b0 con 0x7f5e78105be0 2024-09-12T00:44:07.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.713+0000 7f5e7659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e78105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:07.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.713+0000 7f5e7659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e78105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49930/0 (socket says 172.21.15.2:49930) 2024-09-12T00:44:07.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.713+0000 7f5e7659c640 1 -- 172.21.15.2:0/436574964 learned_addr learned my addr 172.21.15.2:0/436574964 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:07.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.714+0000 7f5e7659c640 1 -- 172.21.15.2:0/436574964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e78108bc0 con 0x7f5e78105be0 2024-09-12T00:44:07.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.714+0000 7f5e7659c640 1 --2- 172.21.15.2:0/436574964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e78105fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009820 tx=0x7f5e6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c61b2e292f1f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:07.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.714+0000 7f5e7559a640 1 -- 172.21.15.2:0/436574964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68037070 con 0x7f5e78105be0 2024-09-12T00:44:07.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.714+0000 7f5e7559a640 1 -- 172.21.15.2:0/436574964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e68032900 con 0x7f5e78105be0 2024-09-12T00:44:07.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.714+0000 7f5e7559a640 1 -- 172.21.15.2:0/436574964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68030850 con 0x7f5e78105be0 2024-09-12T00:44:07.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.715+0000 7f5e7c934640 1 -- 172.21.15.2:0/436574964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 msgr2=0x7f5e78105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:07.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.715+0000 7f5e7c934640 1 --2- 172.21.15.2:0/436574964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e78105fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009820 tx=0x7f5e6802a270 comp rx=0 tx=0).stop 2024-09-12T00:44:07.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.715+0000 7f5e7c934640 1 -- 172.21.15.2:0/436574964 shutdown_connections 2024-09-12T00:44:07.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.715+0000 7f5e7c934640 1 --2- 172.21.15.2:0/436574964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e78105fe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:07.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.715+0000 7f5e7c934640 1 -- 172.21.15.2:0/436574964 >> 172.21.15.2:0/436574964 conn(0x7f5e78101790 msgr2=0x7f5e78103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:07.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.715+0000 7f5e7c934640 1 -- 172.21.15.2:0/436574964 shutdown_connections 2024-09-12T00:44:07.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.715+0000 7f5e7c934640 1 -- 172.21.15.2:0/436574964 wait complete. 2024-09-12T00:44:07.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.716+0000 7f5e7c934640 1 Processor -- start 2024-09-12T00:44:07.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.716+0000 7f5e7c934640 1 -- start start 2024-09-12T00:44:07.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.716+0000 7f5e7c934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e7819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:07.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.716+0000 7f5e7c934640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7810bdf0 con 0x7f5e78105be0 2024-09-12T00:44:07.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.716+0000 7f5e7659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e7819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:07.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.716+0000 7f5e7659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e7819b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49938/0 (socket says 172.21.15.2:49938) 2024-09-12T00:44:07.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.716+0000 7f5e7659c640 1 -- 172.21.15.2:0/3917642369 learned_addr learned my addr 172.21.15.2:0/3917642369 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:07.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.717+0000 7f5e7659c640 1 -- 172.21.15.2:0/3917642369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7819be30 con 0x7f5e78105be0 2024-09-12T00:44:07.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.717+0000 7f5e7659c640 1 --2- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e7819b8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009940 tx=0x7f5e68032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:07.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.717+0000 7f5e677fe640 1 -- 172.21.15.2:0/3917642369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68042070 con 0x7f5e78105be0 2024-09-12T00:44:07.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.717+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7819c0c0 con 0x7f5e78105be0 2024-09-12T00:44:07.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.717+0000 7f5e677fe640 1 -- 172.21.15.2:0/3917642369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e680308c0 con 0x7f5e78105be0 2024-09-12T00:44:07.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.717+0000 7f5e677fe640 1 -- 172.21.15.2:0/3917642369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68037040 con 0x7f5e78105be0 2024-09-12T00:44:07.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.717+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7819edb0 con 0x7f5e78105be0 2024-09-12T00:44:07.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.718+0000 7f5e677fe640 1 -- 172.21.15.2:0/3917642369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5e68045070 con 0x7f5e78105be0 2024-09-12T00:44:07.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.718+0000 7f5e677fe640 1 --2- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f5e60038f70 0x7f5e6003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:07.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.718+0000 7f5e677fe640 1 -- 172.21.15.2:0/3917642369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e6806c260 con 0x7f5e78105be0 2024-09-12T00:44:07.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.718+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e78106060 con 0x7f5e78105be0 2024-09-12T00:44:07.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.719+0000 7f5e75d9b640 1 --2- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f5e60038f70 0x7f5e6003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:07.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.719+0000 7f5e75d9b640 1 --2- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f5e60038f70 0x7f5e6003b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0098c0 tx=0x7f5e6c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:07.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.724+0000 7f5e677fe640 1 -- 172.21.15.2:0/3917642369 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e6806bbb0 con 0x7f5e78105be0 2024-09-12T00:44:07.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:02.910+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) -- 0x7f5e78102a30 con 0x7f5e60038f70 2024-09-12T00:44:07.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.800+0000 7f5e677fe640 1 -- 172.21.15.2:0/3917642369 <== mgr.14118 v2:172.21.15.2:6800/975752128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f5e78102a30 con 0x7f5e60038f70 2024-09-12T00:44:07.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.802+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f5e60038f70 msgr2=0x7f5e6003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:07.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.802+0000 7f5e7c934640 1 --2- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f5e60038f70 0x7f5e6003b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0098c0 tx=0x7f5e6c006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:07.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.802+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 msgr2=0x7f5e7819b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:07.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.802+0000 7f5e7c934640 1 --2- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e7819b8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009940 tx=0x7f5e68032ce0 comp rx=0 tx=0).stop 2024-09-12T00:44:07.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.803+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 shutdown_connections 2024-09-12T00:44:07.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.803+0000 7f5e7c934640 1 --2- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f5e60038f70 0x7f5e6003b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:07.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.803+0000 7f5e7c934640 1 --2- 172.21.15.2:0/3917642369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e78105be0 0x7f5e7819b8f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:07.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.803+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 >> 172.21.15.2:0/3917642369 conn(0x7f5e78101790 msgr2=0x7f5e78102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:07.430 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.803+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 shutdown_connections 2024-09-12T00:44:07.430 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:06.803+0000 7f5e7c934640 1 -- 172.21.15.2:0/3917642369 wait complete. 2024-09-12T00:44:07.430 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-09-12T00:44:07.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:07 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:07.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:07 smithi002 ceph-mon[31210]: Added host smithi002 2024-09-12T00:44:07.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:07 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:44:08.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T00:44:08.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.814+0000 7f7fca680640 1 Processor -- start 2024-09-12T00:44:08.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.814+0000 7f7fca680640 1 -- start start 2024-09-12T00:44:08.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.814+0000 7f7fca680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc410a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:08.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.814+0000 7f7fca680640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc407be50 con 0x7f7fc41083e0 2024-09-12T00:44:08.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.814+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc410a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:08.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.814+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc410a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52190/0 (socket says 172.21.15.2:52190) 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.814+0000 7f7fc3fff640 1 -- 172.21.15.2:0/2966107844 learned_addr learned my addr 172.21.15.2:0/2966107844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.815+0000 7f7fc3fff640 1 -- 172.21.15.2:0/2966107844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc410ad10 con 0x7f7fc41083e0 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.816+0000 7f7fc3fff640 1 --2- 172.21.15.2:0/2966107844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc410a7d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009820 tx=0x7f7fb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20451181abecf855 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.816+0000 7f7fc2ffd640 1 -- 172.21.15.2:0/2966107844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb4037070 con 0x7f7fc41083e0 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.816+0000 7f7fc2ffd640 1 -- 172.21.15.2:0/2966107844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fb4032900 con 0x7f7fc41083e0 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.816+0000 7f7fc2ffd640 1 -- 172.21.15.2:0/2966107844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb4030850 con 0x7f7fc41083e0 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.816+0000 7f7fca680640 1 -- 172.21.15.2:0/2966107844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 msgr2=0x7f7fc410a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.816+0000 7f7fca680640 1 --2- 172.21.15.2:0/2966107844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc410a7d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009820 tx=0x7f7fb402a270 comp rx=0 tx=0).stop 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.816+0000 7f7fca680640 1 -- 172.21.15.2:0/2966107844 shutdown_connections 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.816+0000 7f7fca680640 1 --2- 172.21.15.2:0/2966107844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc410a7d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:08.795 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.817+0000 7f7fca680640 1 -- 172.21.15.2:0/2966107844 >> 172.21.15.2:0/2966107844 conn(0x7f7fc4102020 msgr2=0x7f7fc4104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.817+0000 7f7fca680640 1 -- 172.21.15.2:0/2966107844 shutdown_connections 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.817+0000 7f7fca680640 1 -- 172.21.15.2:0/2966107844 wait complete. 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.817+0000 7f7fca680640 1 Processor -- start 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.817+0000 7f7fca680640 1 -- start start 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.817+0000 7f7fca680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.817+0000 7f7fca680640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc410bce0 con 0x7f7fc41083e0 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc419b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52192/0 (socket says 172.21.15.2:52192) 2024-09-12T00:44:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fc3fff640 1 -- 172.21.15.2:0/1682288089 learned_addr learned my addr 172.21.15.2:0/1682288089 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fc3fff640 1 -- 172.21.15.2:0/1682288089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc419be00 con 0x7f7fc41083e0 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fc3fff640 1 --2- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc419b8c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40097f0 tx=0x7f7fb4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fc17fa640 1 -- 172.21.15.2:0/1682288089 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb4042070 con 0x7f7fc41083e0 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fc17fa640 1 -- 172.21.15.2:0/1682288089 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fb4032ca0 con 0x7f7fc41083e0 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fc17fa640 1 -- 172.21.15.2:0/1682288089 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb4037040 con 0x7f7fc41083e0 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc419c090 con 0x7f7fc41083e0 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.818+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc419ed80 con 0x7f7fc41083e0 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.819+0000 7f7fc17fa640 1 -- 172.21.15.2:0/1682288089 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7fb4045070 con 0x7f7fc41083e0 2024-09-12T00:44:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.819+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc4108840 con 0x7f7fc41083e0 2024-09-12T00:44:08.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.819+0000 7f7fc17fa640 1 --2- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f7fac038fc0 0x7f7fac03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:08.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.819+0000 7f7fc17fa640 1 -- 172.21.15.2:0/1682288089 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7fb406bf30 con 0x7f7fc41083e0 2024-09-12T00:44:08.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.820+0000 7f7fc37fe640 1 --2- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f7fac038fc0 0x7f7fac03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:08.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.820+0000 7f7fc37fe640 1 --2- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f7fac038fc0 0x7f7fac03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80098c0 tx=0x7f7fb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:08.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:07.824+0000 7f7fc17fa640 1 -- 172.21.15.2:0/1682288089 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7fb403d430 con 0x7f7fc41083e0 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.041+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7fc4103310 con 0x7f7fac038fc0 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.046+0000 7f7fc17fa640 1 -- 172.21.15.2:0/1682288089 <== mgr.14118 v2:172.21.15.2:6800/975752128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7fc4103310 con 0x7f7fac038fc0 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f7fac038fc0 msgr2=0x7f7fac03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 --2- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f7fac038fc0 0x7f7fac03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80098c0 tx=0x7f7fb8006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 msgr2=0x7f7fc419b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 --2- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc419b8c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40097f0 tx=0x7f7fb4030ec0 comp rx=0 tx=0).stop 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 shutdown_connections 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 --2- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f7fac038fc0 0x7f7fac03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 --2- 172.21.15.2:0/1682288089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fc41083e0 0x7f7fc419b8c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:08.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 >> 172.21.15.2:0/1682288089 conn(0x7f7fc4102020 msgr2=0x7f7fc4102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:08.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 shutdown_connections 2024-09-12T00:44:08.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:08.048+0000 7f7fca680640 1 -- 172.21.15.2:0/1682288089 wait complete. 2024-09-12T00:44:08.800 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-09-12T00:44:09.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:09 smithi002 ceph-mon[31210]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:09.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:09 smithi002 ceph-mon[31210]: Saving service mon spec with placement count:5 2024-09-12T00:44:09.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:09 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:10.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T00:44:10.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.142+0000 7f855389b640 1 Processor -- start 2024-09-12T00:44:10.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.142+0000 7f855389b640 1 -- start start 2024-09-12T00:44:10.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.142+0000 7f855389b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c10a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:10.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.142+0000 7f855389b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f854c07be90 con 0x7f854c1082f0 2024-09-12T00:44:10.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.142+0000 7f8551637640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c10a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.142+0000 7f8551637640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c10a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52208/0 (socket says 172.21.15.2:52208) 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.142+0000 7f8551637640 1 -- 172.21.15.2:0/2219317262 learned_addr learned my addr 172.21.15.2:0/2219317262 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.143+0000 7f8551637640 1 -- 172.21.15.2:0/2219317262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c10ac20 con 0x7f854c1082f0 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.143+0000 7f8551637640 1 --2- 172.21.15.2:0/2219317262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c10a6e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8548009820 tx=0x7f854802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c248b301dca0dab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.143+0000 7f8543fff640 1 -- 172.21.15.2:0/2219317262 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8548037070 con 0x7f854c1082f0 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.143+0000 7f8543fff640 1 -- 172.21.15.2:0/2219317262 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8548032920 con 0x7f854c1082f0 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.143+0000 7f8543fff640 1 -- 172.21.15.2:0/2219317262 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8548030810 con 0x7f854c1082f0 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.144+0000 7f855389b640 1 -- 172.21.15.2:0/2219317262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 msgr2=0x7f854c10a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.144+0000 7f855389b640 1 --2- 172.21.15.2:0/2219317262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c10a6e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8548009820 tx=0x7f854802a270 comp rx=0 tx=0).stop 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.144+0000 7f855389b640 1 -- 172.21.15.2:0/2219317262 shutdown_connections 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.144+0000 7f855389b640 1 --2- 172.21.15.2:0/2219317262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c10a6e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.144+0000 7f855389b640 1 -- 172.21.15.2:0/2219317262 >> 172.21.15.2:0/2219317262 conn(0x7f854c101f10 msgr2=0x7f854c104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.144+0000 7f855389b640 1 -- 172.21.15.2:0/2219317262 shutdown_connections 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.144+0000 7f855389b640 1 -- 172.21.15.2:0/2219317262 wait complete. 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.145+0000 7f855389b640 1 Processor -- start 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.145+0000 7f855389b640 1 -- start start 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.145+0000 7f855389b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c19b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.145+0000 7f855389b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f854c10bc90 con 0x7f854c1082f0 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.145+0000 7f8551637640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c19b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.145+0000 7f8551637640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c19b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52224/0 (socket says 172.21.15.2:52224) 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.145+0000 7f8551637640 1 -- 172.21.15.2:0/489700285 learned_addr learned my addr 172.21.15.2:0/489700285 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.145+0000 7f8551637640 1 -- 172.21.15.2:0/489700285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c19bda0 con 0x7f854c1082f0 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.146+0000 7f8551637640 1 --2- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c19b860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8548030380 tx=0x7f8548032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.146+0000 7f85427fc640 1 -- 172.21.15.2:0/489700285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8548037040 con 0x7f854c1082f0 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.146+0000 7f85427fc640 1 -- 172.21.15.2:0/489700285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8548040070 con 0x7f854c1082f0 2024-09-12T00:44:10.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.146+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c19c030 con 0x7f854c1082f0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.146+0000 7f85427fc640 1 -- 172.21.15.2:0/489700285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854803a7b0 con 0x7f854c1082f0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.146+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c19ed20 con 0x7f854c1082f0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.147+0000 7f85427fc640 1 -- 172.21.15.2:0/489700285 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f854803b420 con 0x7f854c1082f0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.147+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c108750 con 0x7f854c1082f0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.147+0000 7f85427fc640 1 --2- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f8538038fc0 0x7f853803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.147+0000 7f85427fc640 1 -- 172.21.15.2:0/489700285 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f854806c5f0 con 0x7f854c1082f0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.147+0000 7f8550e36640 1 --2- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f8538038fc0 0x7f853803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.148+0000 7f8550e36640 1 --2- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f8538038fc0 0x7f853803b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f853c0098c0 tx=0x7f853c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.152+0000 7f85427fc640 1 -- 172.21.15.2:0/489700285 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f854804a200 con 0x7f854c1082f0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.359+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f854c103240 con 0x7f8538038fc0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.364+0000 7f85427fc640 1 -- 172.21.15.2:0/489700285 <== mgr.14118 v2:172.21.15.2:6800/975752128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f854c103240 con 0x7f8538038fc0 2024-09-12T00:44:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f8538038fc0 msgr2=0x7f853803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 --2- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f8538038fc0 0x7f853803b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f853c0098c0 tx=0x7f853c006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 msgr2=0x7f854c19b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 --2- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c19b860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8548030380 tx=0x7f8548032670 comp rx=0 tx=0).stop 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 shutdown_connections 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 --2- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f8538038fc0 0x7f853803b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 --2- 172.21.15.2:0/489700285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c1082f0 0x7f854c19b860 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 >> 172.21.15.2:0/489700285 conn(0x7f854c101f10 msgr2=0x7f854c102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 shutdown_connections 2024-09-12T00:44:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:10.366+0000 7f855389b640 1 -- 172.21.15.2:0/489700285 wait complete. 2024-09-12T00:44:11.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:10 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:11.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:10 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:11.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:10 smithi002 ceph-mon[31210]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:11.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:10 smithi002 ceph-mon[31210]: Saving service mgr spec with placement count:2 2024-09-12T00:44:11.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:10 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:12.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:12 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/898079444' entity='client.admin' 2024-09-12T00:44:12.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:12 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.349+0000 7f01ed3e0640 1 Processor -- start 2024-09-12T00:44:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.349+0000 7f01ed3e0640 1 -- start start 2024-09-12T00:44:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.350+0000 7f01ed3e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e8107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.350+0000 7f01ed3e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81082d0 con 0x7f01e8107900 2024-09-12T00:44:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.350+0000 7f01e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e8107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.350+0000 7f01e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e8107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52228/0 (socket says 172.21.15.2:52228) 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.350+0000 7f01e6ffd640 1 -- 172.21.15.2:0/2040811471 learned_addr learned my addr 172.21.15.2:0/2040811471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.350+0000 7f01e6ffd640 1 -- 172.21.15.2:0/2040811471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e8108b00 con 0x7f01e8107900 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.351+0000 7f01e6ffd640 1 --2- 172.21.15.2:0/2040811471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e8107d00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009820 tx=0x7f01d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eac74b0fd94360 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.351+0000 7f01e5ffb640 1 -- 172.21.15.2:0/2040811471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d8037070 con 0x7f01e8107900 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.351+0000 7f01e5ffb640 1 -- 172.21.15.2:0/2040811471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d8032920 con 0x7f01e8107900 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.351+0000 7f01e5ffb640 1 -- 172.21.15.2:0/2040811471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d8030810 con 0x7f01e8107900 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.352+0000 7f01ed3e0640 1 -- 172.21.15.2:0/2040811471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 msgr2=0x7f01e8107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:12.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.352+0000 7f01ed3e0640 1 --2- 172.21.15.2:0/2040811471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e8107d00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009820 tx=0x7f01d802a270 comp rx=0 tx=0).stop 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.352+0000 7f01ed3e0640 1 -- 172.21.15.2:0/2040811471 shutdown_connections 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.352+0000 7f01ed3e0640 1 --2- 172.21.15.2:0/2040811471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e8107d00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.352+0000 7f01ed3e0640 1 -- 172.21.15.2:0/2040811471 >> 172.21.15.2:0/2040811471 conn(0x7f01e81030b0 msgr2=0x7f01e81054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.352+0000 7f01ed3e0640 1 -- 172.21.15.2:0/2040811471 shutdown_connections 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.352+0000 7f01ed3e0640 1 -- 172.21.15.2:0/2040811471 wait complete. 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.352+0000 7f01ed3e0640 1 Processor -- start 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01ed3e0640 1 -- start start 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01ed3e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01ed3e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01e810beb0 con 0x7f01e8107900 2024-09-12T00:44:12.983 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52236/0 (socket says 172.21.15.2:52236) 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01e6ffd640 1 -- 172.21.15.2:0/898079444 learned_addr learned my addr 172.21.15.2:0/898079444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01e6ffd640 1 -- 172.21.15.2:0/898079444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e819be00 con 0x7f01e8107900 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01e6ffd640 1 --2- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e819b8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01d8030560 tx=0x7f01d8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01cffff640 1 -- 172.21.15.2:0/898079444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d8037040 con 0x7f01e8107900 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.353+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e819c090 con 0x7f01e8107900 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.354+0000 7f01cffff640 1 -- 172.21.15.2:0/898079444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d8040070 con 0x7f01e8107900 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.354+0000 7f01cffff640 1 -- 172.21.15.2:0/898079444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d803a6d0 con 0x7f01e8107900 2024-09-12T00:44:12.984 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.354+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e819ed80 con 0x7f01e8107900 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.354+0000 7f01cffff640 1 -- 172.21.15.2:0/898079444 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f01d803a940 con 0x7f01e8107900 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.355+0000 7f01cffff640 1 --2- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f01d0038f70 0x7f01d003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.355+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e8107d80 con 0x7f01e8107900 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.355+0000 7f01cffff640 1 -- 172.21.15.2:0/898079444 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f01d806c6a0 con 0x7f01e8107900 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.355+0000 7f01e67fc640 1 --2- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f01d0038f70 0x7f01d003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.355+0000 7f01e67fc640 1 --2- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f01d0038f70 0x7f01d003b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0098c0 tx=0x7f01dc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.359+0000 7f01cffff640 1 -- 172.21.15.2:0/898079444 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01d8044c70 con 0x7f01e8107900 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.567+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f01e819f350 con 0x7f01e8107900 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.569+0000 7f01cffff640 1 -- 172.21.15.2:0/898079444 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f01d8045980 con 0x7f01e8107900 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f01d0038f70 msgr2=0x7f01d003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:12.985 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 --2- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f01d0038f70 0x7f01d003b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0098c0 tx=0x7f01dc006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:12.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 msgr2=0x7f01e819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:12.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 --2- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e819b8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01d8030560 tx=0x7f01d8032670 comp rx=0 tx=0).stop 2024-09-12T00:44:12.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 shutdown_connections 2024-09-12T00:44:12.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 --2- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f01d0038f70 0x7f01d003b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:12.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 --2- 172.21.15.2:0/898079444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01e8107900 0x7f01e819b8c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:12.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 >> 172.21.15.2:0/898079444 conn(0x7f01e81030b0 msgr2=0x7f01e8103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:12.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 shutdown_connections 2024-09-12T00:44:12.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:11.572+0000 7f01ed3e0640 1 -- 172.21.15.2:0/898079444 wait complete. 2024-09-12T00:44:14.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.435+0000 7f23ac794640 1 Processor -- start 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.435+0000 7f23ac794640 1 -- start start 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.435+0000 7f23ac794640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a410a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.435+0000 7f23ac794640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23a407be10 con 0x7f23a4108420 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.435+0000 7f23aa530640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a410a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.435+0000 7f23aa530640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a410a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52248/0 (socket says 172.21.15.2:52248) 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.435+0000 7f23aa530640 1 -- 172.21.15.2:0/2448662325 learned_addr learned my addr 172.21.15.2:0/2448662325 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.436+0000 7f23aa530640 1 -- 172.21.15.2:0/2448662325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a410ad50 con 0x7f23a4108420 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.436+0000 7f23aa530640 1 --2- 172.21.15.2:0/2448662325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a410a810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009820 tx=0x7f23a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3895d03304d90515 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23a952e640 1 -- 172.21.15.2:0/2448662325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a0037070 con 0x7f23a4108420 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23a952e640 1 -- 172.21.15.2:0/2448662325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23a0032920 con 0x7f23a4108420 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23a952e640 1 -- 172.21.15.2:0/2448662325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a0030810 con 0x7f23a4108420 2024-09-12T00:44:14.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23ac794640 1 -- 172.21.15.2:0/2448662325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 msgr2=0x7f23a410a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23ac794640 1 --2- 172.21.15.2:0/2448662325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a410a810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009820 tx=0x7f23a002a270 comp rx=0 tx=0).stop 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23ac794640 1 -- 172.21.15.2:0/2448662325 shutdown_connections 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23ac794640 1 --2- 172.21.15.2:0/2448662325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a410a810 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23ac794640 1 -- 172.21.15.2:0/2448662325 >> 172.21.15.2:0/2448662325 conn(0x7f23a4102020 msgr2=0x7f23a4104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23ac794640 1 -- 172.21.15.2:0/2448662325 shutdown_connections 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.437+0000 7f23ac794640 1 -- 172.21.15.2:0/2448662325 wait complete. 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.438+0000 7f23ac794640 1 Processor -- start 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.438+0000 7f23ac794640 1 -- start start 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.438+0000 7f23ac794640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.438+0000 7f23ac794640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23a410bd00 con 0x7f23a4108420 2024-09-12T00:44:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.438+0000 7f23aa530640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.438+0000 7f23aa530640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a419b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52250/0 (socket says 172.21.15.2:52250) 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.438+0000 7f23aa530640 1 -- 172.21.15.2:0/3255882864 learned_addr learned my addr 172.21.15.2:0/3255882864 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.438+0000 7f23aa530640 1 -- 172.21.15.2:0/3255882864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a419be30 con 0x7f23a4108420 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.439+0000 7f23aa530640 1 --2- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a419b8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23a0030420 tx=0x7f23a0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.439+0000 7f239b7fe640 1 -- 172.21.15.2:0/3255882864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a0037040 con 0x7f23a4108420 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.439+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a419c0c0 con 0x7f23a4108420 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.439+0000 7f239b7fe640 1 -- 172.21.15.2:0/3255882864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23a0040070 con 0x7f23a4108420 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.439+0000 7f239b7fe640 1 -- 172.21.15.2:0/3255882864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a003a6e0 con 0x7f23a4108420 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.439+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a419edb0 con 0x7f23a4108420 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.440+0000 7f239b7fe640 1 -- 172.21.15.2:0/3255882864 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f23a003b420 con 0x7f23a4108420 2024-09-12T00:44:14.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.440+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a4108880 con 0x7f23a4108420 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.440+0000 7f239b7fe640 1 --2- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f2390038f70 0x7f239003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.440+0000 7f239b7fe640 1 -- 172.21.15.2:0/3255882864 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f23a006c5a0 con 0x7f23a4108420 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.440+0000 7f23a9d2f640 1 --2- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f2390038f70 0x7f239003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.441+0000 7f23a9d2f640 1 --2- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f2390038f70 0x7f239003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23940098c0 tx=0x7f2394006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.445+0000 7f239b7fe640 1 -- 172.21.15.2:0/3255882864 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23a003b710 con 0x7f23a4108420 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.622+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f23a419f410 con 0x7f23a4108420 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.625+0000 7f239b7fe640 1 -- 172.21.15.2:0/3255882864 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f23a0031e60 con 0x7f23a4108420 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f2390038f70 msgr2=0x7f239003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 --2- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f2390038f70 0x7f239003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23940098c0 tx=0x7f2394006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 msgr2=0x7f23a419b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 --2- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a419b8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23a0030420 tx=0x7f23a0032670 comp rx=0 tx=0).stop 2024-09-12T00:44:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 shutdown_connections 2024-09-12T00:44:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 --2- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7f2390038f70 0x7f239003b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 --2- 172.21.15.2:0/3255882864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23a4108420 0x7f23a419b8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 >> 172.21.15.2:0/3255882864 conn(0x7f23a4102020 msgr2=0x7f23a4102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 shutdown_connections 2024-09-12T00:44:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:13.627+0000 7f23ac794640 1 -- 172.21.15.2:0/3255882864 wait complete. 2024-09-12T00:44:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-09-12T00:44:14.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:14 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3255882864' entity='client.admin' 2024-09-12T00:44:15.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:15 smithi002 ceph-mon[31210]: from='mgr.14118 172.21.15.2:0/4130006593' entity='mgr.x' 2024-09-12T00:44:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:15 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/405840523' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T00:44:15.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ignoring --setuser ceph since I am not root 2024-09-12T00:44:15.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ignoring --setgroup ceph since I am not root 2024-09-12T00:44:15.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:15.842+0000 7fb5bbd59040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T00:44:15.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:15.901+0000 7fb5bbd59040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T00:44:16.428 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:16.056+0000 7fb5bbd59040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T00:44:16.428 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:16.125+0000 7fb5bbd59040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T00:44:16.428 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:16.281+0000 7fb5bbd59040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:44:16.428 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:16.428+0000 7fb5bbd59040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T00:44:16.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.550+0000 7fb3b3ca0640 1 Processor -- start 2024-09-12T00:44:16.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.550+0000 7fb3b3ca0640 1 -- start start 2024-09-12T00:44:16.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.551+0000 7fb3b3ca0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:16.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.551+0000 7fb3b3ca0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac107150 con 0x7fb3ac106780 2024-09-12T00:44:16.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.551+0000 7fb3b1a3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.551+0000 7fb3b1a3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52262/0 (socket says 172.21.15.2:52262) 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.551+0000 7fb3b1a3c640 1 -- 172.21.15.2:0/189000511 learned_addr learned my addr 172.21.15.2:0/189000511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.551+0000 7fb3b1a3c640 1 -- 172.21.15.2:0/189000511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac107980 con 0x7fb3ac106780 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.552+0000 7fb3b1a3c640 1 --2- 172.21.15.2:0/189000511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac106b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009820 tx=0x7fb3a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dcae3b96f323ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.552+0000 7fb3b0a3a640 1 -- 172.21.15.2:0/189000511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8037070 con 0x7fb3ac106780 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.552+0000 7fb3b0a3a640 1 -- 172.21.15.2:0/189000511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3a8032920 con 0x7fb3ac106780 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.552+0000 7fb3b0a3a640 1 -- 172.21.15.2:0/189000511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8030810 con 0x7fb3ac106780 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.553+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/189000511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 msgr2=0x7fb3ac106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.553+0000 7fb3b3ca0640 1 --2- 172.21.15.2:0/189000511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac106b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009820 tx=0x7fb3a802a270 comp rx=0 tx=0).stop 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.553+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/189000511 shutdown_connections 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.553+0000 7fb3b3ca0640 1 --2- 172.21.15.2:0/189000511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac106b80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.553+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/189000511 >> 172.21.15.2:0/189000511 conn(0x7fb3ac101f10 msgr2=0x7fb3ac104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:16.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.553+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/189000511 shutdown_connections 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.553+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/189000511 wait complete. 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.553+0000 7fb3b3ca0640 1 Processor -- start 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b3ca0640 1 -- start start 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b3ca0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b3ca0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac10ad30 con 0x7fb3ac106780 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b1a3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b1a3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52270/0 (socket says 172.21.15.2:52270) 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b1a3c640 1 -- 172.21.15.2:0/405840523 learned_addr learned my addr 172.21.15.2:0/405840523 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b1a3c640 1 -- 172.21.15.2:0/405840523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac19bdf0 con 0x7fb3ac106780 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b1a3c640 1 --2- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac19b8b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80097f0 tx=0x7fb3a80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3a2ffd640 1 -- 172.21.15.2:0/405840523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8037040 con 0x7fb3ac106780 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3a2ffd640 1 -- 172.21.15.2:0/405840523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3a8030cc0 con 0x7fb3ac106780 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3a2ffd640 1 -- 172.21.15.2:0/405840523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a803a640 con 0x7fb3ac106780 2024-09-12T00:44:16.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac19c080 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.554+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac19ed70 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.555+0000 7fb3a2ffd640 1 -- 172.21.15.2:0/405840523 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb3a803b3f0 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.555+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ac106c00 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.556+0000 7fb3a2ffd640 1 --2- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb398038fc0 0x7fb39803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.556+0000 7fb3a2ffd640 1 -- 172.21.15.2:0/405840523 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb3a806c4a0 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.556+0000 7fb3b123b640 1 --2- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb398038fc0 0x7fb39803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.556+0000 7fb3b123b640 1 --2- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb398038fc0 0x7fb39803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0098c0 tx=0x7fb39c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.560+0000 7fb3a2ffd640 1 -- 172.21.15.2:0/405840523 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3a80328c0 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:14.792+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fb3ac19ef40 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.685+0000 7fb3a2ffd640 1 -- 172.21.15.2:0/405840523 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fb3a8042dc0 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.687+0000 7fb3a2ffd640 1 -- 172.21.15.2:0/405840523 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fb3a803a8f0 con 0x7fb3ac106780 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb398038fc0 msgr2=0x7fb39803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:16.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 --2- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb398038fc0 0x7fb39803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0098c0 tx=0x7fb39c006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 msgr2=0x7fb3ac19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 --2- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac19b8b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80097f0 tx=0x7fb3a80327b0 comp rx=0 tx=0).stop 2024-09-12T00:44:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 shutdown_connections 2024-09-12T00:44:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 --2- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fb398038fc0 0x7fb39803b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 --2- 172.21.15.2:0/405840523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ac106780 0x7fb3ac19b8b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 >> 172.21.15.2:0/405840523 conn(0x7fb3ac101f10 msgr2=0x7fb3ac102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 shutdown_connections 2024-09-12T00:44:16.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:15.689+0000 7fb3b3ca0640 1 -- 172.21.15.2:0/405840523 wait complete. 2024-09-12T00:44:16.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:16 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/405840523' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T00:44:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:16 smithi002 ceph-mon[31210]: mgrmap e9: x(active, since 19s) 2024-09-12T00:44:16.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:16.761+0000 7fb5bbd59040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T00:44:16.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:16.828+0000 7fb5bbd59040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T00:44:17.256 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:17 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:17.035+0000 7fb5bbd59040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T00:44:17.863 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:17 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/922153823' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T00:44:17.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-12T00:44:17.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.006+0000 7fc1a2f62640 1 Processor -- start 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.006+0000 7fc1a2f62640 1 -- start start 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.006+0000 7fc1a2f62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c10a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.006+0000 7fc1a2f62640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c07be10 con 0x7fc19c1083a0 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.007+0000 7fc1a0cfe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c10a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.007+0000 7fc1a0cfe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c10a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48336/0 (socket says 172.21.15.2:48336) 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.007+0000 7fc1a0cfe640 1 -- 172.21.15.2:0/1411712915 learned_addr learned my addr 172.21.15.2:0/1411712915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:17.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.007+0000 7fc1a0cfe640 1 -- 172.21.15.2:0/1411712915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c10acd0 con 0x7fc19c1083a0 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.008+0000 7fc1a0cfe640 1 --2- 172.21.15.2:0/1411712915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c10a790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc190009820 tx=0x7fc19002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a4f8e9a5111c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.008+0000 7fc19b7fe640 1 -- 172.21.15.2:0/1411712915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190037070 con 0x7fc19c1083a0 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.008+0000 7fc19b7fe640 1 -- 172.21.15.2:0/1411712915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc190032920 con 0x7fc19c1083a0 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.008+0000 7fc19b7fe640 1 -- 172.21.15.2:0/1411712915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190030810 con 0x7fc19c1083a0 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.009+0000 7fc1a2f62640 1 -- 172.21.15.2:0/1411712915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 msgr2=0x7fc19c10a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.009+0000 7fc1a2f62640 1 --2- 172.21.15.2:0/1411712915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c10a790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc190009820 tx=0x7fc19002a270 comp rx=0 tx=0).stop 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.009+0000 7fc1a2f62640 1 -- 172.21.15.2:0/1411712915 shutdown_connections 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.009+0000 7fc1a2f62640 1 --2- 172.21.15.2:0/1411712915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c10a790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.009+0000 7fc1a2f62640 1 -- 172.21.15.2:0/1411712915 >> 172.21.15.2:0/1411712915 conn(0x7fc19c101f40 msgr2=0x7fc19c104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.009+0000 7fc1a2f62640 1 -- 172.21.15.2:0/1411712915 shutdown_connections 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.009+0000 7fc1a2f62640 1 -- 172.21.15.2:0/1411712915 wait complete. 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a2f62640 1 Processor -- start 2024-09-12T00:44:17.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a2f62640 1 -- start start 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a2f62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c107c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a2f62640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c10bc80 con 0x7fc19c1083a0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a0cfe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a0cfe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48346/0 (socket says 172.21.15.2:48346) 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a0cfe640 1 -- 172.21.15.2:0/922153823 learned_addr learned my addr 172.21.15.2:0/922153823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a0cfe640 1 -- 172.21.15.2:0/922153823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c108160 con 0x7fc19c1083a0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.010+0000 7fc1a0cfe640 1 --2- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c107c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1900097f0 tx=0x7fc1900327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.011+0000 7fc199ffb640 1 -- 172.21.15.2:0/922153823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190037040 con 0x7fc19c1083a0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.011+0000 7fc199ffb640 1 -- 172.21.15.2:0/922153823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc190030cc0 con 0x7fc19c1083a0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.011+0000 7fc199ffb640 1 -- 172.21.15.2:0/922153823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19003a6b0 con 0x7fc19c1083a0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.011+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c106350 con 0x7fc19c1083a0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.011+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c106890 con 0x7fc19c1083a0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.012+0000 7fc199ffb640 1 -- 172.21.15.2:0/922153823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fc19003baf0 con 0x7fc19c1083a0 2024-09-12T00:44:17.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.012+0000 7fc199ffb640 1 --2- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fc18c038fc0 0x7fc18c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.012+0000 7fc199ffb640 1 -- 172.21.15.2:0/922153823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc19006c570 con 0x7fc19c1083a0 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.012+0000 7fc19bfff640 1 -- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fc18c038fc0 msgr2=0x7fc18c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/975752128 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.012+0000 7fc19bfff640 1 --2- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fc18c038fc0 0x7fc18c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.012+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19c108800 con 0x7fc19c1083a0 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.017+0000 7fc199ffb640 1 -- 172.21.15.2:0/922153823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1900371e0 con 0x7fc19c1083a0 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.213+0000 7fc19bfff640 1 -- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fc18c038fc0 msgr2=0x7fc18c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/975752128 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.213+0000 7fc19bfff640 1 --2- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fc18c038fc0 0x7fc18c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.256+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fc19c103510 con 0x7fc19c1083a0 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.257+0000 7fc199ffb640 1 -- 172.21.15.2:0/922153823 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fc19003a850 con 0x7fc19c1083a0 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fc18c038fc0 msgr2=0x7fc18c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 --2- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fc18c038fc0 0x7fc18c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:17.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 msgr2=0x7fc19c107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 --2- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c107c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1900097f0 tx=0x7fc1900327b0 comp rx=0 tx=0).stop 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 shutdown_connections 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 --2- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fc18c038fc0 0x7fc18c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 --2- 172.21.15.2:0/922153823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c1083a0 0x7fc19c107c20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 >> 172.21.15.2:0/922153823 conn(0x7fc19c101f40 msgr2=0x7fc19c102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 shutdown_connections 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:17.260+0000 7fc1a2f62640 1 -- 172.21.15.2:0/922153823 wait complete. 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-12T00:44:17.876 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-09-12T00:44:18.174 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:17 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:17.976+0000 7fb5bbd59040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T00:44:18.174 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:18 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:18.048+0000 7fb5bbd59040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T00:44:19.069 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:18 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:18.799+0000 7fb5bbd59040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T00:44:19.069 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:18 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:18.920+0000 7fb5bbd59040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T00:44:19.359 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.069+0000 7fb5bbd59040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:44:19.359 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.133+0000 7fb5bbd59040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T00:44:19.359 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.289+0000 7fb5bbd59040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T00:44:19.359 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.359+0000 7fb5bbd59040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T00:44:19.654 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.422+0000 7fb5bbd59040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T00:44:19.654 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.587+0000 7fb5bbd59040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T00:44:19.655 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.655+0000 7fb5bbd59040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T00:44:19.933 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.724+0000 7fb5bbd59040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T00:44:19.933 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.810+0000 7fb5bbd59040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T00:44:19.933 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.872+0000 7fb5bbd59040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T00:44:19.933 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:19.933+0000 7fb5bbd59040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T00:44:21.014 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:20.760+0000 7fb5bbd59040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T00:44:21.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: Active manager daemon x restarted 2024-09-12T00:44:21.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: Activating manager daemon x 2024-09-12T00:44:21.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T00:44:21.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: mgrmap e10: x(active, starting, since 0.00320152s) 2024-09-12T00:44:21.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:44:21.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T00:44:21.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T00:44:21.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T00:44:21.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T00:44:21.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: Manager daemon x is now available 2024-09-12T00:44:21.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:44:21.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T00:44:21.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T00:44:22.598 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:22.459+0000 7fb52706d640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:00:44:22] ENGINE Error in HTTPServer.serve 2024-09-12T00:44:22.598 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: Traceback (most recent call last): 2024-09-12T00:44:22.598 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T00:44:22.598 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._connections.run(self.expiration_interval) 2024-09-12T00:44:22.598 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T00:44:22.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._run(expiration_interval) 2024-09-12T00:44:22.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T00:44:22.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T00:44:22.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T00:44:22.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T00:44:22.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T00:44:22.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: s = self.context.wrap_socket( 2024-09-12T00:44:22.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T00:44:22.600 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: return self.sslsocket_class._create( 2024-09-12T00:44:22.600 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T00:44:22.600 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self.do_handshake() 2024-09-12T00:44:22.600 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T00:44:22.600 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._sslobj.do_handshake() 2024-09-12T00:44:22.600 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T00:44:22.600 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:44:22.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-12T00:44:22.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T00:44:22.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T00:44:22.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-12T00:44:22.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.256+0000 7fcc79af3640 1 Processor -- start 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.256+0000 7fcc79af3640 1 -- start start 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.256+0000 7fcc79af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7410a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.256+0000 7fcc79af3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7407be90 con 0x7fcc74108320 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.256+0000 7fcc737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7410a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.257+0000 7fcc737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7410a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48350/0 (socket says 172.21.15.2:48350) 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.257+0000 7fcc737fe640 1 -- 172.21.15.2:0/2799238334 learned_addr learned my addr 172.21.15.2:0/2799238334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.257+0000 7fcc737fe640 1 -- 172.21.15.2:0/2799238334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7410ac50 con 0x7fcc74108320 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc737fe640 1 --2- 172.21.15.2:0/2799238334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7410a710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009820 tx=0x7fcc6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed82c1d390ff0766 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc727fc640 1 -- 172.21.15.2:0/2799238334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc64037070 con 0x7fcc74108320 2024-09-12T00:44:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc727fc640 1 -- 172.21.15.2:0/2799238334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc64032920 con 0x7fcc74108320 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc727fc640 1 -- 172.21.15.2:0/2799238334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc64030810 con 0x7fcc74108320 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc79af3640 1 -- 172.21.15.2:0/2799238334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 msgr2=0x7fcc7410a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc79af3640 1 --2- 172.21.15.2:0/2799238334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7410a710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009820 tx=0x7fcc6402a270 comp rx=0 tx=0).stop 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc79af3640 1 -- 172.21.15.2:0/2799238334 shutdown_connections 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc79af3640 1 --2- 172.21.15.2:0/2799238334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7410a710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc79af3640 1 -- 172.21.15.2:0/2799238334 >> 172.21.15.2:0/2799238334 conn(0x7fcc74101f40 msgr2=0x7fcc74104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc79af3640 1 -- 172.21.15.2:0/2799238334 shutdown_connections 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.258+0000 7fcc79af3640 1 -- 172.21.15.2:0/2799238334 wait complete. 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.259+0000 7fcc79af3640 1 Processor -- start 2024-09-12T00:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.259+0000 7fcc79af3640 1 -- start start 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.259+0000 7fcc79af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7419dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.259+0000 7fcc79af3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7410bcc0 con 0x7fcc74108320 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.259+0000 7fcc737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7419dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.259+0000 7fcc737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7419dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48352/0 (socket says 172.21.15.2:48352) 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.260+0000 7fcc737fe640 1 -- 172.21.15.2:0/4008964608 learned_addr learned my addr 172.21.15.2:0/4008964608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.260+0000 7fcc737fe640 1 -- 172.21.15.2:0/4008964608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7419dff0 con 0x7fcc74108320 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.260+0000 7fcc737fe640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7419dab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcc64030380 tx=0x7fcc64032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.260+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc64037040 con 0x7fcc74108320 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.260+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc64040070 con 0x7fcc74108320 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.260+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7419e280 con 0x7fcc74108320 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.260+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc6403a7b0 con 0x7fcc74108320 2024-09-12T00:44:22.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.260+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc741a0f70 con 0x7fcc74108320 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.261+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fcc6403aa30 con 0x7fcc74108320 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.261+0000 7fcc70ff9640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 0x7fcc6003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.261+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 --> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcc74108780 con 0x7fcc60038fc0 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.261+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcc6406c670 con 0x7fcc74108320 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.261+0000 7fcc72ffd640 1 -- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 msgr2=0x7fcc6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/975752128 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.261+0000 7fcc72ffd640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 0x7fcc6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.462+0000 7fcc72ffd640 1 -- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 msgr2=0x7fcc6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/975752128 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.462+0000 7fcc72ffd640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 0x7fcc6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T00:44:22.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.863+0000 7fcc72ffd640 1 -- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 msgr2=0x7fcc6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/975752128 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:18.863+0000 7fcc72ffd640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 0x7fcc6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:19.664+0000 7fcc72ffd640 1 -- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 msgr2=0x7fcc6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/975752128 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:19.664+0000 7fcc72ffd640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 0x7fcc6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:20.764+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7fcc6406b120 con 0x7fcc74108320 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:20.764+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 msgr2=0x7fcc6003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:20.764+0000 7fcc70ff9640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 0x7fcc6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.765+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fcc64045460 con 0x7fcc74108320 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.765+0000 7fcc70ff9640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcc6003c890 0x7fcc6003ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.765+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcc6403aec0 con 0x7fcc6003c890 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.766+0000 7fcc72ffd640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcc6003c890 0x7fcc6003ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.767+0000 7fcc72ffd640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcc6003c890 0x7fcc6003ec80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c003980 tx=0x7fcc5c006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:22.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.767+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fcc6403aec0 con 0x7fcc6003c890 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.774+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fcc741031b0 con 0x7fcc6003c890 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc70ff9640 1 -- 172.21.15.2:0/4008964608 <== mgr.14150 v2:172.21.15.2:6800/288268916 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fcc741031b0 con 0x7fcc6003c890 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcc6003c890 msgr2=0x7fcc6003ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcc6003c890 0x7fcc6003ec80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c003980 tx=0x7fcc5c006e10 comp rx=0 tx=0).stop 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 msgr2=0x7fcc7419dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7419dab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcc64030380 tx=0x7fcc64032670 comp rx=0 tx=0).stop 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 shutdown_connections 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcc6003c890 0x7fcc6003ec80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:6800/975752128,v1:172.21.15.2:6801/975752128] conn(0x7fcc60038fc0 0x7fcc6003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 --2- 172.21.15.2:0/4008964608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc74108320 0x7fcc7419dab0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:22.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 >> 172.21.15.2:0/4008964608 conn(0x7fcc74101f40 msgr2=0x7fcc74102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:22.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 shutdown_connections 2024-09-12T00:44:22.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:21.775+0000 7fcc79af3640 1 -- 172.21.15.2:0/4008964608 wait complete. 2024-09-12T00:44:22.617 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-09-12T00:44:22.617 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-mon[31210]: mgrmap e11: x(active, since 1.00587s) 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-mon[31210]: [12/Sep/2024:00:44:22] ENGINE Bus STARTING 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-mon[31210]: [12/Sep/2024:00:44:22] ENGINE Serving on https://172.21.15.2:7150 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-mon[31210]: [12/Sep/2024:00:44:22] ENGINE Error in HTTPServer.serve 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-12T00:44:22.867 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T00:44:22.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-mon[31210]: [12/Sep/2024:00:44:22] ENGINE Serving on http://172.21.15.2:8765 2024-09-12T00:44:22.869 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:22 smithi002 ceph-mon[31210]: [12/Sep/2024:00:44:22] ENGINE Bus STARTED 2024-09-12T00:44:23.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.048+0000 7fb3dd60c640 1 Processor -- start 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.048+0000 7fb3dd60c640 1 -- start start 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.048+0000 7fb3dd60c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.048+0000 7fb3dd60c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d807c7e0 con 0x7fb3d807de40 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.049+0000 7fb3d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.049+0000 7fb3d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48436/0 (socket says 172.21.15.2:48436) 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.049+0000 7fb3d6ffd640 1 -- 172.21.15.2:0/589398683 learned_addr learned my addr 172.21.15.2:0/589398683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.049+0000 7fb3d6ffd640 1 -- 172.21.15.2:0/589398683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d807c960 con 0x7fb3d807de40 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3d6ffd640 1 --2- 172.21.15.2:0/589398683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d807c2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009820 tx=0x7fb3c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf565bbf200024b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3d5ffb640 1 -- 172.21.15.2:0/589398683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3c8037070 con 0x7fb3d807de40 2024-09-12T00:44:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3d5ffb640 1 -- 172.21.15.2:0/589398683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c8032920 con 0x7fb3d807de40 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3d5ffb640 1 -- 172.21.15.2:0/589398683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3c8030810 con 0x7fb3d807de40 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3dd60c640 1 -- 172.21.15.2:0/589398683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 msgr2=0x7fb3d807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3dd60c640 1 --2- 172.21.15.2:0/589398683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d807c2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009820 tx=0x7fb3c802a270 comp rx=0 tx=0).stop 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3dd60c640 1 -- 172.21.15.2:0/589398683 shutdown_connections 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3dd60c640 1 --2- 172.21.15.2:0/589398683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d807c2a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.050+0000 7fb3dd60c640 1 -- 172.21.15.2:0/589398683 >> 172.21.15.2:0/589398683 conn(0x7fb3d8102fd0 msgr2=0x7fb3d8105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.051+0000 7fb3dd60c640 1 -- 172.21.15.2:0/589398683 shutdown_connections 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.051+0000 7fb3dd60c640 1 -- 172.21.15.2:0/589398683 wait complete. 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.051+0000 7fb3dd60c640 1 Processor -- start 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.051+0000 7fb3dd60c640 1 -- start start 2024-09-12T00:44:23.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3dd60c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d819da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3dd60c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d810de60 con 0x7fb3d807de40 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d819da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d819da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48438/0 (socket says 172.21.15.2:48438) 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3d6ffd640 1 -- 172.21.15.2:0/983299928 learned_addr learned my addr 172.21.15.2:0/983299928 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3d6ffd640 1 -- 172.21.15.2:0/983299928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d819dfb0 con 0x7fb3d807de40 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3d6ffd640 1 --2- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d819da70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8030380 tx=0x7fb3c8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3bffff640 1 -- 172.21.15.2:0/983299928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3c8037040 con 0x7fb3d807de40 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3bffff640 1 -- 172.21.15.2:0/983299928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c8040070 con 0x7fb3d807de40 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d819e240 con 0x7fb3d807de40 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3bffff640 1 -- 172.21.15.2:0/983299928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3c803a7b0 con 0x7fb3d807de40 2024-09-12T00:44:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.052+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d81a0f30 con 0x7fb3d807de40 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.053+0000 7fb3bffff640 1 -- 172.21.15.2:0/983299928 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fb3c803aa30 con 0x7fb3d807de40 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.053+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d807c320 con 0x7fb3d807de40 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.054+0000 7fb3bffff640 1 --2- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb3c0038eb0 0x7fb3c003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.054+0000 7fb3bffff640 1 -- 172.21.15.2:0/983299928 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb3c806c5d0 con 0x7fb3d807de40 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.054+0000 7fb3d67fc640 1 --2- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb3c0038eb0 0x7fb3c003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.054+0000 7fb3d67fc640 1 --2- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb3c0038eb0 0x7fb3c003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0098c0 tx=0x7fb3cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.058+0000 7fb3bffff640 1 -- 172.21.15.2:0/983299928 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3c8044c70 con 0x7fb3d807de40 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.241+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fb3d8104320 con 0x7fb3c0038eb0 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.260+0000 7fb3bffff640 1 -- 172.21.15.2:0/983299928 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fb3c8045980 con 0x7fb3d807de40 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.318+0000 7fb3bffff640 1 -- 172.21.15.2:0/983299928 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fb3d8104320 con 0x7fb3c0038eb0 2024-09-12T00:44:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.320+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb3c0038eb0 msgr2=0x7fb3c003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.320+0000 7fb3dd60c640 1 --2- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb3c0038eb0 0x7fb3c003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0098c0 tx=0x7fb3cc006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.320+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 msgr2=0x7fb3d819da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.320+0000 7fb3dd60c640 1 --2- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d819da70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8030380 tx=0x7fb3c8032670 comp rx=0 tx=0).stop 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.321+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 shutdown_connections 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.321+0000 7fb3dd60c640 1 --2- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb3c0038eb0 0x7fb3c003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.321+0000 7fb3dd60c640 1 --2- 172.21.15.2:0/983299928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d807de40 0x7fb3d819da70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.321+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 >> 172.21.15.2:0/983299928 conn(0x7fb3d8102fd0 msgr2=0x7fb3d8103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.321+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 shutdown_connections 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:23.321+0000 7fb3dd60c640 1 -- 172.21.15.2:0/983299928 wait complete. 2024-09-12T00:44:23.858 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-09-12T00:44:24.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:24.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:24 smithi002 ceph-mon[31210]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:24.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:24 smithi002 ceph-mon[31210]: mgrmap e12: x(active, since 2s) 2024-09-12T00:44:24.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:24.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$7qBiY8DvqvRPDBxBCbXKSuCnARNNcB7IWmnp76dQlPDrQfEz4CBf6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726101864, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.266+0000 7f8597474640 1 Processor -- start 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.266+0000 7f8597474640 1 -- start start 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.266+0000 7f8597474640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f8590107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.267+0000 7f8597474640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85901082d0 con 0x7f8590107900 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.267+0000 7f8595210640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f8590107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.267+0000 7f8595210640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f8590107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48448/0 (socket says 172.21.15.2:48448) 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.267+0000 7f8595210640 1 -- 172.21.15.2:0/1699020515 learned_addr learned my addr 172.21.15.2:0/1699020515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:25.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.267+0000 7f8595210640 1 -- 172.21.15.2:0/1699020515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8590108b00 con 0x7f8590107900 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.268+0000 7f8595210640 1 --2- 172.21.15.2:0/1699020515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f8590107d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f858c009820 tx=0x7f858c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd99e8d410a4da9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.268+0000 7f8587fff640 1 -- 172.21.15.2:0/1699020515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858c037070 con 0x7f8590107900 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.268+0000 7f8587fff640 1 -- 172.21.15.2:0/1699020515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c032920 con 0x7f8590107900 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.268+0000 7f8587fff640 1 -- 172.21.15.2:0/1699020515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858c030810 con 0x7f8590107900 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.269+0000 7f8597474640 1 -- 172.21.15.2:0/1699020515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 msgr2=0x7f8590107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.269+0000 7f8597474640 1 --2- 172.21.15.2:0/1699020515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f8590107d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f858c009820 tx=0x7f858c02a270 comp rx=0 tx=0).stop 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.269+0000 7f8597474640 1 -- 172.21.15.2:0/1699020515 shutdown_connections 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.269+0000 7f8597474640 1 --2- 172.21.15.2:0/1699020515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f8590107d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.269+0000 7f8597474640 1 -- 172.21.15.2:0/1699020515 >> 172.21.15.2:0/1699020515 conn(0x7f85901030b0 msgr2=0x7f85901054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.269+0000 7f8597474640 1 -- 172.21.15.2:0/1699020515 shutdown_connections 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.269+0000 7f8597474640 1 -- 172.21.15.2:0/1699020515 wait complete. 2024-09-12T00:44:25.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.270+0000 7f8597474640 1 Processor -- start 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.270+0000 7f8597474640 1 -- start start 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.270+0000 7f8597474640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f859019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.270+0000 7f8597474640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f859010beb0 con 0x7f8590107900 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.270+0000 7f8595210640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f859019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.270+0000 7f8595210640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f859019b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48454/0 (socket says 172.21.15.2:48454) 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.270+0000 7f8595210640 1 -- 172.21.15.2:0/683901511 learned_addr learned my addr 172.21.15.2:0/683901511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.271+0000 7f8595210640 1 -- 172.21.15.2:0/683901511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859019be00 con 0x7f8590107900 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.271+0000 7f8595210640 1 --2- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f859019b8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f858c030560 tx=0x7f858c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.271+0000 7f85867fc640 1 -- 172.21.15.2:0/683901511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858c037040 con 0x7f8590107900 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.271+0000 7f85867fc640 1 -- 172.21.15.2:0/683901511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c040070 con 0x7f8590107900 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.271+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859019c090 con 0x7f8590107900 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.271+0000 7f85867fc640 1 -- 172.21.15.2:0/683901511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858c03a6d0 con 0x7f8590107900 2024-09-12T00:44:25.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.271+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859019ed80 con 0x7f8590107900 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.272+0000 7f85867fc640 1 -- 172.21.15.2:0/683901511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f858c03a940 con 0x7f8590107900 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.272+0000 7f85867fc640 1 --2- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f857c038fc0 0x7f857c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.272+0000 7f85867fc640 1 -- 172.21.15.2:0/683901511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f858c06c9d0 con 0x7f8590107900 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.272+0000 7f8594a0f640 1 --2- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f857c038fc0 0x7f857c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.272+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8590107d80 con 0x7f8590107900 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.273+0000 7f8594a0f640 1 --2- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f857c038fc0 0x7f857c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f85800098c0 tx=0x7f8580006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.277+0000 7f85867fc640 1 -- 172.21.15.2:0/683901511 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f858c041270 con 0x7f8590107900 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.477+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f859019c570 con 0x7f857c038fc0 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.726+0000 7f85867fc640 1 -- 172.21.15.2:0/683901511 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f859019c570 con 0x7f857c038fc0 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.728+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f857c038fc0 msgr2=0x7f857c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.728+0000 7f8597474640 1 --2- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f857c038fc0 0x7f857c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f85800098c0 tx=0x7f8580006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:25.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.728+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 msgr2=0x7f859019b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:25.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.729+0000 7f8597474640 1 --2- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f859019b8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f858c030560 tx=0x7f858c032670 comp rx=0 tx=0).stop 2024-09-12T00:44:25.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.729+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 shutdown_connections 2024-09-12T00:44:25.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.729+0000 7f8597474640 1 --2- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f857c038fc0 0x7f857c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:25.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.729+0000 7f8597474640 1 --2- 172.21.15.2:0/683901511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8590107900 0x7f859019b8c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:25.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.729+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 >> 172.21.15.2:0/683901511 conn(0x7f85901030b0 msgr2=0x7f8590103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:25.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.729+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 shutdown_connections 2024-09-12T00:44:25.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:24.729+0000 7f8597474640 1 -- 172.21.15.2:0/683901511 wait complete. 2024-09-12T00:44:25.443 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-09-12T00:44:25.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:25 smithi002 ceph-mon[31210]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:25.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:25 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:26.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:26 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1694850832' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.286+0000 7f229dccf640 1 Processor -- start 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.286+0000 7f229dccf640 1 -- start start 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.286+0000 7f229dccf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f2298106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.286+0000 7f229dccf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2298107150 con 0x7f2298106780 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.286+0000 7f22977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f2298106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.286+0000 7f22977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f2298106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36228/0 (socket says 172.21.15.2:36228) 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.286+0000 7f22977fe640 1 -- 172.21.15.2:0/2600926413 learned_addr learned my addr 172.21.15.2:0/2600926413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.287+0000 7f22977fe640 1 -- 172.21.15.2:0/2600926413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2298107980 con 0x7f2298106780 2024-09-12T00:44:27.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.287+0000 7f22977fe640 1 --2- 172.21.15.2:0/2600926413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f2298106b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2288009820 tx=0x7f228802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e682d2e713c0ea5b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.287+0000 7f22967fc640 1 -- 172.21.15.2:0/2600926413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2288037070 con 0x7f2298106780 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f22967fc640 1 -- 172.21.15.2:0/2600926413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2288032920 con 0x7f2298106780 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f22967fc640 1 -- 172.21.15.2:0/2600926413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2288030810 con 0x7f2298106780 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f229dccf640 1 -- 172.21.15.2:0/2600926413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 msgr2=0x7f2298106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f229dccf640 1 --2- 172.21.15.2:0/2600926413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f2298106b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2288009820 tx=0x7f228802a270 comp rx=0 tx=0).stop 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f229dccf640 1 -- 172.21.15.2:0/2600926413 shutdown_connections 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f229dccf640 1 --2- 172.21.15.2:0/2600926413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f2298106b80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f229dccf640 1 -- 172.21.15.2:0/2600926413 >> 172.21.15.2:0/2600926413 conn(0x7f2298101f10 msgr2=0x7f2298104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f229dccf640 1 -- 172.21.15.2:0/2600926413 shutdown_connections 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.288+0000 7f229dccf640 1 -- 172.21.15.2:0/2600926413 wait complete. 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.289+0000 7f229dccf640 1 Processor -- start 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.289+0000 7f229dccf640 1 -- start start 2024-09-12T00:44:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.289+0000 7f229dccf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f229819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.289+0000 7f229dccf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f229810ad30 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.289+0000 7f22977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f229819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.289+0000 7f22977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f229819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36240/0 (socket says 172.21.15.2:36240) 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.289+0000 7f22977fe640 1 -- 172.21.15.2:0/1694850832 learned_addr learned my addr 172.21.15.2:0/1694850832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.290+0000 7f22977fe640 1 -- 172.21.15.2:0/1694850832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229819be20 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.290+0000 7f22977fe640 1 --2- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f229819b8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2288030560 tx=0x7f2288032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.290+0000 7f2294ff9640 1 -- 172.21.15.2:0/1694850832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2288037040 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.290+0000 7f2294ff9640 1 -- 172.21.15.2:0/1694850832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2288040070 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.290+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229819c0b0 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.290+0000 7f2294ff9640 1 -- 172.21.15.2:0/1694850832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f228803a740 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.290+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f229819eda0 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.291+0000 7f2294ff9640 1 -- 172.21.15.2:0/1694850832 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f228803a9b0 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.291+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2298106c00 con 0x7f2298106780 2024-09-12T00:44:27.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.291+0000 7f2294ff9640 1 --2- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2280038fc0 0x7f228003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.291+0000 7f2294ff9640 1 -- 172.21.15.2:0/1694850832 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f228806c6e0 con 0x7f2298106780 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.292+0000 7f2296ffd640 1 --2- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2280038fc0 0x7f228003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.292+0000 7f2296ffd640 1 --2- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2280038fc0 0x7f228003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f228c0098c0 tx=0x7f228c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.296+0000 7f2294ff9640 1 -- 172.21.15.2:0/1694850832 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f228803adf0 con 0x7f2298106780 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.472+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f229802d9b0 con 0x7f2298106780 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.472+0000 7f2294ff9640 1 -- 172.21.15.2:0/1694850832 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f2288042e30 con 0x7f2298106780 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.474+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2280038fc0 msgr2=0x7f228003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.474+0000 7f229dccf640 1 --2- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2280038fc0 0x7f228003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f228c0098c0 tx=0x7f228c006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.474+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 msgr2=0x7f229819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.474+0000 7f229dccf640 1 --2- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f229819b8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2288030560 tx=0x7f2288032670 comp rx=0 tx=0).stop 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.474+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 shutdown_connections 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.474+0000 7f229dccf640 1 --2- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2280038fc0 0x7f228003b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.474+0000 7f229dccf640 1 --2- 172.21.15.2:0/1694850832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2298106780 0x7f229819b8e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.474+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 >> 172.21.15.2:0/1694850832 conn(0x7f2298101f10 msgr2=0x7f2298102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:27.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.475+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 shutdown_connections 2024-09-12T00:44:27.092 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:26.475+0000 7f229dccf640 1 -- 172.21.15.2:0/1694850832 wait complete. 2024-09-12T00:44:27.098 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T00:44:27.098 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-12T00:44:27.106 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T00:44:27.106 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-12T00:44:27.106 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-12T00:44:27.106 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T00:44:27.109 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-09-12T00:44:27.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:27.110 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-09-12T00:44:27.110 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-09-12T00:44:27.110 INFO:teuthology.orchestra.run.smithi002.stdout: Password: vetprg523w 2024-09-12T00:44:27.110 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:27.110 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config directory 2024-09-12T00:44:28.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.533+0000 7fcb5ccdd640 1 Processor -- start 2024-09-12T00:44:28.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.533+0000 7fcb5ccdd640 1 -- start start 2024-09-12T00:44:28.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.533+0000 7fcb5ccdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb5810a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:28.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.533+0000 7fcb5ccdd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5807be70 con 0x7fcb58108310 2024-09-12T00:44:28.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.534+0000 7fcb5659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb5810a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.534+0000 7fcb5659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb5810a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36256/0 (socket says 172.21.15.2:36256) 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.534+0000 7fcb5659c640 1 -- 172.21.15.2:0/2283716518 learned_addr learned my addr 172.21.15.2:0/2283716518 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.534+0000 7fcb5659c640 1 -- 172.21.15.2:0/2283716518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5810ac40 con 0x7fcb58108310 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.535+0000 7fcb5659c640 1 --2- 172.21.15.2:0/2283716518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb5810a700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009820 tx=0x7fcb4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1444abd3015227 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.535+0000 7fcb5559a640 1 -- 172.21.15.2:0/2283716518 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb48037070 con 0x7fcb58108310 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.535+0000 7fcb5559a640 1 -- 172.21.15.2:0/2283716518 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb48032920 con 0x7fcb58108310 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.535+0000 7fcb5559a640 1 -- 172.21.15.2:0/2283716518 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb48030810 con 0x7fcb58108310 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.536+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/2283716518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 msgr2=0x7fcb5810a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.536+0000 7fcb5ccdd640 1 --2- 172.21.15.2:0/2283716518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb5810a700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009820 tx=0x7fcb4802a270 comp rx=0 tx=0).stop 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.536+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/2283716518 shutdown_connections 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.536+0000 7fcb5ccdd640 1 --2- 172.21.15.2:0/2283716518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb5810a700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:28.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.536+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/2283716518 >> 172.21.15.2:0/2283716518 conn(0x7fcb58101f10 msgr2=0x7fcb58104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.536+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/2283716518 shutdown_connections 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.536+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/2283716518 wait complete. 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5ccdd640 1 Processor -- start 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5ccdd640 1 -- start start 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5ccdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb58107b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5ccdd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5810bbf0 con 0x7fcb58108310 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb58107b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb58107b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36266/0 (socket says 172.21.15.2:36266) 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5659c640 1 -- 172.21.15.2:0/3150270066 learned_addr learned my addr 172.21.15.2:0/3150270066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5659c640 1 -- 172.21.15.2:0/3150270066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb581080d0 con 0x7fcb58108310 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.537+0000 7fcb5659c640 1 --2- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb58107b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcb48030380 tx=0x7fcb48032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.538+0000 7fcb477fe640 1 -- 172.21.15.2:0/3150270066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb48037040 con 0x7fcb58108310 2024-09-12T00:44:28.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.538+0000 7fcb477fe640 1 -- 172.21.15.2:0/3150270066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb48040070 con 0x7fcb58108310 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.538+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb581062c0 con 0x7fcb58108310 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.538+0000 7fcb477fe640 1 -- 172.21.15.2:0/3150270066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4803a7b0 con 0x7fcb58108310 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.538+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb58106800 con 0x7fcb58108310 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.539+0000 7fcb477fe640 1 -- 172.21.15.2:0/3150270066 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fcb4803aa30 con 0x7fcb58108310 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.539+0000 7fcb477fe640 1 --2- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcb40038fc0 0x7fcb4003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.539+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb58108770 con 0x7fcb58108310 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.539+0000 7fcb477fe640 1 -- 172.21.15.2:0/3150270066 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcb4806c7e0 con 0x7fcb58108310 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.539+0000 7fcb55d9b640 1 --2- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcb40038fc0 0x7fcb4003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:28.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.539+0000 7fcb55d9b640 1 --2- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcb40038fc0 0x7fcb4003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0098c0 tx=0x7fcb4c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.544+0000 7fcb477fe640 1 -- 172.21.15.2:0/3150270066 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb48044c70 con 0x7fcb58108310 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.728+0000 7fcb477fe640 1 -- 172.21.15.2:0/3150270066 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fcb48045980 con 0x7fcb58108310 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.817+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fcb58106fa0 con 0x7fcb58108310 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.819+0000 7fcb477fe640 1 -- 172.21.15.2:0/3150270066 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fcb48041270 con 0x7fcb58108310 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcb40038fc0 msgr2=0x7fcb4003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 --2- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcb40038fc0 0x7fcb4003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0098c0 tx=0x7fcb4c006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 msgr2=0x7fcb58107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 --2- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb58107b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcb48030380 tx=0x7fcb48032670 comp rx=0 tx=0).stop 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 shutdown_connections 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 --2- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcb40038fc0 0x7fcb4003b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 --2- 172.21.15.2:0/3150270066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58108310 0x7fcb58107b90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:28.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 >> 172.21.15.2:0/3150270066 conn(0x7fcb58101f10 msgr2=0x7fcb58102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 shutdown_connections 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-12T00:44:27.821+0000 7fcb5ccdd640 1 -- 172.21.15.2:0/3150270066 wait complete. 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-09-12T00:44:28.445 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:28.445 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T00:44:28.445 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:28.445 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-09-12T00:44:28.479 INFO:tasks.cephadm:Fetching config... 2024-09-12T00:44:28.479 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:44:28.479 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T00:44:28.496 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T00:44:28.497 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:44:28.497 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T00:44:28.552 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T00:44:28.553 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:44:28.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T00:44:28.621 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T00:44:28.621 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:44:28.622 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T00:44:28.677 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T00:44:28.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgtOlD4oXnyr089VXyV3Kkusltgnjy7s9UQKcuTVBPbLSwPAC1c+kGJ9QSdRj5U21UZH1WdtP5hb5aKiIV0gLoy4XAQBOhLaxiA5iTGWuygKthIz6nmX2lEfXNLhiHQkK6pYMyoK4uUgxLc0UqAqL5iQ58ANSFbVIVgSnbIl2LTceHodFhiyDvpT3IPsEkP9i3ruFk3O9tJRifjqbTvBqDS6/zr52bnq8nLEcC2UDCEyeUGPGqRKCACuKiSjvBYj+Ims5YLHKXTM1jYgTqpvHrL/EcseNBSJvV9vA31KyBflT1BTGUQN5ed9eIM/RfQjUMRX+vzk3odSZpw7pm8mR5YTzcjqDy98vFn0Hf3nvn6r2dSMnM+J7+eglIyyad1I1l+GYA5PPdjU+XlOmRZ1fVExDKhP/pUQAB9HJZO4dqZ2LdDwdZZjRObvBuSLtikfbiP76XOEB5BX5fPKaeBWab0AfnfKLcwNvIx59ykH96Ztto1FmwKUgn49ggzxFQiFU= ceph-c8315cee-709f-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T00:44:28.753 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgtOlD4oXnyr089VXyV3Kkusltgnjy7s9UQKcuTVBPbLSwPAC1c+kGJ9QSdRj5U21UZH1WdtP5hb5aKiIV0gLoy4XAQBOhLaxiA5iTGWuygKthIz6nmX2lEfXNLhiHQkK6pYMyoK4uUgxLc0UqAqL5iQ58ANSFbVIVgSnbIl2LTceHodFhiyDvpT3IPsEkP9i3ruFk3O9tJRifjqbTvBqDS6/zr52bnq8nLEcC2UDCEyeUGPGqRKCACuKiSjvBYj+Ims5YLHKXTM1jYgTqpvHrL/EcseNBSJvV9vA31KyBflT1BTGUQN5ed9eIM/RfQjUMRX+vzk3odSZpw7pm8mR5YTzcjqDy98vFn0Hf3nvn6r2dSMnM+J7+eglIyyad1I1l+GYA5PPdjU+XlOmRZ1fVExDKhP/pUQAB9HJZO4dqZ2LdDwdZZjRObvBuSLtikfbiP76XOEB5BX5fPKaeBWab0AfnfKLcwNvIx59ykH96Ztto1FmwKUgn49ggzxFQiFU= ceph-c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:44:28.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgtOlD4oXnyr089VXyV3Kkusltgnjy7s9UQKcuTVBPbLSwPAC1c+kGJ9QSdRj5U21UZH1WdtP5hb5aKiIV0gLoy4XAQBOhLaxiA5iTGWuygKthIz6nmX2lEfXNLhiHQkK6pYMyoK4uUgxLc0UqAqL5iQ58ANSFbVIVgSnbIl2LTceHodFhiyDvpT3IPsEkP9i3ruFk3O9tJRifjqbTvBqDS6/zr52bnq8nLEcC2UDCEyeUGPGqRKCACuKiSjvBYj+Ims5YLHKXTM1jYgTqpvHrL/EcseNBSJvV9vA31KyBflT1BTGUQN5ed9eIM/RfQjUMRX+vzk3odSZpw7pm8mR5YTzcjqDy98vFn0Hf3nvn6r2dSMnM+J7+eglIyyad1I1l+GYA5PPdjU+XlOmRZ1fVExDKhP/pUQAB9HJZO4dqZ2LdDwdZZjRObvBuSLtikfbiP76XOEB5BX5fPKaeBWab0AfnfKLcwNvIx59ykH96Ztto1FmwKUgn49ggzxFQiFU= ceph-c8315cee-709f-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T00:44:28.806 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgtOlD4oXnyr089VXyV3Kkusltgnjy7s9UQKcuTVBPbLSwPAC1c+kGJ9QSdRj5U21UZH1WdtP5hb5aKiIV0gLoy4XAQBOhLaxiA5iTGWuygKthIz6nmX2lEfXNLhiHQkK6pYMyoK4uUgxLc0UqAqL5iQ58ANSFbVIVgSnbIl2LTceHodFhiyDvpT3IPsEkP9i3ruFk3O9tJRifjqbTvBqDS6/zr52bnq8nLEcC2UDCEyeUGPGqRKCACuKiSjvBYj+Ims5YLHKXTM1jYgTqpvHrL/EcseNBSJvV9vA31KyBflT1BTGUQN5ed9eIM/RfQjUMRX+vzk3odSZpw7pm8mR5YTzcjqDy98vFn0Hf3nvn6r2dSMnM+J7+eglIyyad1I1l+GYA5PPdjU+XlOmRZ1fVExDKhP/pUQAB9HJZO4dqZ2LdDwdZZjRObvBuSLtikfbiP76XOEB5BX5fPKaeBWab0AfnfKLcwNvIx59ykH96Ztto1FmwKUgn49ggzxFQiFU= ceph-c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:44:28.818 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgtOlD4oXnyr089VXyV3Kkusltgnjy7s9UQKcuTVBPbLSwPAC1c+kGJ9QSdRj5U21UZH1WdtP5hb5aKiIV0gLoy4XAQBOhLaxiA5iTGWuygKthIz6nmX2lEfXNLhiHQkK6pYMyoK4uUgxLc0UqAqL5iQ58ANSFbVIVgSnbIl2LTceHodFhiyDvpT3IPsEkP9i3ruFk3O9tJRifjqbTvBqDS6/zr52bnq8nLEcC2UDCEyeUGPGqRKCACuKiSjvBYj+Ims5YLHKXTM1jYgTqpvHrL/EcseNBSJvV9vA31KyBflT1BTGUQN5ed9eIM/RfQjUMRX+vzk3odSZpw7pm8mR5YTzcjqDy98vFn0Hf3nvn6r2dSMnM+J7+eglIyyad1I1l+GYA5PPdjU+XlOmRZ1fVExDKhP/pUQAB9HJZO4dqZ2LdDwdZZjRObvBuSLtikfbiP76XOEB5BX5fPKaeBWab0AfnfKLcwNvIx59ykH96Ztto1FmwKUgn49ggzxFQiFU= ceph-c8315cee-709f-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T00:44:28.862 INFO:teuthology.orchestra.run.smithi167.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgtOlD4oXnyr089VXyV3Kkusltgnjy7s9UQKcuTVBPbLSwPAC1c+kGJ9QSdRj5U21UZH1WdtP5hb5aKiIV0gLoy4XAQBOhLaxiA5iTGWuygKthIz6nmX2lEfXNLhiHQkK6pYMyoK4uUgxLc0UqAqL5iQ58ANSFbVIVgSnbIl2LTceHodFhiyDvpT3IPsEkP9i3ruFk3O9tJRifjqbTvBqDS6/zr52bnq8nLEcC2UDCEyeUGPGqRKCACuKiSjvBYj+Ims5YLHKXTM1jYgTqpvHrL/EcseNBSJvV9vA31KyBflT1BTGUQN5ed9eIM/RfQjUMRX+vzk3odSZpw7pm8mR5YTzcjqDy98vFn0Hf3nvn6r2dSMnM+J7+eglIyyad1I1l+GYA5PPdjU+XlOmRZ1fVExDKhP/pUQAB9HJZO4dqZ2LdDwdZZjRObvBuSLtikfbiP76XOEB5BX5fPKaeBWab0AfnfKLcwNvIx59ykH96Ztto1FmwKUgn49ggzxFQiFU= ceph-c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:44:28.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T00:44:28.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:28 smithi002 ceph-mon[31210]: mgrmap e13: x(active, since 6s) 2024-09-12T00:44:28.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:28 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3150270066' entity='client.admin' 2024-09-12T00:44:29.127 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:44:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.622+0000 7f51b602f640 1 -- 172.21.15.2:0/2682386344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 msgr2=0x7f51b01019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.622+0000 7f51b602f640 1 --2- 172.21.15.2:0/2682386344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 0x7f51b01019f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009880 tx=0x7f51a002a5d0 comp rx=0 tx=0).stop 2024-09-12T00:44:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.622+0000 7f51b602f640 1 -- 172.21.15.2:0/2682386344 shutdown_connections 2024-09-12T00:44:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.622+0000 7f51b602f640 1 --2- 172.21.15.2:0/2682386344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 0x7f51b01019f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.622+0000 7f51b602f640 1 -- 172.21.15.2:0/2682386344 >> 172.21.15.2:0/2682386344 conn(0x7f51b00fcd80 msgr2=0x7f51b00ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.622+0000 7f51b602f640 1 -- 172.21.15.2:0/2682386344 shutdown_connections 2024-09-12T00:44:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.622+0000 7f51b602f640 1 -- 172.21.15.2:0/2682386344 wait complete. 2024-09-12T00:44:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.623+0000 7f51b602f640 1 Processor -- start 2024-09-12T00:44:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.623+0000 7f51b602f640 1 -- start start 2024-09-12T00:44:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.623+0000 7f51b602f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 0x7f51b0196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.623+0000 7f51b602f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0107700 con 0x7f51b01015f0 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.623+0000 7f51af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 0x7f51b0196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.623+0000 7f51af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 0x7f51b0196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36278/0 (socket says 172.21.15.2:36278) 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.623+0000 7f51af7fe640 1 -- 172.21.15.2:0/806589288 learned_addr learned my addr 172.21.15.2:0/806589288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.624+0000 7f51af7fe640 1 -- 172.21.15.2:0/806589288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b01972d0 con 0x7f51b01015f0 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.624+0000 7f51af7fe640 1 --2- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 0x7f51b0196d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004f60 tx=0x7f51a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.624+0000 7f51acff9640 1 -- 172.21.15.2:0/806589288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a003f070 con 0x7f51b01015f0 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.624+0000 7f51acff9640 1 -- 172.21.15.2:0/806589288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51a0004cc0 con 0x7f51b01015f0 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.624+0000 7f51acff9640 1 -- 172.21.15.2:0/806589288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a0035030 con 0x7f51b01015f0 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.624+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b0197560 con 0x7f51b01015f0 2024-09-12T00:44:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.624+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b019a210 con 0x7f51b01015f0 2024-09-12T00:44:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.625+0000 7f51acff9640 1 -- 172.21.15.2:0/806589288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f51a0042070 con 0x7f51b01015f0 2024-09-12T00:44:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.625+0000 7f51acff9640 1 --2- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5198039060 0x7f519803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.625+0000 7f51acff9640 1 -- 172.21.15.2:0/806589288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f51a006cf00 con 0x7f51b01015f0 2024-09-12T00:44:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.625+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b0107e80 con 0x7f51b01015f0 2024-09-12T00:44:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.625+0000 7f51aeffd640 1 --2- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5198039060 0x7f519803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.626+0000 7f51aeffd640 1 --2- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5198039060 0x7f519803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51a40098c0 tx=0x7f51a4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.630+0000 7f51acff9640 1 -- 172.21.15.2:0/806589288 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51a00433b0 con 0x7f51b01015f0 2024-09-12T00:44:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.806+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f51b002d940 con 0x7f51b01015f0 2024-09-12T00:44:29.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.808+0000 7f51acff9640 1 -- 172.21.15.2:0/806589288 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f51a0003dd0 con 0x7f51b01015f0 2024-09-12T00:44:29.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.810+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5198039060 msgr2=0x7f519803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:29.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.810+0000 7f51b602f640 1 --2- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5198039060 0x7f519803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51a40098c0 tx=0x7f51a4006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:29.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.810+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 msgr2=0x7f51b0196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:29.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.810+0000 7f51b602f640 1 --2- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 0x7f51b0196d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004f60 tx=0x7f51a00048f0 comp rx=0 tx=0).stop 2024-09-12T00:44:29.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.811+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 shutdown_connections 2024-09-12T00:44:29.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.811+0000 7f51b602f640 1 --2- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5198039060 0x7f519803b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:29.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.811+0000 7f51b602f640 1 --2- 172.21.15.2:0/806589288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b01015f0 0x7f51b0196d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:29.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.811+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 >> 172.21.15.2:0/806589288 conn(0x7f51b00fcd80 msgr2=0x7f51b00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:29.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.811+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 shutdown_connections 2024-09-12T00:44:29.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:29.811+0000 7f51b602f640 1 -- 172.21.15.2:0/806589288 wait complete. 2024-09-12T00:44:30.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:30 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/806589288' entity='client.admin' 2024-09-12T00:44:31.225 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T00:44:31.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T00:44:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:44:32.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.382+0000 7fc143c08640 1 -- 172.21.15.2:0/906556512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 msgr2=0x7fc13c100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:32.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.382+0000 7fc143c08640 1 --2- 172.21.15.2:0/906556512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 0x7fc13c100910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc138009880 tx=0x7fc13802a5d0 comp rx=0 tx=0).stop 2024-09-12T00:44:32.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.382+0000 7fc143c08640 1 -- 172.21.15.2:0/906556512 shutdown_connections 2024-09-12T00:44:32.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.382+0000 7fc143c08640 1 --2- 172.21.15.2:0/906556512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 0x7fc13c100910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:32.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.382+0000 7fc143c08640 1 -- 172.21.15.2:0/906556512 >> 172.21.15.2:0/906556512 conn(0x7fc13c0fbc80 msgr2=0x7fc13c0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:32.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.382+0000 7fc143c08640 1 -- 172.21.15.2:0/906556512 shutdown_connections 2024-09-12T00:44:32.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.382+0000 7fc143c08640 1 -- 172.21.15.2:0/906556512 wait complete. 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.382+0000 7fc143c08640 1 Processor -- start 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc143c08640 1 -- start start 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc143c08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 0x7fc13c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc143c08640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c106620 con 0x7fc13c100510 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc1419a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 0x7fc13c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc1419a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 0x7fc13c06a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36292/0 (socket says 172.21.15.2:36292) 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc1419a4640 1 -- 172.21.15.2:0/1153880775 learned_addr learned my addr 172.21.15.2:0/1153880775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc1419a4640 1 -- 172.21.15.2:0/1153880775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c199aa0 con 0x7fc13c100510 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc1419a4640 1 --2- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 0x7fc13c06a990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc138004f60 tx=0x7fc1380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc132ffd640 1 -- 172.21.15.2:0/1153880775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc13803f070 con 0x7fc13c100510 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc132ffd640 1 -- 172.21.15.2:0/1153880775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc138004d40 con 0x7fc13c100510 2024-09-12T00:44:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc132ffd640 1 -- 172.21.15.2:0/1153880775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc138035030 con 0x7fc13c100510 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13c199c70 con 0x7fc13c100510 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.383+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13c19a090 con 0x7fc13c100510 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.384+0000 7fc132ffd640 1 -- 172.21.15.2:0/1153880775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fc138042070 con 0x7fc13c100510 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.384+0000 7fc132ffd640 1 --2- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc128039060 0x7fc12803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.384+0000 7fc132ffd640 1 -- 172.21.15.2:0/1153880775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc13806cce0 con 0x7fc13c100510 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.384+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13c106da0 con 0x7fc13c100510 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.385+0000 7fc1411a3640 1 --2- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc128039060 0x7fc12803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.385+0000 7fc1411a3640 1 --2- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc128039060 0x7fc12803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0098c0 tx=0x7fc12c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.389+0000 7fc132ffd640 1 -- 172.21.15.2:0/1153880775 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc138042360 con 0x7fc13c100510 2024-09-12T00:44:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.569+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fc13c02da10 con 0x7fc128039060 2024-09-12T00:44:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.572+0000 7fc132ffd640 1 -- 172.21.15.2:0/1153880775 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc13c02da10 con 0x7fc128039060 2024-09-12T00:44:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc128039060 msgr2=0x7fc12803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 --2- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc128039060 0x7fc12803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0098c0 tx=0x7fc12c006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 msgr2=0x7fc13c06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 --2- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 0x7fc13c06a990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc138004f60 tx=0x7fc1380048f0 comp rx=0 tx=0).stop 2024-09-12T00:44:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 shutdown_connections 2024-09-12T00:44:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 --2- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc128039060 0x7fc12803b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 --2- 172.21.15.2:0/1153880775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13c100510 0x7fc13c06a990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 >> 172.21.15.2:0/1153880775 conn(0x7fc13c0fbc80 msgr2=0x7fc13c0fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 shutdown_connections 2024-09-12T00:44:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:32.574+0000 7fc143c08640 1 -- 172.21.15.2:0/1153880775 wait complete. 2024-09-12T00:44:33.249 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:33.249 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:33.249 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:44:33.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:32 smithi002 ceph-mon[31210]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-12T00:44:33.351 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi071 2024-09-12T00:44:33.351 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:44:33.351 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.conf 2024-09-12T00:44:33.371 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:44:33.372 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:44:33.430 INFO:tasks.cephadm:Adding host smithi071 to orchestrator... 2024-09-12T00:44:33.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch host add smithi071 2024-09-12T00:44:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:44:34.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.088+0000 7f8e0e59e640 1 -- 172.21.15.2:0/375519999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 msgr2=0x7f8e08100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:34.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.088+0000 7f8e0e59e640 1 --2- 172.21.15.2:0/375519999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 0x7f8e08100920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009880 tx=0x7f8e0402a5d0 comp rx=0 tx=0).stop 2024-09-12T00:44:34.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.088+0000 7f8e0e59e640 1 -- 172.21.15.2:0/375519999 shutdown_connections 2024-09-12T00:44:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.088+0000 7f8e0e59e640 1 --2- 172.21.15.2:0/375519999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 0x7f8e08100920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.088+0000 7f8e0e59e640 1 -- 172.21.15.2:0/375519999 >> 172.21.15.2:0/375519999 conn(0x7f8e080fbfc0 msgr2=0x7f8e080fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.089+0000 7f8e0e59e640 1 -- 172.21.15.2:0/375519999 shutdown_connections 2024-09-12T00:44:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.089+0000 7f8e0e59e640 1 -- 172.21.15.2:0/375519999 wait complete. 2024-09-12T00:44:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.089+0000 7f8e0e59e640 1 Processor -- start 2024-09-12T00:44:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.089+0000 7f8e0e59e640 1 -- start start 2024-09-12T00:44:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0e59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 0x7f8e080fc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0e59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0810a990 con 0x7f8e08100540 2024-09-12T00:44:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0d59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 0x7f8e080fc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0d59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 0x7f8e080fc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36298/0 (socket says 172.21.15.2:36298) 2024-09-12T00:44:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0d59c640 1 -- 172.21.15.2:0/2432193123 learned_addr learned my addr 172.21.15.2:0/2432193123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0d59c640 1 -- 172.21.15.2:0/2432193123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e080fe360 con 0x7f8e08100540 2024-09-12T00:44:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0d59c640 1 --2- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 0x7f8e080fc470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009230 tx=0x7f8e04003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8dfe7fc640 1 -- 172.21.15.2:0/2432193123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e0403f070 con 0x7f8e08100540 2024-09-12T00:44:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8dfe7fc640 1 -- 172.21.15.2:0/2432193123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0403bc80 con 0x7f8e08100540 2024-09-12T00:44:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e080fca10 con 0x7f8e08100540 2024-09-12T00:44:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8dfe7fc640 1 -- 172.21.15.2:0/2432193123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e04035030 con 0x7f8e08100540 2024-09-12T00:44:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.090+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e080fced0 con 0x7f8e08100540 2024-09-12T00:44:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.091+0000 7f8dfe7fc640 1 -- 172.21.15.2:0/2432193123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f8e04042070 con 0x7f8e08100540 2024-09-12T00:44:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.091+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e08101a20 con 0x7f8e08100540 2024-09-12T00:44:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.092+0000 7f8dfe7fc640 1 --2- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8df4039060 0x7f8df403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.092+0000 7f8dfe7fc640 1 -- 172.21.15.2:0/2432193123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8e0406cd40 con 0x7f8e08100540 2024-09-12T00:44:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.092+0000 7f8e0cd9b640 1 --2- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8df4039060 0x7f8df403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.092+0000 7f8e0cd9b640 1 --2- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8df4039060 0x7f8df403b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8df80098c0 tx=0x7f8df8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:34.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.096+0000 7f8dfe7fc640 1 -- 172.21.15.2:0/2432193123 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e0404c350 con 0x7f8e08100540 2024-09-12T00:44:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:34.276+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}) -- 0x7f8e080fda10 con 0x7f8df4039060 2024-09-12T00:44:34.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:34 smithi002 ceph-mon[31210]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:44:34.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:34 smithi002 ceph-mon[31210]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:44:34.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:34 smithi002 ceph-mon[31210]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:44:34.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:34.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:34.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:35.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:35 smithi002 ceph-mon[31210]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:36.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:36 smithi002 ceph-mon[31210]: Deploying cephadm binary to smithi071 2024-09-12T00:44:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.103+0000 7f8dfe7fc640 1 -- 172.21.15.2:0/2432193123 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8e080fda10 con 0x7f8df4039060 2024-09-12T00:44:38.102 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi071' with addr '172.21.15.71' 2024-09-12T00:44:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.105+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8df4039060 msgr2=0x7f8df403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.105+0000 7f8e0e59e640 1 --2- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8df4039060 0x7f8df403b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8df80098c0 tx=0x7f8df8006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.105+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 msgr2=0x7f8e080fc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.105+0000 7f8e0e59e640 1 --2- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 0x7f8e080fc470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009230 tx=0x7f8e04003d40 comp rx=0 tx=0).stop 2024-09-12T00:44:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.105+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 shutdown_connections 2024-09-12T00:44:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.105+0000 7f8e0e59e640 1 --2- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8df4039060 0x7f8df403b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.105+0000 7f8e0e59e640 1 --2- 172.21.15.2:0/2432193123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e08100540 0x7f8e080fc470 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.105+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 >> 172.21.15.2:0/2432193123 conn(0x7f8e080fbfc0 msgr2=0x7f8e08103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.106+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 shutdown_connections 2024-09-12T00:44:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:38.106+0000 7f8e0e59e640 1 -- 172.21.15.2:0/2432193123 wait complete. 2024-09-12T00:44:38.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T00:44:38.977 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:44:39.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:39.386 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:39 smithi002 ceph-mon[31210]: Added host smithi071 2024-09-12T00:44:39.386 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:44:39.386 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:39.386 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.411+0000 7f5a94752640 1 -- 172.21.15.2:0/1727963416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 msgr2=0x7f5a8c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.411+0000 7f5a94752640 1 --2- 172.21.15.2:0/1727963416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 0x7f5a8c107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009880 tx=0x7f5a8802a5d0 comp rx=0 tx=0).stop 2024-09-12T00:44:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.411+0000 7f5a94752640 1 -- 172.21.15.2:0/1727963416 shutdown_connections 2024-09-12T00:44:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.411+0000 7f5a94752640 1 --2- 172.21.15.2:0/1727963416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 0x7f5a8c107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:39.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.411+0000 7f5a94752640 1 -- 172.21.15.2:0/1727963416 >> 172.21.15.2:0/1727963416 conn(0x7f5a8c0fd290 msgr2=0x7f5a8c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:39.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.411+0000 7f5a94752640 1 -- 172.21.15.2:0/1727963416 shutdown_connections 2024-09-12T00:44:39.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.411+0000 7f5a94752640 1 -- 172.21.15.2:0/1727963416 wait complete. 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.412+0000 7f5a94752640 1 Processor -- start 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.412+0000 7f5a94752640 1 -- start start 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.412+0000 7f5a94752640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 0x7f5a8c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.412+0000 7f5a94752640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c10bc90 con 0x7f5a8c107660 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.412+0000 7f5a924ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 0x7f5a8c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.412+0000 7f5a924ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 0x7f5a8c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42014/0 (socket says 172.21.15.2:42014) 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.412+0000 7f5a924ee640 1 -- 172.21.15.2:0/3003627350 learned_addr learned my addr 172.21.15.2:0/3003627350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.412+0000 7f5a924ee640 1 -- 172.21.15.2:0/3003627350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c199860 con 0x7f5a8c107660 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.413+0000 7f5a924ee640 1 --2- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 0x7f5a8c199320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009230 tx=0x7f5a88003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.413+0000 7f5a837fe640 1 -- 172.21.15.2:0/3003627350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a8803f070 con 0x7f5a8c107660 2024-09-12T00:44:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.413+0000 7f5a837fe640 1 -- 172.21.15.2:0/3003627350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a8803bc80 con 0x7f5a8c107660 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.413+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8c199af0 con 0x7f5a8c107660 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.413+0000 7f5a837fe640 1 -- 172.21.15.2:0/3003627350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a88035030 con 0x7f5a8c107660 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.413+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8c19dbf0 con 0x7f5a8c107660 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.414+0000 7f5a837fe640 1 -- 172.21.15.2:0/3003627350 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f5a88042070 con 0x7f5a8c107660 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.414+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8c102cd0 con 0x7f5a8c107660 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.414+0000 7f5a837fe640 1 --2- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5a78039060 0x7f5a7803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.414+0000 7f5a837fe640 1 -- 172.21.15.2:0/3003627350 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5a8806cd10 con 0x7f5a8c107660 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.414+0000 7f5a91ced640 1 --2- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5a78039060 0x7f5a7803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.415+0000 7f5a91ced640 1 --2- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5a78039060 0x7f5a7803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0098c0 tx=0x7f5a7c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:39.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.419+0000 7f5a837fe640 1 -- 172.21.15.2:0/3003627350 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a88031e20 con 0x7f5a8c107660 2024-09-12T00:44:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.613+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a8c19a680 con 0x7f5a78039060 2024-09-12T00:44:39.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.614+0000 7f5a837fe640 1 -- 172.21.15.2:0/3003627350 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f5a8c19a680 con 0x7f5a78039060 2024-09-12T00:44:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}] 2024-09-12T00:44:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.616+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5a78039060 msgr2=0x7f5a7803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.616+0000 7f5a94752640 1 --2- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5a78039060 0x7f5a7803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0098c0 tx=0x7f5a7c006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.616+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 msgr2=0x7f5a8c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.616+0000 7f5a94752640 1 --2- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 0x7f5a8c199320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009230 tx=0x7f5a88003d40 comp rx=0 tx=0).stop 2024-09-12T00:44:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.616+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 shutdown_connections 2024-09-12T00:44:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.616+0000 7f5a94752640 1 --2- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5a78039060 0x7f5a7803b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.616+0000 7f5a94752640 1 --2- 172.21.15.2:0/3003627350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a8c107660 0x7f5a8c199320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.616+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 >> 172.21.15.2:0/3003627350 conn(0x7f5a8c0fd290 msgr2=0x7f5a8c075e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.617+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 shutdown_connections 2024-09-12T00:44:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:39.617+0000 7f5a94752640 1 -- 172.21.15.2:0/3003627350 wait complete. 2024-09-12T00:44:40.226 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi167 2024-09-12T00:44:40.226 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:44:40.226 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.conf 2024-09-12T00:44:40.245 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:44:40.245 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:44:40.305 INFO:tasks.cephadm:Adding host smithi167 to orchestrator... 2024-09-12T00:44:40.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch host add smithi167 2024-09-12T00:44:40.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:40.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:40 smithi002 ceph-mon[31210]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:44:40.559 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:44:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.977+0000 7f06487c1640 1 -- 172.21.15.2:0/2107805693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 msgr2=0x7f0640106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.977+0000 7f06487c1640 1 --2- 172.21.15.2:0/2107805693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 0x7f0640106920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0630009c10 tx=0x7f063002aa10 comp rx=0 tx=0).stop 2024-09-12T00:44:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.977+0000 7f06487c1640 1 -- 172.21.15.2:0/2107805693 shutdown_connections 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.977+0000 7f06487c1640 1 --2- 172.21.15.2:0/2107805693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 0x7f0640106920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.977+0000 7f06487c1640 1 -- 172.21.15.2:0/2107805693 >> 172.21.15.2:0/2107805693 conn(0x7f0640077310 msgr2=0x7f06400fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.977+0000 7f06487c1640 1 -- 172.21.15.2:0/2107805693 shutdown_connections 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.977+0000 7f06487c1640 1 -- 172.21.15.2:0/2107805693 wait complete. 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.977+0000 7f06487c1640 1 Processor -- start 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f06487c1640 1 -- start start 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f06487c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 0x7f06401970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f06487c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f064010ab70 con 0x7f0640106540 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f064655d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 0x7f06401970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f064655d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 0x7f06401970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42032/0 (socket says 172.21.15.2:42032) 2024-09-12T00:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f064655d640 1 -- 172.21.15.2:0/440912287 learned_addr learned my addr 172.21.15.2:0/440912287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f064655d640 1 -- 172.21.15.2:0/440912287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0640197620 con 0x7f0640106540 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f064655d640 1 --2- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 0x7f06401970e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0630005dd0 tx=0x7f0630030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.978+0000 7f063f7fe640 1 -- 172.21.15.2:0/440912287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0630034070 con 0x7f0640106540 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.979+0000 7f063f7fe640 1 -- 172.21.15.2:0/440912287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f063002f8c0 con 0x7f0640106540 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.979+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06401978b0 con 0x7f0640106540 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.979+0000 7f063f7fe640 1 -- 172.21.15.2:0/440912287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0630004520 con 0x7f0640106540 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.979+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0640197cd0 con 0x7f0640106540 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.979+0000 7f063f7fe640 1 -- 172.21.15.2:0/440912287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f0630037020 con 0x7f0640106540 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.980+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0640101bb0 con 0x7f0640106540 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.980+0000 7f063f7fe640 1 --2- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0628039060 0x7f062803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.980+0000 7f063f7fe640 1 -- 172.21.15.2:0/440912287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f063006cf20 con 0x7f0640106540 2024-09-12T00:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.980+0000 7f0645d5c640 1 --2- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0628039060 0x7f062803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.980+0000 7f0645d5c640 1 --2- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0628039060 0x7f062803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f06340098c0 tx=0x7f0634006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:40.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:40.984+0000 7f063f7fe640 1 -- 172.21.15.2:0/440912287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f063003f070 con 0x7f0640106540 2024-09-12T00:44:41.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:41.163+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}) -- 0x7f06401984e0 con 0x7f0628039060 2024-09-12T00:44:42.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:41 smithi002 ceph-mon[31210]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:42.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:41 smithi002 ceph-mon[31210]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:43.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: Deploying cephadm binary to smithi167 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:43.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:43.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:44.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:44 smithi002 ceph-mon[31210]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:44.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:44 smithi002 ceph-mon[31210]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:44:45.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.006+0000 7f063f7fe640 1 -- 172.21.15.2:0/440912287 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f06401984e0 con 0x7f0628039060 2024-09-12T00:44:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi167' with addr '172.21.15.167' 2024-09-12T00:44:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0628039060 msgr2=0x7f062803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 --2- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0628039060 0x7f062803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f06340098c0 tx=0x7f0634006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 msgr2=0x7f06401970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 --2- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 0x7f06401970e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0630005dd0 tx=0x7f0630030c30 comp rx=0 tx=0).stop 2024-09-12T00:44:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 shutdown_connections 2024-09-12T00:44:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 --2- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0628039060 0x7f062803b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 --2- 172.21.15.2:0/440912287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0640106540 0x7f06401970e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 >> 172.21.15.2:0/440912287 conn(0x7f0640077310 msgr2=0x7f06400696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 shutdown_connections 2024-09-12T00:44:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:45.008+0000 7f06487c1640 1 -- 172.21.15.2:0/440912287 wait complete. 2024-09-12T00:44:45.657 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T00:44:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:44:46.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:46 smithi002 ceph-mon[31210]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:46.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:46.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:46 smithi002 ceph-mon[31210]: Added host smithi167 2024-09-12T00:44:46.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:44:46.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:46.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:46.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.358+0000 7f35e8eb4640 1 -- 172.21.15.2:0/3909256523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 msgr2=0x7f35e4106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:46.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.358+0000 7f35e8eb4640 1 --2- 172.21.15.2:0/3909256523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 0x7f35e4106950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009880 tx=0x7f35d402a5d0 comp rx=0 tx=0).stop 2024-09-12T00:44:46.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.358+0000 7f35e8eb4640 1 -- 172.21.15.2:0/3909256523 shutdown_connections 2024-09-12T00:44:46.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.358+0000 7f35e8eb4640 1 --2- 172.21.15.2:0/3909256523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 0x7f35e4106950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:46.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.358+0000 7f35e8eb4640 1 -- 172.21.15.2:0/3909256523 >> 172.21.15.2:0/3909256523 conn(0x7f35e40fc1a0 msgr2=0x7f35e40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:46.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.358+0000 7f35e8eb4640 1 -- 172.21.15.2:0/3909256523 shutdown_connections 2024-09-12T00:44:46.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.358+0000 7f35e8eb4640 1 -- 172.21.15.2:0/3909256523 wait complete. 2024-09-12T00:44:46.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.359+0000 7f35e8eb4640 1 Processor -- start 2024-09-12T00:44:46.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.359+0000 7f35e8eb4640 1 -- start start 2024-09-12T00:44:46.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.359+0000 7f35e8eb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 0x7f35e40fc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:46.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.359+0000 7f35e8eb4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35e410aba0 con 0x7f35e4106570 2024-09-12T00:44:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.359+0000 7f35e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 0x7f35e40fc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.359+0000 7f35e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 0x7f35e40fc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54126/0 (socket says 172.21.15.2:54126) 2024-09-12T00:44:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.359+0000 7f35e259c640 1 -- 172.21.15.2:0/580616208 learned_addr learned my addr 172.21.15.2:0/580616208 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.360+0000 7f35e259c640 1 -- 172.21.15.2:0/580616208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e40fe540 con 0x7f35e4106570 2024-09-12T00:44:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.360+0000 7f35e259c640 1 --2- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 0x7f35e40fc650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009230 tx=0x7f35d4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.360+0000 7f35d37fe640 1 -- 172.21.15.2:0/580616208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35d403f070 con 0x7f35e4106570 2024-09-12T00:44:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.360+0000 7f35d37fe640 1 -- 172.21.15.2:0/580616208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35d403bc80 con 0x7f35e4106570 2024-09-12T00:44:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.360+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e40fcb90 con 0x7f35e4106570 2024-09-12T00:44:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.360+0000 7f35d37fe640 1 -- 172.21.15.2:0/580616208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35d4035030 con 0x7f35e4106570 2024-09-12T00:44:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.360+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e40fd050 con 0x7f35e4106570 2024-09-12T00:44:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.361+0000 7f35d37fe640 1 -- 172.21.15.2:0/580616208 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f35d4042070 con 0x7f35e4106570 2024-09-12T00:44:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.361+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e4101be0 con 0x7f35e4106570 2024-09-12T00:44:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.362+0000 7f35d37fe640 1 --2- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f35cc0390c0 0x7f35cc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.362+0000 7f35d37fe640 1 -- 172.21.15.2:0/580616208 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f35d406c9a0 con 0x7f35e4106570 2024-09-12T00:44:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.362+0000 7f35e1d9b640 1 --2- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f35cc0390c0 0x7f35cc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.362+0000 7f35e1d9b640 1 --2- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f35cc0390c0 0x7f35cc03b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f35d80098c0 tx=0x7f35d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:46.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.366+0000 7f35d37fe640 1 -- 172.21.15.2:0/580616208 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35d4030c30 con 0x7f35e4106570 2024-09-12T00:44:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.547+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35e40fdb80 con 0x7f35cc0390c0 2024-09-12T00:44:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.548+0000 7f35d37fe640 1 -- 172.21.15.2:0/580616208 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7f35e40fdb80 con 0x7f35cc0390c0 2024-09-12T00:44:46.546 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:44:46.546 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}] 2024-09-12T00:44:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f35cc0390c0 msgr2=0x7f35cc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 --2- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f35cc0390c0 0x7f35cc03b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f35d80098c0 tx=0x7f35d8006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 msgr2=0x7f35e40fc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 --2- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 0x7f35e40fc650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009230 tx=0x7f35d4003d40 comp rx=0 tx=0).stop 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 shutdown_connections 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 --2- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f35cc0390c0 0x7f35cc03b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 --2- 172.21.15.2:0/580616208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35e4106570 0x7f35e40fc650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 >> 172.21.15.2:0/580616208 conn(0x7f35e40fc1a0 msgr2=0x7f35e4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 shutdown_connections 2024-09-12T00:44:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:46.550+0000 7f35e8eb4640 1 -- 172.21.15.2:0/580616208 wait complete. 2024-09-12T00:44:47.147 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T00:44:47.148 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T00:44:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:44:47.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:47 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:47.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:47 smithi002 ceph-mon[31210]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:44:47.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.814+0000 7f61ec21d640 1 -- 172.21.15.2:0/560751687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 msgr2=0x7f61e4106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:47.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.814+0000 7f61ec21d640 1 --2- 172.21.15.2:0/560751687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 0x7f61e4106920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009c10 tx=0x7f61e002aa10 comp rx=0 tx=0).stop 2024-09-12T00:44:47.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.814+0000 7f61ec21d640 1 -- 172.21.15.2:0/560751687 shutdown_connections 2024-09-12T00:44:47.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.814+0000 7f61ec21d640 1 --2- 172.21.15.2:0/560751687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 0x7f61e4106920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:47.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.814+0000 7f61ec21d640 1 -- 172.21.15.2:0/560751687 >> 172.21.15.2:0/560751687 conn(0x7f61e4077310 msgr2=0x7f61e40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:47.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.814+0000 7f61ec21d640 1 -- 172.21.15.2:0/560751687 shutdown_connections 2024-09-12T00:44:47.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.814+0000 7f61ec21d640 1 -- 172.21.15.2:0/560751687 wait complete. 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.815+0000 7f61ec21d640 1 Processor -- start 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.815+0000 7f61ec21d640 1 -- start start 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.815+0000 7f61ec21d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 0x7f61e4197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.815+0000 7f61ec21d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410ab70 con 0x7f61e4106540 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.815+0000 7f61e9fb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 0x7f61e4197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.815+0000 7f61e9fb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 0x7f61e4197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54144/0 (socket says 172.21.15.2:54144) 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.815+0000 7f61e9fb9640 1 -- 172.21.15.2:0/1178042783 learned_addr learned my addr 172.21.15.2:0/1178042783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.816+0000 7f61e9fb9640 1 -- 172.21.15.2:0/1178042783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e4197650 con 0x7f61e4106540 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.816+0000 7f61e9fb9640 1 --2- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 0x7f61e4197110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009d30 tx=0x7f61e0030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.816+0000 7f61daffd640 1 -- 172.21.15.2:0/1178042783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e0034070 con 0x7f61e4106540 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.816+0000 7f61daffd640 1 -- 172.21.15.2:0/1178042783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e002f8c0 con 0x7f61e4106540 2024-09-12T00:44:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.816+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e41978e0 con 0x7f61e4106540 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.816+0000 7f61daffd640 1 -- 172.21.15.2:0/1178042783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e00044d0 con 0x7f61e4106540 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.816+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e4197d60 con 0x7f61e4106540 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.817+0000 7f61daffd640 1 -- 172.21.15.2:0/1178042783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f61e0037020 con 0x7f61e4106540 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.817+0000 7f61daffd640 1 --2- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f61d00390c0 0x7f61d003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.817+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e4101bb0 con 0x7f61e4106540 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.817+0000 7f61daffd640 1 -- 172.21.15.2:0/1178042783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f61e006ce80 con 0x7f61e4106540 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.817+0000 7f61e97b8640 1 --2- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f61d00390c0 0x7f61d003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.817+0000 7f61e97b8640 1 --2- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f61d00390c0 0x7f61d003b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f61d40098c0 tx=0x7f61d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.822+0000 7f61daffd640 1 -- 172.21.15.2:0/1178042783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61e0070030 con 0x7f61e4106540 2024-09-12T00:44:47.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:47.999+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f61e4198500 con 0x7f61e4106540 2024-09-12T00:44:48.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.364+0000 7f61daffd640 1 -- 172.21.15.2:0/1178042783 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f61e4198500 con 0x7f61e4106540 2024-09-12T00:44:48.363 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-12T00:44:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.366+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f61d00390c0 msgr2=0x7f61d003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.366+0000 7f61ec21d640 1 --2- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f61d00390c0 0x7f61d003b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f61d40098c0 tx=0x7f61d4006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.366+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 msgr2=0x7f61e4197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.366+0000 7f61ec21d640 1 --2- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 0x7f61e4197110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009d30 tx=0x7f61e0030c30 comp rx=0 tx=0).stop 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.366+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 shutdown_connections 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.366+0000 7f61ec21d640 1 --2- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f61d00390c0 0x7f61d003b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.366+0000 7f61ec21d640 1 --2- 172.21.15.2:0/1178042783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e4106540 0x7f61e4197110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.366+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 >> 172.21.15.2:0/1178042783 conn(0x7f61e4077310 msgr2=0x7f61e40696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.367+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 shutdown_connections 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:44:48.367+0000 7f61ec21d640 1 -- 172.21.15.2:0/1178042783 wait complete. 2024-09-12T00:44:48.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:48 smithi002 ceph-mon[31210]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:48.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:48 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1178042783' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T00:44:49.000 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-09-12T00:44:49.000 INFO:tasks.cephadm:Adding mon.b on smithi071 2024-09-12T00:44:49.000 INFO:tasks.cephadm:Adding mon.c on smithi167 2024-09-12T00:44:49.000 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi071:172.21.15.71=b;smithi167:172.21.15.167=c' 2024-09-12T00:44:49.305 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T00:44:49.352 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T00:44:49.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1178042783' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T00:44:49.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:44:49.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:49.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:49.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:49.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:49.367 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:44:49.368 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:44:49.368 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:49 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:44:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.864+0000 7f572bb32640 1 -- 172.21.15.167:0/3278465166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 msgr2=0x7f5724104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.864+0000 7f572bb32640 1 --2- 172.21.15.167:0/3278465166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 0x7f5724104580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5720009880 tx=0x7f572002a5d0 comp rx=0 tx=0).stop 2024-09-12T00:44:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.864+0000 7f572bb32640 1 -- 172.21.15.167:0/3278465166 shutdown_connections 2024-09-12T00:44:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.864+0000 7f572bb32640 1 --2- 172.21.15.167:0/3278465166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 0x7f5724104580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.864+0000 7f572bb32640 1 -- 172.21.15.167:0/3278465166 >> 172.21.15.167:0/3278465166 conn(0x7f57240fbcd0 msgr2=0x7f57240fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.864+0000 7f572bb32640 1 -- 172.21.15.167:0/3278465166 shutdown_connections 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.864+0000 7f572bb32640 1 -- 172.21.15.167:0/3278465166 wait complete. 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.865+0000 7f572bb32640 1 Processor -- start 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.865+0000 7f572bb32640 1 -- start start 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.865+0000 7f572bb32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 0x7f5724101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.865+0000 7f572bb32640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57241076d0 con 0x7f5724102190 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.865+0000 7f57298ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 0x7f5724101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.865+0000 7f57298ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 0x7f5724101a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.167:41860/0 (socket says 172.21.15.167:41860) 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.865+0000 7f57298ce640 1 -- 172.21.15.167:0/2674144040 learned_addr learned my addr 172.21.15.167:0/2674144040 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.866+0000 7f57298ce640 1 -- 172.21.15.167:0/2674144040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5724101f50 con 0x7f5724102190 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.866+0000 7f57298ce640 1 --2- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 0x7f5724101a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5720004f60 tx=0x7f57200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.866+0000 7f571affd640 1 -- 172.21.15.167:0/2674144040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f572003f070 con 0x7f5724102190 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.866+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5724100140 con 0x7f5724102190 2024-09-12T00:44:49.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.866+0000 7f571affd640 1 -- 172.21.15.167:0/2674144040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5720003ad0 con 0x7f5724102190 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.866+0000 7f571affd640 1 -- 172.21.15.167:0/2674144040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5720035030 con 0x7f5724102190 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.866+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5724100680 con 0x7f5724102190 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.867+0000 7f571affd640 1 -- 172.21.15.167:0/2674144040 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f5720042070 con 0x7f5724102190 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.867+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5724107e50 con 0x7f5724102190 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.867+0000 7f571affd640 1 --2- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5710039060 0x7f571003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.867+0000 7f571affd640 1 -- 172.21.15.167:0/2674144040 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f572006ced0 con 0x7f5724102190 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.868+0000 7f57290cd640 1 --2- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5710039060 0x7f571003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.868+0000 7f57290cd640 1 --2- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5710039060 0x7f571003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f57140098c0 tx=0x7f5714006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:49.873+0000 7f571affd640 1 -- 172.21.15.167:0/2674144040 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f572004c350 con 0x7f5724102190 2024-09-12T00:44:50.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.063+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi071:172.21.15.71=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}) -- 0x7f5724190220 con 0x7f5710039060 2024-09-12T00:44:50.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.068+0000 7f571affd640 1 -- 172.21.15.167:0/2674144040 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5724190220 con 0x7f5710039060 2024-09-12T00:44:50.068 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mon update... 2024-09-12T00:44:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.070+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5710039060 msgr2=0x7f571003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.070+0000 7f572bb32640 1 --2- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5710039060 0x7f571003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f57140098c0 tx=0x7f5714006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.070+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 msgr2=0x7f5724101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.070+0000 7f572bb32640 1 --2- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 0x7f5724101a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5720004f60 tx=0x7f57200048f0 comp rx=0 tx=0).stop 2024-09-12T00:44:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.070+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 shutdown_connections 2024-09-12T00:44:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.070+0000 7f572bb32640 1 --2- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5710039060 0x7f571003b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.070+0000 7f572bb32640 1 --2- 172.21.15.167:0/2674144040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724102190 0x7f5724101a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.070+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 >> 172.21.15.167:0/2674144040 conn(0x7f57240fbcd0 msgr2=0x7f57240fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.071+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 shutdown_connections 2024-09-12T00:44:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:50.071+0000 7f572bb32640 1 -- 172.21.15.167:0/2674144040 wait complete. 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:44:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:44:50.793 DEBUG:teuthology.orchestra.run.smithi071:mon.b> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T00:44:50.796 DEBUG:teuthology.orchestra.run.smithi167:mon.c> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T00:44:50.799 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T00:44:50.799 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T00:44:51.439 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:44:51.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:51 smithi002 ceph-mon[31210]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:44:51.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:51 smithi002 ceph-mon[31210]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:44:51.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:51 smithi002 ceph-mon[31210]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi071:172.21.15.71=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:51.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:51 smithi002 ceph-mon[31210]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi071:172.21.15.71=b;smithi167:172.21.15.167=c;count:3 2024-09-12T00:44:51.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:51 smithi002 ceph-mon[31210]: Deploying daemon mon.c on smithi167 2024-09-12T00:44:51.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.859+0000 7fa660da9640 1 -- 172.21.15.167:0/1220520938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 msgr2=0x7fa65c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.859+0000 7fa660da9640 1 --2- 172.21.15.167:0/1220520938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 0x7fa65c106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa644009810 tx=0x7fa64402a540 comp rx=0 tx=0).stop 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.860+0000 7fa660da9640 1 -- 172.21.15.167:0/1220520938 shutdown_connections 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.860+0000 7fa660da9640 1 --2- 172.21.15.167:0/1220520938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 0x7fa65c106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.860+0000 7fa660da9640 1 -- 172.21.15.167:0/1220520938 >> 172.21.15.167:0/1220520938 conn(0x7fa65c077310 msgr2=0x7fa65c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.860+0000 7fa660da9640 1 -- 172.21.15.167:0/1220520938 shutdown_connections 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.860+0000 7fa660da9640 1 -- 172.21.15.167:0/1220520938 wait complete. 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.860+0000 7fa660da9640 1 Processor -- start 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.861+0000 7fa660da9640 1 -- start start 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.861+0000 7fa660da9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 0x7fa65c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:51.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.861+0000 7fa660da9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c10ab70 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.861+0000 7fa65a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 0x7fa65c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.861+0000 7fa65a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 0x7fa65c1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.167:41880/0 (socket says 172.21.15.167:41880) 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.861+0000 7fa65a59c640 1 -- 172.21.15.167:0/2178186437 learned_addr learned my addr 172.21.15.167:0/2178186437 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.862+0000 7fa65a59c640 1 -- 172.21.15.167:0/2178186437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c199800 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.862+0000 7fa65a59c640 1 --2- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 0x7fa65c1992c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa6440045e0 tx=0x7fa644004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.862+0000 7fa6537fe640 1 -- 172.21.15.167:0/2178186437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa644030e70 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.862+0000 7fa6537fe640 1 -- 172.21.15.167:0/2178186437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6440318e0 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.862+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65c199a90 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.862+0000 7fa6537fe640 1 -- 172.21.15.167:0/2178186437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6440049c0 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.862+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65c19db90 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.863+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65c101bb0 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.863+0000 7fa6537fe640 1 -- 172.21.15.167:0/2178186437 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fa644039040 con 0x7fa65c106540 2024-09-12T00:44:51.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.863+0000 7fa6537fe640 1 --2- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa648039060 0x7fa64803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:44:51.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.863+0000 7fa6537fe640 1 -- 172.21.15.167:0/2178186437 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa64406d380 con 0x7fa65c106540 2024-09-12T00:44:51.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.863+0000 7fa659d9b640 1 --2- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa648039060 0x7fa64803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:44:51.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.864+0000 7fa659d9b640 1 --2- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa648039060 0x7fa64803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0098c0 tx=0x7fa64c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:44:51.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:51.868+0000 7fa6537fe640 1 -- 172.21.15.167:0/2178186437 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa644040030 con 0x7fa65c106540 2024-09-12T00:44:52.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.102+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa65c1069a0 con 0x7fa65c106540 2024-09-12T00:44:52.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.102+0000 7fa6537fe640 1 -- 172.21.15.167:0/2178186437 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7fa64403b3b0 con 0x7fa65c106540 2024-09-12T00:44:52.102 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:44:52.102 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","modified":"2024-09-12T00:43:29.460356Z","created":"2024-09-12T00:43:29.460356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T00:44:52.102 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-12T00:44:52.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa648039060 msgr2=0x7fa64803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:52.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 --2- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa648039060 0x7fa64803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0098c0 tx=0x7fa64c006db0 comp rx=0 tx=0).stop 2024-09-12T00:44:52.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 msgr2=0x7fa65c1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:44:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 --2- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 0x7fa65c1992c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa6440045e0 tx=0x7fa644004610 comp rx=0 tx=0).stop 2024-09-12T00:44:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 shutdown_connections 2024-09-12T00:44:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 --2- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa648039060 0x7fa64803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 --2- 172.21.15.167:0/2178186437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa65c106540 0x7fa65c1992c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:44:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 >> 172.21.15.167:0/2178186437 conn(0x7fa65c077310 msgr2=0x7fa65c0ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:44:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 shutdown_connections 2024-09-12T00:44:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:44:52.105+0000 7fa660da9640 1 -- 172.21.15.167:0/2178186437 wait complete. 2024-09-12T00:44:52.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:52 smithi002 ceph-mon[31210]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:52.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:52 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/2178186437' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:44:54.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:44:54 smithi002 ceph-mon[31210]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 podman[35196]: 2024-09-12 00:44:54.697732205 +0000 UTC m=+0.129857572 container create bf55787134d2277c7af328ddec0a19b7a33229482ad09e230e3707adb6a8abd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T00:44:54.828 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T00:44:54.828 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T00:44:55.089 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:44:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 podman[35196]: 2024-09-12 00:44:54.919134446 +0000 UTC m=+0.351259826 container init bf55787134d2277c7af328ddec0a19b7a33229482ad09e230e3707adb6a8abd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:44:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 podman[35196]: 2024-09-12 00:44:54.922729617 +0000 UTC m=+0.354854995 container start bf55787134d2277c7af328ddec0a19b7a33229482ad09e230e3707adb6a8abd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T00:44:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T00:44:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T00:44:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: pidfile_write: ignore empty --pid-file 2024-09-12T00:44:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: load: jerasure load: lrc 2024-09-12T00:44:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: RocksDB version: 7.9.2 2024-09-12T00:44:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Git sha 0 2024-09-12T00:44:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T00:44:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: DB SUMMARY 2024-09-12T00:44:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: DB Session ID: 5IMZICV887V73W7KTDYG 2024-09-12T00:44:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: CURRENT file: CURRENT 2024-09-12T00:44:55.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T00:44:55.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T00:44:55.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-12T00:44:55.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-12T00:44:55.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.error_if_exists: 0 2024-09-12T00:44:55.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.create_if_missing: 0 2024-09-12T00:44:55.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.paranoid_checks: 1 2024-09-12T00:44:55.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T00:44:55.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T00:44:55.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T00:44:55.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.env: 0x561558a7a940 2024-09-12T00:44:55.214 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T00:44:55.214 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.info_log: 0x56155ad9d6e0 2024-09-12T00:44:55.214 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.statistics: (nil) 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.use_fsync: 0 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_log_file_size: 0 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.allow_fallocate: 1 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T00:44:55.216 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T00:44:55.217 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.use_direct_reads: 0 2024-09-12T00:44:55.217 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T00:44:55.217 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T00:44:55.217 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.db_log_dir: 2024-09-12T00:44:55.217 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.wal_dir: 2024-09-12T00:44:55.217 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T00:44:55.217 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T00:44:55.218 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T00:44:55.218 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T00:44:55.218 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T00:44:55.218 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T00:44:55.218 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T00:44:55.218 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T00:44:55.218 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.write_buffer_manager: 0x56155adacdc0 2024-09-12T00:44:55.218 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T00:44:55.219 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T00:44:55.219 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T00:44:55.219 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T00:44:55.219 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T00:44:55.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T00:44:55.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T00:44:55.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T00:44:55.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.unordered_write: 0 2024-09-12T00:44:55.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T00:44:55.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T00:44:55.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T00:44:55.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T00:44:55.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.row_cache: None 2024-09-12T00:44:55.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.wal_filter: None 2024-09-12T00:44:55.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T00:44:55.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T00:44:55.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.two_write_queues: 0 2024-09-12T00:44:55.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T00:44:55.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.wal_compression: 0 2024-09-12T00:44:55.223 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.atomic_flush: 0 2024-09-12T00:44:55.223 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T00:44:55.223 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T00:44:55.223 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T00:44:55.223 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.log_readahead_size: 0 2024-09-12T00:44:55.224 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T00:44:55.224 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T00:44:55.224 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T00:44:55.224 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T00:44:55.224 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T00:44:55.224 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T00:44:55.224 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T00:44:55.224 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_background_jobs: 2 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_background_compactions: -1 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_subcompactions: 1 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T00:44:55.225 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_open_files: -1 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_background_flushes: -1 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Compression algorithms supported: 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: kZSTD supported: 0 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: kXpressCompression supported: 0 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: kBZip2Compression supported: 0 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T00:44:55.226 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: kLZ4Compression supported: 1 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: kZlibCompression supported: 1 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: kSnappyCompression supported: 1 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.merge_operator: 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_filter: None 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T00:44:55.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56155ad9d320) 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: cache_index_and_filter_blocks: 1 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: pin_top_level_index_and_filter: 1 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_type: 0 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: data_block_index_type: 0 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_shortening: 1 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: checksum: 4 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: no_block_cache: 0 2024-09-12T00:44:55.228 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache: 0x56155ad911f0 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_name: BinnedLRUCache 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_options: 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: capacity : 536870912 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: num_shard_bits : 4 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: strict_capacity_limit : 0 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: high_pri_pool_ratio: 0.000 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_compressed: (nil) 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: persistent_cache: (nil) 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_size: 4096 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_size_deviation: 10 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_restart_interval: 16 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_block_restart_interval: 1 2024-09-12T00:44:55.229 INFO:journalctl@ceph.mon.c.smithi167.stdout: metadata_block_size: 4096 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: partition_filters: 0 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: use_delta_encoding: 1 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: filter_policy: bloomfilter 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: whole_key_filtering: 1 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: verify_compression: 0 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: read_amp_bytes_per_bit: 0 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: format_version: 5 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: enable_index_compression: 1 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_align: 0 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: max_auto_readahead_size: 262144 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: prepopulate_block_cache: 0 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: initial_auto_readahead_size: 8192 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T00:44:55.230 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression: NoCompression 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.num_levels: 7 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T00:44:55.231 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T00:44:55.232 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T00:44:55.233 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T00:44:55.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.inplace_update_support: 0 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T00:44:55.235 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.bloom_locality: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.max_successive_merges: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.ttl: 2592000 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.enable_blob_files: false 2024-09-12T00:44:55.236 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.min_blob_size: 0 2024-09-12T00:44:55.237 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T00:44:55.237 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T00:44:55.237 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T00:44:55.237 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T00:44:55.237 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T00:44:55.237 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T00:44:55.237 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T00:44:55.237 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T00:44:55.238 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T00:44:55.238 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T00:44:55.238 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4510801a-7e80-485a-84fa-7125d5749e0e 2024-09-12T00:44:55.238 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726101894950386, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T00:44:55.238 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T00:44:55.238 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726101894950818, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726101894, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4510801a-7e80-485a-84fa-7125d5749e0e", "db_session_id": "5IMZICV887V73W7KTDYG", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726101894950920, "job": 1, "event": "recovery_finished"} 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56155adbee00 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: DB pointer 0x56155aeba000 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** DB Stats ** 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T00:44:55.239 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T00:44:55.240 INFO:journalctl@ceph.mon.c.smithi167.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T00:44:55.241 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout: Block cache BinnedLRUCache@0x56155ad911f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: using public_addr v2:172.21.15.167:0/0 -> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: starting mon.c rank -1 at public addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] at bind addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(???) e0 preinit fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T00:44:55.242 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout: e1 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout: btime 2024-09-12T00:43:32:673188+0000 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout: legacy client fscid: -1 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout: No filesystems configured 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T00:44:55.243 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T00:44:55.244 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T00:44:55.244 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T00:44:55.244 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T00:44:55.244 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T00:44:55.245 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T00:44:55.245 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:55.245 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1178042783' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T00:44:55.245 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1178042783' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T00:44:55.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:44:55.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:55.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:55.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:55.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:55.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:44:55.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:44:55.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:44:55.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:55.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-12T00:44:55.248 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:44:55.248 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:55.248 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:55.248 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:55.248 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:44:55.248 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:44:55.249 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:44:55.249 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:44:55.249 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:44:55.249 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi071:172.21.15.71=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:44:55.249 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi071:172.21.15.71=b;smithi167:172.21.15.167=c;count:3 2024-09-12T00:44:55.249 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: Deploying daemon mon.c on smithi167 2024-09-12T00:44:55.250 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:55.250 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/2178186437' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:44:55.250 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:44:55.250 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 ceph-mon[35234]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T00:44:55.250 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:54 smithi167 bash[35196]: bf55787134d2277c7af328ddec0a19b7a33229482ad09e230e3707adb6a8abd1 2024-09-12T00:44:55.250 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:44:55 smithi167 systemd[1]: Started Ceph mon.c for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:45:00.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.113+0000 7f644b102640 1 -- 172.21.15.167:0/2322650778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 msgr2=0x7f642c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:00.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.113+0000 7f644b102640 1 --2- 172.21.15.167:0/2322650778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 0x7f642c0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6444102b40 tx=0x7f644002c490 comp rx=0 tx=0).stop 2024-09-12T00:45:00.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.113+0000 7f644b102640 1 -- 172.21.15.167:0/2322650778 shutdown_connections 2024-09-12T00:45:00.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.113+0000 7f644b102640 1 --2- 172.21.15.167:0/2322650778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 0x7f642c0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:00.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.113+0000 7f644b102640 1 -- 172.21.15.167:0/2322650778 >> 172.21.15.167:0/2322650778 conn(0x7f64440fd3b0 msgr2=0x7f64440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:00.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.113+0000 7f644b102640 1 -- 172.21.15.167:0/2322650778 shutdown_connections 2024-09-12T00:45:00.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.113+0000 7f644b102640 1 -- 172.21.15.167:0/2322650778 wait complete. 2024-09-12T00:45:00.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.114+0000 7f644b102640 1 Processor -- start 2024-09-12T00:45:00.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.114+0000 7f644b102640 1 -- start start 2024-09-12T00:45:00.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f644b102640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 0x7f6444197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:00.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f644b102640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 0x7f644419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:00.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f644b102640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64441097d0 con 0x7f642c003530 2024-09-12T00:45:00.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f644b102640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6444109650 con 0x7f6444197840 2024-09-12T00:45:00.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f643bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 0x7f644419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:00.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f643bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 0x7f644419bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33560/0 (socket says 172.21.15.167:33560) 2024-09-12T00:45:00.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f643bfff640 1 -- 172.21.15.167:0/1887122921 learned_addr learned my addr 172.21.15.167:0/1887122921 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:45:00.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f643bfff640 1 -- 172.21.15.167:0/1887122921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 msgr2=0x7f644419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T00:45:00.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f643bfff640 1 -- 172.21.15.167:0/1887122921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 msgr2=0x7f644419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T00:45:00.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f643bfff640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 0x7f644419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T00:45:00.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f643bfff640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 0x7f644419bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:45:00.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f6448e9e640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 0x7f6444197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:00.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f6448e9e640 1 -- 172.21.15.167:0/1887122921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 msgr2=0x7f644419bbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:45:00.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f6448e9e640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 0x7f644419bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:00.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.115+0000 7f6448e9e640 1 -- 172.21.15.167:0/1887122921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6444197e60 con 0x7f642c003530 2024-09-12T00:45:00.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.116+0000 7f6448e9e640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 0x7f6444197300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6440005f30 tx=0x7f6440033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:00.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.116+0000 7f6439ffb640 1 -- 172.21.15.167:0/1887122921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6440038040 con 0x7f642c003530 2024-09-12T00:45:00.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.116+0000 7f6439ffb640 1 -- 172.21.15.167:0/1887122921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6440032e00 con 0x7f642c003530 2024-09-12T00:45:00.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.116+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644419c110 con 0x7f642c003530 2024-09-12T00:45:00.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.116+0000 7f6439ffb640 1 -- 172.21.15.167:0/1887122921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6440004a00 con 0x7f642c003530 2024-09-12T00:45:00.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.116+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644419c650 con 0x7f642c003530 2024-09-12T00:45:00.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.117+0000 7f6439ffb640 1 -- 172.21.15.167:0/1887122921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f6440043020 con 0x7f642c003530 2024-09-12T00:45:00.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.117+0000 7f6439ffb640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6430038e50 0x7f643003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:00.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.117+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6444102df0 con 0x7f642c003530 2024-09-12T00:45:00.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.118+0000 7f6439ffb640 1 -- 172.21.15.167:0/1887122921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f644006e5f0 con 0x7f642c003530 2024-09-12T00:45:00.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.118+0000 7f643bfff640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6430038e50 0x7f643003b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:00.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.118+0000 7f643bfff640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6430038e50 0x7f643003b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6434009100 tx=0x7f6434008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:00.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.123+0000 7f6439ffb640 1 -- 172.21.15.167:0/1887122921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f644004a020 con 0x7f642c003530 2024-09-12T00:45:00.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.356+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6444190fb0 con 0x7f642c003530 2024-09-12T00:45:00.357 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:00.357 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:45:00.357 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: mon.a calling monitor election 2024-09-12T00:45:00.357 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.357 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.357 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:00.357 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: mon.c calling monitor election 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: monmap epoch 2 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: last_changed 2024-09-12T00:44:54.977091+0000 2024-09-12T00:45:00.358 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: min_mon_release 19 (squid) 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: election_strategy: 1 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: fsmap 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: mgrmap e13: x(active, since 39s) 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: overall HEALTH_OK 2024-09-12T00:45:00.359 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:00.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:00.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:00.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:00.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:00.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.357+0000 7f6439ffb640 1 -- 172.21.15.167:0/1887122921 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f644004c970 con 0x7f642c003530 2024-09-12T00:45:00.361 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:45:00.361 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","modified":"2024-09-12T00:44:54.977091Z","created":"2024-09-12T00:43:29.460356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T00:45:00.362 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 2 2024-09-12T00:45:00.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6430038e50 msgr2=0x7f643003b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:00.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6430038e50 0x7f643003b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6434009100 tx=0x7f6434008040 comp rx=0 tx=0).stop 2024-09-12T00:45:00.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 msgr2=0x7f6444197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:00.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 0x7f6444197300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6440005f30 tx=0x7f6440033680 comp rx=0 tx=0).stop 2024-09-12T00:45:00.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 shutdown_connections 2024-09-12T00:45:00.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6430038e50 0x7f643003b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:00.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6444197840 0x7f644419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:00.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 --2- 172.21.15.167:0/1887122921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f642c003530 0x7f6444197300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:00.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 >> 172.21.15.167:0/1887122921 conn(0x7f64440fd3b0 msgr2=0x7f64440ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:00.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 shutdown_connections 2024-09-12T00:45:00.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:00.359+0000 7f644b102640 1 -- 172.21.15.167:0/1887122921 wait complete. 2024-09-12T00:45:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:45:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: mon.a calling monitor election 2024-09-12T00:45:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: mon.c calling monitor election 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: monmap epoch 2 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: last_changed 2024-09-12T00:44:54.977091+0000 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: min_mon_release 19 (squid) 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: election_strategy: 1 2024-09-12T00:45:00.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: fsmap 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: mgrmap e13: x(active, since 39s) 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: overall HEALTH_OK 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:00.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:01.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:01 smithi167 ceph-mon[35234]: Deploying daemon mon.b on smithi071 2024-09-12T00:45:01.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:01 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/1887122921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:45:01.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:01 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:01.441 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:01 smithi002 ceph-mon[31210]: Deploying daemon mon.b on smithi071 2024-09-12T00:45:01.441 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:01 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/1887122921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:45:01.441 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:01 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:01.962 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T00:45:01.962 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T00:45:02.216 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:45:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:02 smithi167 ceph-mon[35234]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:02.453 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:02 smithi002 ceph-mon[31210]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:02.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 -- 172.21.15.167:0/2673907713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac102850 msgr2=0x7f38ac102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:02.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 --2- 172.21.15.167:0/2673907713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac102850 0x7f38ac102c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f389c009880 tx=0x7f389c02a670 comp rx=0 tx=0).stop 2024-09-12T00:45:02.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 -- 172.21.15.167:0/2673907713 shutdown_connections 2024-09-12T00:45:02.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 --2- 172.21.15.167:0/2673907713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac102850 0x7f38ac102c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:02.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 -- 172.21.15.167:0/2673907713 >> 172.21.15.167:0/2673907713 conn(0x7f38ac0fc250 msgr2=0x7f38ac0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:02.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 -- 172.21.15.167:0/2673907713 shutdown_connections 2024-09-12T00:45:02.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 -- 172.21.15.167:0/2673907713 wait complete. 2024-09-12T00:45:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 Processor -- start 2024-09-12T00:45:02.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.634+0000 7f38b22e7640 1 -- start start 2024-09-12T00:45:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38b22e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 0x7f38ac197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38b22e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac1979d0 0x7f38ac19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:02.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38b22e7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac10bdc0 con 0x7f38ac1979d0 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38b22e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac10bc40 con 0x7f38ac102850 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38abfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 0x7f38ac197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38abfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 0x7f38ac197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50902/0 (socket says 172.21.15.167:50902) 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38abfff640 1 -- 172.21.15.167:0/4249286343 learned_addr learned my addr 172.21.15.167:0/4249286343 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38abfff640 1 -- 172.21.15.167:0/4249286343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 msgr2=0x7f38ac197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38abfff640 1 -- 172.21.15.167:0/4249286343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 msgr2=0x7f38ac197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38abfff640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 0x7f38ac197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38abfff640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 0x7f38ac197490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.635+0000 7f38ab7fe640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac1979d0 0x7f38ac19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38ab7fe640 1 -- 172.21.15.167:0/4249286343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 msgr2=0x7f38ac197490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38ab7fe640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 0x7f38ac197490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38ab7fe640 1 -- 172.21.15.167:0/4249286343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac197ff0 con 0x7f38ac1979d0 2024-09-12T00:45:02.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38ab7fe640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac1979d0 0x7f38ac19bd10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38a000b3d0 tx=0x7f38a000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:02.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38a97fa640 1 -- 172.21.15.167:0/4249286343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f38a0011630 con 0x7f38ac1979d0 2024-09-12T00:45:02.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac19c250 con 0x7f38ac1979d0 2024-09-12T00:45:02.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38a97fa640 1 -- 172.21.15.167:0/4249286343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a0011cb0 con 0x7f38ac1979d0 2024-09-12T00:45:02.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38a97fa640 1 -- 172.21.15.167:0/4249286343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f38a0010df0 con 0x7f38ac1979d0 2024-09-12T00:45:02.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.636+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ac19c790 con 0x7f38ac1979d0 2024-09-12T00:45:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.637+0000 7f38a97fa640 1 -- 172.21.15.167:0/4249286343 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f38a0018020 con 0x7f38ac1979d0 2024-09-12T00:45:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.637+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ac06ad10 con 0x7f38ac1979d0 2024-09-12T00:45:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.637+0000 7f38a97fa640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3894038e00 0x7f389403b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.638+0000 7f38a97fa640 1 -- 172.21.15.167:0/4249286343 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f38a004bc80 con 0x7f38ac1979d0 2024-09-12T00:45:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.638+0000 7f38abfff640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3894038e00 0x7f389403b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:02.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.638+0000 7f38abfff640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3894038e00 0x7f389403b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f389c0096c0 tx=0x7f389c005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:02.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.643+0000 7f38a97fa640 1 -- 172.21.15.167:0/4249286343 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38a0052080 con 0x7f38ac1979d0 2024-09-12T00:45:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.870+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f38ac19caa0 con 0x7f38ac1979d0 2024-09-12T00:45:02.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.871+0000 7f38a97fa640 1 -- 172.21.15.167:0/4249286343 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f38a001f020 con 0x7f38ac1979d0 2024-09-12T00:45:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:45:02.905 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","modified":"2024-09-12T00:44:54.977091Z","created":"2024-09-12T00:43:29.460356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 2 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3894038e00 msgr2=0x7f389403b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3894038e00 0x7f389403b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f389c0096c0 tx=0x7f389c005a40 comp rx=0 tx=0).stop 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac1979d0 msgr2=0x7f38ac19bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac1979d0 0x7f38ac19bd10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38a000b3d0 tx=0x7f38a000b890 comp rx=0 tx=0).stop 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 shutdown_connections 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3894038e00 0x7f389403b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38ac1979d0 0x7f38ac19bd10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 --2- 172.21.15.167:0/4249286343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38ac102850 0x7f38ac197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 >> 172.21.15.167:0/4249286343 conn(0x7f38ac0fc250 msgr2=0x7f38ac105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:02.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 shutdown_connections 2024-09-12T00:45:02.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:02.873+0000 7f38b22e7640 1 -- 172.21.15.167:0/4249286343 wait complete. 2024-09-12T00:45:03.294 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:03 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/4249286343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:45:03.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:03 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/4249286343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:45:03.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:03 smithi071 systemd[1]: Started Ceph mon.b for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:45:04.518 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T00:45:04.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T00:45:04.763 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:45:08.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.777+0000 7f8616405640 1 -- 172.21.15.167:0/3542772530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f8005740 msgr2=0x7f85f8007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:08.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.777+0000 7f8616405640 1 --2- 172.21.15.167:0/3542772530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f8005740 0x7f85f8007bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f86101016c0 tx=0x7f860002c3f0 comp rx=0 tx=0).stop 2024-09-12T00:45:08.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.777+0000 7f8616405640 1 -- 172.21.15.167:0/3542772530 shutdown_connections 2024-09-12T00:45:08.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.777+0000 7f8616405640 1 --2- 172.21.15.167:0/3542772530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f8005740 0x7f85f8007bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:08.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.777+0000 7f8616405640 1 -- 172.21.15.167:0/3542772530 >> 172.21.15.167:0/3542772530 conn(0x7f86100fc280 msgr2=0x7f86100fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:08.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.777+0000 7f8616405640 1 -- 172.21.15.167:0/3542772530 shutdown_connections 2024-09-12T00:45:08.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.777+0000 7f8616405640 1 -- 172.21.15.167:0/3542772530 wait complete. 2024-09-12T00:45:08.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.778+0000 7f8616405640 1 Processor -- start 2024-09-12T00:45:08.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.778+0000 7f8616405640 1 -- start start 2024-09-12T00:45:08.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f8616405640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 0x7f86101950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:08.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f8616405640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 0x7f86101999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:08.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f8616405640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610199ee0 0x7f861019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f8616405640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f86101075c0 con 0x7f8610199ee0 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f8616405640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8610107440 con 0x7f85f8005740 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f8616405640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8610107740 con 0x7f8610195610 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 0x7f86101999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 0x7f86101999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50906/0 (socket says 172.21.15.167:50906) 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860f7fe640 1 -- 172.21.15.167:0/4186563285 learned_addr learned my addr 172.21.15.167:0/4186563285 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f86149a2640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610199ee0 0x7f861019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860ffff640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 0x7f86101950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860f7fe640 1 -- 172.21.15.167:0/4186563285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 msgr2=0x7f86101999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860f7fe640 1 -- 172.21.15.167:0/4186563285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 msgr2=0x7f86101999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T00:45:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860f7fe640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 0x7f86101999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860f7fe640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 0x7f86101999a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860ffff640 1 -- 172.21.15.167:0/4186563285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 msgr2=0x7f86101950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860ffff640 1 -- 172.21.15.167:0/4186563285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 msgr2=0x7f86101950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860ffff640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 0x7f86101950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f860ffff640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 0x7f86101950d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f86149a2640 1 -- 172.21.15.167:0/4186563285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 msgr2=0x7f86101999a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f86149a2640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 0x7f86101999a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f86149a2640 1 -- 172.21.15.167:0/4186563285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 msgr2=0x7f86101950d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f86149a2640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 0x7f86101950d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.779+0000 7f86149a2640 1 -- 172.21.15.167:0/4186563285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86101a1c50 con 0x7f8610199ee0 2024-09-12T00:45:08.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.780+0000 7f86149a2640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610199ee0 0x7f861019a390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f860800bd50 tx=0x7f860800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:08.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.780+0000 7f860d7fa640 1 -- 172.21.15.167:0/4186563285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608019070 con 0x7f8610199ee0 2024-09-12T00:45:08.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.780+0000 7f860d7fa640 1 -- 172.21.15.167:0/4186563285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8608014920 con 0x7f8610199ee0 2024-09-12T00:45:08.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.780+0000 7f860d7fa640 1 -- 172.21.15.167:0/4186563285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608012990 con 0x7f8610199ee0 2024-09-12T00:45:08.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.780+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86101a1e80 con 0x7f8610199ee0 2024-09-12T00:45:08.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.780+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86101a23b0 con 0x7f8610199ee0 2024-09-12T00:45:08.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.781+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86101086a0 con 0x7f8610199ee0 2024-09-12T00:45:08.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.781+0000 7f860d7fa640 1 -- 172.21.15.167:0/4186563285 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f860801c070 con 0x7f8610199ee0 2024-09-12T00:45:08.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.782+0000 7f860d7fa640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f85fc0394f0 0x7f85fc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:08.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.782+0000 7f860d7fa640 1 -- 172.21.15.167:0/4186563285 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f860804bde0 con 0x7f8610199ee0 2024-09-12T00:45:08.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.782+0000 7f860ffff640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f85fc0394f0 0x7f85fc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:08.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.782+0000 7f860ffff640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f85fc0394f0 0x7f85fc03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8600014cc0 tx=0x7f8600005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:08.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:08.789+0000 7f860d7fa640 1 -- 172.21.15.167:0/4186563285 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8608011df0 con 0x7f8610199ee0 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: mon.a calling monitor election 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: mon.c calling monitor election 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: monmap epoch 3 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: last_changed 2024-09-12T00:45:03.608496+0000 2024-09-12T00:45:08.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: min_mon_release 19 (squid) 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: election_strategy: 1 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: fsmap 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: mgrmap e13: x(active, since 47s) 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: overall HEALTH_OK 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:08.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:09.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.031+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f861002d7c0 con 0x7f8610199ee0 2024-09-12T00:45:09.031 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:09.031 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:45:09.031 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: mon.a calling monitor election 2024-09-12T00:45:09.031 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: mon.c calling monitor election 2024-09-12T00:45:09.031 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:09.031 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:09.031 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:09.031 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: monmap epoch 3 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: last_changed 2024-09-12T00:45:03.608496+0000 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: min_mon_release 19 (squid) 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: election_strategy: 1 2024-09-12T00:45:09.032 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: fsmap 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: mgrmap e13: x(active, since 47s) 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: overall HEALTH_OK 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:09.033 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:09.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.032+0000 7f860d7fa640 1 -- 172.21.15.167:0/4186563285 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7f860800e090 con 0x7f8610199ee0 2024-09-12T00:45:09.034 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:45:09.034 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":3,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","modified":"2024-09-12T00:45:03.608496Z","created":"2024-09-12T00:43:29.460356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 3 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f85fc0394f0 msgr2=0x7f85fc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f85fc0394f0 0x7f85fc03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8600014cc0 tx=0x7f8600005f60 comp rx=0 tx=0).stop 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610199ee0 msgr2=0x7f861019a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610199ee0 0x7f861019a390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f860800bd50 tx=0x7f860800be40 comp rx=0 tx=0).stop 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 shutdown_connections 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f85fc0394f0 0x7f85fc03b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610199ee0 0x7f861019a390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610195610 0x7f86101999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 --2- 172.21.15.167:0/4186563285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f8005740 0x7f86101950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 >> 172.21.15.167:0/4186563285 conn(0x7f86100fc280 msgr2=0x7f86100fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:09.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 shutdown_connections 2024-09-12T00:45:09.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:09.034+0000 7f8616405640 1 -- 172.21.15.167:0/4186563285 wait complete. 2024-09-12T00:45:09.746 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:09.746 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:09 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/4186563285' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:45:09.747 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:09.748 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T00:45:09.748 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T00:45:09.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:09.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:09 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/4186563285' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:45:09.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:45:10.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 -- 172.21.15.2:0/1558598074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c102760 msgr2=0x7f109c102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 --2- 172.21.15.2:0/1558598074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c102760 0x7f109c102b40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f108c009880 tx=0x7f108c02a670 comp rx=0 tx=0).stop 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 -- 172.21.15.2:0/1558598074 shutdown_connections 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 --2- 172.21.15.2:0/1558598074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c102760 0x7f109c102b40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 -- 172.21.15.2:0/1558598074 >> 172.21.15.2:0/1558598074 conn(0x7f109c0fc1a0 msgr2=0x7f109c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 -- 172.21.15.2:0/1558598074 shutdown_connections 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 -- 172.21.15.2:0/1558598074 wait complete. 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 Processor -- start 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.547+0000 7f10a24b4640 1 -- start start 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f10a24b4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 0x7f109c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f10a24b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c199b90 0x7f109c19df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f10a24b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f109c19e460 0x7f109c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f10a24b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f109c10bcd0 con 0x7f109c199b90 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f10a24b4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f109c10bb50 con 0x7f109c102760 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f10a24b4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f109c10be50 con 0x7f109c19e460 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c199b90 0x7f109c19df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c199b90 0x7f109c19df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45248/0 (socket says 172.21.15.2:45248) 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109b7fe640 1 -- 172.21.15.2:0/689932861 learned_addr learned my addr 172.21.15.2:0/689932861 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109bfff640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 0x7f109c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f10a0a51640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f109c19e460 0x7f109c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109bfff640 1 -- 172.21.15.2:0/689932861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 msgr2=0x7f109c199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109bfff640 1 -- 172.21.15.2:0/689932861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 msgr2=0x7f109c199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109bfff640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 0x7f109c199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109bfff640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 0x7f109c199650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:45:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109b7fe640 1 -- 172.21.15.2:0/689932861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f109c19e460 msgr2=0x7f109c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109b7fe640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f109c19e460 0x7f109c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109b7fe640 1 -- 172.21.15.2:0/689932861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 msgr2=0x7f109c199650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109b7fe640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 0x7f109c199650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f109b7fe640 1 -- 172.21.15.2:0/689932861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109c1a61d0 con 0x7f109c199b90 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.548+0000 7f10a0a51640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f109c19e460 0x7f109c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.549+0000 7f109b7fe640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c199b90 0x7f109c19df20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f109000b520 tx=0x7f109000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.549+0000 7f10997fa640 1 -- 172.21.15.2:0/689932861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090004230 con 0x7f109c199b90 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.549+0000 7f10997fa640 1 -- 172.21.15.2:0/689932861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10900043d0 con 0x7f109c199b90 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.549+0000 7f10997fa640 1 -- 172.21.15.2:0/689932861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090003d60 con 0x7f109c199b90 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.549+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109c1a6400 con 0x7f109c199b90 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.549+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109c1a68c0 con 0x7f109c199b90 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.550+0000 7f10997fa640 1 -- 172.21.15.2:0/689932861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f109000e070 con 0x7f109c199b90 2024-09-12T00:45:10.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.550+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109c102bc0 con 0x7f109c199b90 2024-09-12T00:45:10.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.550+0000 7f10997fa640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f10840394f0 0x7f108403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:10.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.550+0000 7f10997fa640 1 -- 172.21.15.2:0/689932861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f109004b910 con 0x7f109c199b90 2024-09-12T00:45:10.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.550+0000 7f109bfff640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f10840394f0 0x7f108403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:10.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.551+0000 7f109bfff640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f10840394f0 0x7f108403b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f108c005ab0 tx=0x7f108c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:10.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.559+0000 7f10997fa640 1 -- 172.21.15.2:0/689932861 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1090014020 con 0x7f109c199b90 2024-09-12T00:45:10.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.748+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f109c1a6be0 con 0x7f109c199b90 2024-09-12T00:45:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.748+0000 7f10997fa640 1 -- 172.21.15.2:0/689932861 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f1090010d70 con 0x7f109c199b90 2024-09-12T00:45:10.748 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:10.748 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-12T00:45:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f10840394f0 msgr2=0x7f108403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f10840394f0 0x7f108403b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f108c005ab0 tx=0x7f108c005a20 comp rx=0 tx=0).stop 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c199b90 msgr2=0x7f109c19df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c199b90 0x7f109c19df20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f109000b520 tx=0x7f109000b9e0 comp rx=0 tx=0).stop 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 shutdown_connections 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f10840394f0 0x7f108403b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f109c19e460 0x7f109c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f109c199b90 0x7f109c19df20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 --2- 172.21.15.2:0/689932861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109c102760 0x7f109c199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 >> 172.21.15.2:0/689932861 conn(0x7f109c0fc1a0 msgr2=0x7f109c107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 shutdown_connections 2024-09-12T00:45:10.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:10.752+0000 7f10a24b4640 1 -- 172.21.15.2:0/689932861 wait complete. 2024-09-12T00:45:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:45:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: mon.a calling monitor election 2024-09-12T00:45:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: mon.c calling monitor election 2024-09-12T00:45:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:45:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: monmap epoch 3 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: last_changed 2024-09-12T00:45:03.608496+0000 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: min_mon_release 19 (squid) 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: election_strategy: 1 2024-09-12T00:45:10.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: fsmap 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: mgrmap e13: x(active, since 47s) 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: overall HEALTH_OK 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/4186563285' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T00:45:10.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:11.410 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T00:45:11.410 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:45:11.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T00:45:11.440 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:45:11.440 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:45:11.507 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:45:11.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: mon.b calling monitor election 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: mon.b calling monitor election 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: mon.c calling monitor election 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: mon.a calling monitor election 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: monmap epoch 3 2024-09-12T00:45:11.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: last_changed 2024-09-12T00:45:03.608496+0000 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: min_mon_release 19 (squid) 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: election_strategy: 1 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: fsmap 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: mgrmap e13: x(active, since 49s) 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: overall HEALTH_OK 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/689932861' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:11.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:11.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:11.535 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:45:11.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:45:11.599 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:45:11.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T00:45:11.628 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:45:11.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: mon.b calling monitor election 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: mon.b calling monitor election 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: mon.c calling monitor election 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: mon.a calling monitor election 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T00:45:11.691 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: monmap epoch 3 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: last_changed 2024-09-12T00:45:03.608496+0000 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: min_mon_release 19 (squid) 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: election_strategy: 1 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: fsmap 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:45:11.692 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: mgrmap e13: x(active, since 49s) 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: overall HEALTH_OK 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/689932861' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.694 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.694 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.694 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.694 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.694 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.694 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:11.694 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:11.694 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:11.695 INFO:tasks.cephadm:Adding mgr.x on smithi002 2024-09-12T00:45:11.695 INFO:tasks.cephadm:Adding mgr.y on smithi071 2024-09-12T00:45:11.696 INFO:tasks.cephadm:Adding mgr.z on smithi167 2024-09-12T00:45:11.696 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi002=x;smithi071=y;smithi167=z' 2024-09-12T00:45:11.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: mon.b calling monitor election 2024-09-12T00:45:11.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-12T00:45:11.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-12T00:45:11.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-12T00:45:11.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: mon.b calling monitor election 2024-09-12T00:45:11.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: mon.c calling monitor election 2024-09-12T00:45:11.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: mon.a calling monitor election 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: monmap epoch 3 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: last_changed 2024-09-12T00:45:03.608496+0000 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: created 2024-09-12T00:43:29.460356+0000 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: min_mon_release 19 (squid) 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: election_strategy: 1 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: fsmap 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T00:45:11.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: mgrmap e13: x(active, since 49s) 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: overall HEALTH_OK 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/689932861' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:11.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:11.970 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:45:12.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.379+0000 7fbd76941640 1 -- 172.21.15.167:0/3661241249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd700ff9a0 msgr2=0x7fbd700ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:12.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.379+0000 7fbd76941640 1 --2- 172.21.15.167:0/3661241249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd700ff9a0 0x7fbd700ffda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009880 tx=0x7fbd6002a5d0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.379+0000 7fbd76941640 1 -- 172.21.15.167:0/3661241249 shutdown_connections 2024-09-12T00:45:12.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.379+0000 7fbd76941640 1 --2- 172.21.15.167:0/3661241249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd700ff9a0 0x7fbd700ffda0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.379+0000 7fbd76941640 1 -- 172.21.15.167:0/3661241249 >> 172.21.15.167:0/3661241249 conn(0x7fbd700fb510 msgr2=0x7fbd700fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:12.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.379+0000 7fbd76941640 1 -- 172.21.15.167:0/3661241249 shutdown_connections 2024-09-12T00:45:12.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.379+0000 7fbd76941640 1 -- 172.21.15.167:0/3661241249 wait complete. 2024-09-12T00:45:12.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd76941640 1 Processor -- start 2024-09-12T00:45:12.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd76941640 1 -- start start 2024-09-12T00:45:12.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd76941640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd700ff9a0 0x7fbd70196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:12.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd76941640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd70197510 0x7fbd7019c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:12.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd76941640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd70197990 0x7fbd7019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:12.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd76941640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd701077c0 con 0x7fbd70197510 2024-09-12T00:45:12.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd76941640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbd70107640 con 0x7fbd70197990 2024-09-12T00:45:12.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd76941640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd70107940 con 0x7fbd700ff9a0 2024-09-12T00:45:12.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd700ff9a0 0x7fbd70196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:12.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd700ff9a0 0x7fbd70196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43806/0 (socket says 172.21.15.167:43806) 2024-09-12T00:45:12.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd6ffff640 1 -- 172.21.15.167:0/3209856096 learned_addr learned my addr 172.21.15.167:0/3209856096 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:45:12.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd6f7fe640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd70197510 0x7fbd7019c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:12.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.380+0000 7fbd74ede640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd70197990 0x7fbd7019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:12.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6f7fe640 1 -- 172.21.15.167:0/3209856096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd700ff9a0 msgr2=0x7fbd70196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:12.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6f7fe640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd700ff9a0 0x7fbd70196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6f7fe640 1 -- 172.21.15.167:0/3209856096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd70197990 msgr2=0x7fbd7019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6f7fe640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd70197990 0x7fbd7019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6f7fe640 1 -- 172.21.15.167:0/3209856096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7019f3d0 con 0x7fbd70197510 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6ffff640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd700ff9a0 0x7fbd70196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6f7fe640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd70197510 0x7fbd7019c580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400b450 tx=0x7fbd6400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6d7fa640 1 -- 172.21.15.167:0/3209856096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64004230 con 0x7fbd70197510 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6d7fa640 1 -- 172.21.15.167:0/3209856096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd640043d0 con 0x7fbd70197510 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd6d7fa640 1 -- 172.21.15.167:0/3209856096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64003cb0 con 0x7fbd70197510 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7019f6c0 con 0x7fbd70197510 2024-09-12T00:45:12.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.381+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd7019fcd0 con 0x7fbd70197510 2024-09-12T00:45:12.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.382+0000 7fbd6d7fa640 1 -- 172.21.15.167:0/3209856096 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fbd6400f050 con 0x7fbd70197510 2024-09-12T00:45:12.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.382+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd70190580 con 0x7fbd70197510 2024-09-12T00:45:12.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.382+0000 7fbd6d7fa640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbd580394f0 0x7fbd5803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:12.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.382+0000 7fbd6d7fa640 1 -- 172.21.15.167:0/3209856096 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbd6404bd70 con 0x7fbd70197510 2024-09-12T00:45:12.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.383+0000 7fbd6ffff640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbd580394f0 0x7fbd5803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:12.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.383+0000 7fbd6ffff640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbd580394f0 0x7fbd5803b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009230 tx=0x7fbd600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:12.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.387+0000 7fbd6d7fa640 1 -- 172.21.15.167:0/3209856096 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd6400d040 con 0x7fbd70197510 2024-09-12T00:45:12.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.566+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi071=y;smithi167=z", "target": ["mon-mgr", ""]}) -- 0x7fbd700626c0 con 0x7fbd580394f0 2024-09-12T00:45:12.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.572+0000 7fbd6d7fa640 1 -- 172.21.15.167:0/3209856096 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbd700626c0 con 0x7fbd580394f0 2024-09-12T00:45:12.571 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mgr update... 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbd580394f0 msgr2=0x7fbd5803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbd580394f0 0x7fbd5803b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009230 tx=0x7fbd600058d0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd70197510 msgr2=0x7fbd7019c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd70197510 0x7fbd7019c580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400b450 tx=0x7fbd6400b910 comp rx=0 tx=0).stop 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 shutdown_connections 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbd580394f0 0x7fbd5803b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd70197990 0x7fbd7019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd70197510 0x7fbd7019c580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 --2- 172.21.15.167:0/3209856096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd700ff9a0 0x7fbd70196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 >> 172.21.15.167:0/3209856096 conn(0x7fbd700fb510 msgr2=0x7fbd700fc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:12.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 shutdown_connections 2024-09-12T00:45:12.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:45:12.574+0000 7fbd76941640 1 -- 172.21.15.167:0/3209856096 wait complete. 2024-09-12T00:45:12.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:12 smithi071 ceph-mon[35276]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:12.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:12 smithi071 ceph-mon[35276]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T00:45:12.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:12 smithi071 ceph-mon[35276]: Reconfiguring daemon mon.a on smithi002 2024-09-12T00:45:12.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:12 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:12.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:12 smithi002 ceph-mon[31210]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:12.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:12 smithi002 ceph-mon[31210]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T00:45:12.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:12 smithi002 ceph-mon[31210]: Reconfiguring daemon mon.a on smithi002 2024-09-12T00:45:12.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:12 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:12.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:12 smithi167 ceph-mon[35234]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:12.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:12 smithi167 ceph-mon[35234]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T00:45:12.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:12 smithi167 ceph-mon[35234]: Reconfiguring daemon mon.a on smithi002 2024-09-12T00:45:12.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:12 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:45:13.174 DEBUG:teuthology.orchestra.run.smithi071:mgr.y> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T00:45:13.177 DEBUG:teuthology.orchestra.run.smithi167:mgr.z> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T00:45:13.179 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T00:45:13.179 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:45:13.180 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:45:13.198 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:45:13.198 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-12T00:45:13.254 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:45:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:13.255 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T00:45:13.255 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:13.255 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:13.255 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-12 00:44:31.036543719 +0000 2024-09-12T00:45:13.255 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-12 00:39:17.851150125 +0000 2024-09-12T00:45:13.255 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-12 00:39:17.851150125 +0000 2024-09-12T00:45:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-12 00:39:17.851150125 +0000 2024-09-12T00:45:13.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:45:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-12T00:45:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-12T00:45:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000101054 s, 5.1 MB/s 2024-09-12T00:45:13.321 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:45:13.378 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-12T00:45:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:45:13.434 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:13.435 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T00:45:13.435 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:13.435 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:13.435 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-12 00:44:31.069542969 +0000 2024-09-12T00:45:13.435 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-12 00:39:18.177142463 +0000 2024-09-12T00:45:13.435 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-12 00:39:18.177142463 +0000 2024-09-12T00:45:13.435 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-12 00:39:18.177142463 +0000 2024-09-12T00:45:13.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:45:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-12T00:45:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-12T00:45:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000109627 s, 4.7 MB/s 2024-09-12T00:45:13.499 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:45:13.556 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-12T00:45:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:45:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:13.613 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T00:45:13.613 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:13.613 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:13.614 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-12 00:44:31.102542219 +0000 2024-09-12T00:45:13.614 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-12 00:39:18.495134989 +0000 2024-09-12T00:45:13.614 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-12 00:39:18.495134989 +0000 2024-09-12T00:45:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-12 00:39:18.495134989 +0000 2024-09-12T00:45:13.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:45:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-12T00:45:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-12T00:45:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000106071 s, 4.8 MB/s 2024-09-12T00:45:13.681 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:45:13.737 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-12 00:44:31.135541468 +0000 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-12 00:39:18.834127021 +0000 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-12 00:39:18.834127021 +0000 2024-09-12T00:45:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-12 00:39:18.834127021 +0000 2024-09-12T00:45:13.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi071=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: Saving service mgr spec with placement smithi002=x;smithi071=y;smithi167=z;count:3 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:13.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:13 smithi002 ceph-mon[31210]: Reconfiguring daemon mgr.x on smithi002 2024-09-12T00:45:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-12T00:45:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-12T00:45:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000106558 s, 4.8 MB/s 2024-09-12T00:45:13.860 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:45:13.917 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T00:45:13.917 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:45:13.937 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:45:13.937 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-12T00:45:13.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi071=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:13.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: Saving service mgr spec with placement smithi002=x;smithi071=y;smithi167=z;count:3 2024-09-12T00:45:13.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:13.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:13.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:13.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T00:45:13.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:13.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:13.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:13.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:13 smithi071 ceph-mon[35276]: Reconfiguring daemon mgr.x on smithi002 2024-09-12T00:45:13.959 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:45:13.959 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:13.959 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T00:45:13.959 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:13.960 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:13.960 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-12 00:45:02.956932505 +0000 2024-09-12T00:45:13.960 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-12 00:39:24.978997729 +0000 2024-09-12T00:45:13.960 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-12 00:39:24.978997729 +0000 2024-09-12T00:45:13.960 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-12 00:39:24.978997729 +0000 2024-09-12T00:45:13.960 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:45:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-12T00:45:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-12T00:45:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000290124 s, 1.8 MB/s 2024-09-12T00:45:14.029 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi071=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: Saving service mgr spec with placement smithi002=x;smithi071=y;smithi167=z;count:3 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:13 smithi167 ceph-mon[35234]: Reconfiguring daemon mgr.x on smithi002 2024-09-12T00:45:14.087 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-12 00:45:02.956932505 +0000 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-12 00:39:25.308991810 +0000 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-12 00:39:25.308991810 +0000 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-12 00:39:25.308991810 +0000 2024-09-12T00:45:14.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:45:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-12T00:45:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-12T00:45:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000168985 s, 3.0 MB/s 2024-09-12T00:45:14.209 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:45:14.266 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-12 00:45:02.957932488 +0000 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-12 00:39:25.627986088 +0000 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-12 00:39:25.627986088 +0000 2024-09-12T00:45:14.322 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-12 00:39:25.627986088 +0000 2024-09-12T00:45:14.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:45:14.385 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-12T00:45:14.385 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-12T00:45:14.385 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000238628 s, 2.1 MB/s 2024-09-12T00:45:14.386 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:45:14.443 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-12T00:45:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:45:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:14.498 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T00:45:14.499 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:14.499 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:14.499 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-12 00:45:02.957932488 +0000 2024-09-12T00:45:14.499 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-12 00:39:25.931980635 +0000 2024-09-12T00:45:14.499 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-12 00:39:25.931980635 +0000 2024-09-12T00:45:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-12 00:39:25.931980635 +0000 2024-09-12T00:45:14.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:45:14.563 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-12T00:45:14.563 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-12T00:45:14.563 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000214418 s, 2.4 MB/s 2024-09-12T00:45:14.565 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:45:14.621 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-12T00:45:14.622 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:45:14.635 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:14 smithi071 ceph-mon[35276]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:14.635 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.635 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.635 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:14.636 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:14.636 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:14.642 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:45:14.642 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-12 00:44:54.377766460 +0000 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-12 00:39:31.682741896 +0000 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-12 00:39:31.682741896 +0000 2024-09-12T00:45:14.703 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-12 00:39:31.682741896 +0000 2024-09-12T00:45:14.703 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:45:14.771 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-12T00:45:14.771 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-12T00:45:14.771 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000267648 s, 1.9 MB/s 2024-09-12T00:45:14.773 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:45:14.833 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-12T00:45:14.891 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:45:14.891 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:14.892 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T00:45:14.892 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:14.892 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:14.892 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-12 00:44:54.378766442 +0000 2024-09-12T00:45:14.892 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-12 00:39:32.025735737 +0000 2024-09-12T00:45:14.892 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-12 00:39:32.025735737 +0000 2024-09-12T00:45:14.892 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-12 00:39:32.025735737 +0000 2024-09-12T00:45:14.892 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:45:14.955 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:14 smithi167 ceph-mon[35234]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:14.955 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.955 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.955 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:14.955 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:14.955 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:14.957 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-12T00:45:14.957 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-12T00:45:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000288927 s, 1.8 MB/s 2024-09-12T00:45:14.959 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:45:14.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:14 smithi002 ceph-mon[31210]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:15.018 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-12 00:44:54.378766442 +0000 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-12 00:39:32.366729614 +0000 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-12 00:39:32.366729614 +0000 2024-09-12T00:45:15.075 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-12 00:39:32.366729614 +0000 2024-09-12T00:45:15.076 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:45:15.140 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-12T00:45:15.140 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-12T00:45:15.140 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000246519 s, 2.1 MB/s 2024-09-12T00:45:15.141 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:45:15.198 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-12T00:45:15.254 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:45:15.254 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:45:15.254 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T00:45:15.255 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:45:15.255 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:45:15.255 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-12 00:44:54.378766442 +0000 2024-09-12T00:45:15.255 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-12 00:39:32.691723778 +0000 2024-09-12T00:45:15.255 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-12 00:39:32.691723778 +0000 2024-09-12T00:45:15.255 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-12 00:39:32.691723778 +0000 2024-09-12T00:45:15.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:45:15.318 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-12T00:45:15.319 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-12T00:45:15.319 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000177898 s, 2.9 MB/s 2024-09-12T00:45:15.320 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:45:15.376 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-09-12T00:45:15.377 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T00:45:15.645 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:45:15.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:15 smithi002 ceph-mon[31210]: Reconfiguring mon.b (monmap changed)... 2024-09-12T00:45:15.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:15 smithi002 ceph-mon[31210]: Reconfiguring daemon mon.b on smithi071 2024-09-12T00:45:15.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:15.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:15.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:15.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:15.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:15.922 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:15 smithi167 ceph-mon[35234]: Reconfiguring mon.b (monmap changed)... 2024-09-12T00:45:15.922 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:15 smithi167 ceph-mon[35234]: Reconfiguring daemon mon.b on smithi071 2024-09-12T00:45:15.922 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:15.922 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:15.922 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:15.922 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:15.922 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:15.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:15 smithi071 ceph-mon[35276]: Reconfiguring mon.b (monmap changed)... 2024-09-12T00:45:15.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:15 smithi071 ceph-mon[35276]: Reconfiguring daemon mon.b on smithi071 2024-09-12T00:45:15.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:15.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:15.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T00:45:15.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T00:45:15.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:16.928 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:16 smithi002 ceph-mon[31210]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:16.929 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:16 smithi002 ceph-mon[31210]: Reconfiguring mon.c (monmap changed)... 2024-09-12T00:45:16.929 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:16 smithi002 ceph-mon[31210]: Reconfiguring daemon mon.c on smithi167 2024-09-12T00:45:16.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:16 smithi071 ceph-mon[35276]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:16.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:16 smithi071 ceph-mon[35276]: Reconfiguring mon.c (monmap changed)... 2024-09-12T00:45:16.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:16 smithi071 ceph-mon[35276]: Reconfiguring daemon mon.c on smithi167 2024-09-12T00:45:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:16 smithi167 ceph-mon[35234]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:16 smithi167 ceph-mon[35234]: Reconfiguring mon.c (monmap changed)... 2024-09-12T00:45:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:16 smithi167 ceph-mon[35234]: Reconfiguring daemon mon.c on smithi167 2024-09-12T00:45:17.927 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:45:17.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-09-12T00:45:18.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:18.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:18.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:18.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:18.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:18.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T00:45:18.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:18.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:18.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:17 smithi167 ceph-mon[35234]: Deploying daemon mgr.z on smithi167 2024-09-12T00:45:18.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:18.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:17 smithi071 ceph-mon[35276]: Deploying daemon mgr.z on smithi167 2024-09-12T00:45:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T00:45:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:18.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:18.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:17 smithi002 ceph-mon[31210]: Deploying daemon mgr.z on smithi167 2024-09-12T00:45:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.673+0000 7f98b0667640 1 -- 172.21.15.2:0/347666749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8104fb0 msgr2=0x7f98a81073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.673+0000 7f98b0667640 1 --2- 172.21.15.2:0/347666749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8104fb0 0x7f98a81073a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9898009900 tx=0x7f989802a410 comp rx=0 tx=0).stop 2024-09-12T00:45:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.673+0000 7f98b0667640 1 -- 172.21.15.2:0/347666749 shutdown_connections 2024-09-12T00:45:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.673+0000 7f98b0667640 1 --2- 172.21.15.2:0/347666749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98a81078e0 0x7f98a8109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.673+0000 7f98b0667640 1 --2- 172.21.15.2:0/347666749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8104fb0 0x7f98a81073a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.673+0000 7f98b0667640 1 --2- 172.21.15.2:0/347666749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a8102680 0x7f98a8104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.673+0000 7f98b0667640 1 -- 172.21.15.2:0/347666749 >> 172.21.15.2:0/347666749 conn(0x7f98a80fc280 msgr2=0x7f98a80fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.673+0000 7f98b0667640 1 -- 172.21.15.2:0/347666749 shutdown_connections 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.674+0000 7f98b0667640 1 -- 172.21.15.2:0/347666749 wait complete. 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.674+0000 7f98b0667640 1 Processor -- start 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.674+0000 7f98b0667640 1 -- start start 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.674+0000 7f98b0667640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8102680 0x7f98a819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.674+0000 7f98b0667640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a8104fb0 0x7f98a819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.674+0000 7f98b0667640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98a81078e0 0x7f98a81a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98b0667640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98a810d8b0 con 0x7f98a8102680 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98b0667640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98a810d730 con 0x7f98a8104fb0 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98b0667640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f98a810da30 con 0x7f98a81078e0 2024-09-12T00:45:18.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8102680 0x7f98a819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8102680 0x7f98a819a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34798/0 (socket says 172.21.15.2:34798) 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 -- 172.21.15.2:0/2876050929 learned_addr learned my addr 172.21.15.2:0/2876050929 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98aec04640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98a81078e0 0x7f98a81a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98adc02640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a8104fb0 0x7f98a819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 -- 172.21.15.2:0/2876050929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98a81078e0 msgr2=0x7f98a81a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98a81078e0 0x7f98a81a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 -- 172.21.15.2:0/2876050929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a8104fb0 msgr2=0x7f98a819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a8104fb0 0x7f98a819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 -- 172.21.15.2:0/2876050929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a81a1db0 con 0x7f98a8102680 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98ae403640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8102680 0x7f98a819a180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f98a400d950 tx=0x7f98a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4017070 con 0x7f98a8102680 2024-09-12T00:45:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a4009c30 con 0x7f98a8102680 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a81a20a0 con 0x7f98a8102680 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a400f6b0 con 0x7f98a8102680 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.675+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a81a25b0 con 0x7f98a8102680 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.676+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f98a400f850 con 0x7f98a8102680 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.676+0000 7f989f7fe640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f98940392c0 0x7f989403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.676+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a8109430 con 0x7f98a8102680 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.677+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f98a404bf80 con 0x7f98a8102680 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.677+0000 7f98adc02640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f98940392c0 0x7f989403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.677+0000 7f98adc02640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f98940392c0 0x7f989403b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f989802aa00 tx=0x7f9898031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.681+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98a401ae90 con 0x7f98a8102680 2024-09-12T00:45:18.741 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:18 smithi167 podman[37003]: 2024-09-12 00:45:18.691305363 +0000 UTC m=+0.141534464 container create 925b74cc6ea276796b9be5806fb82acf59ded3f563e41c0e6937886618b596c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-12T00:45:18.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:18.867+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f98a8062630 con 0x7f98940392c0 2024-09-12T00:45:18.992 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:18 smithi167 podman[37003]: 2024-09-12 00:45:18.91046099 +0000 UTC m=+0.360690092 container init 925b74cc6ea276796b9be5806fb82acf59ded3f563e41c0e6937886618b596c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T00:45:18.992 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:18 smithi167 podman[37003]: 2024-09-12 00:45:18.913645436 +0000 UTC m=+0.363874547 container start 925b74cc6ea276796b9be5806fb82acf59ded3f563e41c0e6937886618b596c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T00:45:18.992 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:18 smithi167 ceph-mgr[37030]: -- 172.21.15.167:0/3573409459 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569352170e0 con 0x5569351f5400 2024-09-12T00:45:19.246 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:18 smithi167 bash[37003]: 925b74cc6ea276796b9be5806fb82acf59ded3f563e41c0e6937886618b596c6 2024-09-12T00:45:19.246 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:18 smithi167 systemd[1]: Started Ceph mgr.z for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:45:19.246 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:19.038+0000 7f89aa3ef040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T00:45:19.246 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:19.099+0000 7f89aa3ef040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T00:45:19.246 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:19.247+0000 7f89aa3ef040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T00:45:19.537 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:19.313+0000 7f89aa3ef040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T00:45:19.537 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:19.460+0000 7f89aa3ef040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:45:19.915 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:19.603+0000 7f89aa3ef040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:19.916+0000 7f89aa3ef040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:19.916 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:19.917 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:19.917 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T00:45:19.917 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:19.917 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:19.917 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-mon[35234]: Deploying daemon mgr.y on smithi071 2024-09-12T00:45:19.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:19.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:19.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:45:19.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:45:19.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:19.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:19.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T00:45:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:19.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:19 smithi002 ceph-mon[31210]: Deploying daemon mgr.y on smithi071 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:20.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T00:45:20.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T00:45:20.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T00:45:20.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:20.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:19 smithi071 ceph-mon[35276]: Deploying daemon mgr.y on smithi071 2024-09-12T00:45:20.287 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:19.977+0000 7f89aa3ef040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T00:45:20.287 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:20.159+0000 7f89aa3ef040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T00:45:20.918 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:20 smithi071 systemd[1]: Starting Ceph mgr.y for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:45:21.178 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:20 smithi071 podman[36625]: 2024-09-12 00:45:20.919485299 +0000 UTC m=+0.109958491 container create eb9232484a384512bbc84e08111ffbda874abfda2dae3155b4cbbd6a6b276f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T00:45:21.178 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:20 smithi071 podman[36625]: 2024-09-12 00:45:20.824975094 +0000 UTC m=+0.015448241 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:45:21.178 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 podman[36625]: 2024-09-12 00:45:21.104910549 +0000 UTC m=+0.295383695 container init eb9232484a384512bbc84e08111ffbda874abfda2dae3155b4cbbd6a6b276f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T00:45:21.178 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 podman[36625]: 2024-09-12 00:45:21.107985204 +0000 UTC m=+0.298458350 container start eb9232484a384512bbc84e08111ffbda874abfda2dae3155b4cbbd6a6b276f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T00:45:21.179 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mgr[36644]: -- 172.21.15.71:0/2004469261 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac093510e0 con 0x55ac0932f000 2024-09-12T00:45:21.179 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 bash[36625]: eb9232484a384512bbc84e08111ffbda874abfda2dae3155b4cbbd6a6b276f38 2024-09-12T00:45:21.287 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:21.037+0000 7f89aa3ef040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T00:45:21.287 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:21.103+0000 7f89aa3ef040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T00:45:21.441 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 systemd[1]: Started Ceph mgr.y for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:45:21.441 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:21.229+0000 7f390b5ea040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T00:45:21.441 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:21.288+0000 7f390b5ea040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T00:45:21.781 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:21.443+0000 7f390b5ea040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T00:45:21.781 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:21.513+0000 7f390b5ea040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T00:45:21.781 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:21.670+0000 7f390b5ea040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1184800117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b4432c-3283-4d50-9efe-ebf233a7f1aa"}]: dispatch 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1184800117' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b4432c-3283-4d50-9efe-ebf233a7f1aa"}]': finished 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:21.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:21 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1682244364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:45:22.037 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:21.857+0000 7f89aa3ef040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T00:45:22.037 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:21.979+0000 7f89aa3ef040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T00:45:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1184800117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b4432c-3283-4d50-9efe-ebf233a7f1aa"}]: dispatch 2024-09-12T00:45:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1184800117' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b4432c-3283-4d50-9efe-ebf233a7f1aa"}]': finished 2024-09-12T00:45:22.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T00:45:22.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:22.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:22.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:22.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:22.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:22.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:22.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:21 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1682244364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:45:22.096 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:21.829+0000 7f390b5ea040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T00:45:22.096 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:22.096 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1184800117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b4432c-3283-4d50-9efe-ebf233a7f1aa"}]: dispatch 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1184800117' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b4432c-3283-4d50-9efe-ebf233a7f1aa"}]': finished 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:22.097 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:21 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1682244364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:45:22.338 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.126+0000 7f89aa3ef040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:45:22.338 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.188+0000 7f89aa3ef040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T00:45:22.338 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.339+0000 7f89aa3ef040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T00:45:22.401 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:22.151+0000 7f390b5ea040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T00:45:22.402 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:22.213+0000 7f390b5ea040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T00:45:22.635 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.414+0000 7f89aa3ef040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T00:45:22.635 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.474+0000 7f89aa3ef040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T00:45:22.635 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.636+0000 7f89aa3ef040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T00:45:22.691 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:22.402+0000 7f390b5ea040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T00:45:22.908 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.703+0000 7f89aa3ef040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T00:45:22.909 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.769+0000 7f89aa3ef040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T00:45:22.909 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.850+0000 7f89aa3ef040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T00:45:23.287 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.910+0000 7f89aa3ef040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T00:45:23.287 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:22.969+0000 7f89aa3ef040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T00:45:23.691 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:23.295+0000 7f390b5ea040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:23.361+0000 7f390b5ea040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:23.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:23.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:23.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:23.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:23.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:23.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:23.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:24.037 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:45:23 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:45:23.753+0000 7f89aa3ef040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T00:45:24.323 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.071+0000 7f390b5ea040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T00:45:24.323 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.183+0000 7f390b5ea040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T00:45:24.323 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.324+0000 7f390b5ea040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:45:24.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:24.560+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 14) ==== 92059+0+0 (secure 0 0 0) 0x7f98a4023870 con 0x7f98a8102680 2024-09-12T00:45:24.600 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.384+0000 7f390b5ea040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T00:45:24.600 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.529+0000 7f390b5ea040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T00:45:24.600 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.601+0000 7f390b5ea040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T00:45:24.601 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-mon[35276]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:24.601 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-mon[35276]: Standby manager daemon z started 2024-09-12T00:45:24.601 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T00:45:24.601 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:45:24.601 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T00:45:24.601 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:45:24.878 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.660+0000 7f390b5ea040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T00:45:24.878 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.815+0000 7f390b5ea040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T00:45:24.879 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.879+0000 7f390b5ea040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T00:45:24.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:24 smithi002 ceph-mon[31210]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:24.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:24 smithi002 ceph-mon[31210]: Standby manager daemon z started 2024-09-12T00:45:24.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:24 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T00:45:24.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:24 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:45:24.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:24 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T00:45:24.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:24 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:45:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:24 smithi167 ceph-mon[35234]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:24 smithi167 ceph-mon[35234]: Standby manager daemon z started 2024-09-12T00:45:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:24 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T00:45:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:24 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:45:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:24 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T00:45:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:24 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.167:0/624522256' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:45:25.143 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:24.945+0000 7f390b5ea040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T00:45:25.143 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:25.026+0000 7f390b5ea040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T00:45:25.143 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:25.084+0000 7f390b5ea040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T00:45:25.143 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:25.143+0000 7f390b5ea040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T00:45:25.923 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:25 smithi071 ceph-mon[35276]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-12T00:45:25.923 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:25 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T00:45:25.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:25 smithi002 ceph-mon[31210]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-12T00:45:25.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:25 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T00:45:26.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:25 smithi167 ceph-mon[35234]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-12T00:45:26.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:25 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T00:45:26.191 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:45:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:45:25.924+0000 7f390b5ea040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T00:45:26.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:26 smithi002 ceph-mon[31210]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:26.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:26 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:26.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:26 smithi002 ceph-mon[31210]: Standby manager daemon y started 2024-09-12T00:45:26.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:26 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T00:45:26.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:26 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:45:26.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:26 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T00:45:26.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:26 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:45:26.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:26.832+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f98a401e120 con 0x7f98a8102680 2024-09-12T00:45:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:26 smithi071 ceph-mon[35276]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:26.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:26 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:26.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:26 smithi071 ceph-mon[35276]: Standby manager daemon y started 2024-09-12T00:45:26.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:26 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T00:45:26.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:26 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:45:26.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:26 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T00:45:26.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:26 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:45:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:26 smithi167 ceph-mon[35234]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:26 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:27.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:26 smithi167 ceph-mon[35234]: Standby manager daemon y started 2024-09-12T00:45:27.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:26 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T00:45:27.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:26 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:45:27.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:26 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T00:45:27.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:26 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.71:0/3122152005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:45:27.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:27 smithi002 ceph-mon[31210]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:27.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:27 smithi002 ceph-mon[31210]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-12T00:45:27.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:27 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T00:45:28.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:27 smithi071 ceph-mon[35276]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:28.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:27 smithi071 ceph-mon[35276]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-12T00:45:28.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:27 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T00:45:28.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:27 smithi167 ceph-mon[35234]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:28.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:27 smithi167 ceph-mon[35234]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-12T00:45:28.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:27 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T00:45:30.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:29 smithi167 ceph-mon[35234]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:30.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T00:45:30.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:30.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:29 smithi167 ceph-mon[35234]: Deploying daemon osd.0 on smithi002 2024-09-12T00:45:30.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:29 smithi002 ceph-mon[31210]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:30.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T00:45:30.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:30.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:29 smithi002 ceph-mon[31210]: Deploying daemon osd.0 on smithi002 2024-09-12T00:45:30.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:29 smithi071 ceph-mon[35276]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:30.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T00:45:30.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:30.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:29 smithi071 ceph-mon[35276]: Deploying daemon osd.0 on smithi002 2024-09-12T00:45:32.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:31 smithi071 ceph-mon[35276]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:32.200 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:31 smithi002 ceph-mon[31210]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:32.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:31 smithi167 ceph-mon[35234]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:34.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:33 smithi071 ceph-mon[35276]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:34.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:33 smithi002 ceph-mon[31210]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:34.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:33 smithi167 ceph-mon[35234]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:36.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:35 smithi071 ceph-mon[35276]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:36.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:35 smithi002 ceph-mon[31210]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:36.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:35 smithi167 ceph-mon[35234]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:36.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:36.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:36.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:37.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:37.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:37.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:37.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:37.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:37.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:38.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:37 smithi071 ceph-mon[35276]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:38.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:37 smithi002 ceph-mon[31210]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:38.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:37 smithi167 ceph-mon[35234]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:38 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:38 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:38 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:38 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:38 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:39.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:38 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:39.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:38 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:39.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:38 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:39.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:38 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:39.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:38 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:39.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:38 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:39.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:38 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:39.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:38 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:39.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:38 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:39.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:38 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.144+0000 7f989f7fe640 1 -- 172.21.15.2:0/2876050929 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f98a8062630 con 0x7f98940392c0 2024-09-12T00:45:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-09-12T00:45:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f98940392c0 msgr2=0x7f989403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f98940392c0 0x7f989403b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f989802aa00 tx=0x7f9898031400 comp rx=0 tx=0).stop 2024-09-12T00:45:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8102680 msgr2=0x7f98a819a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8102680 0x7f98a819a180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f98a400d950 tx=0x7f98a400de10 comp rx=0 tx=0).stop 2024-09-12T00:45:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 shutdown_connections 2024-09-12T00:45:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f98940392c0 0x7f989403b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98a81078e0 0x7f98a81a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a8104fb0 0x7f98a819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 --2- 172.21.15.2:0/2876050929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98a8102680 0x7f98a819a180 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 >> 172.21.15.2:0/2876050929 conn(0x7f98a80fc280 msgr2=0x7f98a8101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 shutdown_connections 2024-09-12T00:45:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:45:40.147+0000 7f98b0667640 1 -- 172.21.15.2:0/2876050929 wait complete. 2024-09-12T00:45:40.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:40 smithi071 ceph-mon[35276]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:40.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:40.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:40 smithi002 ceph-mon[31210]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:40 smithi167 ceph-mon[35234]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:45:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:40.795 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T00:45:40.798 INFO:tasks.cephadm:Deploying osd.1 on smithi071 with /dev/vg_nvme/lv_4... 2024-09-12T00:45:40.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T00:45:41.037 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:45:42.304 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:45:42 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T00:45:42.195+0000 7f0f0d45e640 -1 osd.0 0 log_to_monitors true 2024-09-12T00:45:42.643 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:42 smithi071 ceph-mon[35276]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:42.644 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:42 smithi071 ceph-mon[35276]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T00:45:42.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:42 smithi002 ceph-mon[31210]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:42.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:42 smithi002 ceph-mon[31210]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T00:45:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:42 smithi167 ceph-mon[35234]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:42 smithi167 ceph-mon[35234]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T00:45:43.311 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:45:43.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-09-12T00:45:43.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:43 smithi071 ceph-mon[35276]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T00:45:43.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:43 smithi071 ceph-mon[35276]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T00:45:43.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:43 smithi071 ceph-mon[35276]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:45:43.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:43.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:43 smithi071 ceph-mon[35276]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:45:43.582 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:45:43.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:43 smithi002 ceph-mon[31210]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T00:45:43.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:43 smithi002 ceph-mon[31210]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T00:45:43.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:43 smithi002 ceph-mon[31210]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:45:43.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:43.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:43 smithi002 ceph-mon[31210]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:45:43.632 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:45:43 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T00:45:43.388+0000 7f0f08bbe640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:45:43.632 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:45:43 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T00:45:43.391+0000 7f0f051f8640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:45:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:43 smithi167 ceph-mon[35234]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T00:45:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:43 smithi167 ceph-mon[35234]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T00:45:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:43 smithi167 ceph-mon[35234]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:45:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:43 smithi167 ceph-mon[35234]: from='osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 -- 172.21.15.71:0/2198218767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4105030 msgr2=0x7f2da4107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/2198218767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4105030 0x7f2da4107420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009900 tx=0x7f2d9402a410 comp rx=0 tx=0).stop 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 -- 172.21.15.71:0/2198218767 shutdown_connections 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/2198218767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4107960 0x7f2da4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/2198218767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4105030 0x7f2da4107420 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/2198218767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4102700 0x7f2da4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 -- 172.21.15.71:0/2198218767 >> 172.21.15.71:0/2198218767 conn(0x7f2da40fc280 msgr2=0x7f2da40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 -- 172.21.15.71:0/2198218767 shutdown_connections 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 -- 172.21.15.71:0/2198218767 wait complete. 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.047+0000 7f2da9f1c640 1 Processor -- start 2024-09-12T00:45:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da9f1c640 1 -- start start 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da9f1c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4102700 0x7f2da4197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da9f1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4105030 0x7f2da4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da9f1c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4107960 0x7f2da419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da9f1c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2da410d850 con 0x7f2da4105030 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da9f1c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2da410d6d0 con 0x7f2da4102700 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da9f1c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2da410d9d0 con 0x7f2da4107960 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4102700 0x7f2da4197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4102700 0x7f2da4197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52236/0 (socket says 172.21.15.71:52236) 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 -- 172.21.15.71:0/869658772 learned_addr learned my addr 172.21.15.71:0/869658772 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da2ffd640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4105030 0x7f2da4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da3fff640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4107960 0x7f2da419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 -- 172.21.15.71:0/869658772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4107960 msgr2=0x7f2da419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4107960 0x7f2da419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 -- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4105030 msgr2=0x7f2da4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4105030 0x7f2da4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 -- 172.21.15.71:0/869658772 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da419fb60 con 0x7f2da4102700 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da2ffd640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4105030 0x7f2da4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.048+0000 7f2da37fe640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4102700 0x7f2da4197f30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800e9f0 tx=0x7f2d9800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.049+0000 7f2da0ff9640 1 -- 172.21.15.71:0/869658772 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9800cd80 con 0x7f2da4102700 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.049+0000 7f2da0ff9640 1 -- 172.21.15.71:0/869658772 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d98010910 con 0x7f2da4102700 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.049+0000 7f2da0ff9640 1 -- 172.21.15.71:0/869658772 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98018990 con 0x7f2da4102700 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.049+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da419fe50 con 0x7f2da4102700 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.049+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da41a02b0 con 0x7f2da4102700 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.050+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da40fdd70 con 0x7f2da4102700 2024-09-12T00:45:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.051+0000 7f2da0ff9640 1 -- 172.21.15.71:0/869658772 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f2d98010ac0 con 0x7f2da4102700 2024-09-12T00:45:44.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.051+0000 7f2da0ff9640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d8c0a2ba0 0x7f2d8c0a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:45:44.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.052+0000 7f2da0ff9640 1 -- 172.21.15.71:0/869658772 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f2d980cda70 con 0x7f2da4102700 2024-09-12T00:45:44.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.052+0000 7f2da2ffd640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d8c0a2ba0 0x7f2d8c0a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:45:44.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.052+0000 7f2da2ffd640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d8c0a2ba0 0x7f2d8c0a5060 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d94005ab0 tx=0x7f2d94000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:45:44.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.055+0000 7f2da0ff9640 1 -- 172.21.15.71:0/869658772 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d9809bf10 con 0x7f2da4102700 2024-09-12T00:45:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:45:44.236+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2da4062630 con 0x7f2d8c0a2ba0 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi002 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:44.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:44.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:45:44.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:45:44.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:44.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:44 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi002 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:44.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:44.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:45:44.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:45:44.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:44.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:44 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T00:45:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi002 2024-09-12T00:45:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:44.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:44 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:45.664 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:45 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:45:45.665 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:45 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:45:45.665 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:45 smithi071 ceph-mon[35276]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:45.665 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:45 smithi071 ceph-mon[35276]: osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] boot 2024-09-12T00:45:45.665 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:45 smithi071 ceph-mon[35276]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T00:45:45.665 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:45.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:45 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:45:45.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:45 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:45:45.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:45 smithi002 ceph-mon[31210]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:45.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:45 smithi002 ceph-mon[31210]: osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] boot 2024-09-12T00:45:45.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:45 smithi002 ceph-mon[31210]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T00:45:45.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:45 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:45:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:45 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:45:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:45 smithi167 ceph-mon[35234]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:45:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:45 smithi167 ceph-mon[35234]: osd.0 [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] boot 2024-09-12T00:45:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:45 smithi167 ceph-mon[35234]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T00:45:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:45:46.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:46 smithi071 ceph-mon[35276]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:46.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:46 smithi071 ceph-mon[35276]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T00:45:46.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:46 smithi002 ceph-mon[31210]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:46 smithi002 ceph-mon[31210]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T00:45:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:46 smithi167 ceph-mon[35234]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T00:45:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:46 smithi167 ceph-mon[35234]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T00:45:47.688 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:47 smithi167 ceph-mon[35234]: from='client.? 172.21.15.71:0/1382119582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]: dispatch 2024-09-12T00:45:47.688 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:47 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]: dispatch 2024-09-12T00:45:47.688 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:47 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]': finished 2024-09-12T00:45:47.689 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:47 smithi167 ceph-mon[35234]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T00:45:47.689 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:47 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:45:47.689 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:47 smithi167 ceph-mon[35234]: from='client.? 172.21.15.71:0/3680447187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:45:47.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:47 smithi071 ceph-mon[35276]: from='client.? 172.21.15.71:0/1382119582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]: dispatch 2024-09-12T00:45:47.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:47 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]: dispatch 2024-09-12T00:45:47.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:47 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]': finished 2024-09-12T00:45:47.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:47 smithi071 ceph-mon[35276]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T00:45:47.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:47 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:45:47.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:47 smithi071 ceph-mon[35276]: from='client.? 172.21.15.71:0/3680447187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:45:47.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:47 smithi002 ceph-mon[31210]: from='client.? 172.21.15.71:0/1382119582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]: dispatch 2024-09-12T00:45:47.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:47 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]: dispatch 2024-09-12T00:45:47.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:47 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e439cd3f-487d-4354-ab99-7d3cada1e585"}]': finished 2024-09-12T00:45:47.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:47 smithi002 ceph-mon[31210]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T00:45:47.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:47 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:45:47.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:47 smithi002 ceph-mon[31210]: from='client.? 172.21.15.71:0/3680447187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:45:48.921 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:48 smithi167 ceph-mon[35234]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:48 smithi071 ceph-mon[35276]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:48.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:48 smithi002 ceph-mon[31210]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:50.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:50 smithi071 ceph-mon[35276]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:50 smithi002 ceph-mon[31210]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:51.040 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:50 smithi167 ceph-mon[35234]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:52.893 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:52 smithi071 ceph-mon[35276]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:52.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:52 smithi002 ceph-mon[31210]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:53.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:52 smithi167 ceph-mon[35234]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:54.645 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:54 smithi071 ceph-mon[35276]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:54.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:54 smithi002 ceph-mon[31210]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:55.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:54 smithi167 ceph-mon[35234]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:55.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T00:45:55.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:55.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:55 smithi071 ceph-mon[35276]: Deploying daemon osd.1 on smithi071 2024-09-12T00:45:55.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T00:45:55.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:55.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:55 smithi002 ceph-mon[31210]: Deploying daemon osd.1 on smithi071 2024-09-12T00:45:56.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T00:45:56.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:45:56.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:55 smithi167 ceph-mon[35234]: Deploying daemon osd.1 on smithi071 2024-09-12T00:45:56.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:56 smithi071 ceph-mon[35276]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:56.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:56 smithi002 ceph-mon[31210]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:57.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:56 smithi167 ceph-mon[35234]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:45:58 smithi167 ceph-mon[35234]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:45:58 smithi071 ceph-mon[35276]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:45:58.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:45:58 smithi002 ceph-mon[31210]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:00 smithi071 ceph-mon[35276]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:00.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:00 smithi002 ceph-mon[31210]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:01.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:00 smithi167 ceph-mon[35234]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:01.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:01 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:01 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:01 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:01.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:01 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:01.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:01 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:01.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:01 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:01 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:01 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:01 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:02.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:02 smithi071 ceph-mon[35276]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:02.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:02 smithi002 ceph-mon[31210]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:03.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:02 smithi167 ceph-mon[35234]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:04.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:04 smithi071 ceph-mon[35276]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:04.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:04 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:04 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:04 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:04.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:04 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:04.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:04 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:04 smithi002 ceph-mon[31210]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:04 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:04 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:04 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:04 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:04 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:04 smithi167 ceph-mon[35234]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:04 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:04 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:04 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:04 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:04 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:04.871 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 1 on host 'smithi071' 2024-09-12T00:46:04.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.872+0000 7f2da0ff9640 1 -- 172.21.15.71:0/869658772 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2da4062630 con 0x7f2d8c0a2ba0 2024-09-12T00:46:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.874+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d8c0a2ba0 msgr2=0x7f2d8c0a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.874+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d8c0a2ba0 0x7f2d8c0a5060 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d94005ab0 tx=0x7f2d94000bc0 comp rx=0 tx=0).stop 2024-09-12T00:46:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4102700 msgr2=0x7f2da4197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4102700 0x7f2da4197f30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800e9f0 tx=0x7f2d9800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:46:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 shutdown_connections 2024-09-12T00:46:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d8c0a2ba0 0x7f2d8c0a5060 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4107960 0x7f2da419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4105030 0x7f2da4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 --2- 172.21.15.71:0/869658772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2da4102700 0x7f2da4197f30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 >> 172.21.15.71:0/869658772 conn(0x7f2da40fc280 msgr2=0x7f2da4102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:46:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 shutdown_connections 2024-09-12T00:46:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:04.875+0000 7f2da9f1c640 1 -- 172.21.15.71:0/869658772 wait complete. 2024-09-12T00:46:05.478 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:05.478 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:05.478 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:05.510 DEBUG:teuthology.orchestra.run.smithi071:osd.1> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T00:46:05.512 INFO:tasks.cephadm:Deploying osd.2 on smithi167 with /dev/vg_nvme/lv_4... 2024-09-12T00:46:05.512 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T00:46:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:05.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:46:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:06.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:06 smithi167 ceph-mon[35234]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:06.640 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:06 smithi071 ceph-mon[35276]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:06.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:06 smithi002 ceph-mon[31210]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:07.192 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1[39754]: 2024-09-12T00:46:07.176+0000 7fc224ad8640 -1 osd.1 0 log_to_monitors true 2024-09-12T00:46:07.433 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:07 smithi167 ceph-mon[35234]: from='osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T00:46:07.434 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:07 smithi167 ceph-mon[35234]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T00:46:07.561 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:07 smithi071 ceph-mon[35276]: from='osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T00:46:07.562 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:07 smithi071 ceph-mon[35276]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T00:46:07.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:07 smithi002 ceph-mon[31210]: from='osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T00:46:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:07 smithi002 ceph-mon[31210]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T00:46:08.126 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:46:08.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_4 2024-09-12T00:46:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:46:08.439 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:08 smithi167 ceph-mon[35234]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:08.440 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:08 smithi167 ceph-mon[35234]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T00:46:08.440 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:08 smithi167 ceph-mon[35234]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T00:46:08.440 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:08 smithi167 ceph-mon[35234]: from='osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:46:08.440 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:08.440 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:08 smithi167 ceph-mon[35234]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:46:08.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:08 smithi071 ceph-mon[35276]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:08.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:08 smithi071 ceph-mon[35276]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T00:46:08.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:08 smithi071 ceph-mon[35276]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T00:46:08.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:08 smithi071 ceph-mon[35276]: from='osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:46:08.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:08 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:08.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:08 smithi071 ceph-mon[35276]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:46:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:08 smithi002 ceph-mon[31210]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:08 smithi002 ceph-mon[31210]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T00:46:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:08 smithi002 ceph-mon[31210]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T00:46:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:08 smithi002 ceph-mon[31210]: from='osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:46:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:08 smithi002 ceph-mon[31210]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:46:08.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.880+0000 7f1a2a964640 1 -- 172.21.15.167:0/1643682104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 msgr2=0x7f1a24102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.880+0000 7f1a2a964640 1 --2- 172.21.15.167:0/1643682104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 0x7f1a24102180 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009900 tx=0x7f1a1802a410 comp rx=0 tx=0).stop 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 -- 172.21.15.167:0/1643682104 shutdown_connections 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 --2- 172.21.15.167:0/1643682104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a241026c0 0x7f1a24108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 --2- 172.21.15.167:0/1643682104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 0x7f1a24102180 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 --2- 172.21.15.167:0/1643682104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a24100b00 0x7f1a24100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 -- 172.21.15.167:0/1643682104 >> 172.21.15.167:0/1643682104 conn(0x7f1a240fc290 msgr2=0x7f1a240fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 -- 172.21.15.167:0/1643682104 shutdown_connections 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 -- 172.21.15.167:0/1643682104 wait complete. 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 Processor -- start 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.881+0000 7f1a2a964640 1 -- start start 2024-09-12T00:46:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a2a964640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a24100b00 0x7f1a24104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a2a964640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 0x7f1a241030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a2a964640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a241026c0 0x7f1a24103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a2a964640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2410c7e0 con 0x7f1a241026c0 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a2a964640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2410c660 con 0x7f1a24100b00 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a2a964640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2410c960 con 0x7f1a24101d00 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 0x7f1a241030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 0x7f1a241030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49898/0 (socket says 172.21.15.167:49898) 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 -- 172.21.15.167:0/2626537633 learned_addr learned my addr 172.21.15.167:0/2626537633 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a23fff640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a24100b00 0x7f1a24104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a28f01640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a241026c0 0x7f1a24103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 -- 172.21.15.167:0/2626537633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a24100b00 msgr2=0x7f1a24104a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a24100b00 0x7f1a24104a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:08.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 -- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a241026c0 msgr2=0x7f1a24103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a241026c0 0x7f1a24103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 -- 172.21.15.167:0/2626537633 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a24103ee0 con 0x7f1a24101d00 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a28f01640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a241026c0 0x7f1a24103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a237fe640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 0x7f1a241030e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009230 tx=0x7f1a18004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a217fa640 1 -- 172.21.15.167:0/2626537633 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1803f030 con 0x7f1a24101d00 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.882+0000 7f1a217fa640 1 -- 172.21.15.167:0/2626537633 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a18003ce0 con 0x7f1a24101d00 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.883+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a241a20b0 con 0x7f1a24101d00 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.883+0000 7f1a217fa640 1 -- 172.21.15.167:0/2626537633 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18035070 con 0x7f1a24101d00 2024-09-12T00:46:08.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.883+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a241a25e0 con 0x7f1a24101d00 2024-09-12T00:46:08.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.884+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a241a27b0 con 0x7f1a24101d00 2024-09-12T00:46:08.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.885+0000 7f1a217fa640 1 -- 172.21.15.167:0/2626537633 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f1a18042030 con 0x7f1a24101d00 2024-09-12T00:46:08.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.885+0000 7f1a217fa640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1a0c0a2af0 0x7f1a0c0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:08.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.885+0000 7f1a217fa640 1 -- 172.21.15.167:0/2626537633 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f1a180ee080 con 0x7f1a24101d00 2024-09-12T00:46:08.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.885+0000 7f1a23fff640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1a0c0a2af0 0x7f1a0c0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:08.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.886+0000 7f1a23fff640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1a0c0a2af0 0x7f1a0c0a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1a24101b60 tx=0x7f1a1400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:46:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:08.890+0000 7f1a217fa640 1 -- 172.21.15.167:0/2626537633 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a180bc950 con 0x7f1a24101d00 2024-09-12T00:46:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:09.072+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1a2406aef0 con 0x7f1a0c0a2af0 2024-09-12T00:46:09.441 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1[39754]: 2024-09-12T00:46:09.146+0000 7fc220238640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:46:09.442 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1[39754]: 2024-09-12T00:46:09.151+0000 7fc21886a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:46:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:46:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T00:46:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi071 2024-09-12T00:46:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:09.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:09 smithi071 ceph-mon[35276]: from='osd.1 ' entity='osd.1' 2024-09-12T00:46:09.449 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi071 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:09.450 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.451 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:46:09.451 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:46:09.451 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:09.451 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:09 smithi167 ceph-mon[35234]: from='osd.1 ' entity='osd.1' 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi071 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-12T00:46:09.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:09.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:09.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:09.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:46:09.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:46:09.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:09.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:09 smithi002 ceph-mon[31210]: from='osd.1 ' entity='osd.1' 2024-09-12T00:46:10.425 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:10 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:46:10.425 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:10 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:46:10.426 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:10 smithi167 ceph-mon[35234]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:10.426 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:10 smithi167 ceph-mon[35234]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:46:10.426 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:10 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:10.427 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:10 smithi167 ceph-mon[35234]: osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] boot 2024-09-12T00:46:10.427 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:10 smithi167 ceph-mon[35234]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T00:46:10.427 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:10 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:10.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:10 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:46:10.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:10 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:46:10.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:10 smithi071 ceph-mon[35276]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:10.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:10 smithi071 ceph-mon[35276]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:46:10.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:10.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:10 smithi071 ceph-mon[35276]: osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] boot 2024-09-12T00:46:10.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:10 smithi071 ceph-mon[35276]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T00:46:10.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:10 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:46:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:10 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:46:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:10 smithi002 ceph-mon[31210]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T00:46:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:10 smithi002 ceph-mon[31210]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:46:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:10 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:10 smithi002 ceph-mon[31210]: osd.1 [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] boot 2024-09-12T00:46:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:10 smithi002 ceph-mon[31210]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T00:46:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:10 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:46:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:12 smithi167 ceph-mon[35234]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:12 smithi167 ceph-mon[35234]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T00:46:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:12 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/131219640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]: dispatch 2024-09-12T00:46:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:12 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]: dispatch 2024-09-12T00:46:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:12 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]': finished 2024-09-12T00:46:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:12 smithi167 ceph-mon[35234]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T00:46:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:12 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:12.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:12 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/3709823849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:46:12.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:12 smithi071 ceph-mon[35276]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:12 smithi071 ceph-mon[35276]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T00:46:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:12 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/131219640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]: dispatch 2024-09-12T00:46:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:12 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]: dispatch 2024-09-12T00:46:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:12 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]': finished 2024-09-12T00:46:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:12 smithi071 ceph-mon[35276]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T00:46:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:12 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:12 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/3709823849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:46:12.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:12 smithi002 ceph-mon[31210]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:12.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:12 smithi002 ceph-mon[31210]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T00:46:12.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:12 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/131219640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]: dispatch 2024-09-12T00:46:12.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:12 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]: dispatch 2024-09-12T00:46:12.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:12 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa192766-bc23-47c9-b1ff-343437163ca5"}]': finished 2024-09-12T00:46:12.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:12 smithi002 ceph-mon[31210]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T00:46:12.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:12 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:12.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:12 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/3709823849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:46:14.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:14 smithi071 ceph-mon[35276]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:14.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:14 smithi002 ceph-mon[31210]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:14.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:14 smithi167 ceph-mon[35234]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:16.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:16 smithi071 ceph-mon[35276]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:16.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:16 smithi002 ceph-mon[31210]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:16.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:16 smithi167 ceph-mon[35234]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:18.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:18 smithi071 ceph-mon[35276]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:18.456 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:18 smithi167 ceph-mon[35234]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:18.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:18 smithi002 ceph-mon[31210]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:20.374 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:20 smithi167 ceph-mon[35234]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:20.374 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T00:46:20.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:20.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:20 smithi167 ceph-mon[35234]: Deploying daemon osd.2 on smithi167 2024-09-12T00:46:20.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:20 smithi071 ceph-mon[35276]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:20.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T00:46:20.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:20.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:20 smithi071 ceph-mon[35276]: Deploying daemon osd.2 on smithi167 2024-09-12T00:46:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:20 smithi002 ceph-mon[31210]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T00:46:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:20 smithi002 ceph-mon[31210]: Deploying daemon osd.2 on smithi167 2024-09-12T00:46:22.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:22 smithi071 ceph-mon[35276]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:22.458 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:22 smithi167 ceph-mon[35234]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:22.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:22 smithi002 ceph-mon[31210]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:24.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:24 smithi071 ceph-mon[35276]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:24.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:24 smithi002 ceph-mon[31210]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:24.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:24 smithi167 ceph-mon[35234]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:26.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:26 smithi167 ceph-mon[35234]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:26.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:26 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:26.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:26 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:26.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:26 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:26.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:26 smithi071 ceph-mon[35276]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:26.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:26 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:26.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:26 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:26.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:26 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:26.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:26 smithi002 ceph-mon[31210]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:26.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:26 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:26.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:26 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:26.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:26 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:28.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:28 smithi071 ceph-mon[35276]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:28.445 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:28 smithi167 ceph-mon[35234]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:28.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:28 smithi002 ceph-mon[31210]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:29.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:29.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:29.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:29.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:29.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:29.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:30.255 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:30 smithi167 ceph-mon[35234]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:30.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.298+0000 7f1a217fa640 1 -- 172.21.15.167:0/2626537633 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1a2406aef0 con 0x7f1a0c0a2af0 2024-09-12T00:46:30.298 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 2 on host 'smithi167' 2024-09-12T00:46:30.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1a0c0a2af0 msgr2=0x7f1a0c0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1a0c0a2af0 0x7f1a0c0a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1a24101b60 tx=0x7f1a1400b390 comp rx=0 tx=0).stop 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 msgr2=0x7f1a241030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 0x7f1a241030e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009230 tx=0x7f1a18004360 comp rx=0 tx=0).stop 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 shutdown_connections 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1a0c0a2af0 0x7f1a0c0a4fb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a241026c0 0x7f1a24103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a24101d00 0x7f1a241030e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 --2- 172.21.15.167:0/2626537633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a24100b00 0x7f1a24104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 >> 172.21.15.167:0/2626537633 conn(0x7f1a240fc290 msgr2=0x7f1a2406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 shutdown_connections 2024-09-12T00:46:30.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:46:30.301+0000 7f1a2a964640 1 -- 172.21.15.167:0/2626537633 wait complete. 2024-09-12T00:46:30.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:30 smithi002 ceph-mon[31210]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:30.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:30 smithi071 ceph-mon[35276]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:30.919 DEBUG:teuthology.orchestra.run.smithi167:osd.2> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T00:46:30.922 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_3... 2024-09-12T00:46:30.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T00:46:31.190 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:46:31.487 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:31.487 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:31.487 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:31.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:31.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:31.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:31.593 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:31.593 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:31.593 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:32.422 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:32 smithi002 ceph-mon[31210]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:32.422 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:32 smithi002 ceph-mon[31210]: from='osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T00:46:32.422 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:32 smithi002 ceph-mon[31210]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T00:46:32.481 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:32 smithi167 ceph-mon[35234]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:32.481 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:32 smithi167 ceph-mon[35234]: from='osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T00:46:32.481 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:32 smithi167 ceph-mon[35234]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T00:46:32.481 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:32 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2[40203]: 2024-09-12T00:46:32.220+0000 7f9c3bd91640 -1 osd.2 0 log_to_monitors true 2024-09-12T00:46:32.612 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:32 smithi071 ceph-mon[35276]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:32.612 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:32 smithi071 ceph-mon[35276]: from='osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T00:46:32.612 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:32 smithi071 ceph-mon[35276]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T00:46:33.503 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:46:33.530 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-09-12T00:46:33.531 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:33 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2[40203]: 2024-09-12T00:46:33.314+0000 7f9c374f1640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:46:33.531 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:33 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2[40203]: 2024-09-12T00:46:33.319+0000 7f9c33b2b640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:46:33.531 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:33 smithi167 ceph-mon[35234]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T00:46:33.531 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:33 smithi167 ceph-mon[35234]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T00:46:33.531 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:33 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:33.531 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:33 smithi167 ceph-mon[35234]: from='osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:46:33.531 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:33 smithi167 ceph-mon[35234]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:46:33.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:33 smithi071 ceph-mon[35276]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T00:46:33.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:33 smithi071 ceph-mon[35276]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T00:46:33.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:33 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:33.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:33 smithi071 ceph-mon[35276]: from='osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:46:33.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:33 smithi071 ceph-mon[35276]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:46:33.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:33 smithi002 ceph-mon[31210]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T00:46:33.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:33 smithi002 ceph-mon[31210]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T00:46:33.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:33 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:33.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:33 smithi002 ceph-mon[31210]: from='osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:46:33.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:33 smithi002 ceph-mon[31210]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:46:33.806 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:46:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 -- 172.21.15.2:0/1496543835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644101cd0 msgr2=0x7f4644102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 --2- 172.21.15.2:0/1496543835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644101cd0 0x7f4644102150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4634009900 tx=0x7f463402a410 comp rx=0 tx=0).stop 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 -- 172.21.15.2:0/1496543835 shutdown_connections 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 --2- 172.21.15.2:0/1496543835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4644102690 0x7f4644108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 --2- 172.21.15.2:0/1496543835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644101cd0 0x7f4644102150 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 --2- 172.21.15.2:0/1496543835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4644100ad0 0x7f4644100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 -- 172.21.15.2:0/1496543835 >> 172.21.15.2:0/1496543835 conn(0x7f46440fc280 msgr2=0x7f46440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 -- 172.21.15.2:0/1496543835 shutdown_connections 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 -- 172.21.15.2:0/1496543835 wait complete. 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 Processor -- start 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.256+0000 7f464b8b0640 1 -- start start 2024-09-12T00:46:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f464b8b0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4644100ad0 0x7f4644197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f464b8b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4644101cd0 0x7f4644198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f464b8b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644102690 0x7f464419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f464b8b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f464410c750 con 0x7f4644102690 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f464b8b0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f464410c5d0 con 0x7f4644100ad0 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f464b8b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f464410c8d0 con 0x7f4644101cd0 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4648e4b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4644101cd0 0x7f4644198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4649e4d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644102690 0x7f464419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4648e4b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4644101cd0 0x7f4644198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:40878/0 (socket says 172.21.15.2:40878) 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4648e4b640 1 -- 172.21.15.2:0/146270325 learned_addr learned my addr 172.21.15.2:0/146270325 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f464964c640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4644100ad0 0x7f4644197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4649e4d640 1 -- 172.21.15.2:0/146270325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4644101cd0 msgr2=0x7f4644198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4649e4d640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4644101cd0 0x7f4644198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4649e4d640 1 -- 172.21.15.2:0/146270325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4644100ad0 msgr2=0x7f4644197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4649e4d640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4644100ad0 0x7f4644197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4649e4d640 1 -- 172.21.15.2:0/146270325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464419fb30 con 0x7f4644102690 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4648e4b640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4644101cd0 0x7f4644198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f464964c640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4644100ad0 0x7f4644197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.257+0000 7f4649e4d640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644102690 0x7f464419f4c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f463c00e940 tx=0x7f463c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.258+0000 7f463a7fc640 1 -- 172.21.15.2:0/146270325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c004d20 con 0x7f4644102690 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.258+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4644102f50 con 0x7f4644102690 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.258+0000 7f463a7fc640 1 -- 172.21.15.2:0/146270325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f463c005020 con 0x7f4644102690 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.258+0000 7f463a7fc640 1 -- 172.21.15.2:0/146270325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c0116b0 con 0x7f4644102690 2024-09-12T00:46:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.258+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4644103460 con 0x7f4644102690 2024-09-12T00:46:34.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.259+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4644103720 con 0x7f4644102690 2024-09-12T00:46:34.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.260+0000 7f463a7fc640 1 -- 172.21.15.2:0/146270325 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f463c0054d0 con 0x7f4644102690 2024-09-12T00:46:34.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.261+0000 7f463a7fc640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f46300a2b20 0x7f46300a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:34.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.261+0000 7f464964c640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f46300a2b20 0x7f46300a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:34.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.261+0000 7f463a7fc640 1 -- 172.21.15.2:0/146270325 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f463c0cdc10 con 0x7f4644102690 2024-09-12T00:46:34.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.261+0000 7f464964c640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f46300a2b20 0x7f46300a4fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4644101b30 tx=0x7f464000f7a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:46:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.269+0000 7f463a7fc640 1 -- 172.21.15.2:0/146270325 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f463c016030 con 0x7f4644102690 2024-09-12T00:46:34.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:34.455+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f464406a6d0 con 0x7f46300a2b20 2024-09-12T00:46:34.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:34.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:34.456 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:46:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T00:46:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:34.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:34.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:34.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:34.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:34.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:35.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:46:35.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi167 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] boot 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:46:35.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi167 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] boot 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:35.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi167 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: osd.2 [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] boot 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:46:35.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:46:35.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:46:35.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:35.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:46:36.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:36 smithi002 ceph-mon[31210]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:36.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T00:46:36.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:36 smithi002 ceph-mon[31210]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T00:46:36.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:46:36.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:36 smithi071 ceph-mon[35276]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:36.713 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T00:46:36.713 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:36 smithi071 ceph-mon[35276]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T00:46:36.713 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:46:36.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:36 smithi167 ceph-mon[35234]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T00:46:36.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T00:46:36.792 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:36 smithi167 ceph-mon[35234]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T00:46:36.792 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:46:37.184 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:46:36 smithi002 sudo[49570]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:46:37.184 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:46:36 smithi002 sudo[49570]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:37.184 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:46:36 smithi002 sudo[49570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:37.184 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:46:36 smithi002 sudo[49570]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:37.341+0000 7f463a7fc640 1 -- 172.21.15.2:0/146270325 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f463c0982e0 con 0x7f4644102690 2024-09-12T00:46:37.494 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:46:37 smithi002 sudo[49604]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:46:37.494 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:46:37 smithi002 sudo[49604]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:37.495 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:46:37 smithi002 sudo[49604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:37.495 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 00:46:37 smithi002 sudo[49604]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:37.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:46:37.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:37 smithi002 ceph-mon[31210]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T00:46:37.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:37 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3883259415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a26f41bb-17a5-4199-8781-40a93619bb05"}]: dispatch 2024-09-12T00:46:37.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:37 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3883259415' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a26f41bb-17a5-4199-8781-40a93619bb05"}]': finished 2024-09-12T00:46:37.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:37 smithi002 ceph-mon[31210]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T00:46:37.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:46:37.609 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:46:37.609 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:37 smithi071 ceph-mon[35276]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T00:46:37.609 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:37 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3883259415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a26f41bb-17a5-4199-8781-40a93619bb05"}]: dispatch 2024-09-12T00:46:37.609 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:37 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3883259415' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a26f41bb-17a5-4199-8781-40a93619bb05"}]': finished 2024-09-12T00:46:37.609 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:37 smithi071 ceph-mon[35276]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T00:46:37.609 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:46:37.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:46:37.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:37 smithi167 ceph-mon[35234]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T00:46:37.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:37 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3883259415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a26f41bb-17a5-4199-8781-40a93619bb05"}]: dispatch 2024-09-12T00:46:37.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:37 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3883259415' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a26f41bb-17a5-4199-8781-40a93619bb05"}]': finished 2024-09-12T00:46:37.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:37 smithi167 ceph-mon[35234]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T00:46:37.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:46:37.864 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:37 smithi071 sudo[43899]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:46:37.864 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:37 smithi071 sudo[43899]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:37.864 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:37 smithi071 sudo[43899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:37.864 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:37 smithi071 sudo[43899]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:38.191 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:37 smithi071 sudo[43902]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:46:38.191 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:37 smithi071 sudo[43902]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:38.191 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:37 smithi071 sudo[43902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:38.192 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 00:46:37 smithi071 sudo[43902]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:38.387 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:38 smithi167 sudo[44294]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:46:38.387 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:38 smithi167 sudo[44294]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:38.387 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:38 smithi167 sudo[44294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:38.388 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:38 smithi167 sudo[44294]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:38.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:38 smithi167 ceph-mon[35234]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:38.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:38 smithi167 ceph-mon[35234]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T00:46:38.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:38 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:38.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:38 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3284829703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:46:38.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:38 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:38.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:38 smithi071 ceph-mon[35276]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:38.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:38 smithi071 ceph-mon[35276]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T00:46:38.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:38 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:38.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:38 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3284829703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:46:38.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:38 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:38.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 ceph-mon[31210]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:38.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 ceph-mon[31210]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T00:46:38.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:38.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3284829703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:46:38.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:38.787 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:38 smithi167 sudo[44297]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:46:38.787 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:38 smithi167 sudo[44297]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:38.787 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:38 smithi167 sudo[44297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:38.787 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 00:46:38 smithi167 sudo[44297]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 sudo[49845]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:46:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 sudo[49845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 sudo[49845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:38 smithi002 sudo[49845]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:39.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:39 smithi002 sudo[50033]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:46:39.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:39 smithi002 sudo[50033]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:39.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:39 smithi002 sudo[50033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:39.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:39 smithi002 sudo[50033]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:39.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:39 smithi167 sudo[44300]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:46:39.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:39 smithi167 sudo[44300]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:39.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:39 smithi167 sudo[44300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:39.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:39 smithi167 sudo[44300]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:40.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:39 smithi167 sudo[44303]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:46:40.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:39 smithi167 sudo[44303]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:40.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:39 smithi167 sudo[44303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:40.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:39 smithi167 sudo[44303]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:40.309 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 sudo[43905]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:46:40.309 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 sudo[43905]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:40.309 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 sudo[43905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:40.309 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 sudo[43905]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:40.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 sudo[43908]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:46:40.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 sudo[43908]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 sudo[43908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 sudo[43908]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:40.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:41.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:41 smithi071 ceph-mon[35276]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:41 smithi071 ceph-mon[35276]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:41 smithi071 ceph-mon[35276]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:41 smithi071 ceph-mon[35276]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:41 smithi071 ceph-mon[35276]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:41.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:41 smithi002 ceph-mon[31210]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:41.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:41 smithi002 ceph-mon[31210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:41.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:41 smithi002 ceph-mon[31210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:41.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:41 smithi002 ceph-mon[31210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:41.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:41.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:41.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:41.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:41 smithi002 ceph-mon[31210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:41.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:41 smithi167 ceph-mon[35234]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:41.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:41 smithi167 ceph-mon[35234]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:41.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:41 smithi167 ceph-mon[35234]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:41.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:41 smithi167 ceph-mon[35234]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:46:41.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:46:41.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:46:41.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:46:41.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:41 smithi167 ceph-mon[35234]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:46:42.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:42 smithi002 ceph-mon[31210]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:42.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:42 smithi071 ceph-mon[35276]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:42 smithi167 ceph-mon[35234]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:44.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:44 smithi002 ceph-mon[31210]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:44.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:44 smithi071 ceph-mon[35276]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:44 smithi167 ceph-mon[35234]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:46.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:46 smithi002 ceph-mon[31210]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:46.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T00:46:46.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:46.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:46 smithi002 ceph-mon[31210]: Deploying daemon osd.3 on smithi002 2024-09-12T00:46:46.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:46 smithi071 ceph-mon[35276]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:46.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:46 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T00:46:46.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:46 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:46.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:46 smithi071 ceph-mon[35276]: Deploying daemon osd.3 on smithi002 2024-09-12T00:46:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:46 smithi167 ceph-mon[35234]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:46:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:46 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T00:46:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:46 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:46 smithi167 ceph-mon[35234]: Deploying daemon osd.3 on smithi002 2024-09-12T00:46:48.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:48 smithi002 ceph-mon[31210]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T00:46:48.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:48 smithi167 ceph-mon[35234]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T00:46:48.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:48 smithi071 ceph-mon[35276]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T00:46:50.556 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:50 smithi002 ceph-mon[31210]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T00:46:50.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:50 smithi071 ceph-mon[35276]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T00:46:50.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:50 smithi167 ceph-mon[35234]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T00:46:52.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:52 smithi002 ceph-mon[31210]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T00:46:52.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:52 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:52.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:52 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:52.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:52 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:52.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:52 smithi071 ceph-mon[35276]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T00:46:52.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:52 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:52.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:52 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:52.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:52 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:52.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:52 smithi167 ceph-mon[35234]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T00:46:52.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:52 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:52.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:52 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:52.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:52 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:54.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:54 smithi002 ceph-mon[31210]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:54.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:54 smithi071 ceph-mon[35276]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:54 smithi167 ceph-mon[35234]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:55.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.269+0000 7f463a7fc640 1 -- 172.21.15.2:0/146270325 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f464406a6d0 con 0x7f46300a2b20 2024-09-12T00:46:55.268 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-09-12T00:46:55.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f46300a2b20 msgr2=0x7f46300a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:55.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f46300a2b20 0x7f46300a4fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4644101b30 tx=0x7f464000f7a0 comp rx=0 tx=0).stop 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644102690 msgr2=0x7f464419f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644102690 0x7f464419f4c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f463c00e940 tx=0x7f463c00ee00 comp rx=0 tx=0).stop 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 shutdown_connections 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f46300a2b20 0x7f46300a4fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4644102690 0x7f464419f4c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4644101cd0 0x7f4644198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 --2- 172.21.15.2:0/146270325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4644100ad0 0x7f4644197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 >> 172.21.15.2:0/146270325 conn(0x7f46440fc280 msgr2=0x7f4644069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 shutdown_connections 2024-09-12T00:46:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:46:55.272+0000 7f464b8b0640 1 -- 172.21.15.2:0/146270325 wait complete. 2024-09-12T00:46:55.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:55.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:55.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:55.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:46:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:55.911 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T00:46:55.914 INFO:tasks.cephadm:Deploying osd.4 on smithi071 with /dev/vg_nvme/lv_3... 2024-09-12T00:46:55.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T00:46:56.165 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:46:56.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:56 smithi002 ceph-mon[31210]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:56.628 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:56 smithi071 ceph-mon[35276]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:56 smithi167 ceph-mon[35234]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:58.354 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 00:46:58 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T00:46:58.120+0000 7ff8d2158640 -1 osd.3 0 log_to_monitors true 2024-09-12T00:46:58.597 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:58 smithi071 ceph-mon[35276]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:58.597 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:58 smithi071 ceph-mon[35276]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T00:46:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:46:58.626 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-09-12T00:46:58.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:58 smithi002 ceph-mon[31210]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:58.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:58 smithi002 ceph-mon[31210]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T00:46:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:58 smithi167 ceph-mon[35234]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T00:46:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:58 smithi167 ceph-mon[35234]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T00:46:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:46:59.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 -- 172.21.15.71:0/766942500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 msgr2=0x7f7854103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:59.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 --2- 172.21.15.71:0/766942500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 0x7f7854103280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f783c009900 tx=0x7f783c02a410 comp rx=0 tx=0).stop 2024-09-12T00:46:59.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 -- 172.21.15.71:0/766942500 shutdown_connections 2024-09-12T00:46:59.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 --2- 172.21.15.71:0/766942500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78541037c0 0x7f785410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:59.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 --2- 172.21.15.71:0/766942500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 0x7f7854103280 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:59.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 --2- 172.21.15.71:0/766942500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7854101c00 0x7f7854102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 -- 172.21.15.71:0/766942500 >> 172.21.15.71:0/766942500 conn(0x7f78540fd390 msgr2=0x7f78540ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 -- 172.21.15.71:0/766942500 shutdown_connections 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.328+0000 7f7858cbd640 1 -- 172.21.15.71:0/766942500 wait complete. 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7858cbd640 1 Processor -- start 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7858cbd640 1 -- start start 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7858cbd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7854101c00 0x7f7854197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7858cbd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 0x7f78541983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7858cbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78541037c0 0x7f785419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7858cbd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f785410d880 con 0x7f78541037c0 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7858cbd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f785410d700 con 0x7f7854102e00 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7858cbd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f785410da00 con 0x7f7854101c00 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 0x7f78541983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 0x7f78541983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45352/0 (socket says 172.21.15.71:45352) 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 -- 172.21.15.71:0/2280539487 learned_addr learned my addr 172.21.15.71:0/2280539487 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f785259c640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7854101c00 0x7f7854197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7852d9d640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78541037c0 0x7f785419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 -- 172.21.15.71:0/2280539487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7854101c00 msgr2=0x7f7854197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7854101c00 0x7f7854197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 -- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78541037c0 msgr2=0x7f785419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78541037c0 0x7f785419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 -- 172.21.15.71:0/2280539487 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785419fab0 con 0x7f7854102e00 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7852d9d640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78541037c0 0x7f785419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.329+0000 7f7851d9b640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 0x7f78541983c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f783c009230 tx=0x7f783c004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.330+0000 7f784b7fe640 1 -- 172.21.15.71:0/2280539487 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c03f030 con 0x7f7854102e00 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.330+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785419fd40 con 0x7f7854102e00 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.330+0000 7f784b7fe640 1 -- 172.21.15.71:0/2280539487 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f783c003ce0 con 0x7f7854102e00 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.330+0000 7f784b7fe640 1 -- 172.21.15.71:0/2280539487 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c035070 con 0x7f7854102e00 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.330+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78541a01c0 con 0x7f7854102e00 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.331+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7854108f80 con 0x7f7854102e00 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.332+0000 7f784b7fe640 1 -- 172.21.15.71:0/2280539487 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f783c042030 con 0x7f7854102e00 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.332+0000 7f784b7fe640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f78400a2bb0 0x7f78400a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.333+0000 7f784b7fe640 1 -- 172.21.15.71:0/2280539487 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3373+0+0 (secure 0 0 0) 0x7f783c0ee320 con 0x7f7854102e00 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.333+0000 7f785259c640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f78400a2bb0 0x7f78400a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.333+0000 7f785259c640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f78400a2bb0 0x7f78400a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7854102c60 tx=0x7f784c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.337+0000 7f784b7fe640 1 -- 172.21.15.71:0/2280539487 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f783c0bc5d0 con 0x7f7854102e00 2024-09-12T00:46:59.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:46:59.514+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7854062630 con 0x7f78400a2bb0 2024-09-12T00:46:59.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T00:46:59.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T00:46:59.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:46:59.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:46:59.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi002 2024-09-12T00:46:59.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:59.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:59.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-12T00:46:59.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:59.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:59.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:46:59 smithi071 ceph-mon[35276]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:46:59.745 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T00:46:59.411+0000 7ff8cd8b8640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:46:59.745 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T00:46:59.419+0000 7ff8c9ef2640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:46:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T00:46:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi002 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:59.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:59.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:46:59 smithi002 ceph-mon[31210]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:46:59.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T00:46:59.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi002 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-12T00:46:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:46:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:46:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:46:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:46:59 smithi167 ceph-mon[35234]: from='osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:47:00.572 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:47:00.572 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T00:47:00.572 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:00.572 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:00.572 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:00.573 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:00.573 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:00.573 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:00.573 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] boot 2024-09-12T00:47:00.573 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T00:47:00.573 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:00.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:47:00.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T00:47:00.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:00.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:00.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:00.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:00.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:00.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:00.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] boot 2024-09-12T00:47:00.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T00:47:00.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: osd.3 [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] boot 2024-09-12T00:47:00.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T00:47:00.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:47:01.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:01 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:47:01.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:01 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:47:01.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:01 smithi071 ceph-mon[35276]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T00:47:01.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:01 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:47:01.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:01 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:47:01.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:01 smithi002 ceph-mon[31210]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T00:47:01.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:01 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:47:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:01 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:47:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:01 smithi167 ceph-mon[35234]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T00:47:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:02 smithi071 ceph-mon[35276]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:02 smithi071 ceph-mon[35276]: from='client.? 172.21.15.71:0/968523337' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]: dispatch 2024-09-12T00:47:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:02 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]: dispatch 2024-09-12T00:47:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:02 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]': finished 2024-09-12T00:47:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:02 smithi071 ceph-mon[35276]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T00:47:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:02 smithi071 ceph-mon[35276]: from='client.? 172.21.15.71:0/2841186136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:02 smithi002 ceph-mon[31210]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:02 smithi002 ceph-mon[31210]: from='client.? 172.21.15.71:0/968523337' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]: dispatch 2024-09-12T00:47:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:02 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]: dispatch 2024-09-12T00:47:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:02 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]': finished 2024-09-12T00:47:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:02 smithi002 ceph-mon[31210]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T00:47:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:02 smithi002 ceph-mon[31210]: from='client.? 172.21.15.71:0/2841186136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:02 smithi167 ceph-mon[35234]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:02 smithi167 ceph-mon[35234]: from='client.? 172.21.15.71:0/968523337' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]: dispatch 2024-09-12T00:47:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:02 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]: dispatch 2024-09-12T00:47:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:02 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47671b0e-1a96-4bdb-b0f6-78d139586f29"}]': finished 2024-09-12T00:47:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:02 smithi167 ceph-mon[35234]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T00:47:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:02 smithi167 ceph-mon[35234]: from='client.? 172.21.15.71:0/2841186136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:04.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:03 smithi071 ceph-mon[35276]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:04.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:03 smithi071 ceph-mon[35276]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T00:47:04.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:04.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:03 smithi002 ceph-mon[31210]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:04.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:03 smithi002 ceph-mon[31210]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T00:47:04.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:04.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:03 smithi167 ceph-mon[35234]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:04.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:03 smithi167 ceph-mon[35234]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T00:47:04.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:05.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:04 smithi071 ceph-mon[35276]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T00:47:05.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:04 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:05.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:04 smithi002 ceph-mon[31210]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T00:47:05.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:04 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:05.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:04 smithi167 ceph-mon[35234]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T00:47:05.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:04 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:06.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:05 smithi071 ceph-mon[35276]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:06.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:05 smithi002 ceph-mon[31210]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:05 smithi167 ceph-mon[35234]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:08.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:07 smithi071 ceph-mon[35276]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T00:47:08.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:07 smithi002 ceph-mon[31210]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T00:47:08.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:07 smithi167 ceph-mon[35234]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T00:47:10.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:09 smithi071 ceph-mon[35276]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T00:47:10.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:09 smithi002 ceph-mon[31210]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T00:47:10.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:09 smithi167 ceph-mon[35234]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T00:47:11.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T00:47:11.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:11.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:10 smithi071 ceph-mon[35276]: Deploying daemon osd.4 on smithi071 2024-09-12T00:47:11.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:10 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T00:47:11.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:10 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:11.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:10 smithi002 ceph-mon[31210]: Deploying daemon osd.4 on smithi071 2024-09-12T00:47:11.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:10 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T00:47:11.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:10 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:11.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:10 smithi167 ceph-mon[35234]: Deploying daemon osd.4 on smithi071 2024-09-12T00:47:12.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:11 smithi071 ceph-mon[35276]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:47:12.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:11 smithi002 ceph-mon[31210]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:47:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:11 smithi167 ceph-mon[35234]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:47:14.146 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:13 smithi071 ceph-mon[35276]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T00:47:14.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:13 smithi002 ceph-mon[31210]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T00:47:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:13 smithi167 ceph-mon[35234]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T00:47:15.996 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:15 smithi071 ceph-mon[35276]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T00:47:16.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:15 smithi002 ceph-mon[31210]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T00:47:16.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:15 smithi167 ceph-mon[35234]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T00:47:17.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:17.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:17.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:17.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:17.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:18.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:18 smithi071 ceph-mon[35276]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T00:47:18.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:18 smithi002 ceph-mon[31210]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T00:47:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:18 smithi167 ceph-mon[35234]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T00:47:20.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:20 smithi071 ceph-mon[35276]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:20.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:20.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:20.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:20.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:20.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:20.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.475+0000 7f784b7fe640 1 -- 172.21.15.71:0/2280539487 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7854062630 con 0x7f78400a2bb0 2024-09-12T00:47:20.474 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 4 on host 'smithi071' 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f78400a2bb0 msgr2=0x7f78400a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f78400a2bb0 0x7f78400a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7854102c60 tx=0x7f784c009680 comp rx=0 tx=0).stop 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 msgr2=0x7f78541983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 0x7f78541983c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f783c009230 tx=0x7f783c004360 comp rx=0 tx=0).stop 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 shutdown_connections 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f78400a2bb0 0x7f78400a5070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78541037c0 0x7f785419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854102e00 0x7f78541983c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 --2- 172.21.15.71:0/2280539487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7854101c00 0x7f7854197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:20.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 >> 172.21.15.71:0/2280539487 conn(0x7f78540fd390 msgr2=0x7f7854106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:47:20.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 shutdown_connections 2024-09-12T00:47:20.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:47:20.477+0000 7f7858cbd640 1 -- 172.21.15.71:0/2280539487 wait complete. 2024-09-12T00:47:20.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:20 smithi002 ceph-mon[31210]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:20.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:20 smithi167 ceph-mon[35234]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:20.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:20.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:20.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:20.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:20.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:21.112 DEBUG:teuthology.orchestra.run.smithi071:osd.4> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T00:47:21.115 INFO:tasks.cephadm:Deploying osd.5 on smithi167 with /dev/vg_nvme/lv_3... 2024-09-12T00:47:21.115 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T00:47:21.331 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:21.331 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:21.331 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:21.367 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:47:21.487 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:21.488 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:21.488 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:21.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:21.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:21.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:22.442 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 00:47:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T00:47:22.110+0000 7fdf8ee2a640 -1 osd.4 0 log_to_monitors true 2024-09-12T00:47:22.718 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:22 smithi167 ceph-mon[35234]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:22.718 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:22 smithi167 ceph-mon[35234]: from='osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T00:47:22.718 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:22 smithi167 ceph-mon[35234]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T00:47:22.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:22 smithi002 ceph-mon[31210]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:22.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:22 smithi002 ceph-mon[31210]: from='osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T00:47:22.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:22 smithi002 ceph-mon[31210]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T00:47:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:22 smithi071 ceph-mon[35276]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:22.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:22 smithi071 ceph-mon[35276]: from='osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T00:47:22.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:22 smithi071 ceph-mon[35276]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T00:47:23.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:23 smithi167 ceph-mon[35234]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T00:47:23.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:23 smithi167 ceph-mon[35234]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T00:47:23.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:23 smithi167 ceph-mon[35234]: from='osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:47:23.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:23.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:23 smithi167 ceph-mon[35234]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:47:23.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:23 smithi167 ceph-mon[35234]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:47:23.744 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:23 smithi071 ceph-mon[35276]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T00:47:23.744 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:23 smithi071 ceph-mon[35276]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T00:47:23.744 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:23 smithi071 ceph-mon[35276]: from='osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:47:23.744 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:23.744 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:23 smithi071 ceph-mon[35276]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:47:23.744 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:23 smithi071 ceph-mon[35276]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:47:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:23 smithi002 ceph-mon[31210]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T00:47:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:23 smithi002 ceph-mon[31210]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T00:47:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:23 smithi002 ceph-mon[31210]: from='osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:47:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:23 smithi002 ceph-mon[31210]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:47:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:23 smithi002 ceph-mon[31210]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:47:23.947 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:47:23.976 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_3 2024-09-12T00:47:24.224 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:47:24.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:24.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T00:47:24.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:24.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:24.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi071 2024-09-12T00:47:24.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:24.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:24.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:24.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:24.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:24 smithi167 ceph-mon[35234]: from='osd.4 ' entity='osd.4' 2024-09-12T00:47:24.694 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T00:47:24.298+0000 7fdf8b5c1640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:47:24.694 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T00:47:24.310+0000 7fdf82bbc640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:47:24.694 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:24.694 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi071 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.695 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:24 smithi071 ceph-mon[35276]: from='osd.4 ' entity='osd.4' 2024-09-12T00:47:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 -- 172.21.15.167:0/1447556527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850101c00 msgr2=0x7f6850102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 --2- 172.21.15.167:0/1447556527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850101c00 0x7f6850102000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6840009900 tx=0x7f684002a410 comp rx=0 tx=0).stop 2024-09-12T00:47:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 -- 172.21.15.167:0/1447556527 shutdown_connections 2024-09-12T00:47:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 --2- 172.21.15.167:0/1447556527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68501037c0 0x7f685010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 --2- 172.21.15.167:0/1447556527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6850102e00 0x7f6850103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 --2- 172.21.15.167:0/1447556527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850101c00 0x7f6850102000 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 -- 172.21.15.167:0/1447556527 >> 172.21.15.167:0/1447556527 conn(0x7f68500fd390 msgr2=0x7f68500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:47:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 -- 172.21.15.167:0/1447556527 shutdown_connections 2024-09-12T00:47:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 -- 172.21.15.167:0/1447556527 wait complete. 2024-09-12T00:47:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.724+0000 7f6855d03640 1 Processor -- start 2024-09-12T00:47:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f6855d03640 1 -- start start 2024-09-12T00:47:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f6855d03640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6850101c00 0x7f68501980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:47:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f6855d03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850102e00 0x7f68501985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f6855d03640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501037c0 0x7f685019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f6855d03640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f685010d980 con 0x7f68501037c0 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f6855d03640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f685010d800 con 0x7f6850101c00 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f6855d03640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f685010db00 con 0x7f6850102e00 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850102e00 0x7f68501985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850102e00 0x7f68501985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51518/0 (socket says 172.21.15.167:51518) 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684effd640 1 -- 172.21.15.167:0/909040775 learned_addr learned my addr 172.21.15.167:0/909040775 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684ffff640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501037c0 0x7f685019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684f7fe640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6850101c00 0x7f68501980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:47:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684effd640 1 -- 172.21.15.167:0/909040775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6850101c00 msgr2=0x7f68501980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684effd640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6850101c00 0x7f68501980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684effd640 1 -- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501037c0 msgr2=0x7f685019f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684effd640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501037c0 0x7f685019f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.725+0000 7f684effd640 1 -- 172.21.15.167:0/909040775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685019fcd0 con 0x7f6850102e00 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.726+0000 7f684effd640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850102e00 0x7f68501985e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f684400b4a0 tx=0x7f684400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.726+0000 7f684cff9640 1 -- 172.21.15.167:0/909040775 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844014070 con 0x7f6850102e00 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.726+0000 7f684cff9640 1 -- 172.21.15.167:0/909040775 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6844010af0 con 0x7f6850102e00 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.726+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685019ffc0 con 0x7f6850102e00 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.726+0000 7f684cff9640 1 -- 172.21.15.167:0/909040775 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844017d10 con 0x7f6850102e00 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.726+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68501a0540 con 0x7f6850102e00 2024-09-12T00:47:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.727+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68501090a0 con 0x7f6850102e00 2024-09-12T00:47:24.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.728+0000 7f684cff9640 1 -- 172.21.15.167:0/909040775 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f6844017070 con 0x7f6850102e00 2024-09-12T00:47:24.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.729+0000 7f684cff9640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68380a2c30 0x7f68380a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:47:24.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.729+0000 7f684cff9640 1 -- 172.21.15.167:0/909040775 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f68440cd520 con 0x7f6850102e00 2024-09-12T00:47:24.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.729+0000 7f684f7fe640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68380a2c30 0x7f68380a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:47:24.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.729+0000 7f684f7fe640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68380a2c30 0x7f68380a50f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6840006010 tx=0x7f6840000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:47:24.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.732+0000 7f684cff9640 1 -- 172.21.15.167:0/909040775 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f684409b610 con 0x7f6850102e00 2024-09-12T00:47:24.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:24.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T00:47:24.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:24.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:24.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi071 2024-09-12T00:47:24.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:24.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:24.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:24.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:24.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:24.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:24 smithi002 ceph-mon[31210]: from='osd.4 ' entity='osd.4' 2024-09-12T00:47:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:24.905+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6850062630 con 0x7f68380a2c30 2024-09-12T00:47:25.625 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:47:25.625 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:47:25.625 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-12T00:47:25.625 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:25.626 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:25.626 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:25.626 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:25.626 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] boot 2024-09-12T00:47:25.626 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T00:47:25.626 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:25 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:25.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] boot 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T00:47:25.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:25 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: osd.4 [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] boot 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T00:47:25.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:25 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:47:26.773 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:26 smithi167 ceph-mon[35234]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:26.774 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:26 smithi167 ceph-mon[35234]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:26 smithi071 ceph-mon[35276]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:26 smithi071 ceph-mon[35276]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:26.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:26 smithi002 ceph-mon[31210]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-12T00:47:26.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:26 smithi002 ceph-mon[31210]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:27.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:27 smithi167 ceph-mon[35234]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T00:47:27.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:27 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/3672936772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]: dispatch 2024-09-12T00:47:27.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:27 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]: dispatch 2024-09-12T00:47:27.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:27 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]': finished 2024-09-12T00:47:27.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:27 smithi167 ceph-mon[35234]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T00:47:27.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:27 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:27.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:27 smithi071 ceph-mon[35276]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T00:47:27.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:27 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/3672936772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]: dispatch 2024-09-12T00:47:27.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:27 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]: dispatch 2024-09-12T00:47:27.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:27 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]': finished 2024-09-12T00:47:27.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:27 smithi071 ceph-mon[35276]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T00:47:27.947 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:27 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:27.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:27 smithi002 ceph-mon[31210]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T00:47:27.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:27 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/3672936772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]: dispatch 2024-09-12T00:47:27.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:27 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]: dispatch 2024-09-12T00:47:27.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:27 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d03cf8b-e439-469f-96d6-35be185b6a19"}]': finished 2024-09-12T00:47:27.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:27 smithi002 ceph-mon[31210]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T00:47:27.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:27 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:28 smithi167 ceph-mon[35234]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:28 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/3031588158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:28.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:28 smithi071 ceph-mon[35276]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:28.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:28 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/3031588158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:28.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:28 smithi002 ceph-mon[31210]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:28.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:28 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/3031588158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:30.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:30 smithi167 ceph-mon[35234]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:30.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:30 smithi002 ceph-mon[31210]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:30.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:30 smithi071 ceph-mon[35276]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:32.651 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:32 smithi167 ceph-mon[35234]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:32.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:32 smithi071 ceph-mon[35276]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:32.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:32 smithi002 ceph-mon[31210]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:34.735 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:34 smithi167 ceph-mon[35234]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:34.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:34 smithi071 ceph-mon[35276]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:34.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:34 smithi002 ceph-mon[31210]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:36.728 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:36 smithi167 ceph-mon[35234]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:36.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T00:47:36.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:36.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:36 smithi071 ceph-mon[35276]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:36.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T00:47:36.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:36.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:36 smithi002 ceph-mon[31210]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:36.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T00:47:36.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:37.760 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:37 smithi167 ceph-mon[35234]: Deploying daemon osd.5 on smithi167 2024-09-12T00:47:37.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:37 smithi071 ceph-mon[35276]: Deploying daemon osd.5 on smithi167 2024-09-12T00:47:37.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:37 smithi002 ceph-mon[31210]: Deploying daemon osd.5 on smithi167 2024-09-12T00:47:38.780 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:38 smithi167 ceph-mon[35234]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:38.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:38 smithi071 ceph-mon[35276]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:38.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:38 smithi002 ceph-mon[31210]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:40 smithi167 ceph-mon[35234]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:40.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:40 smithi071 ceph-mon[35276]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:40.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:40 smithi002 ceph-mon[31210]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:42 smithi167 ceph-mon[35234]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:42 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:42 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:42 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:42.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:42 smithi071 ceph-mon[35276]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:42.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:42 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:42.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:42 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:42.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:42 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:42.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:42 smithi002 ceph-mon[31210]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:42.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:42 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:42 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:42 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:44.672 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:44 smithi167 ceph-mon[35234]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:44.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:44 smithi071 ceph-mon[35276]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:44.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:44 smithi002 ceph-mon[31210]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:46.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:45 smithi167 ceph-mon[35234]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:46.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.227 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.228 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:46.228 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:46.228 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:45 smithi002 ceph-mon[31210]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:46.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:46.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:46.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.268+0000 7f684cff9640 1 -- 172.21.15.167:0/909040775 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6850062630 con 0x7f68380a2c30 2024-09-12T00:47:46.268 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 5 on host 'smithi167' 2024-09-12T00:47:46.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68380a2c30 msgr2=0x7f68380a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:46.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68380a2c30 0x7f68380a50f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6840006010 tx=0x7f6840000bc0 comp rx=0 tx=0).stop 2024-09-12T00:47:46.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850102e00 msgr2=0x7f68501985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:46.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850102e00 0x7f68501985e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f684400b4a0 tx=0x7f684400b960 comp rx=0 tx=0).stop 2024-09-12T00:47:46.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 shutdown_connections 2024-09-12T00:47:46.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68380a2c30 0x7f68380a50f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:46.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501037c0 0x7f685019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:46.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6850102e00 0x7f68501985e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:46.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 --2- 172.21.15.167:0/909040775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6850101c00 0x7f68501980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:46.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 >> 172.21.15.167:0/909040775 conn(0x7f68500fd390 msgr2=0x7f6850106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:47:46.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 shutdown_connections 2024-09-12T00:47:46.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:47:46.270+0000 7f6855d03640 1 -- 172.21.15.167:0/909040775 wait complete. 2024-09-12T00:47:46.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:45 smithi071 ceph-mon[35276]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:46.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:46.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:46.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:46.892 DEBUG:teuthology.orchestra.run.smithi167:osd.5> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T00:47:46.894 INFO:tasks.cephadm:Deploying osd.6 on smithi002 with /dev/vg_nvme/lv_2... 2024-09-12T00:47:46.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T00:47:47.125 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:46 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:47.126 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:46 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:47.126 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:46 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:47.164 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:47:47.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:47.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:47.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:47.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:46 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:47:47.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:46 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:47.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:46 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:48.317 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:48 smithi167 ceph-mon[35234]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:48.317 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:48 smithi167 ceph-mon[35234]: from='osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T00:47:48.317 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:48 smithi167 ceph-mon[35234]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T00:47:48.317 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 00:47:48 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T00:47:48.099+0000 7f1a5f02a640 -1 osd.5 0 log_to_monitors true 2024-09-12T00:47:48.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:48 smithi002 ceph-mon[31210]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:48.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:48 smithi002 ceph-mon[31210]: from='osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T00:47:48.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:48 smithi002 ceph-mon[31210]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T00:47:48.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:48 smithi071 ceph-mon[35276]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:48.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:48 smithi071 ceph-mon[35276]: from='osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T00:47:48.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:48 smithi071 ceph-mon[35276]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T00:47:49.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:49 smithi167 ceph-mon[35234]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T00:47:49.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:49 smithi167 ceph-mon[35234]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T00:47:49.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:49 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:49.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:49 smithi167 ceph-mon[35234]: from='osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:47:49.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:49 smithi167 ceph-mon[35234]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:47:49.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:49 smithi002 ceph-mon[31210]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T00:47:49.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:49 smithi002 ceph-mon[31210]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T00:47:49.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:49 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:49.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:49 smithi002 ceph-mon[31210]: from='osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:47:49.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:49 smithi002 ceph-mon[31210]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:47:49.602 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:47:49.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-09-12T00:47:49.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:49 smithi071 ceph-mon[35276]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T00:47:49.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:49 smithi071 ceph-mon[35276]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T00:47:49.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:49 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:49.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:49 smithi071 ceph-mon[35276]: from='osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:47:49.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:49 smithi071 ceph-mon[35276]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:47:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:47:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 -- 172.21.15.2:0/256637090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 msgr2=0x7f44e8101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 --2- 172.21.15.2:0/256637090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 0x7f44e8101c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009ca0 tx=0x7f44e002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:47:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 -- 172.21.15.2:0/256637090 shutdown_connections 2024-09-12T00:47:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 --2- 172.21.15.2:0/256637090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 0x7f44e8101c40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 --2- 172.21.15.2:0/256637090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e8100df0 0x7f44e8101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 --2- 172.21.15.2:0/256637090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e81004b0 0x7f44e81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 -- 172.21.15.2:0/256637090 >> 172.21.15.2:0/256637090 conn(0x7f44e80fc280 msgr2=0x7f44e80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:47:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 -- 172.21.15.2:0/256637090 shutdown_connections 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.333+0000 7f44eefc3640 1 -- 172.21.15.2:0/256637090 wait complete. 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.334+0000 7f44eefc3640 1 Processor -- start 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.334+0000 7f44eefc3640 1 -- start start 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.334+0000 7f44eefc3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e81004b0 0x7f44e819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.334+0000 7f44eefc3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e8100df0 0x7f44e819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.334+0000 7f44eefc3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 0x7f44e81a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.334+0000 7f44eefc3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44e810fa40 con 0x7f44e8101790 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.334+0000 7f44eefc3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44e810f8c0 con 0x7f44e8100df0 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.334+0000 7f44eefc3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f44e810fbc0 con 0x7f44e81004b0 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 0x7f44e81a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:47:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 0x7f44e81a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43012/0 (socket says 172.21.15.2:43012) 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 -- 172.21.15.2:0/1117963925 learned_addr learned my addr 172.21.15.2:0/1117963925 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44e7fff640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e8100df0 0x7f44e819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 -- 172.21.15.2:0/1117963925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e81004b0 msgr2=0x7f44e819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e81004b0 0x7f44e819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 -- 172.21.15.2:0/1117963925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e8100df0 msgr2=0x7f44e819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e8100df0 0x7f44e819a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 -- 172.21.15.2:0/1117963925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e81a1c60 con 0x7f44e8101790 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44e7fff640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e8100df0 0x7f44e819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44ed560640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 0x7f44e81a15f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f44e0005e30 tx=0x7f44e0031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44e5ffb640 1 -- 172.21.15.2:0/1117963925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0003c30 con 0x7f44e8101790 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44e5ffb640 1 -- 172.21.15.2:0/1117963925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44e0003dd0 con 0x7f44e8101790 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e81a1ef0 con 0x7f44e8101790 2024-09-12T00:47:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.335+0000 7f44e5ffb640 1 -- 172.21.15.2:0/1117963925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e002fde0 con 0x7f44e8101790 2024-09-12T00:47:50.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.336+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e81a23f0 con 0x7f44e8101790 2024-09-12T00:47:50.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.337+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e810b200 con 0x7f44e8101790 2024-09-12T00:47:50.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.338+0000 7f44e5ffb640 1 -- 172.21.15.2:0/1117963925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f44e0004050 con 0x7f44e8101790 2024-09-12T00:47:50.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.339+0000 7f44e5ffb640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f44d00a2c30 0x7f44d00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:47:50.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.339+0000 7f44e5ffb640 1 -- 172.21.15.2:0/1117963925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7f44e00ef650 con 0x7f44e8101790 2024-09-12T00:47:50.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.339+0000 7f44ecd5f640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f44d00a2c30 0x7f44d00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:47:50.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.340+0000 7f44ecd5f640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f44d00a2c30 0x7f44d00a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44d8005fd0 tx=0x7f44d8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:47:50.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.342+0000 7f44e5ffb640 1 -- 172.21.15.2:0/1117963925 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44e00bd450 con 0x7f44e8101790 2024-09-12T00:47:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:47:50.527+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f44e8062630 con 0x7f44d00a2c30 2024-09-12T00:47:50.537 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T00:47:50.106+0000 7f1a5a78a640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:47:50.537 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T00:47:50.114+0000 7f1a52dbc640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:47:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:47:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T00:47:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi167 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:50 smithi167 ceph-mon[35234]: from='osd.5 ' entity='osd.5' 2024-09-12T00:47:50.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:50.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:47:50.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi167 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:50 smithi071 ceph-mon[35276]: from='osd.5 ' entity='osd.5' 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi167 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:50.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:47:50.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-12T00:47:50.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:50.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:47:50.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:47:50.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:50 smithi002 ceph-mon[31210]: from='osd.5 ' entity='osd.5' 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] boot 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] boot 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:51.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:51.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:47:51.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:47:51.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:51.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: osd.5 [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] boot 2024-09-12T00:47:51.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T00:47:51.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:47:51.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:47:51.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:47:51.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:47:51.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:47:52.437 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:52 smithi002 ceph-mon[31210]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:52.437 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:52 smithi002 ceph-mon[31210]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T00:47:52.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:52 smithi167 ceph-mon[35234]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:52.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:52 smithi167 ceph-mon[35234]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T00:47:52.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:52 smithi071 ceph-mon[35276]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T00:47:52.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:52 smithi071 ceph-mon[35276]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T00:47:53.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:53 smithi002 ceph-mon[31210]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T00:47:53.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:53 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/886728148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fa40635-b89d-46f4-95a2-19db122e4d3c"}]: dispatch 2024-09-12T00:47:53.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:53 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/886728148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fa40635-b89d-46f4-95a2-19db122e4d3c"}]': finished 2024-09-12T00:47:53.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:53 smithi002 ceph-mon[31210]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T00:47:53.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:53 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:47:53.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:53 smithi167 ceph-mon[35234]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T00:47:53.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:53 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/886728148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fa40635-b89d-46f4-95a2-19db122e4d3c"}]: dispatch 2024-09-12T00:47:53.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:53 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/886728148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fa40635-b89d-46f4-95a2-19db122e4d3c"}]': finished 2024-09-12T00:47:53.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:53 smithi167 ceph-mon[35234]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T00:47:53.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:53 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:47:53.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:53 smithi071 ceph-mon[35276]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T00:47:53.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:53 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/886728148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fa40635-b89d-46f4-95a2-19db122e4d3c"}]: dispatch 2024-09-12T00:47:53.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:53 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/886728148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fa40635-b89d-46f4-95a2-19db122e4d3c"}]': finished 2024-09-12T00:47:53.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:53 smithi071 ceph-mon[35276]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T00:47:53.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:53 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:47:54.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:54 smithi071 ceph-mon[35276]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:47:54.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:54 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3519456944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:54.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:54 smithi071 ceph-mon[35276]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T00:47:54.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:54 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:47:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:54 smithi002 ceph-mon[31210]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:47:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:54 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3519456944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:54 smithi002 ceph-mon[31210]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T00:47:54.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:54 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:47:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:54 smithi167 ceph-mon[35234]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:47:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:54 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3519456944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:47:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:54 smithi167 ceph-mon[35234]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T00:47:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:54 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:47:56.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:56 smithi071 ceph-mon[35276]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:47:56.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:56 smithi002 ceph-mon[31210]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:47:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:56 smithi167 ceph-mon[35234]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:47:58.441 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:47:58 smithi002 ceph-mon[31210]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T00:47:58.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:47:58 smithi071 ceph-mon[35276]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T00:47:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:47:58 smithi167 ceph-mon[35234]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T00:48:00.408 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:00 smithi002 ceph-mon[31210]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T00:48:00.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:00 smithi071 ceph-mon[35276]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T00:48:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:00 smithi167 ceph-mon[35234]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T00:48:02.571 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:02 smithi167 ceph-mon[35234]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:48:02.571 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T00:48:02.571 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:02.571 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:02 smithi167 ceph-mon[35234]: Deploying daemon osd.6 on smithi002 2024-09-12T00:48:02.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:02 smithi002 ceph-mon[31210]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:48:02.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T00:48:02.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:02.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:02 smithi002 ceph-mon[31210]: Deploying daemon osd.6 on smithi002 2024-09-12T00:48:02.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:02 smithi071 ceph-mon[35276]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:48:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T00:48:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:02 smithi071 ceph-mon[35276]: Deploying daemon osd.6 on smithi002 2024-09-12T00:48:04.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:04 smithi071 ceph-mon[35276]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T00:48:04.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:04 smithi002 ceph-mon[31210]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T00:48:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:04 smithi167 ceph-mon[35234]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T00:48:06.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:06 smithi002 ceph-mon[31210]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T00:48:06.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:06 smithi071 ceph-mon[35276]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T00:48:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:06 smithi167 ceph-mon[35234]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T00:48:08.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:08 smithi002 ceph-mon[31210]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T00:48:08.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:08.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:08.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:08.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:08 smithi071 ceph-mon[35276]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T00:48:08.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:08 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:08.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:08 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:08.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:08 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:08 smithi167 ceph-mon[35234]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T00:48:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:10.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:10 smithi002 ceph-mon[31210]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:10.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:10 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:10.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:10 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:10.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:10 smithi071 ceph-mon[35276]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:10.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:10.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:10.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:10 smithi167 ceph-mon[35234]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:10.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:10 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:10.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:10 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:10.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.943+0000 7f44e5ffb640 1 -- 172.21.15.2:0/1117963925 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f44e8062630 con 0x7f44d00a2c30 2024-09-12T00:48:10.942 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 6 on host 'smithi002' 2024-09-12T00:48:10.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.945+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f44d00a2c30 msgr2=0x7f44d00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:10.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.945+0000 7f44eefc3640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f44d00a2c30 0x7f44d00a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44d8005fd0 tx=0x7f44d8005850 comp rx=0 tx=0).stop 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.945+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 msgr2=0x7f44e81a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.945+0000 7f44eefc3640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 0x7f44e81a15f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f44e0005e30 tx=0x7f44e0031ee0 comp rx=0 tx=0).stop 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.946+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 shutdown_connections 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.946+0000 7f44eefc3640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f44d00a2c30 0x7f44d00a50f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.946+0000 7f44eefc3640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e8101790 0x7f44e81a15f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.946+0000 7f44eefc3640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e8100df0 0x7f44e819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.946+0000 7f44eefc3640 1 --2- 172.21.15.2:0/1117963925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e81004b0 0x7f44e819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.946+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 >> 172.21.15.2:0/1117963925 conn(0x7f44e80fc280 msgr2=0x7f44e80fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.946+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 shutdown_connections 2024-09-12T00:48:10.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:48:10.946+0000 7f44eefc3640 1 -- 172.21.15.2:0/1117963925 wait complete. 2024-09-12T00:48:11.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:11.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:11.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:11.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.527 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.556 DEBUG:teuthology.orchestra.run.smithi002:osd.6> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T00:48:11.559 INFO:tasks.cephadm:Deploying osd.7 on smithi071 with /dev/vg_nvme/lv_2... 2024-09-12T00:48:11.559 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T00:48:11.587 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:11.587 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:11.588 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.588 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:11.588 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.588 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:11.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:11.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:11.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:11.815 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:48:12.740 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:12 smithi002 ceph-mon[31210]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:12.934 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:12 smithi071 ceph-mon[35276]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:12 smithi167 ceph-mon[35234]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:13.638 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 00:48:13 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T00:48:13.464+0000 7ffacf289640 -1 osd.6 0 log_to_monitors true 2024-09-12T00:48:13.845 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:13 smithi071 ceph-mon[35276]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T00:48:13.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:13 smithi002 ceph-mon[31210]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T00:48:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:13 smithi167 ceph-mon[35234]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T00:48:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:48:14.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:14.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:14.780 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:14.780 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:48:14.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T00:48:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T00:48:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:48:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:15.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:15.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:15.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:15.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:15.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:15.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:15.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 -- 172.21.15.71:0/2776419554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4101cd0 msgr2=0x7f6aa4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:15.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 --2- 172.21.15.71:0/2776419554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4101cd0 0x7f6aa4102150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009900 tx=0x7f6a8c02a410 comp rx=0 tx=0).stop 2024-09-12T00:48:15.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 -- 172.21.15.71:0/2776419554 shutdown_connections 2024-09-12T00:48:15.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 --2- 172.21.15.71:0/2776419554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6aa4102690 0x7f6aa4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 --2- 172.21.15.71:0/2776419554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4101cd0 0x7f6aa4102150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 --2- 172.21.15.71:0/2776419554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa4100ad0 0x7f6aa4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 -- 172.21.15.71:0/2776419554 >> 172.21.15.71:0/2776419554 conn(0x7f6aa40fc280 msgr2=0x7f6aa40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 -- 172.21.15.71:0/2776419554 shutdown_connections 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.235+0000 7f6aa9991640 1 -- 172.21.15.71:0/2776419554 wait complete. 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa9991640 1 Processor -- start 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa9991640 1 -- start start 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa9991640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4100ad0 0x7f6aa4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa9991640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6aa4101cd0 0x7f6aa4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa9991640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa4102690 0x7f6aa419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:48:15.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa9991640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa410c780 con 0x7f6aa4101cd0 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa9991640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa410c600 con 0x7f6aa4100ad0 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa9991640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa410c900 con 0x7f6aa4102690 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4100ad0 0x7f6aa4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6aa4101cd0 0x7f6aa4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4100ad0 0x7f6aa4197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58394/0 (socket says 172.21.15.71:58394) 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa2ffd640 1 -- 172.21.15.71:0/3470704041 learned_addr learned my addr 172.21.15.71:0/3470704041 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.236+0000 7f6aa37fe640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa4102690 0x7f6aa419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa2ffd640 1 -- 172.21.15.71:0/3470704041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa4102690 msgr2=0x7f6aa419f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa2ffd640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa4102690 0x7f6aa419f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa2ffd640 1 -- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6aa4101cd0 msgr2=0x7f6aa4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa2ffd640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6aa4101cd0 0x7f6aa4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:15.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa2ffd640 1 -- 172.21.15.71:0/3470704041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa419fb50 con 0x7f6aa4100ad0 2024-09-12T00:48:15.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa37fe640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa4102690 0x7f6aa419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:48:15.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa2ffd640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4100ad0 0x7f6aa4197f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00ccb0 tx=0x7f6a9c00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:48:15.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa898f640 1 -- 172.21.15.71:0/3470704041 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c003b70 con 0x7f6aa4100ad0 2024-09-12T00:48:15.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa898f640 1 -- 172.21.15.71:0/3470704041 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a9c00ae50 con 0x7f6aa4100ad0 2024-09-12T00:48:15.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa4102f50 con 0x7f6aa4100ad0 2024-09-12T00:48:15.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa898f640 1 -- 172.21.15.71:0/3470704041 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00f810 con 0x7f6aa4100ad0 2024-09-12T00:48:15.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.237+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa41034b0 con 0x7f6aa4100ad0 2024-09-12T00:48:15.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.238+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa41037d0 con 0x7f6aa4100ad0 2024-09-12T00:48:15.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.239+0000 7f6aa898f640 1 -- 172.21.15.71:0/3470704041 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f6a9c00f9b0 con 0x7f6aa4100ad0 2024-09-12T00:48:15.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.240+0000 7f6aa898f640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6a900a2c30 0x7f6a900a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:48:15.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.240+0000 7f6aa898f640 1 -- 172.21.15.71:0/3470704041 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7f6a9c0ce6b0 con 0x7f6aa4100ad0 2024-09-12T00:48:15.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.240+0000 7f6aa27fc640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6a900a2c30 0x7f6a900a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:48:15.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.241+0000 7f6aa27fc640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6a900a2c30 0x7f6a900a50f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005ab0 tx=0x7f6a8c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:48:15.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.247+0000 7f6aa898f640 1 -- 172.21.15.71:0/3470704041 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a9c014070 con 0x7f6aa4100ad0 2024-09-12T00:48:15.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:15.428+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6aa40fe480 con 0x7f6a900a2c30 2024-09-12T00:48:15.657 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T00:48:15.379+0000 7ffaca9e9640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:48:15.657 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T00:48:15.388+0000 7ffac301b640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:48:15.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi002 2024-09-12T00:48:15.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-12T00:48:15.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:15.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:48:15.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T00:48:15.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:15.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:15.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' 2024-09-12T00:48:15.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:48:15.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:48:15.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:15 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi002 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' 2024-09-12T00:48:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:48:15.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:48:15.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:15 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi002 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: from='osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261]' entity='osd.6' 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:48:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:48:16.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:15 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:16.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:16 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:48:16.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:16 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:48:16.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:16 smithi071 ceph-mon[35276]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:16.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:16 smithi071 ceph-mon[35276]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:48:16.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:16.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:16 smithi071 ceph-mon[35276]: osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] boot 2024-09-12T00:48:16.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:16 smithi071 ceph-mon[35276]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T00:48:16.936 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:16 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:48:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:16 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:48:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:16 smithi002 ceph-mon[31210]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:16 smithi002 ceph-mon[31210]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:48:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:16 smithi002 ceph-mon[31210]: osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] boot 2024-09-12T00:48:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:16 smithi002 ceph-mon[31210]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T00:48:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:16 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:48:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:16 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:48:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:16 smithi167 ceph-mon[35234]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-12T00:48:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:16 smithi167 ceph-mon[35234]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:48:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:16 smithi167 ceph-mon[35234]: osd.6 [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] boot 2024-09-12T00:48:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:16 smithi167 ceph-mon[35234]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T00:48:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:48:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:18 smithi002 ceph-mon[31210]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:18 smithi002 ceph-mon[31210]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T00:48:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:18 smithi002 ceph-mon[31210]: from='client.? 172.21.15.71:0/122702188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]: dispatch 2024-09-12T00:48:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:18 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]: dispatch 2024-09-12T00:48:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:18 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]': finished 2024-09-12T00:48:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:18 smithi002 ceph-mon[31210]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T00:48:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:18 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:18 smithi002 ceph-mon[31210]: from='client.? 172.21.15.71:0/3367302888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:48:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:18 smithi167 ceph-mon[35234]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:18 smithi167 ceph-mon[35234]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T00:48:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:18 smithi167 ceph-mon[35234]: from='client.? 172.21.15.71:0/122702188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]: dispatch 2024-09-12T00:48:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:18 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]: dispatch 2024-09-12T00:48:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:18 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]': finished 2024-09-12T00:48:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:18 smithi167 ceph-mon[35234]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T00:48:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:18 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:19.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:18 smithi167 ceph-mon[35234]: from='client.? 172.21.15.71:0/3367302888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:48:19.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:18 smithi071 ceph-mon[35276]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:19.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:18 smithi071 ceph-mon[35276]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T00:48:19.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:18 smithi071 ceph-mon[35276]: from='client.? 172.21.15.71:0/122702188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]: dispatch 2024-09-12T00:48:19.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:18 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]: dispatch 2024-09-12T00:48:19.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:18 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "756dd9c7-23d4-49e5-bf61-aa62aa16dccf"}]': finished 2024-09-12T00:48:19.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:18 smithi071 ceph-mon[35276]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T00:48:19.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:18 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:19.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:18 smithi071 ceph-mon[35276]: from='client.? 172.21.15.71:0/3367302888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:48:20.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:20 smithi071 ceph-mon[35276]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:20.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:20 smithi002 ceph-mon[31210]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:21.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:20 smithi167 ceph-mon[35234]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:22 smithi071 ceph-mon[35276]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:22.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:22 smithi002 ceph-mon[31210]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:22 smithi167 ceph-mon[35234]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:24.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:24 smithi071 ceph-mon[35276]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:24.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:24 smithi002 ceph-mon[31210]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:24 smithi167 ceph-mon[35234]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:26 smithi071 ceph-mon[35276]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:26 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T00:48:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:26 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:26.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:26 smithi002 ceph-mon[31210]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:26.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:26 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T00:48:26.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:26 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:26 smithi167 ceph-mon[35234]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:26 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T00:48:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:26 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:27.761 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:27 smithi071 ceph-mon[35276]: Deploying daemon osd.7 on smithi071 2024-09-12T00:48:27.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:27 smithi002 ceph-mon[31210]: Deploying daemon osd.7 on smithi071 2024-09-12T00:48:28.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:27 smithi167 ceph-mon[35234]: Deploying daemon osd.7 on smithi071 2024-09-12T00:48:28.902 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:28 smithi071 ceph-mon[35276]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:28.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:28 smithi002 ceph-mon[31210]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:29.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:28 smithi167 ceph-mon[35234]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:30.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:30 smithi071 ceph-mon[35276]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:30.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:30 smithi002 ceph-mon[31210]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:30 smithi167 ceph-mon[35234]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:32.750 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:32 smithi071 ceph-mon[35276]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:32.750 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:32.751 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:32.751 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:32.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:32 smithi002 ceph-mon[31210]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:32.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:32.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:32.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:32 smithi167 ceph-mon[35234]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:34.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:34 smithi071 ceph-mon[35276]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:34.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:34 smithi002 ceph-mon[31210]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:34 smithi167 ceph-mon[35234]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:35.824 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:35.824 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:35.824 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:35.825 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:35.825 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:35.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.872+0000 7f6aa898f640 1 -- 172.21.15.71:0/3470704041 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6aa40fe480 con 0x7f6a900a2c30 2024-09-12T00:48:35.872 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 7 on host 'smithi071' 2024-09-12T00:48:35.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6a900a2c30 msgr2=0x7f6a900a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:35.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6a900a2c30 0x7f6a900a50f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005ab0 tx=0x7f6a8c0315b0 comp rx=0 tx=0).stop 2024-09-12T00:48:35.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4100ad0 msgr2=0x7f6aa4197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:35.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4100ad0 0x7f6aa4197f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00ccb0 tx=0x7f6a9c00a620 comp rx=0 tx=0).stop 2024-09-12T00:48:35.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 shutdown_connections 2024-09-12T00:48:35.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6a900a2c30 0x7f6a900a50f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:35.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa4102690 0x7f6aa419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:35.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6aa4101cd0 0x7f6aa4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:35.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 --2- 172.21.15.71:0/3470704041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4100ad0 0x7f6aa4197f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:35.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 >> 172.21.15.71:0/3470704041 conn(0x7f6aa40fc280 msgr2=0x7f6aa40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:48:35.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 shutdown_connections 2024-09-12T00:48:35.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:48:35.875+0000 7f6aa9991640 1 -- 172.21.15.71:0/3470704041 wait complete. 2024-09-12T00:48:36.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:36.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:36.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:36.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:36.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:36.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:36.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:36.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:36.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:36.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:36.531 DEBUG:teuthology.orchestra.run.smithi071:osd.7> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T00:48:36.534 INFO:tasks.cephadm:Deploying osd.8 on smithi167 with /dev/vg_nvme/lv_2... 2024-09-12T00:48:36.534 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T00:48:36.791 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:48:36.911 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:36 smithi167 ceph-mon[35234]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:36.912 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:36.912 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:36.912 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:36 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:37.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:36 smithi071 ceph-mon[35276]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:37.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:37.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:37.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:36 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:37.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:36 smithi002 ceph-mon[31210]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:37.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:37.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:37.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:36 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:38.539 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 00:48:38 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T00:48:38.266+0000 7f5a242c7640 -1 osd.7 0 log_to_monitors true 2024-09-12T00:48:39.051 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:38 smithi167 ceph-mon[35234]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:39.051 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:38 smithi167 ceph-mon[35234]: from='osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T00:48:39.051 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:38 smithi167 ceph-mon[35234]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T00:48:39.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:38 smithi071 ceph-mon[35276]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:39.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:38 smithi071 ceph-mon[35276]: from='osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T00:48:39.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:38 smithi071 ceph-mon[35276]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T00:48:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:38 smithi002 ceph-mon[31210]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:38 smithi002 ceph-mon[31210]: from='osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T00:48:39.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:38 smithi002 ceph-mon[31210]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T00:48:39.329 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:48:39.354 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_2 2024-09-12T00:48:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi071 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:39.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:39.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:39.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:39.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-12T00:48:39.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:39.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:39.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:39.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:39 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 -- 172.21.15.167:0/2157160820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004100ad0 msgr2=0x7f9004100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 --2- 172.21.15.167:0/2157160820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004100ad0 0x7f9004100ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009900 tx=0x7f8ff402a410 comp rx=0 tx=0).stop 2024-09-12T00:48:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 -- 172.21.15.167:0/2157160820 shutdown_connections 2024-09-12T00:48:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 --2- 172.21.15.167:0/2157160820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004102690 0x7f9004108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 --2- 172.21.15.167:0/2157160820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9004101cd0 0x7f9004102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 --2- 172.21.15.167:0/2157160820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004100ad0 0x7f9004100ed0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 -- 172.21.15.167:0/2157160820 >> 172.21.15.167:0/2157160820 conn(0x7f90040fc280 msgr2=0x7f90040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 -- 172.21.15.167:0/2157160820 shutdown_connections 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.067+0000 7f9009b01640 1 -- 172.21.15.167:0/2157160820 wait complete. 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.068+0000 7f9009b01640 1 Processor -- start 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.068+0000 7f9009b01640 1 -- start start 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.068+0000 7f9009b01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004100ad0 0x7f900406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9009b01640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9004101cd0 0x7f900419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9009b01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004102690 0x7f900419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9009b01640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f900410c750 con 0x7f9004100ad0 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9009b01640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f900410c5d0 con 0x7f9004101cd0 2024-09-12T00:48:40.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9009b01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f900410c8d0 con 0x7f9004102690 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004102690 0x7f900419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004102690 0x7f900419f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48828/0 (socket says 172.21.15.167:48828) 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 -- 172.21.15.167:0/3452205573 learned_addr learned my addr 172.21.15.167:0/3452205573 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f90037fe640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004100ad0 0x7f900406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9002ffd640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9004101cd0 0x7f900419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 -- 172.21.15.167:0/3452205573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9004101cd0 msgr2=0x7f900419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9004101cd0 0x7f900419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 -- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004100ad0 msgr2=0x7f900406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004100ad0 0x7f900406aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 -- 172.21.15.167:0/3452205573 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900419fba0 con 0x7f9004102690 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9003fff640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004102690 0x7f900419f290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00eb10 tx=0x7f8ffc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9000ff9640 1 -- 172.21.15.167:0/3452205573 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc004b20 con 0x7f9004102690 2024-09-12T00:48:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9000ff9640 1 -- 172.21.15.167:0/3452205573 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ffc004cc0 con 0x7f9004102690 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900419fe30 con 0x7f9004102690 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9000ff9640 1 -- 172.21.15.167:0/3452205573 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc010760 con 0x7f9004102690 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.069+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041a02f0 con 0x7f9004102690 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.071+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9004107f70 con 0x7f9004102690 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.073+0000 7f9000ff9640 1 -- 172.21.15.167:0/3452205573 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8ffc005020 con 0x7f9004102690 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.073+0000 7f9000ff9640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8fec0a2b80 0x7f8fec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.074+0000 7f9000ff9640 1 -- 172.21.15.167:0/3452205573 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7f8ffc0ce940 con 0x7f9004102690 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.074+0000 7f90037fe640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8fec0a2b80 0x7f8fec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.074+0000 7f90037fe640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8fec0a2b80 0x7f8fec0a5040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005ab0 tx=0x7f8ff4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:48:40.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.078+0000 7f9000ff9640 1 -- 172.21.15.167:0/3452205573 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ffc09c520 con 0x7f9004102690 2024-09-12T00:48:40.191 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T00:48:39.803+0000 7f5a1fa27640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:48:40.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T00:48:39.811+0000 7f5a1c061640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:48:40.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T00:48:40.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T00:48:40.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:40.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:48:40.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:48:40.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:40.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi071 2024-09-12T00:48:40.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:40.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:39 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi071 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:40.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:40.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:48:40.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-12T00:48:40.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:40.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:48:40.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:39 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:40.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:48:40.260+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9004062630 con 0x7f8fec0a2b80 2024-09-12T00:48:40.891 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:40 smithi167 ceph-mon[35234]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:48:40.892 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:40 smithi167 ceph-mon[35234]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T00:48:40.892 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:40.892 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:40.892 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:40 smithi167 ceph-mon[35234]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:48:40.892 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:48:40.892 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:48:40.892 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:40 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:41.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:40 smithi071 ceph-mon[35276]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:48:41.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:40 smithi071 ceph-mon[35276]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T00:48:41.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:41.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:41.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:40 smithi071 ceph-mon[35276]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:48:41.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:48:41.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:48:41.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:40 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:41.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:40 smithi002 ceph-mon[31210]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:48:41.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:40 smithi002 ceph-mon[31210]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T00:48:41.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:41.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:41.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:40 smithi002 ceph-mon[31210]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:48:41.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:48:41.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:48:41.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:40 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:41.923 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:41 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:48:41.924 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:41 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:48:41.924 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:41 smithi167 ceph-mon[35234]: osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] boot 2024-09-12T00:48:41.924 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:41 smithi167 ceph-mon[35234]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T00:48:41.924 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:41.924 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:41 smithi167 ceph-mon[35234]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:42.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:41 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:48:42.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:41 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:48:42.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:41 smithi071 ceph-mon[35276]: osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] boot 2024-09-12T00:48:42.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:41 smithi071 ceph-mon[35276]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T00:48:42.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:42.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:41 smithi071 ceph-mon[35276]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:42.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:41 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:48:42.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:41 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:48:42.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:41 smithi002 ceph-mon[31210]: osd.7 [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] boot 2024-09-12T00:48:42.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:41 smithi002 ceph-mon[31210]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T00:48:42.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:48:42.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:41 smithi002 ceph-mon[31210]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:42 smithi002 ceph-mon[31210]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T00:48:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:42 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/2750569886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]: dispatch 2024-09-12T00:48:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:42 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]: dispatch 2024-09-12T00:48:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:42 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]': finished 2024-09-12T00:48:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:42 smithi002 ceph-mon[31210]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T00:48:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:42 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:43.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:42 smithi071 ceph-mon[35276]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T00:48:43.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:42 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/2750569886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]: dispatch 2024-09-12T00:48:43.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:42 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]: dispatch 2024-09-12T00:48:43.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:42 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]': finished 2024-09-12T00:48:43.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:42 smithi071 ceph-mon[35276]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T00:48:43.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:42 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:43.251 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:42 smithi167 ceph-mon[35234]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T00:48:43.252 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:42 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/2750569886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]: dispatch 2024-09-12T00:48:43.252 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:42 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]: dispatch 2024-09-12T00:48:43.252 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:42 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b6ae68b-311e-4fb8-a90b-8d392b44de12"}]': finished 2024-09-12T00:48:43.252 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:42 smithi167 ceph-mon[35234]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T00:48:43.252 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:42 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:44.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:43 smithi071 ceph-mon[35276]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:44.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:43 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/986085534' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:48:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:43 smithi071 ceph-mon[35276]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T00:48:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:44.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:43 smithi002 ceph-mon[31210]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:44.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:43 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/986085534' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:48:44.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:43 smithi002 ceph-mon[31210]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T00:48:44.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:44.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:43 smithi167 ceph-mon[35234]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:44.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:43 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/986085534' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:48:44.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:43 smithi167 ceph-mon[35234]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T00:48:44.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:45.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:45 smithi071 ceph-mon[35276]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T00:48:45.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:45.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:45 smithi002 ceph-mon[31210]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T00:48:45.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:45 smithi167 ceph-mon[35234]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T00:48:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:48:46.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:46 smithi071 ceph-mon[35276]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:46.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:46 smithi002 ceph-mon[31210]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:46 smithi167 ceph-mon[35234]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:48.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:48 smithi071 ceph-mon[35276]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:48.738 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:48 smithi167 ceph-mon[35234]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:48.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:48 smithi002 ceph-mon[31210]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:50 smithi167 ceph-mon[35234]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:50.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:50 smithi071 ceph-mon[35276]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:50.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:50 smithi002 ceph-mon[31210]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:52.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:52 smithi071 ceph-mon[35276]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:52.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:52 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T00:48:52.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:52 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:52.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:52 smithi071 ceph-mon[35276]: Deploying daemon osd.8 on smithi167 2024-09-12T00:48:52.734 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:52 smithi167 ceph-mon[35234]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:52.734 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:52 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T00:48:52.734 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:52 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:52.734 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:52 smithi167 ceph-mon[35234]: Deploying daemon osd.8 on smithi167 2024-09-12T00:48:52.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:52 smithi002 ceph-mon[31210]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:52.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:52 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T00:48:52.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:52 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:48:52.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:52 smithi002 ceph-mon[31210]: Deploying daemon osd.8 on smithi167 2024-09-12T00:48:54.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:54 smithi071 ceph-mon[35276]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:54.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:54 smithi002 ceph-mon[31210]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:54.777 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:54 smithi167 ceph-mon[35234]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:56.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:56 smithi071 ceph-mon[35276]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:56 smithi002 ceph-mon[31210]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:56 smithi167 ceph-mon[35234]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:57.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:57 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:57.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:57 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:57.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:57 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:57.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:57 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:57.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:57 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:57.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:57 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:57.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:57 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:48:57.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:57 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:57.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:57 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:48:58.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:48:58 smithi002 ceph-mon[31210]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:58.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:48:58 smithi167 ceph-mon[35234]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:48:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:48:58 smithi071 ceph-mon[35276]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:00 smithi002 ceph-mon[31210]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:00 smithi167 ceph-mon[35234]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:00 smithi071 ceph-mon[35276]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:01.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.205+0000 7f9000ff9640 1 -- 172.21.15.167:0/3452205573 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9004062630 con 0x7f8fec0a2b80 2024-09-12T00:49:01.205 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 8 on host 'smithi167' 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8fec0a2b80 msgr2=0x7f8fec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8fec0a2b80 0x7f8fec0a5040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005ab0 tx=0x7f8ff4000bc0 comp rx=0 tx=0).stop 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004102690 msgr2=0x7f900419f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004102690 0x7f900419f290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00eb10 tx=0x7f8ffc00c2d0 comp rx=0 tx=0).stop 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 shutdown_connections 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8fec0a2b80 0x7f8fec0a5040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9004102690 0x7f900419f290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9004101cd0 0x7f900419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 --2- 172.21.15.167:0/3452205573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004100ad0 0x7f900406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:01.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 >> 172.21.15.167:0/3452205573 conn(0x7f90040fc280 msgr2=0x7f9004105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:49:01.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 shutdown_connections 2024-09-12T00:49:01.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:01.208+0000 7f9009b01640 1 -- 172.21.15.167:0/3452205573 wait complete. 2024-09-12T00:49:01.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:01 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:01.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:01 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:01.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:01 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:01 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:01 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:01 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:01.854 DEBUG:teuthology.orchestra.run.smithi167:osd.8> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T00:49:01.856 INFO:tasks.cephadm:Deploying osd.9 on smithi002 with /dev/vg_nvme/lv_1... 2024-09-12T00:49:01.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T00:49:01.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:01 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:01.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:01 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:01 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:02.128 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:49:02.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:02 smithi002 ceph-mon[31210]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:02.741 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:02 smithi167 ceph-mon[35234]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:02.843 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:02 smithi071 ceph-mon[35276]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:04.013 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 00:49:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T00:49:03.687+0000 7f40afcdd640 -1 osd.8 0 log_to_monitors true 2024-09-12T00:49:04.614 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:04 smithi167 ceph-mon[35234]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:04.615 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:04 smithi167 ceph-mon[35234]: from='osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T00:49:04.615 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:04 smithi167 ceph-mon[35234]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T00:49:04.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:04 smithi002 ceph-mon[31210]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:04 smithi002 ceph-mon[31210]: from='osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T00:49:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:04 smithi002 ceph-mon[31210]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T00:49:04.778 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:49:04.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-09-12T00:49:04.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:04 smithi071 ceph-mon[35276]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:04.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:04 smithi071 ceph-mon[35276]: from='osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T00:49:04.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:04 smithi071 ceph-mon[35276]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T00:49:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:49:05.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/1114264240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0101d10 msgr2=0x7fe1f0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:05.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/1114264240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0101d10 0x7fe1f0102190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009900 tx=0x7fe1e402a410 comp rx=0 tx=0).stop 2024-09-12T00:49:05.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/1114264240 shutdown_connections 2024-09-12T00:49:05.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/1114264240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1f01026d0 0x7fe1f0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:05.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/1114264240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0101d10 0x7fe1f0102190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:05.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/1114264240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f0100b10 0x7fe1f0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:05.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/1114264240 >> 172.21.15.2:0/1114264240 conn(0x7fe1f00fc2a0 msgr2=0x7fe1f00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:49:05.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/1114264240 shutdown_connections 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/1114264240 wait complete. 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 Processor -- start 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.601+0000 7fe1f5f6f640 1 -- start start 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1f5f6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0100b10 0x7fe1f019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1f5f6f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f0101d10 0x7fe1f019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1f5f6f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1f01026d0 0x7fe1f01a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1f5f6f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010d8c0 con 0x7fe1f0100b10 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1f5f6f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010d740 con 0x7fe1f01026d0 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1f5f6f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010da40 con 0x7fe1f0101d10 2024-09-12T00:49:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0100b10 0x7fe1f019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0100b10 0x7fe1f019a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45436/0 (socket says 172.21.15.2:45436) 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 -- 172.21.15.2:0/3359508791 learned_addr learned my addr 172.21.15.2:0/3359508791 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1effff640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1f01026d0 0x7fe1f01a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1eeffd640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f0101d10 0x7fe1f019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 -- 172.21.15.2:0/3359508791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f0101d10 msgr2=0x7fe1f019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f0101d10 0x7fe1f019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 -- 172.21.15.2:0/3359508791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1f01026d0 msgr2=0x7fe1f01a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1f01026d0 0x7fe1f01a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 -- 172.21.15.2:0/3359508791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f01a1d50 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ef7fe640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0100b10 0x7fe1f019a120 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000d950 tx=0x7fe1e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.602+0000 7fe1ecff9640 1 -- 172.21.15.2:0/3359508791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0017020 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.603+0000 7fe1ecff9640 1 -- 172.21.15.2:0/3359508791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e0009c30 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.603+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f01a1fe0 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.603+0000 7fe1ecff9640 1 -- 172.21.15.2:0/3359508791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000f740 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.603+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f01a2490 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.603+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f01a2780 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.605+0000 7fe1ecff9640 1 -- 172.21.15.2:0/3359508791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe1e001a020 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.606+0000 7fe1ecff9640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe1d80a2bb0 0x7fe1d80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.606+0000 7fe1eeffd640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe1d80a2bb0 0x7fe1d80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.606+0000 7fe1ecff9640 1 -- 172.21.15.2:0/3359508791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5549+0+0 (secure 0 0 0) 0x7fe1e00ce290 con 0x7fe1f0100b10 2024-09-12T00:49:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.606+0000 7fe1eeffd640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe1d80a2bb0 0x7fe1d80a5070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40314e0 tx=0x7fe1e4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:49:05.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.609+0000 7fe1ecff9640 1 -- 172.21.15.2:0/3359508791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1e0021070 con 0x7fe1f0100b10 2024-09-12T00:49:05.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T00:49:05.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T00:49:05.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:05.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:49:05.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:49:05.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi167 2024-09-12T00:49:05.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-12T00:49:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:05.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.787 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T00:49:05.469+0000 7f40ab43d640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T00:49:05.787 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T00:49:05.482+0000 7f40a7a77640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:49:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T00:49:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T00:49:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:49:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:49:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi167 2024-09-12T00:49:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:05.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:05.797+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe1f01a2950 con 0x7fe1d80a2bb0 2024-09-12T00:49:05.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi167 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-12T00:49:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:06 smithi002 ceph-mon[31210]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:06 smithi002 ceph-mon[31210]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:49:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:06 smithi002 ceph-mon[31210]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T00:49:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:06 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:06 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:06 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:06 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:06 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:06 smithi167 ceph-mon[35234]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:06 smithi167 ceph-mon[35234]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:49:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:06 smithi167 ceph-mon[35234]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T00:49:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:06 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:06 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:06 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:06 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:06 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:06.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:06 smithi071 ceph-mon[35276]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:06.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:06 smithi071 ceph-mon[35276]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:49:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:06 smithi071 ceph-mon[35276]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T00:49:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:06 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:06 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:06 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:06 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:06 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:07 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:49:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:07 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:49:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:07 smithi002 ceph-mon[31210]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:07 smithi002 ceph-mon[31210]: osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] boot 2024-09-12T00:49:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:07 smithi002 ceph-mon[31210]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T00:49:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:07 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:07 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:49:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:07 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:49:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:07 smithi167 ceph-mon[35234]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:07 smithi167 ceph-mon[35234]: osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] boot 2024-09-12T00:49:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:07 smithi167 ceph-mon[35234]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T00:49:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:07 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:07.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:07 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:49:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:07 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:49:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:07 smithi071 ceph-mon[35276]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:07 smithi071 ceph-mon[35276]: osd.8 [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] boot 2024-09-12T00:49:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:07 smithi071 ceph-mon[35276]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T00:49:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:07 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:49:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:08 smithi002 ceph-mon[31210]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:08 smithi002 ceph-mon[31210]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T00:49:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:08 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/493999509' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12040e9d-e418-4d1a-a924-f4ef7d87ab15"}]: dispatch 2024-09-12T00:49:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:08 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/493999509' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12040e9d-e418-4d1a-a924-f4ef7d87ab15"}]': finished 2024-09-12T00:49:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:08 smithi002 ceph-mon[31210]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T00:49:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:08 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:08 smithi167 ceph-mon[35234]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:08 smithi167 ceph-mon[35234]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T00:49:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:08 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/493999509' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12040e9d-e418-4d1a-a924-f4ef7d87ab15"}]: dispatch 2024-09-12T00:49:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:08 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/493999509' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12040e9d-e418-4d1a-a924-f4ef7d87ab15"}]': finished 2024-09-12T00:49:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:08 smithi167 ceph-mon[35234]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T00:49:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:08 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:08.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:08 smithi071 ceph-mon[35276]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-12T00:49:08.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:08 smithi071 ceph-mon[35276]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T00:49:08.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:08 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/493999509' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12040e9d-e418-4d1a-a924-f4ef7d87ab15"}]: dispatch 2024-09-12T00:49:08.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:08 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/493999509' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12040e9d-e418-4d1a-a924-f4ef7d87ab15"}]': finished 2024-09-12T00:49:08.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:08 smithi071 ceph-mon[35276]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T00:49:08.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:08 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:09.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:09 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2226567848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:49:09.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:09 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2226567848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:49:09.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:09 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2226567848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:49:10.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:10 smithi002 ceph-mon[31210]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:10 smithi002 ceph-mon[31210]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T00:49:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:10 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:10.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:10 smithi167 ceph-mon[35234]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:10.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:10 smithi167 ceph-mon[35234]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T00:49:10.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:10 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:10 smithi071 ceph-mon[35276]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:10 smithi071 ceph-mon[35276]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T00:49:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:10 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:11.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:11 smithi167 ceph-mon[35234]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T00:49:11.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:11 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:11.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:11 smithi071 ceph-mon[35276]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T00:49:11.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:11 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:11.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:11 smithi002 ceph-mon[31210]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T00:49:11.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:11 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:12.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:12 smithi167 ceph-mon[35234]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T00:49:12.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:12 smithi071 ceph-mon[35276]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T00:49:12.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:12 smithi002 ceph-mon[31210]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T00:49:14.757 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:14 smithi002 ceph-mon[31210]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-12T00:49:14.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:14 smithi167 ceph-mon[35234]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-12T00:49:14.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:14 smithi071 ceph-mon[35276]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-12T00:49:16.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:16 smithi167 ceph-mon[35234]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T00:49:16.885 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:16 smithi002 ceph-mon[31210]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T00:49:16.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:16 smithi071 ceph-mon[35276]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T00:49:17.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T00:49:17.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:17 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:17.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T00:49:17.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:17 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:17.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T00:49:17.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:17 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:18.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:18 smithi002 ceph-mon[31210]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:49:18.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:18 smithi002 ceph-mon[31210]: Deploying daemon osd.9 on smithi002 2024-09-12T00:49:18.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:18 smithi167 ceph-mon[35234]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:49:18.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:18 smithi167 ceph-mon[35234]: Deploying daemon osd.9 on smithi002 2024-09-12T00:49:18.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:18 smithi071 ceph-mon[35276]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:49:18.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:18 smithi071 ceph-mon[35276]: Deploying daemon osd.9 on smithi002 2024-09-12T00:49:20.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:20 smithi167 ceph-mon[35234]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T00:49:20.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:20 smithi071 ceph-mon[35276]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T00:49:20.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:20 smithi002 ceph-mon[31210]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T00:49:22.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:22 smithi002 ceph-mon[31210]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-12T00:49:22.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:22 smithi167 ceph-mon[35234]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-12T00:49:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:22 smithi071 ceph-mon[35276]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-12T00:49:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:23.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:23 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:23.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:23.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:23.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:23 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:23.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:23.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:23.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:23 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:24.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:24 smithi071 ceph-mon[35276]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:24.965 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:24 smithi002 ceph-mon[31210]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:24 smithi167 ceph-mon[35234]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:26.128 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 9 on host 'smithi002' 2024-09-12T00:49:26.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.128+0000 7fe1ecff9640 1 -- 172.21.15.2:0/3359508791 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe1f01a2950 con 0x7fe1d80a2bb0 2024-09-12T00:49:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe1d80a2bb0 msgr2=0x7fe1d80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe1d80a2bb0 0x7fe1d80a5070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40314e0 tx=0x7fe1e4000bc0 comp rx=0 tx=0).stop 2024-09-12T00:49:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0100b10 msgr2=0x7fe1f019a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0100b10 0x7fe1f019a120 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000d950 tx=0x7fe1e000de10 comp rx=0 tx=0).stop 2024-09-12T00:49:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 shutdown_connections 2024-09-12T00:49:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe1d80a2bb0 0x7fe1d80a5070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1f01026d0 0x7fe1f01a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f0101d10 0x7fe1f019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 --2- 172.21.15.2:0/3359508791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f0100b10 0x7fe1f019a120 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 >> 172.21.15.2:0/3359508791 conn(0x7fe1f00fc2a0 msgr2=0x7fe1f0109920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:49:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 shutdown_connections 2024-09-12T00:49:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:49:26.130+0000 7fe1f5f6f640 1 -- 172.21.15.2:0/3359508791 wait complete. 2024-09-12T00:49:26.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:26 smithi002 ceph-mon[31210]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:26.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:26 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:26.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:26 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:26.876 DEBUG:teuthology.orchestra.run.smithi002:osd.9> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T00:49:26.879 INFO:tasks.cephadm:Deploying osd.10 on smithi071 with /dev/vg_nvme/lv_1... 2024-09-12T00:49:26.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T00:49:26.908 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:26 smithi071 ceph-mon[35276]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:26.908 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:26 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:26.908 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:26 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:26 smithi167 ceph-mon[35234]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:26 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:26 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:27.136 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:49:28.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:28 smithi002 ceph-mon[31210]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:28.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:28 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:28.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:28 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:28.349 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:28 smithi071 ceph-mon[35276]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:28.349 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:28 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:28.349 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:28 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:28.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:28 smithi167 ceph-mon[35234]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:28.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:28 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:28.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:28 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:29.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:29 smithi071 ceph-mon[35276]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T00:49:29.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:29 smithi002 ceph-mon[31210]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T00:49:29.245 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 00:49:28 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T00:49:28.907+0000 7f22defa3640 -1 osd.9 0 log_to_monitors true 2024-09-12T00:49:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:29 smithi167 ceph-mon[35234]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T00:49:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T00:49:29.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_1 2024-09-12T00:49:29.915 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:49:30.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:30 smithi071 ceph-mon[35276]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:30.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:30 smithi071 ceph-mon[35276]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T00:49:30.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:30 smithi071 ceph-mon[35276]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T00:49:30.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:30 smithi071 ceph-mon[35276]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:49:30.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:30 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:30.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:30 smithi002 ceph-mon[31210]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:30.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:30 smithi002 ceph-mon[31210]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T00:49:30.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:30 smithi002 ceph-mon[31210]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T00:49:30.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:30 smithi002 ceph-mon[31210]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:49:30.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:30 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 -- 172.21.15.71:0/3059392180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c102e00 msgr2=0x7ff72c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 --2- 172.21.15.71:0/3059392180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c102e00 0x7ff72c103280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff728009900 tx=0x7ff72802a410 comp rx=0 tx=0).stop 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 -- 172.21.15.71:0/3059392180 shutdown_connections 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 --2- 172.21.15.71:0/3059392180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72c1037c0 0x7ff72c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 --2- 172.21.15.71:0/3059392180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c102e00 0x7ff72c103280 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 --2- 172.21.15.71:0/3059392180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff72c101c00 0x7ff72c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 -- 172.21.15.71:0/3059392180 >> 172.21.15.71:0/3059392180 conn(0x7ff72c0fd390 msgr2=0x7ff72c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 -- 172.21.15.71:0/3059392180 shutdown_connections 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.351+0000 7ff733c2a640 1 -- 172.21.15.71:0/3059392180 wait complete. 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff733c2a640 1 Processor -- start 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff733c2a640 1 -- start start 2024-09-12T00:49:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff733c2a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c101c00 0x7ff72c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff733c2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff72c102e00 0x7ff72c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff733c2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72c1037c0 0x7ff72c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff733c2a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c10d900 con 0x7ff72c1037c0 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff733c2a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c10d780 con 0x7ff72c101c00 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff733c2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c10da80 con 0x7ff72c102e00 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff7319c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c101c00 0x7ff72c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff7319c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c101c00 0x7ff72c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56410/0 (socket says 172.21.15.71:56410) 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff7319c6640 1 -- 172.21.15.71:0/4010305040 learned_addr learned my addr 172.21.15.71:0/4010305040 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-12T00:49:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.352+0000 7ff7321c7640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72c1037c0 0x7ff72c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff7311c5640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff72c102e00 0x7ff72c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff7319c6640 1 -- 172.21.15.71:0/4010305040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff72c102e00 msgr2=0x7ff72c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff7319c6640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff72c102e00 0x7ff72c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff7319c6640 1 -- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72c1037c0 msgr2=0x7ff72c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff7319c6640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72c1037c0 0x7ff72c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff7319c6640 1 -- 172.21.15.71:0/4010305040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c0753e0 con 0x7ff72c101c00 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff7319c6640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c101c00 0x7ff72c075f90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00b450 tx=0x7ff71c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff722ffd640 1 -- 172.21.15.71:0/4010305040 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c015020 con 0x7ff72c101c00 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff722ffd640 1 -- 172.21.15.71:0/4010305040 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff71c011d70 con 0x7ff72c101c00 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72c1a2110 con 0x7ff72c101c00 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff722ffd640 1 -- 172.21.15.71:0/4010305040 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00f340 con 0x7ff72c101c00 2024-09-12T00:49:30.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.353+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72c1a26a0 con 0x7ff72c101c00 2024-09-12T00:49:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.354+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72c108fa0 con 0x7ff72c101c00 2024-09-12T00:49:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.355+0000 7ff722ffd640 1 -- 172.21.15.71:0/4010305040 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff71c018020 con 0x7ff72c101c00 2024-09-12T00:49:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.356+0000 7ff722ffd640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff7180a2c00 0x7ff7180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.356+0000 7ff7311c5640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff7180a2c00 0x7ff7180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.356+0000 7ff722ffd640 1 -- 172.21.15.71:0/4010305040 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7ff71c0ce190 con 0x7ff72c101c00 2024-09-12T00:49:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.356+0000 7ff7311c5640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff7180a2c00 0x7ff7180a50c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff728000c00 tx=0x7ff7280315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:49:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.360+0000 7ff722ffd640 1 -- 172.21.15.71:0/4010305040 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff71c01f020 con 0x7ff72c101c00 2024-09-12T00:49:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:30.537+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff72c062630 con 0x7ff7180a2c00 2024-09-12T00:49:30.536 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:30 smithi167 ceph-mon[35234]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:30.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:30 smithi167 ceph-mon[35234]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T00:49:30.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:30 smithi167 ceph-mon[35234]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T00:49:30.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:30 smithi167 ceph-mon[35234]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-12T00:49:30.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:30 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:30.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 00:49:30 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T00:49:30.874+0000 7f22da703640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T00:49:30.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 00:49:30 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T00:49:30.890+0000 7f22d2d35640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:49:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:49:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T00:49:31.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:31.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:31.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:31.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:31.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi002 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-12T00:49:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:31.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' 2024-09-12T00:49:31.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:31.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:31.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:31 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:49:31.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T00:49:31.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:31.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi002 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:31.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:31 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-12T00:49:31.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T00:49:31.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:31.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi002 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680]' entity='osd.9' 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:31.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:31 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:32.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:32 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:49:32.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:32 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:49:32.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:32 smithi071 ceph-mon[35276]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:32.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:32.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:32 smithi071 ceph-mon[35276]: osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] boot 2024-09-12T00:49:32.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:32 smithi071 ceph-mon[35276]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T00:49:32.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:32.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:32 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:49:32.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:32 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:49:32.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:32 smithi167 ceph-mon[35234]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:32.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:32.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:32 smithi167 ceph-mon[35234]: osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] boot 2024-09-12T00:49:32.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:32 smithi167 ceph-mon[35234]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T00:49:32.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:32 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:49:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:32 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:49:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:32 smithi002 ceph-mon[31210]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T00:49:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:32 smithi002 ceph-mon[31210]: osd.9 [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] boot 2024-09-12T00:49:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:32 smithi002 ceph-mon[31210]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T00:49:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:49:33.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:33 smithi002 ceph-mon[31210]: from='client.? 172.21.15.71:0/3534430412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]: dispatch 2024-09-12T00:49:33.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:33 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]: dispatch 2024-09-12T00:49:33.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:33 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]': finished 2024-09-12T00:49:33.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:33 smithi002 ceph-mon[31210]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T00:49:33.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:33 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:33.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:33 smithi071 ceph-mon[35276]: from='client.? 172.21.15.71:0/3534430412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]: dispatch 2024-09-12T00:49:33.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:33 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]: dispatch 2024-09-12T00:49:33.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:33 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]': finished 2024-09-12T00:49:33.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:33 smithi071 ceph-mon[35276]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T00:49:33.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:33 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:33.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:33 smithi167 ceph-mon[35234]: from='client.? 172.21.15.71:0/3534430412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]: dispatch 2024-09-12T00:49:33.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:33 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]: dispatch 2024-09-12T00:49:33.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:33 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d33cc429-55b5-465a-b98d-d205e51e2b89"}]': finished 2024-09-12T00:49:33.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:33 smithi167 ceph-mon[35234]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T00:49:33.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:33 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:34.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:34 smithi071 ceph-mon[35276]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:34.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:34 smithi071 ceph-mon[35276]: from='client.? 172.21.15.71:0/1311372419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:49:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:34 smithi002 ceph-mon[31210]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:34 smithi002 ceph-mon[31210]: from='client.? 172.21.15.71:0/1311372419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:49:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:34 smithi167 ceph-mon[35234]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:34 smithi167 ceph-mon[35234]: from='client.? 172.21.15.71:0/1311372419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:49:36.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:36 smithi071 ceph-mon[35276]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:36.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:36 smithi002 ceph-mon[31210]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:36.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:36 smithi167 ceph-mon[35234]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:38.389 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:38 smithi071 ceph-mon[35276]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:38.498 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:38 smithi002 ceph-mon[31210]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:38.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:38 smithi167 ceph-mon[35234]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:40.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:40 smithi071 ceph-mon[35276]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:40.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:40 smithi002 ceph-mon[31210]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:40.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:40 smithi167 ceph-mon[35234]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:42.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:42 smithi071 ceph-mon[35276]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:42.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:42 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T00:49:42.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:42 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:42.434 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:42 smithi071 ceph-mon[35276]: Deploying daemon osd.10 on smithi071 2024-09-12T00:49:42.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:42 smithi002 ceph-mon[31210]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:42.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:42 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T00:49:42.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:42 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:42.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:42 smithi002 ceph-mon[31210]: Deploying daemon osd.10 on smithi071 2024-09-12T00:49:42.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:42 smithi167 ceph-mon[35234]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:42.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:42 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T00:49:42.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:42 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:42.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:42 smithi167 ceph-mon[35234]: Deploying daemon osd.10 on smithi071 2024-09-12T00:49:44.375 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:44 smithi071 ceph-mon[35276]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:44.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:44 smithi002 ceph-mon[31210]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:44.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:44 smithi167 ceph-mon[35234]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:46.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:46 smithi071 ceph-mon[35276]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:46.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:46 smithi002 ceph-mon[31210]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:46.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:46 smithi167 ceph-mon[35234]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:48.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:48 smithi071 ceph-mon[35276]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:48.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:48.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:48.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:48.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:48 smithi002 ceph-mon[31210]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:48.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:48.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:48.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:48.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:48 smithi167 ceph-mon[35234]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:48.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:48.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:48.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:50 smithi071 ceph-mon[35276]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:50.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:50.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:50.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:50 smithi002 ceph-mon[31210]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:50.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:50.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:50.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:50 smithi167 ceph-mon[35234]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:50.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:50.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.811+0000 7ff722ffd640 1 -- 172.21.15.71:0/4010305040 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff72c062630 con 0x7ff7180a2c00 2024-09-12T00:49:50.811 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 10 on host 'smithi071' 2024-09-12T00:49:50.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff7180a2c00 msgr2=0x7ff7180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:50.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff7180a2c00 0x7ff7180a50c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff728000c00 tx=0x7ff7280315d0 comp rx=0 tx=0).stop 2024-09-12T00:49:50.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c101c00 msgr2=0x7ff72c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:50.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c101c00 0x7ff72c075f90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00b450 tx=0x7ff71c00b910 comp rx=0 tx=0).stop 2024-09-12T00:49:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 shutdown_connections 2024-09-12T00:49:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff7180a2c00 0x7ff7180a50c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72c1037c0 0x7ff72c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff72c102e00 0x7ff72c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 --2- 172.21.15.71:0/4010305040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff72c101c00 0x7ff72c075f90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 >> 172.21.15.71:0/4010305040 conn(0x7ff72c0fd390 msgr2=0x7ff72c106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:49:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 shutdown_connections 2024-09-12T00:49:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T00:49:50.814+0000 7ff733c2a640 1 -- 172.21.15.71:0/4010305040 wait complete. 2024-09-12T00:49:51.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:51.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:51.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:51.469 DEBUG:teuthology.orchestra.run.smithi071:osd.10> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T00:49:51.471 INFO:tasks.cephadm:Deploying osd.11 on smithi167 with /dev/vg_nvme/lv_1... 2024-09-12T00:49:51.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T00:49:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:51.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:51.499 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:49:51.499 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:51.500 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:51.728 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:49:52.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:52 smithi071 ceph-mon[35276]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:52.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:52 smithi002 ceph-mon[31210]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:52.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:52 smithi167 ceph-mon[35234]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:53.923 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 00:49:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T00:49:53.775+0000 7fa639e5e640 -1 osd.10 0 log_to_monitors true 2024-09-12T00:49:54.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:54 smithi071 ceph-mon[35276]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:54.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:54 smithi071 ceph-mon[35276]: from='osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T00:49:54.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:54 smithi071 ceph-mon[35276]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T00:49:54.403 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:54 smithi167 ceph-mon[35234]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:54.403 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:54 smithi167 ceph-mon[35234]: from='osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T00:49:54.403 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:54 smithi167 ceph-mon[35234]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T00:49:54.407 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-12T00:49:54.437 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_1 2024-09-12T00:49:54.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:54 smithi002 ceph-mon[31210]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:54.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:54 smithi002 ceph-mon[31210]: from='osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T00:49:54.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:54 smithi002 ceph-mon[31210]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T00:49:54.729 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:49:55.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 -- 172.21.15.167:0/414151140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6510107940 msgr2=0x7f6510109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:55.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 --2- 172.21.15.167:0/414151140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6510107940 0x7f6510109d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6508009ca0 tx=0x7f650802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:49:55.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 -- 172.21.15.167:0/414151140 shutdown_connections 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 --2- 172.21.15.167:0/414151140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6510107940 0x7f6510109d30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 --2- 172.21.15.167:0/414151140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6510105010 0x7f6510107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 --2- 172.21.15.167:0/414151140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65101026e0 0x7f6510104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 -- 172.21.15.167:0/414151140 >> 172.21.15.167:0/414151140 conn(0x7f65100fc280 msgr2=0x7f65100fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 -- 172.21.15.167:0/414151140 shutdown_connections 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.212+0000 7f6517802640 1 -- 172.21.15.167:0/414151140 wait complete. 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6517802640 1 Processor -- start 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6517802640 1 -- start start 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6517802640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65101026e0 0x7f6510197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6517802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6510105010 0x7f65101982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6517802640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6510107940 0x7f651019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:55.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6517802640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f651010d860 con 0x7f6510105010 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6517802640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f651010d6e0 con 0x7f6510107940 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6517802640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f651010d9e0 con 0x7f65101026e0 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f651559e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65101026e0 0x7f6510197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f651559e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65101026e0 0x7f6510197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58888/0 (socket says 172.21.15.167:58888) 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f651559e640 1 -- 172.21.15.167:0/2289066548 learned_addr learned my addr 172.21.15.167:0/2289066548 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6515d9f640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6510107940 0x7f651019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.213+0000 7f6514d9d640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6510105010 0x7f65101982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f651559e640 1 -- 172.21.15.167:0/2289066548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6510107940 msgr2=0x7f651019f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f651559e640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6510107940 0x7f651019f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f651559e640 1 -- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6510105010 msgr2=0x7f65101982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f651559e640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6510105010 0x7f65101982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:49:55.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f651559e640 1 -- 172.21.15.167:0/2289066548 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651019f9d0 con 0x7f65101026e0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f6515d9f640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6510107940 0x7f651019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f6514d9d640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6510105010 0x7f65101982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f651559e640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65101026e0 0x7f6510197db0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f650c00c920 tx=0x7f650c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f65067fc640 1 -- 172.21.15.167:0/2289066548 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c007c70 con 0x7f65101026e0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651019fcc0 con 0x7f65101026e0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f65067fc640 1 -- 172.21.15.167:0/2289066548 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f650c007e10 con 0x7f65101026e0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f65067fc640 1 -- 172.21.15.167:0/2289066548 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c018890 con 0x7f65101026e0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.214+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65101a01a0 con 0x7f65101026e0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.215+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65100fdd70 con 0x7f65101026e0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.217+0000 7f65067fc640 1 -- 172.21.15.167:0/2289066548 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f650c018a50 con 0x7f65101026e0 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.218+0000 7f65067fc640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f64fc0a2b80 0x7f64fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:49:55.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.218+0000 7f65067fc640 1 -- 172.21.15.167:0/2289066548 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6414+0+0 (secure 0 0 0) 0x7f650c0cecb0 con 0x7f65101026e0 2024-09-12T00:49:55.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.218+0000 7f6514d9d640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f64fc0a2b80 0x7f64fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:49:55.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.218+0000 7f6514d9d640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f64fc0a2b80 0x7f64fc0a5040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f651006aa50 tx=0x7f650000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:49:55.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.221+0000 7f65067fc640 1 -- 172.21.15.167:0/2289066548 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f650c014030 con 0x7f65101026e0 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi071 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-12T00:49:55.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:55.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:55.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:55 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:49:55.406+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6510062630 con 0x7f64fc0a2b80 2024-09-12T00:49:55.441 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T00:49:55.178+0000 7fa6355be640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T00:49:55.442 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T00:49:55.190+0000 7fa631bf8640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi071 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-12T00:49:55.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:55.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:55.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:55 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T00:49:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T00:49:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:49:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T00:49:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi071 2024-09-12T00:49:55.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:49:55.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:55 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:49:56.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:56.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:49:56.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T00:49:56.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:56.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:56.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:56.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:56.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:56.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:56.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] boot 2024-09-12T00:49:56.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T00:49:56.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:56.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:56.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:49:56.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T00:49:56.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:56.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:56.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:56.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:56.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:56.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:56.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] boot 2024-09-12T00:49:56.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T00:49:56.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: osd.10 [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] boot 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T00:49:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:49:57.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:57 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:49:57.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:57 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:49:57.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:57 smithi071 ceph-mon[35276]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T00:49:57.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:57 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:49:57.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:57 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:49:57.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:57 smithi167 ceph-mon[35234]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T00:49:57.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:57 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:49:57.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:57 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:49:57.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:57 smithi002 ceph-mon[31210]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T00:49:58.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:58 smithi071 ceph-mon[35276]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:49:58.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:58 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/2392342518' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]: dispatch 2024-09-12T00:49:58.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:58 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]: dispatch 2024-09-12T00:49:58.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:58 smithi071 ceph-mon[35276]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]': finished 2024-09-12T00:49:58.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:58 smithi071 ceph-mon[35276]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T00:49:58.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:58 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:49:58.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:58 smithi002 ceph-mon[31210]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:49:58.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:58 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/2392342518' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]: dispatch 2024-09-12T00:49:58.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:58 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]: dispatch 2024-09-12T00:49:58.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:58 smithi002 ceph-mon[31210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]': finished 2024-09-12T00:49:58.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:58 smithi002 ceph-mon[31210]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T00:49:58.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:58 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:49:58.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:58 smithi167 ceph-mon[35234]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:49:58.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:58 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/2392342518' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]: dispatch 2024-09-12T00:49:58.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:58 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]: dispatch 2024-09-12T00:49:58.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:58 smithi167 ceph-mon[35234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5"}]': finished 2024-09-12T00:49:58.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:58 smithi167 ceph-mon[35234]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T00:49:58.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:58 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:49:59.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:49:59 smithi002 ceph-mon[31210]: from='client.? 172.21.15.167:0/3580577049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:49:59.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:49:59 smithi167 ceph-mon[35234]: from='client.? 172.21.15.167:0/3580577049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:49:59.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:49:59 smithi071 ceph-mon[35276]: from='client.? 172.21.15.167:0/3580577049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T00:50:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:00 smithi002 ceph-mon[31210]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:00 smithi002 ceph-mon[31210]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T00:50:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:00 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:00.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:00 smithi002 ceph-mon[31210]: overall HEALTH_OK 2024-09-12T00:50:00.536 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:00 smithi167 ceph-mon[35234]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:00 smithi167 ceph-mon[35234]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T00:50:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:00 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:00 smithi167 ceph-mon[35234]: overall HEALTH_OK 2024-09-12T00:50:00.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:00 smithi071 ceph-mon[35276]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:00.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:00 smithi071 ceph-mon[35276]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T00:50:00.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:00 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:00.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:00 smithi071 ceph-mon[35276]: overall HEALTH_OK 2024-09-12T00:50:01.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:01 smithi002 ceph-mon[31210]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T00:50:01.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:01 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:01.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:01 smithi167 ceph-mon[35234]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T00:50:01.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:01 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:01.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:01 smithi071 ceph-mon[35276]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T00:50:01.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:01 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:02.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:02 smithi002 ceph-mon[31210]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T00:50:02.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:02 smithi167 ceph-mon[35234]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T00:50:02.593 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:02 smithi071 ceph-mon[35276]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T00:50:04.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:04 smithi002 ceph-mon[31210]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-12T00:50:04.529 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:04 smithi167 ceph-mon[35234]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-12T00:50:04.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:04 smithi071 ceph-mon[35276]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-12T00:50:06.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:06 smithi167 ceph-mon[35234]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T00:50:06.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:06 smithi071 ceph-mon[35276]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T00:50:06.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:06 smithi002 ceph-mon[31210]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T00:50:07.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:07 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T00:50:07.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:07 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:07.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:07 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T00:50:07.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:07 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:07.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:07 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T00:50:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:07 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:08.339 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:08 smithi167 ceph-mon[35234]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:50:08.339 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:08 smithi167 ceph-mon[35234]: Deploying daemon osd.11 on smithi167 2024-09-12T00:50:08.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:08 smithi071 ceph-mon[35276]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:50:08.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:08 smithi071 ceph-mon[35276]: Deploying daemon osd.11 on smithi167 2024-09-12T00:50:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:08 smithi002 ceph-mon[31210]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T00:50:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:08 smithi002 ceph-mon[31210]: Deploying daemon osd.11 on smithi167 2024-09-12T00:50:10.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:10 smithi167 ceph-mon[35234]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T00:50:10.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:10 smithi071 ceph-mon[35276]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T00:50:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:10 smithi002 ceph-mon[31210]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T00:50:12.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:12 smithi167 ceph-mon[35234]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T00:50:12.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:12 smithi071 ceph-mon[35276]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T00:50:12.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:12 smithi002 ceph-mon[31210]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T00:50:13.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:13.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:13.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:13 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:13.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:13.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:13.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:13 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:13.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:13.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:13.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:13 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:14.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:14 smithi167 ceph-mon[35234]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:14.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:14 smithi071 ceph-mon[35276]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:14.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:14 smithi002 ceph-mon[31210]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:16.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.598+0000 7f65067fc640 1 -- 172.21.15.167:0/2289066548 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6510062630 con 0x7f64fc0a2b80 2024-09-12T00:50:16.598 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 11 on host 'smithi167' 2024-09-12T00:50:16.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f64fc0a2b80 msgr2=0x7f64fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:16.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f64fc0a2b80 0x7f64fc0a5040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f651006aa50 tx=0x7f650000a5c0 comp rx=0 tx=0).stop 2024-09-12T00:50:16.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65101026e0 msgr2=0x7f6510197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:16.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65101026e0 0x7f6510197db0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f650c00c920 tx=0x7f650c00cde0 comp rx=0 tx=0).stop 2024-09-12T00:50:16.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 shutdown_connections 2024-09-12T00:50:16.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f64fc0a2b80 0x7f64fc0a5040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:16.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6510107940 0x7f651019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:16.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6510105010 0x7f65101982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:16.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 --2- 172.21.15.167:0/2289066548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65101026e0 0x7f6510197db0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:16.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 >> 172.21.15.167:0/2289066548 conn(0x7f65100fc280 msgr2=0x7f6510102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:16.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 shutdown_connections 2024-09-12T00:50:16.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:16.601+0000 7f6517802640 1 -- 172.21.15.167:0/2289066548 wait complete. 2024-09-12T00:50:16.958 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:16.958 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:16.958 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:16.958 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:16.958 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:16.958 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:16.958 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:16.959 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:16.959 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:16 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:16 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:16 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:17.413 DEBUG:teuthology.orchestra.run.smithi167:osd.11> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T00:50:17.416 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T00:50:17.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T00:50:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:18.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 -- 172.21.15.2:0/954177878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff41037d0 msgr2=0x7f4ff410a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/954177878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff41037d0 0x7f4ff410a060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009ca0 tx=0x7f4fec02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 -- 172.21.15.2:0/954177878 shutdown_connections 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/954177878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff41037d0 0x7f4ff410a060 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/954177878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff4102e10 0x7f4ff4103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/954177878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ff4101c10 0x7f4ff4102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 -- 172.21.15.2:0/954177878 >> 172.21.15.2:0/954177878 conn(0x7f4ff40fd3c0 msgr2=0x7f4ff40ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 -- 172.21.15.2:0/954177878 shutdown_connections 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.140+0000 7f4ffadc5640 1 -- 172.21.15.2:0/954177878 wait complete. 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ffadc5640 1 Processor -- start 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ffadc5640 1 -- start start 2024-09-12T00:50:18.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ffadc5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ff4101c10 0x7f4ff419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ffadc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff4102e10 0x7f4ff419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ffadc5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff41037d0 0x7f4ff41a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ffadc5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410d870 con 0x7f4ff4102e10 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ffadc5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410d6f0 con 0x7f4ff41037d0 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ffadc5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410d9f0 con 0x7f4ff4101c10 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff4102e10 0x7f4ff419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff8b61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ff4101c10 0x7f4ff419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff8b61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ff4101c10 0x7f4ff419a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:55352/0 (socket says 172.21.15.2:55352) 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff4102e10 0x7f4ff419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38336/0 (socket says 172.21.15.2:38336) 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff8b61640 1 -- 172.21.15.2:0/819286245 learned_addr learned my addr 172.21.15.2:0/819286245 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff9362640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff41037d0 0x7f4ff41a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff3fff640 1 -- 172.21.15.2:0/819286245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ff4101c10 msgr2=0x7f4ff419a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff3fff640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ff4101c10 0x7f4ff419a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff3fff640 1 -- 172.21.15.2:0/819286245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff41037d0 msgr2=0x7f4ff41a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff3fff640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff41037d0 0x7f4ff41a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff3fff640 1 -- 172.21.15.2:0/819286245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff41a1c50 con 0x7f4ff4102e10 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.141+0000 7f4ff8b61640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ff4101c10 0x7f4ff419a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.142+0000 7f4ff3fff640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff4102e10 0x7f4ff419a560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c970 tx=0x7f4fe000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.142+0000 7f4ff1ffb640 1 -- 172.21.15.2:0/819286245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0007bb0 con 0x7f4ff4102e10 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.142+0000 7f4ff1ffb640 1 -- 172.21.15.2:0/819286245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe0007d50 con 0x7f4ff4102e10 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.142+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff41a1f40 con 0x7f4ff4102e10 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.142+0000 7f4ff1ffb640 1 -- 172.21.15.2:0/819286245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000f450 con 0x7f4ff4102e10 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.142+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff41a23f0 con 0x7f4ff4102e10 2024-09-12T00:50:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.143+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff41a2680 con 0x7f4ff4102e10 2024-09-12T00:50:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.144+0000 7f4ff1ffb640 1 -- 172.21.15.2:0/819286245 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4fe0004ed0 con 0x7f4ff4102e10 2024-09-12T00:50:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.145+0000 7f4ff1ffb640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4fe40a2bb0 0x7f4fe40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.145+0000 7f4ff8b61640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4fe40a2bb0 0x7f4fe40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.145+0000 7f4ff1ffb640 1 -- 172.21.15.2:0/819286245 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6809+0+0 (secure 0 0 0) 0x7f4fe00ce6a0 con 0x7f4ff4102e10 2024-09-12T00:50:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.146+0000 7f4ff8b61640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4fe40a2bb0 0x7f4fe40a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800f4d0 tx=0x7f4fe800a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:18.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.150+0000 7f4ff1ffb640 1 -- 172.21.15.2:0/819286245 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fe0014030 con 0x7f4ff4102e10 2024-09-12T00:50:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.325+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4ff41a2850 con 0x7f4ff4102e10 2024-09-12T00:50:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.325+0000 7f4ff1ffb640 1 -- 172.21.15.2:0/819286245 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f4fe009b4f0 con 0x7f4ff4102e10 2024-09-12T00:50:18.325 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:18.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4fe40a2bb0 msgr2=0x7f4fe40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:18.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4fe40a2bb0 0x7f4fe40a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800f4d0 tx=0x7f4fe800a3b0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff4102e10 msgr2=0x7f4ff419a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:18.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff4102e10 0x7f4ff419a560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c970 tx=0x7f4fe000ce30 comp rx=0 tx=0).stop 2024-09-12T00:50:18.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 shutdown_connections 2024-09-12T00:50:18.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4fe40a2bb0 0x7f4fe40a5070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff41037d0 0x7f4ff41a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff4102e10 0x7f4ff419a560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 --2- 172.21.15.2:0/819286245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ff4101c10 0x7f4ff419a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:18.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 >> 172.21.15.2:0/819286245 conn(0x7f4ff40fd3c0 msgr2=0x7f4ff4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:18.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 shutdown_connections 2024-09-12T00:50:18.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:18.327+0000 7f4ffadc5640 1 -- 172.21.15.2:0/819286245 wait complete. 2024-09-12T00:50:18.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:18 smithi167 ceph-mon[35234]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:18.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:18 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/819286245' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:18 smithi002 ceph-mon[31210]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:18 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/819286245' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:19.071 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726102196,"num_in_osds":12,"osd_in_since":1726102197,"num_remapped_pgs":0} 2024-09-12T00:50:19.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:18 smithi071 ceph-mon[35276]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:19.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:18 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/819286245' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:19.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 00:50:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T00:50:19.268+0000 7f7c8c4b9640 -1 osd.11 0 log_to_monitors true 2024-09-12T00:50:19.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:19 smithi002 ceph-mon[31210]: from='osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T00:50:19.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:19 smithi002 ceph-mon[31210]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T00:50:20.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T00:50:20.140 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:19 smithi167 ceph-mon[35234]: from='osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T00:50:20.140 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:19 smithi167 ceph-mon[35234]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T00:50:20.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:19 smithi071 ceph-mon[35276]: from='osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T00:50:20.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:19 smithi071 ceph-mon[35276]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T00:50:20.336 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.764+0000 7f8ea9983640 1 -- 172.21.15.2:0/1537509074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 msgr2=0x7f8ea4109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.764+0000 7f8ea9983640 1 --2- 172.21.15.2:0/1537509074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 0x7f8ea4109d50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009ca0 tx=0x7f8e9c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.764+0000 7f8ea9983640 1 -- 172.21.15.2:0/1537509074 shutdown_connections 2024-09-12T00:50:20.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.764+0000 7f8ea9983640 1 --2- 172.21.15.2:0/1537509074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 0x7f8ea4109d50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.764+0000 7f8ea9983640 1 --2- 172.21.15.2:0/1537509074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ea4104fd0 0x7f8ea41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.764+0000 7f8ea9983640 1 --2- 172.21.15.2:0/1537509074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ea41026a0 0x7f8ea4104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.764+0000 7f8ea9983640 1 -- 172.21.15.2:0/1537509074 >> 172.21.15.2:0/1537509074 conn(0x7f8ea40fc2a0 msgr2=0x7f8ea40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.764+0000 7f8ea9983640 1 -- 172.21.15.2:0/1537509074 shutdown_connections 2024-09-12T00:50:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.765+0000 7f8ea9983640 1 -- 172.21.15.2:0/1537509074 wait complete. 2024-09-12T00:50:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.765+0000 7f8ea9983640 1 Processor -- start 2024-09-12T00:50:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.765+0000 7f8ea9983640 1 -- start start 2024-09-12T00:50:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea9983640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ea41026a0 0x7f8ea419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea9983640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ea4104fd0 0x7f8ea419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea9983640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 0x7f8ea41a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea9983640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410d8c0 con 0x7f8ea4107900 2024-09-12T00:50:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea9983640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410d740 con 0x7f8ea4104fd0 2024-09-12T00:50:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea9983640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410da40 con 0x7f8ea41026a0 2024-09-12T00:50:20.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 0x7f8ea41a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:20.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 0x7f8ea41a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38354/0 (socket says 172.21.15.2:38354) 2024-09-12T00:50:20.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 -- 172.21.15.2:0/2316113740 learned_addr learned my addr 172.21.15.2:0/2316113740 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:20.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea27fc640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ea4104fd0 0x7f8ea419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:20.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea2ffd640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ea41026a0 0x7f8ea419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 -- 172.21.15.2:0/2316113740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ea41026a0 msgr2=0x7f8ea419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ea41026a0 0x7f8ea419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 -- 172.21.15.2:0/2316113740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ea4104fd0 msgr2=0x7f8ea419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ea4104fd0 0x7f8ea419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 -- 172.21.15.2:0/2316113740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea41a1d40 con 0x7f8ea4107900 2024-09-12T00:50:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea37fe640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 0x7f8ea41a16d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c031ae0 tx=0x7f8e9c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:20.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea8981640 1 -- 172.21.15.2:0/2316113740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c003c30 con 0x7f8ea4107900 2024-09-12T00:50:20.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea8981640 1 -- 172.21.15.2:0/2316113740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e9c003dd0 con 0x7f8ea4107900 2024-09-12T00:50:20.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea41a1fd0 con 0x7f8ea4107900 2024-09-12T00:50:20.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.766+0000 7f8ea8981640 1 -- 172.21.15.2:0/2316113740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c02fcb0 con 0x7f8ea4107900 2024-09-12T00:50:20.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.767+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea41a2480 con 0x7f8ea4107900 2024-09-12T00:50:20.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.767+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea41093f0 con 0x7f8ea4107900 2024-09-12T00:50:20.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.769+0000 7f8ea8981640 1 -- 172.21.15.2:0/2316113740 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8e9c004050 con 0x7f8ea4107900 2024-09-12T00:50:20.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.769+0000 7f8ea8981640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8e8c0a2bb0 0x7f8e8c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:20.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.770+0000 7f8ea2ffd640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8e8c0a2bb0 0x7f8e8c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:20.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.770+0000 7f8ea8981640 1 -- 172.21.15.2:0/2316113740 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6831+0+0 (secure 0 0 0) 0x7f8e9c0efff0 con 0x7f8ea4107900 2024-09-12T00:50:20.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.770+0000 7f8ea2ffd640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8e8c0a2bb0 0x7f8e8c0a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009b60 tx=0x7f8e94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:20.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.773+0000 7f8ea8981640 1 -- 172.21.15.2:0/2316113740 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e9c0bd4a0 con 0x7f8ea4107900 2024-09-12T00:50:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.950+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8ea402da10 con 0x7f8ea4107900 2024-09-12T00:50:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.950+0000 7f8ea8981640 1 -- 172.21.15.2:0/2316113740 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f8e9c0bcda0 con 0x7f8ea4107900 2024-09-12T00:50:20.949 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8e8c0a2bb0 msgr2=0x7f8e8c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8e8c0a2bb0 0x7f8e8c0a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009b60 tx=0x7f8e94005f90 comp rx=0 tx=0).stop 2024-09-12T00:50:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 msgr2=0x7f8ea41a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 0x7f8ea41a16d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c031ae0 tx=0x7f8e9c031ee0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 shutdown_connections 2024-09-12T00:50:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8e8c0a2bb0 0x7f8e8c0a5070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea4107900 0x7f8ea41a16d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ea4104fd0 0x7f8ea419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 --2- 172.21.15.2:0/2316113740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ea41026a0 0x7f8ea419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:20.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 >> 172.21.15.2:0/2316113740 conn(0x7f8ea40fc2a0 msgr2=0x7f8ea4101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:20.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 shutdown_connections 2024-09-12T00:50:20.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:20.952+0000 7f8ea9983640 1 -- 172.21.15.2:0/2316113740 wait complete. 2024-09-12T00:50:21.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:21.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:21.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:20 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:21.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:21.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:20 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T00:50:20.812+0000 7f7c87c19640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T00:50:21.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T00:50:20.829+0000 7f7c84253640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:50:21.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:21.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T00:50:21.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:21.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:20 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:21.684 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726102196,"num_in_osds":12,"osd_in_since":1726102197,"num_remapped_pgs":0} 2024-09-12T00:50:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:21 smithi167 ceph-mon[35234]: Detected new or changed devices on smithi167 2024-09-12T00:50:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:21 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-12T00:50:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:21 smithi167 ceph-mon[35234]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:50:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:21 smithi167 ceph-mon[35234]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T00:50:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:21 smithi167 ceph-mon[35234]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:21 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2316113740' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:22.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:21 smithi071 ceph-mon[35276]: Detected new or changed devices on smithi167 2024-09-12T00:50:22.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:21 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-12T00:50:22.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:21 smithi071 ceph-mon[35276]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:50:22.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:21 smithi071 ceph-mon[35276]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T00:50:22.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:22.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:22.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:21 smithi071 ceph-mon[35276]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:22.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:21 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2316113740' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:22.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:21 smithi002 ceph-mon[31210]: Detected new or changed devices on smithi167 2024-09-12T00:50:22.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:21 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-12T00:50:22.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:21 smithi002 ceph-mon[31210]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-12T00:50:22.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:21 smithi002 ceph-mon[31210]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T00:50:22.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:22.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:22.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:21 smithi002 ceph-mon[31210]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-12T00:50:22.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:21 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2316113740' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:22.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T00:50:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:22.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:22 smithi002 ceph-mon[31210]: purged_snaps scrub starts 2024-09-12T00:50:22.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:22 smithi002 ceph-mon[31210]: purged_snaps scrub ok 2024-09-12T00:50:22.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:22 smithi002 ceph-mon[31210]: osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] boot 2024-09-12T00:50:22.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:22 smithi002 ceph-mon[31210]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T00:50:22.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:23.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:22 smithi071 ceph-mon[35276]: purged_snaps scrub starts 2024-09-12T00:50:23.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:22 smithi071 ceph-mon[35276]: purged_snaps scrub ok 2024-09-12T00:50:23.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:22 smithi071 ceph-mon[35276]: osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] boot 2024-09-12T00:50:23.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:22 smithi071 ceph-mon[35276]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T00:50:23.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:23.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:22 smithi167 ceph-mon[35234]: purged_snaps scrub starts 2024-09-12T00:50:23.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:22 smithi167 ceph-mon[35234]: purged_snaps scrub ok 2024-09-12T00:50:23.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:22 smithi167 ceph-mon[35234]: osd.11 [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] boot 2024-09-12T00:50:23.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:22 smithi167 ceph-mon[35234]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T00:50:23.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:50:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.404+0000 7f03ac3ab640 1 -- 172.21.15.2:0/13615519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a41026d0 msgr2=0x7f03a4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.404+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/13615519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a41026d0 0x7f03a4108f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f039c009ca0 tx=0x7f039c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.404+0000 7f03ac3ab640 1 -- 172.21.15.2:0/13615519 shutdown_connections 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.404+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/13615519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a41026d0 0x7f03a4108f60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.404+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/13615519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03a4101d10 0x7f03a4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.404+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/13615519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a4100b10 0x7f03a4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.404+0000 7f03ac3ab640 1 -- 172.21.15.2:0/13615519 >> 172.21.15.2:0/13615519 conn(0x7f03a40fc2a0 msgr2=0x7f03a40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 -- 172.21.15.2:0/13615519 shutdown_connections 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 -- 172.21.15.2:0/13615519 wait complete. 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 Processor -- start 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 -- start start 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a4100b10 0x7f03a41a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a4101d10 0x7f03a41a31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03a41026d0 0x7f03a41a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f03a410c770 con 0x7f03a4100b10 2024-09-12T00:50:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03a410c5f0 con 0x7f03a41026d0 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.405+0000 7f03ac3ab640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03a410c8f0 con 0x7f03a4101d10 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a4100b10 0x7f03a41a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03a9946640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a4101d10 0x7f03a41a31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a4100b10 0x7f03a41a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38368/0 (socket says 172.21.15.2:38368) 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 -- 172.21.15.2:0/2382927211 learned_addr learned my addr 172.21.15.2:0/2382927211 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa948640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03a41026d0 0x7f03a41a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 -- 172.21.15.2:0/2382927211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a4101d10 msgr2=0x7f03a41a31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a4101d10 0x7f03a41a31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 -- 172.21.15.2:0/2382927211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03a41026d0 msgr2=0x7f03a41a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03a41026d0 0x7f03a41a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 -- 172.21.15.2:0/2382927211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a41a60d0 con 0x7f03a4100b10 2024-09-12T00:50:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03a9946640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a4101d10 0x7f03a41a31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03aa147640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a4100b10 0x7f03a41a0c50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f03a000d770 tx=0x7f03a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f039b7fe640 1 -- 172.21.15.2:0/2382927211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0017070 con 0x7f03a4100b10 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a41a63c0 con 0x7f03a4100b10 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f039b7fe640 1 -- 172.21.15.2:0/2382927211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a0009c30 con 0x7f03a4100b10 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.406+0000 7f039b7fe640 1 -- 172.21.15.2:0/2382927211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0003dd0 con 0x7f03a4100b10 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.407+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a41a6900 con 0x7f03a4100b10 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.408+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a4195570 con 0x7f03a4100b10 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.409+0000 7f039b7fe640 1 -- 172.21.15.2:0/2382927211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f03a0003f70 con 0x7f03a4100b10 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.409+0000 7f039b7fe640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f03900a2b80 0x7f03900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.410+0000 7f03a9946640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f03900a2b80 0x7f03900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.410+0000 7f039b7fe640 1 -- 172.21.15.2:0/2382927211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f03a00ce890 con 0x7f03a4100b10 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.410+0000 7f03a9946640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f03900a2b80 0x7f03900a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f03a41093e0 tx=0x7f039400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.413+0000 7f039b7fe640 1 -- 172.21.15.2:0/2382927211 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03a0009de0 con 0x7f03a4100b10 2024-09-12T00:50:23.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.590+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f03a402d980 con 0x7f03a4100b10 2024-09-12T00:50:23.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.591+0000 7f039b7fe640 1 -- 172.21.15.2:0/2382927211 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f03a0097030 con 0x7f03a4100b10 2024-09-12T00:50:23.590 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:23.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f03900a2b80 msgr2=0x7f03900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f03900a2b80 0x7f03900a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f03a41093e0 tx=0x7f039400b390 comp rx=0 tx=0).stop 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a4100b10 msgr2=0x7f03a41a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a4100b10 0x7f03a41a0c50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f03a000d770 tx=0x7f03a000dc30 comp rx=0 tx=0).stop 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 shutdown_connections 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f03900a2b80 0x7f03900a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03a41026d0 0x7f03a41a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a4101d10 0x7f03a41a31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 --2- 172.21.15.2:0/2382927211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a4100b10 0x7f03a41a0c50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 >> 172.21.15.2:0/2382927211 conn(0x7f03a40fc2a0 msgr2=0x7f03a40fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 shutdown_connections 2024-09-12T00:50:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:23.593+0000 7f03ac3ab640 1 -- 172.21.15.2:0/2382927211 wait complete. 2024-09-12T00:50:24.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:23 smithi002 ceph-mon[31210]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T00:50:24.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:23 smithi002 ceph-mon[31210]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:24.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:23 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2382927211' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:24.170 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726102221,"num_in_osds":12,"osd_in_since":1726102197,"num_remapped_pgs":0} 2024-09-12T00:50:24.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:50:24.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:23 smithi071 ceph-mon[35276]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T00:50:24.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:23 smithi071 ceph-mon[35276]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:24.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:23 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2382927211' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:24.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:23 smithi167 ceph-mon[35234]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T00:50:24.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:23 smithi167 ceph-mon[35234]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:24.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:23 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2382927211' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T00:50:24.424 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 -- 172.21.15.2:0/1243954338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 msgr2=0x7fd410100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 --2- 172.21.15.2:0/1243954338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 0x7fd410100ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd404009930 tx=0x7fd40402a420 comp rx=0 tx=0).stop 2024-09-12T00:50:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 -- 172.21.15.2:0/1243954338 shutdown_connections 2024-09-12T00:50:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 --2- 172.21.15.2:0/1243954338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd410101420 0x7fd41010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 --2- 172.21.15.2:0/1243954338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 0x7fd410100ee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 --2- 172.21.15.2:0/1243954338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd410106a80 0x7fd410106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 -- 172.21.15.2:0/1243954338 >> 172.21.15.2:0/1243954338 conn(0x7fd4100fc7a0 msgr2=0x7fd4100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 -- 172.21.15.2:0/1243954338 shutdown_connections 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.836+0000 7fd416237640 1 -- 172.21.15.2:0/1243954338 wait complete. 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.837+0000 7fd416237640 1 Processor -- start 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.837+0000 7fd416237640 1 -- start start 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.837+0000 7fd416237640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 0x7fd410198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.837+0000 7fd416237640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd410101420 0x7fd410198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.837+0000 7fd416237640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd410106a80 0x7fd41019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.837+0000 7fd416237640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd410110e90 con 0x7fd410100a80 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.837+0000 7fd416237640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd410110d10 con 0x7fd410106a80 2024-09-12T00:50:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.837+0000 7fd416237640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd410111010 con 0x7fd410101420 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 0x7fd410198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 0x7fd410198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38384/0 (socket says 172.21.15.2:38384) 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 -- 172.21.15.2:0/1775469335 learned_addr learned my addr 172.21.15.2:0/1775469335 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40effd640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd410101420 0x7fd410198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40ffff640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd410106a80 0x7fd41019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 -- 172.21.15.2:0/1775469335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd410101420 msgr2=0x7fd410198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd410101420 0x7fd410198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 -- 172.21.15.2:0/1775469335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd410106a80 msgr2=0x7fd41019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd410106a80 0x7fd41019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 -- 172.21.15.2:0/1775469335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41019d3c0 con 0x7fd410100a80 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40f7fe640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 0x7fd410198410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c920 tx=0x7fd40000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40cff9640 1 -- 172.21.15.2:0/1775469335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400007c70 con 0x7fd410100a80 2024-09-12T00:50:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41019d6b0 con 0x7fd410100a80 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40cff9640 1 -- 172.21.15.2:0/1775469335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd400007e10 con 0x7fd410100a80 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd40cff9640 1 -- 172.21.15.2:0/1775469335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400018890 con 0x7fd410100a80 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.838+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4101a4f90 con 0x7fd410100a80 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.839+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd410100ee0 con 0x7fd410100a80 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.841+0000 7fd40cff9640 1 -- 172.21.15.2:0/1775469335 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fd400018a50 con 0x7fd410100a80 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.841+0000 7fd40cff9640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd3f80a2b80 0x7fd3f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.842+0000 7fd40effd640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd3f80a2b80 0x7fd3f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.842+0000 7fd40cff9640 1 -- 172.21.15.2:0/1775469335 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd4000cef10 con 0x7fd410100a80 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.842+0000 7fd40effd640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd3f80a2b80 0x7fd3f80a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd404006010 tx=0x7fd404000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:24.845+0000 7fd40cff9640 1 -- 172.21.15.2:0/1775469335 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd400014030 con 0x7fd410100a80 2024-09-12T00:50:25.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.023+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd410199770 con 0x7fd410100a80 2024-09-12T00:50:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.024+0000 7fd40cff9640 1 -- 172.21.15.2:0/1775469335 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18372 (secure 0 0 0) 0x7fd410199770 con 0x7fd410100a80 2024-09-12T00:50:25.023 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:25.024 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:50:22.815204+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:50:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd3f80a2b80 msgr2=0x7fd3f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd3f80a2b80 0x7fd3f80a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd404006010 tx=0x7fd404000bc0 comp rx=0 tx=0).stop 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 msgr2=0x7fd410198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 0x7fd410198410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c920 tx=0x7fd40000cde0 comp rx=0 tx=0).stop 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 shutdown_connections 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd3f80a2b80 0x7fd3f80a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd410106a80 0x7fd41019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd410101420 0x7fd410198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 --2- 172.21.15.2:0/1775469335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd410100a80 0x7fd410198410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 >> 172.21.15.2:0/1775469335 conn(0x7fd4100fc7a0 msgr2=0x7fd41006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 shutdown_connections 2024-09-12T00:50:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:25.027+0000 7fd416237640 1 -- 172.21.15.2:0/1775469335 wait complete. 2024-09-12T00:50:25.691 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T00:46:35.272846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T00:50:25.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T00:50:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:25.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:25 smithi002 ceph-mon[31210]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:25.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:25 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1775469335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:50:26.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:25 smithi071 ceph-mon[35276]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:26.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:25 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1775469335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:50:26.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:25 smithi167 ceph-mon[35234]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:26.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:25 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1775469335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:50:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 -- 172.21.15.2:0/1480948937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c102570 msgr2=0x7fe46c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 --2- 172.21.15.2:0/1480948937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c102570 0x7fe46c1029b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009900 tx=0x7fe45c02a480 comp rx=0 tx=0).stop 2024-09-12T00:50:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 -- 172.21.15.2:0/1480948937 shutdown_connections 2024-09-12T00:50:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 --2- 172.21.15.2:0/1480948937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe46c102ef0 0x7fe46c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 --2- 172.21.15.2:0/1480948937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c102570 0x7fe46c1029b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 --2- 172.21.15.2:0/1480948937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe46c100e20 0x7fe46c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 -- 172.21.15.2:0/1480948937 >> 172.21.15.2:0/1480948937 conn(0x7fe46c0fc7d0 msgr2=0x7fe46c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 -- 172.21.15.2:0/1480948937 shutdown_connections 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.370+0000 7fe473e8f640 1 -- 172.21.15.2:0/1480948937 wait complete. 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe473e8f640 1 Processor -- start 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe473e8f640 1 -- start start 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe473e8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c100e20 0x7fe46c1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe473e8f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe46c102570 0x7fe46c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe473e8f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe46c102ef0 0x7fe46c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe473e8f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c110fa0 con 0x7fe46c100e20 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe473e8f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c110e20 con 0x7fe46c102ef0 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe473e8f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c111120 con 0x7fe46c102570 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe471c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c100e20 0x7fe46c1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe471c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c100e20 0x7fe46c1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38464/0 (socket says 172.21.15.2:38464) 2024-09-12T00:50:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe471c2b640 1 -- 172.21.15.2:0/2496761198 learned_addr learned my addr 172.21.15.2:0/2496761198 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe47142a640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe46c102570 0x7fe46c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.371+0000 7fe47242c640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe46c102ef0 0x7fe46c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe471c2b640 1 -- 172.21.15.2:0/2496761198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe46c102570 msgr2=0x7fe46c197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe471c2b640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe46c102570 0x7fe46c197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe471c2b640 1 -- 172.21.15.2:0/2496761198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe46c102ef0 msgr2=0x7fe46c19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe471c2b640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe46c102ef0 0x7fe46c19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe471c2b640 1 -- 172.21.15.2:0/2496761198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46c19c470 con 0x7fe46c100e20 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe471c2b640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c100e20 0x7fe46c1974c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe46800d990 tx=0x7fe46800de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe462ffd640 1 -- 172.21.15.2:0/2496761198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46801b070 con 0x7fe46c100e20 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe462ffd640 1 -- 172.21.15.2:0/2496761198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe46800edf0 con 0x7fe46c100e20 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46c19c760 con 0x7fe46c100e20 2024-09-12T00:50:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe462ffd640 1 -- 172.21.15.2:0/2496761198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468014870 con 0x7fe46c100e20 2024-09-12T00:50:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.372+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46c069f70 con 0x7fe46c100e20 2024-09-12T00:50:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.373+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46c1021b0 con 0x7fe46c100e20 2024-09-12T00:50:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.374+0000 7fe462ffd640 1 -- 172.21.15.2:0/2496761198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe46801e070 con 0x7fe46c100e20 2024-09-12T00:50:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.375+0000 7fe462ffd640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe4580a2c00 0x7fe4580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.375+0000 7fe47142a640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe4580a2c00 0x7fe4580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.376+0000 7fe462ffd640 1 -- 172.21.15.2:0/2496761198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fe4680d0300 con 0x7fe46c100e20 2024-09-12T00:50:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.376+0000 7fe47142a640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe4580a2c00 0x7fe4580a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009230 tx=0x7fe45c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.380+0000 7fe462ffd640 1 -- 172.21.15.2:0/2496761198 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe46809d010 con 0x7fe46c100e20 2024-09-12T00:50:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.555+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe46c198850 con 0x7fe46c100e20 2024-09-12T00:50:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.555+0000 7fe462ffd640 1 -- 172.21.15.2:0/2496761198 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7fe46c198850 con 0x7fe46c100e20 2024-09-12T00:50:26.554 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-12T00:50:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe4580a2c00 msgr2=0x7fe4580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe4580a2c00 0x7fe4580a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009230 tx=0x7fe45c0058d0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c100e20 msgr2=0x7fe46c1974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c100e20 0x7fe46c1974c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe46800d990 tx=0x7fe46800de50 comp rx=0 tx=0).stop 2024-09-12T00:50:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 shutdown_connections 2024-09-12T00:50:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe4580a2c00 0x7fe4580a50c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe46c102ef0 0x7fe46c19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe46c102570 0x7fe46c197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.557+0000 7fe473e8f640 1 --2- 172.21.15.2:0/2496761198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe46c100e20 0x7fe46c1974c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.558+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 >> 172.21.15.2:0/2496761198 conn(0x7fe46c0fc7d0 msgr2=0x7fe46c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.558+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 shutdown_connections 2024-09-12T00:50:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:26.558+0000 7fe473e8f640 1 -- 172.21.15.2:0/2496761198 wait complete. 2024-09-12T00:50:27.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:26 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2496761198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:50:27.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:26 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2496761198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.a on smithi002 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.d on smithi002 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.g on smithi002 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.j on smithi002 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.b on smithi071 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.e on smithi071 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.h on smithi071 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.k on smithi071 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.c on smithi167 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.f on smithi167 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.i on smithi167 2024-09-12T00:50:27.274 INFO:tasks.cephadm:Adding mds.l on smithi167 2024-09-12T00:50:27.275 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l' 2024-09-12T00:50:27.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:26 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2496761198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:50:27.536 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:50:27.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:27 smithi167 ceph-mon[35234]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:28.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 -- 172.21.15.167:0/2307154171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a01079c0 msgr2=0x7fa2a0109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/2307154171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a01079c0 0x7fa2a0109db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa298009ca0 tx=0x7fa29802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 -- 172.21.15.167:0/2307154171 shutdown_connections 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/2307154171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a01079c0 0x7fa2a0109db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/2307154171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a0105090 0x7fa2a0107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/2307154171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a0102760 0x7fa2a0104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 -- 172.21.15.167:0/2307154171 >> 172.21.15.167:0/2307154171 conn(0x7fa2a00fc2a0 msgr2=0x7fa2a00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 -- 172.21.15.167:0/2307154171 shutdown_connections 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.979+0000 7fa2a5e86640 1 -- 172.21.15.167:0/2307154171 wait complete. 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.980+0000 7fa2a5e86640 1 Processor -- start 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.980+0000 7fa2a5e86640 1 -- start start 2024-09-12T00:50:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.980+0000 7fa2a5e86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a0102760 0x7fa2a0197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa2a5e86640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a0105090 0x7fa2a0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa2a5e86640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01079c0 0x7fa2a019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa2a5e86640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a010d8d0 con 0x7fa2a0105090 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa2a5e86640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a010d750 con 0x7fa2a01079c0 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa2a5e86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a010da50 con 0x7fa2a0102760 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a0102760 0x7fa2a0197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a0102760 0x7fa2a0197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33708/0 (socket says 172.21.15.167:33708) 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 -- 172.21.15.167:0/3521789629 learned_addr learned my addr 172.21.15.167:0/3521789629 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29ffff640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01079c0 0x7fa2a019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29effd640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a0105090 0x7fa2a0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 -- 172.21.15.167:0/3521789629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01079c0 msgr2=0x7fa2a019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01079c0 0x7fa2a019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 -- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a0105090 msgr2=0x7fa2a0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a0105090 0x7fa2a0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 -- 172.21.15.167:0/3521789629 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a019fb00 con 0x7fa2a0102760 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29ffff640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01079c0 0x7fa2a019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29effd640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a0105090 0x7fa2a0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29f7fe640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a0102760 0x7fa2a0197ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa29000d770 tx=0x7fa29000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29cff9640 1 -- 172.21.15.167:0/3521789629 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa290017070 con 0x7fa2a0102760 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29cff9640 1 -- 172.21.15.167:0/3521789629 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa290005500 con 0x7fa2a0102760 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a019fdf0 con 0x7fa2a0102760 2024-09-12T00:50:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.981+0000 7fa29cff9640 1 -- 172.21.15.167:0/3521789629 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa290004e00 con 0x7fa2a0102760 2024-09-12T00:50:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.982+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01a0240 con 0x7fa2a0102760 2024-09-12T00:50:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.983+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a00fdd90 con 0x7fa2a0102760 2024-09-12T00:50:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.984+0000 7fa29cff9640 1 -- 172.21.15.167:0/3521789629 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa290004fa0 con 0x7fa2a0102760 2024-09-12T00:50:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.985+0000 7fa29cff9640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa28c0a2c30 0x7fa28c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.985+0000 7fa29cff9640 1 -- 172.21.15.167:0/3521789629 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa2900ce620 con 0x7fa2a0102760 2024-09-12T00:50:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.985+0000 7fa29effd640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa28c0a2c30 0x7fa28c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.988+0000 7fa29effd640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa28c0a2c30 0x7fa28c0a50f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2a01993f0 tx=0x7fa288005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:27.991+0000 7fa29cff9640 1 -- 172.21.15.167:0/3521789629 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa29009ba20 con 0x7fa2a0102760 2024-09-12T00:50:28.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.169+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}) -- 0x7fa2a00628f0 con 0x7fa28c0a2c30 2024-09-12T00:50:28.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.176+0000 7fa29cff9640 1 -- 172.21.15.167:0/3521789629 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa2a00628f0 con 0x7fa28c0a2c30 2024-09-12T00:50:28.176 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mds.all update... 2024-09-12T00:50:28.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa28c0a2c30 msgr2=0x7fa28c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:28.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa28c0a2c30 0x7fa28c0a50f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2a01993f0 tx=0x7fa288005ec0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a0102760 msgr2=0x7fa2a0197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a0102760 0x7fa2a0197ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa29000d770 tx=0x7fa29000dc30 comp rx=0 tx=0).stop 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 shutdown_connections 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa28c0a2c30 0x7fa28c0a50f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01079c0 0x7fa2a019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a0105090 0x7fa2a0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 --2- 172.21.15.167:0/3521789629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2a0102760 0x7fa2a0197ed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 >> 172.21.15.167:0/3521789629 conn(0x7fa2a00fc2a0 msgr2=0x7fa2a0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 shutdown_connections 2024-09-12T00:50:28.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-12T00:50:28.179+0000 7fa2a5e86640 1 -- 172.21.15.167:0/3521789629 wait complete. 2024-09-12T00:50:28.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:27 smithi071 ceph-mon[35276]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:28.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:27 smithi002 ceph-mon[31210]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:28.853 DEBUG:teuthology.orchestra.run.smithi002:mds.a> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T00:50:28.856 DEBUG:teuthology.orchestra.run.smithi002:mds.d> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T00:50:28.899 DEBUG:teuthology.orchestra.run.smithi002:mds.g> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T00:50:28.942 DEBUG:teuthology.orchestra.run.smithi002:mds.j> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T00:50:28.985 DEBUG:teuthology.orchestra.run.smithi071:mds.b> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T00:50:28.988 DEBUG:teuthology.orchestra.run.smithi071:mds.e> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T00:50:29.031 DEBUG:teuthology.orchestra.run.smithi071:mds.h> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T00:50:29.074 DEBUG:teuthology.orchestra.run.smithi071:mds.k> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T00:50:29.117 DEBUG:teuthology.orchestra.run.smithi167:mds.c> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T00:50:29.120 DEBUG:teuthology.orchestra.run.smithi167:mds.f> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T00:50:29.166 DEBUG:teuthology.orchestra.run.smithi167:mds.i> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T00:50:29.209 DEBUG:teuthology.orchestra.run.smithi167:mds.l> sudo journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T00:50:29.252 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T00:50:29.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:29.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:50:29.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:29.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:29 smithi071 ceph-mon[35276]: Deploying daemon mds.l on smithi167 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:29.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:29.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:29 smithi002 ceph-mon[31210]: Deploying daemon mds.l on smithi167 2024-09-12T00:50:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:50:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-09-12T00:50:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:50:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:29.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:50:29.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:29.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:29.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:29.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:29.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:29 smithi167 ceph-mon[35234]: Deploying daemon mds.l on smithi167 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.960+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/1721077667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4108290 msgr2=0x7f2bc410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.960+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/1721077667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4108290 0x7f2bc410ec30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009cd0 tx=0x7f2bbc02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/1721077667 shutdown_connections 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/1721077667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4108290 0x7f2bc410ec30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/1721077667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc4103740 0x7f2bc4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/1721077667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc4102d90 0x7f2bc4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/1721077667 >> 172.21.15.2:0/1721077667 conn(0x7f2bc40fc7d0 msgr2=0x7f2bc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/1721077667 shutdown_connections 2024-09-12T00:50:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/1721077667 wait complete. 2024-09-12T00:50:29.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 Processor -- start 2024-09-12T00:50:29.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.961+0000 7f2bcc4ee640 1 -- start start 2024-09-12T00:50:29.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bcc4ee640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc4102d90 0x7f2bc4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:29.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bcc4ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4103740 0x7f2bc4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:29.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bcc4ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc4108290 0x7f2bc419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:29.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bcc4ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc4112090 con 0x7f2bc4103740 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bcc4ee640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc4111f10 con 0x7f2bc4102d90 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bcc4ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc4112210 con 0x7f2bc4108290 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bc9a89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4103740 0x7f2bc4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bca28a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc4102d90 0x7f2bc4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bca28a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc4102d90 0x7f2bc4198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:33286/0 (socket says 172.21.15.2:33286) 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bc9a89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4103740 0x7f2bc4198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38478/0 (socket says 172.21.15.2:38478) 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bca28a640 1 -- 172.21.15.2:0/586997306 learned_addr learned my addr 172.21.15.2:0/586997306 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bcaa8b640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc4108290 0x7f2bc419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bc9a89640 1 -- 172.21.15.2:0/586997306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc4108290 msgr2=0x7f2bc419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bc9a89640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc4108290 0x7f2bc419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bc9a89640 1 -- 172.21.15.2:0/586997306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc4102d90 msgr2=0x7f2bc4198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bc9a89640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc4102d90 0x7f2bc4198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bc9a89640 1 -- 172.21.15.2:0/586997306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc419d4d0 con 0x7f2bc4103740 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bca28a640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc4102d90 0x7f2bc4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bcaa8b640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc4108290 0x7f2bc419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bc9a89640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4103740 0x7f2bc4198a60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005fd0 tx=0x7f2bb400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.962+0000 7f2bbb7fe640 1 -- 172.21.15.2:0/586997306 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4009c00 con 0x7f2bc4103740 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.963+0000 7f2bbb7fe640 1 -- 172.21.15.2:0/586997306 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bb4009da0 con 0x7f2bc4103740 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.963+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc419d7c0 con 0x7f2bc4103740 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.963+0000 7f2bbb7fe640 1 -- 172.21.15.2:0/586997306 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4010460 con 0x7f2bc4103740 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.963+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc41a50a0 con 0x7f2bc4103740 2024-09-12T00:50:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.964+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc4103170 con 0x7f2bc4103740 2024-09-12T00:50:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.965+0000 7f2bbb7fe640 1 -- 172.21.15.2:0/586997306 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2bb4003f50 con 0x7f2bc4103740 2024-09-12T00:50:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.965+0000 7f2bbb7fe640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2bb00a2b80 0x7f2bb00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.965+0000 7f2bca28a640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2bb00a2b80 0x7f2bb00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.965+0000 7f2bbb7fe640 1 -- 172.21.15.2:0/586997306 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f2bb40ce6f0 con 0x7f2bc4103740 2024-09-12T00:50:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.966+0000 7f2bca28a640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2bb00a2b80 0x7f2bb00a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005fd0 tx=0x7f2bc000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:29.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:29.970+0000 7f2bbb7fe640 1 -- 172.21.15.2:0/586997306 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2bb4017020 con 0x7f2bc4103740 2024-09-12T00:50:30.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.180+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bc410a2a0 con 0x7f2bc4103740 2024-09-12T00:50:30.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.181+0000 7f2bbb7fe640 1 -- 172.21.15.2:0/586997306 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f2bb409baf0 con 0x7f2bc4103740 2024-09-12T00:50:30.180 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:30.180 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":1,"btime":"2024-09-12T00:43:32:673188+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T00:50:30.180 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 1 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2bb00a2b80 msgr2=0x7f2bb00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2bb00a2b80 0x7f2bb00a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005fd0 tx=0x7f2bc000b4a0 comp rx=0 tx=0).stop 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4103740 msgr2=0x7f2bc4198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4103740 0x7f2bc4198a60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005fd0 tx=0x7f2bb400dde0 comp rx=0 tx=0).stop 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 shutdown_connections 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2bb00a2b80 0x7f2bb00a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc4108290 0x7f2bc419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc4103740 0x7f2bc4198a60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 --2- 172.21.15.2:0/586997306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc4102d90 0x7f2bc4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 >> 172.21.15.2:0/586997306 conn(0x7f2bc40fc7d0 msgr2=0x7f2bc4106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 shutdown_connections 2024-09-12T00:50:30.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:30.183+0000 7f2bcc4ee640 1 -- 172.21.15.2:0/586997306 wait complete. 2024-09-12T00:50:30.744 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:30 smithi167 ceph-mon[35234]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:30.744 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:30 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/586997306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:30.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:30 smithi002 ceph-mon[31210]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:30.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:30 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/586997306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:30.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:30 smithi071 ceph-mon[35276]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:30.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:30 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/586997306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:31.537 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 12 00:50:31 smithi167 systemd[1]: Started Ceph mds.l for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:32.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:32.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.167:6832/1821901024,v1:172.21.15.167:6833/1821901024] up:boot 2024-09-12T00:50:32.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: fsmap 1 up:standby 2024-09-12T00:50:32.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:50:32.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:32.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:32.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:32.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:32 smithi071 ceph-mon[35276]: Deploying daemon mds.k on smithi071 2024-09-12T00:50:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.167:6832/1821901024,v1:172.21.15.167:6833/1821901024] up:boot 2024-09-12T00:50:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: fsmap 1 up:standby 2024-09-12T00:50:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:50:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:32.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:32.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:32.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:32 smithi002 ceph-mon[31210]: Deploying daemon mds.k on smithi071 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.167:6832/1821901024,v1:172.21.15.167:6833/1821901024] up:boot 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: fsmap 1 up:standby 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:32.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:32.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:32 smithi167 ceph-mon[35234]: Deploying daemon mds.k on smithi071 2024-09-12T00:50:32.903 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:33.292 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 systemd[1]: Starting Ceph mds.k for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:50:33.597 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 podman[65033]: 2024-09-12 00:50:33.355969326 +0000 UTC m=+0.015937926 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:50:33.598 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 podman[65033]: 2024-09-12 00:50:33.473130489 +0000 UTC m=+0.133099073 container create e1228544ad81a484b7617d90509266df41e2fa5a3e0f854b1e56f9fca551082c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T00:50:33.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.616+0000 7f3b44a00640 1 -- 172.21.15.2:0/58177459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401008d0 msgr2=0x7f3b40100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:33.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.616+0000 7f3b44a00640 1 --2- 172.21.15.2:0/58177459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401008d0 0x7f3b40100d30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009930 tx=0x7f3b3402a420 comp rx=0 tx=0).stop 2024-09-12T00:50:33.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.617+0000 7f3b44a00640 1 -- 172.21.15.2:0/58177459 shutdown_connections 2024-09-12T00:50:33.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.617+0000 7f3b44a00640 1 --2- 172.21.15.2:0/58177459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b40101270 0x7f3b4010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.617+0000 7f3b44a00640 1 --2- 172.21.15.2:0/58177459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401008d0 0x7f3b40100d30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.617+0000 7f3b44a00640 1 --2- 172.21.15.2:0/58177459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b401068d0 0x7f3b40106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.617+0000 7f3b44a00640 1 -- 172.21.15.2:0/58177459 >> 172.21.15.2:0/58177459 conn(0x7f3b400fc610 msgr2=0x7f3b400fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.617+0000 7f3b44a00640 1 -- 172.21.15.2:0/58177459 shutdown_connections 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.617+0000 7f3b44a00640 1 -- 172.21.15.2:0/58177459 wait complete. 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.617+0000 7f3b44a00640 1 Processor -- start 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b44a00640 1 -- start start 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b44a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b401008d0 0x7f3b40199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b44a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b40101270 0x7f3b40199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b44a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401068d0 0x7f3b401a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b44a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40110cd0 con 0x7f3b401068d0 2024-09-12T00:50:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b44a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40110b50 con 0x7f3b401008d0 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b44a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40110e50 con 0x7f3b40101270 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b3ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b401008d0 0x7f3b40199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b3f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401068d0 0x7f3b401a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b3ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b401008d0 0x7f3b40199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:33306/0 (socket says 172.21.15.2:33306) 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b3f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401068d0 0x7f3b401a41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38510/0 (socket says 172.21.15.2:38510) 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b3ed9d640 1 -- 172.21.15.2:0/254587200 learned_addr learned my addr 172.21.15.2:0/254587200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.618+0000 7f3b3e59c640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b40101270 0x7f3b40199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b3f59e640 1 -- 172.21.15.2:0/254587200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b40101270 msgr2=0x7f3b40199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b3f59e640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b40101270 0x7f3b40199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b3f59e640 1 -- 172.21.15.2:0/254587200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b401008d0 msgr2=0x7f3b40199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b3f59e640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b401008d0 0x7f3b40199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b3f59e640 1 -- 172.21.15.2:0/254587200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b401a4700 con 0x7f3b401068d0 2024-09-12T00:50:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b3ed9d640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b401008d0 0x7f3b40199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:50:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b3f59e640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401068d0 0x7f3b401a41c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009d10 tx=0x7f3b38007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b27fff640 1 -- 172.21.15.2:0/254587200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38009e60 con 0x7f3b401068d0 2024-09-12T00:50:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b27fff640 1 -- 172.21.15.2:0/254587200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b380100d0 con 0x7f3b401068d0 2024-09-12T00:50:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b40196f30 con 0x7f3b401068d0 2024-09-12T00:50:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b27fff640 1 -- 172.21.15.2:0/254587200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800ecd0 con 0x7f3b401068d0 2024-09-12T00:50:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.619+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b40197440 con 0x7f3b401068d0 2024-09-12T00:50:33.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.620+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b40100d30 con 0x7f3b401068d0 2024-09-12T00:50:33.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.622+0000 7f3b27fff640 1 -- 172.21.15.2:0/254587200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3b38010280 con 0x7f3b401068d0 2024-09-12T00:50:33.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.622+0000 7f3b27fff640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3b280a2b80 0x7f3b280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:33.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.622+0000 7f3b3ed9d640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3b280a2b80 0x7f3b280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:33.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.622+0000 7f3b27fff640 1 -- 172.21.15.2:0/254587200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f3b380d2320 con 0x7f3b401068d0 2024-09-12T00:50:33.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.623+0000 7f3b3ed9d640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3b280a2b80 0x7f3b280a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3b30005fd0 tx=0x7f3b3000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.626+0000 7f3b27fff640 1 -- 172.21.15.2:0/254587200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b3809f0d0 con 0x7f3b401068d0 2024-09-12T00:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.837+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b40108e60 con 0x7f3b401068d0 2024-09-12T00:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.837+0000 7f3b27fff640 1 -- 172.21.15.2:0/254587200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f3b380a33d0 con 0x7f3b401068d0 2024-09-12T00:50:33.836 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:33.836 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"btime":"2024-09-12T00:50:31:154402+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T00:50:33.837 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-09-12T00:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3b280a2b80 msgr2=0x7f3b280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3b280a2b80 0x7f3b280a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3b30005fd0 tx=0x7f3b3000b4a0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401068d0 msgr2=0x7f3b401a41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401068d0 0x7f3b401a41c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009d10 tx=0x7f3b38007590 comp rx=0 tx=0).stop 2024-09-12T00:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 shutdown_connections 2024-09-12T00:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3b280a2b80 0x7f3b280a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b401068d0 0x7f3b401a41c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b40101270 0x7f3b40199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 --2- 172.21.15.2:0/254587200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b401008d0 0x7f3b40199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 >> 172.21.15.2:0/254587200 conn(0x7f3b400fc610 msgr2=0x7f3b400fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 shutdown_connections 2024-09-12T00:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:33.839+0000 7f3b44a00640 1 -- 172.21.15.2:0/254587200 wait complete. 2024-09-12T00:50:33.941 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 podman[65033]: 2024-09-12 00:50:33.718225692 +0000 UTC m=+0.378194286 container init e1228544ad81a484b7617d90509266df41e2fa5a3e0f854b1e56f9fca551082c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T00:50:33.941 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 podman[65033]: 2024-09-12 00:50:33.721184415 +0000 UTC m=+0.381153005 container start e1228544ad81a484b7617d90509266df41e2fa5a3e0f854b1e56f9fca551082c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T00:50:33.942 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 ceph-mds[65062]: -- 172.21.15.71:0/3937356789 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccb5297860 con 0x55ccb5275000 2024-09-12T00:50:33.942 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k[65058]: starting mds.k at 2024-09-12T00:50:33.942 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 bash[65033]: e1228544ad81a484b7617d90509266df41e2fa5a3e0f854b1e56f9fca551082c 2024-09-12T00:50:33.942 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 00:50:33 smithi071 systemd[1]: Started Ceph mds.k for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:34.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:34 smithi071 ceph-mon[35276]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:34.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:34 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/254587200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:34.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:34.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:34.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:34 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:34.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:34 smithi002 ceph-mon[31210]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:34 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/254587200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:34 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:34 smithi167 ceph-mon[35234]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:34 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/254587200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:34 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:35.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:35 smithi071 ceph-mon[35276]: Deploying daemon mds.j on smithi002 2024-09-12T00:50:35.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:35 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6832/3994124611,v1:172.21.15.71:6833/3994124611] up:boot 2024-09-12T00:50:35.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:35 smithi071 ceph-mon[35276]: fsmap 2 up:standby 2024-09-12T00:50:35.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:35 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:50:35.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:35 smithi002 ceph-mon[31210]: Deploying daemon mds.j on smithi002 2024-09-12T00:50:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:35 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6832/3994124611,v1:172.21.15.71:6833/3994124611] up:boot 2024-09-12T00:50:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:35 smithi002 ceph-mon[31210]: fsmap 2 up:standby 2024-09-12T00:50:35.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:35 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:50:35.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:35 smithi167 ceph-mon[35234]: Deploying daemon mds.j on smithi002 2024-09-12T00:50:35.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:35 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6832/3994124611,v1:172.21.15.71:6833/3994124611] up:boot 2024-09-12T00:50:35.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:35 smithi167 ceph-mon[35234]: fsmap 2 up:standby 2024-09-12T00:50:35.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:35 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:50:36.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:36 smithi002 ceph-mon[31210]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:36.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:36 smithi071 ceph-mon[35276]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:36.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:36.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:36 smithi167 ceph-mon[35234]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:36.833 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:36.955 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 12 00:50:36 smithi002 systemd[1]: Started Ceph mds.j for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.294+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1681351398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 msgr2=0x7f94b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.294+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1681351398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 0x7f94b41067e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009900 tx=0x7f94a802a410 comp rx=0 tx=0).stop 2024-09-12T00:50:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.295+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1681351398 shutdown_connections 2024-09-12T00:50:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.295+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1681351398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b4106f10 0x7f94b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.295+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1681351398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 0x7f94b41067e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.295+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1681351398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4101de0 0x7f94b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.295+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1681351398 >> 172.21.15.2:0/1681351398 conn(0x7f94b40fd8c0 msgr2=0x7f94b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.295+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1681351398 shutdown_connections 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.295+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1681351398 wait complete. 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.295+0000 7f94ba5fb640 1 Processor -- start 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94ba5fb640 1 -- start start 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94ba5fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b4101de0 0x7f94b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94ba5fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 0x7f94b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94ba5fb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4106f10 0x7f94b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94ba5fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4111f90 con 0x7f94b4102790 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94ba5fb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4111e10 con 0x7f94b4106f10 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94ba5fb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4112110 con 0x7f94b4101de0 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 0x7f94b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 0x7f94b4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37712/0 (socket says 172.21.15.2:37712) 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94b37fe640 1 -- 172.21.15.2:0/1115880376 learned_addr learned my addr 172.21.15.2:0/1115880376 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94b8b98640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4106f10 0x7f94b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.296+0000 7f94b3fff640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b4101de0 0x7f94b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b37fe640 1 -- 172.21.15.2:0/1115880376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b4101de0 msgr2=0x7f94b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b37fe640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b4101de0 0x7f94b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b37fe640 1 -- 172.21.15.2:0/1115880376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4106f10 msgr2=0x7f94b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b37fe640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4106f10 0x7f94b4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b37fe640 1 -- 172.21.15.2:0/1115880376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b41a69e0 con 0x7f94b4102790 2024-09-12T00:50:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b37fe640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 0x7f94b4074a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94a8005ab0 tx=0x7f94a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b17fa640 1 -- 172.21.15.2:0/1115880376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a803f030 con 0x7f94b4102790 2024-09-12T00:50:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b41a6c70 con 0x7f94b4102790 2024-09-12T00:50:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b17fa640 1 -- 172.21.15.2:0/1115880376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94a8003ce0 con 0x7f94b4102790 2024-09-12T00:50:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94b17fa640 1 -- 172.21.15.2:0/1115880376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8035070 con 0x7f94b4102790 2024-09-12T00:50:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.297+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b41a7150 con 0x7f94b4102790 2024-09-12T00:50:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.298+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b41021c0 con 0x7f94b4102790 2024-09-12T00:50:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.300+0000 7f94b17fa640 1 -- 172.21.15.2:0/1115880376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f94a8042030 con 0x7f94b4102790 2024-09-12T00:50:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.300+0000 7f94b17fa640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f949c0a2b80 0x7f949c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.300+0000 7f94b3fff640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f949c0a2b80 0x7f949c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.301+0000 7f94b17fa640 1 -- 172.21.15.2:0/1115880376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f94a80ef070 con 0x7f94b4102790 2024-09-12T00:50:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.301+0000 7f94b3fff640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f949c0a2b80 0x7f949c0a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94a40058c0 tx=0x7f94a400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:37.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.306+0000 7f94b17fa640 1 -- 172.21.15.2:0/1115880376 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94a80bbe20 con 0x7f94b4102790 2024-09-12T00:50:37.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.523+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94b410a150 con 0x7f94b4102790 2024-09-12T00:50:37.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.523+0000 7f94b17fa640 1 -- 172.21.15.2:0/1115880376 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f94a80c0120 con 0x7f94b4102790 2024-09-12T00:50:37.522 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:37.522 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"btime":"2024-09-12T00:50:37:169386+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T00:50:37.522 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 4 2024-09-12T00:50:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f949c0a2b80 msgr2=0x7f949c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f949c0a2b80 0x7f949c0a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94a40058c0 tx=0x7f94a400a2d0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 msgr2=0x7f94b4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 0x7f94b4074a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94a8005ab0 tx=0x7f94a80042f0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 shutdown_connections 2024-09-12T00:50:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f949c0a2b80 0x7f949c0a5040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4106f10 0x7f94b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94b4102790 0x7f94b4074a30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 --2- 172.21.15.2:0/1115880376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b4101de0 0x7f94b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 >> 172.21.15.2:0/1115880376 conn(0x7f94b40fd8c0 msgr2=0x7f94b40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 shutdown_connections 2024-09-12T00:50:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:37.525+0000 7f94ba5fb640 1 -- 172.21.15.2:0/1115880376 wait complete. 2024-09-12T00:50:38.069 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: Deploying daemon mds.d on smithi002 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.2:6834/3365784178,v1:172.21.15.2:6835/3365784178] up:boot 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: fsmap 3 up:standby 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T00:50:38.070 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:37 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1115880376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:38.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: Deploying daemon mds.d on smithi002 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.2:6834/3365784178,v1:172.21.15.2:6835/3365784178] up:boot 2024-09-12T00:50:38.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: fsmap 3 up:standby 2024-09-12T00:50:38.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T00:50:38.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:37 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1115880376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:38.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:38.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:38.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:38.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:38.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: Deploying daemon mds.d on smithi002 2024-09-12T00:50:38.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:38.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.2:6834/3365784178,v1:172.21.15.2:6835/3365784178] up:boot 2024-09-12T00:50:38.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: fsmap 3 up:standby 2024-09-12T00:50:38.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T00:50:38.246 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:37 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1115880376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:39.745 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:39 smithi002 systemd[1]: Starting Ceph mds.d for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:50:40.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:39 smithi002 ceph-mon[31210]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:40.053 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:39 smithi002 podman[71271]: 2024-09-12 00:50:39.69942766 +0000 UTC m=+0.016641836 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:50:40.053 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:39 smithi002 podman[71271]: 2024-09-12 00:50:39.833275332 +0000 UTC m=+0.150489492 container create 12770a24cac8ed735509d3af3f382c8b382cf6611e41a19cb370cf91010d3166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:50:40.053 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:40 smithi002 podman[71271]: 2024-09-12 00:50:40.02737183 +0000 UTC m=+0.344585997 container init 12770a24cac8ed735509d3af3f382c8b382cf6611e41a19cb370cf91010d3166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:50:40.053 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:40 smithi002 podman[71271]: 2024-09-12 00:50:40.030329546 +0000 UTC m=+0.347543708 container start 12770a24cac8ed735509d3af3f382c8b382cf6611e41a19cb370cf91010d3166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T00:50:40.053 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:40 smithi002 ceph-mds[71290]: -- 172.21.15.2:0/1288495311 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640fb2ef860 con 0x5640fb2cc800 2024-09-12T00:50:40.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:39 smithi071 ceph-mon[35276]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:40.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:39 smithi167 ceph-mon[35234]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:40.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:40.406 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:40 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d[71286]: starting mds.d at 2024-09-12T00:50:40.406 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:40 smithi002 bash[71271]: 12770a24cac8ed735509d3af3f382c8b382cf6611e41a19cb370cf91010d3166 2024-09-12T00:50:40.406 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 00:50:40 smithi002 systemd[1]: Started Ceph mds.d for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 -- 172.21.15.2:0/1656630917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c102ef0 msgr2=0x7ff56c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 --2- 172.21.15.2:0/1656630917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c102ef0 0x7ff56c10da40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff564009ca0 tx=0x7ff56402a950 comp rx=0 tx=0).stop 2024-09-12T00:50:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 -- 172.21.15.2:0/1656630917 shutdown_connections 2024-09-12T00:50:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 --2- 172.21.15.2:0/1656630917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c102ef0 0x7ff56c10da40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 --2- 172.21.15.2:0/1656630917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c102570 0x7ff56c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 --2- 172.21.15.2:0/1656630917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c100e20 0x7ff56c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 -- 172.21.15.2:0/1656630917 >> 172.21.15.2:0/1656630917 conn(0x7ff56c0fc7d0 msgr2=0x7ff56c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 -- 172.21.15.2:0/1656630917 shutdown_connections 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.121+0000 7ff572fc7640 1 -- 172.21.15.2:0/1656630917 wait complete. 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff572fc7640 1 Processor -- start 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff572fc7640 1 -- start start 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff572fc7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c100e20 0x7ff56c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff572fc7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c102570 0x7ff56c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff572fc7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c102ef0 0x7ff56c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff572fc7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c110f80 con 0x7ff56c100e20 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff572fc7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c110e00 con 0x7ff56c102ef0 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff572fc7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c111100 con 0x7ff56c102570 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff570d63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c100e20 0x7ff56c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff570d63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c100e20 0x7ff56c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37762/0 (socket says 172.21.15.2:37762) 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff570d63640 1 -- 172.21.15.2:0/519659110 learned_addr learned my addr 172.21.15.2:0/519659110 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff571564640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c102ef0 0x7ff56c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.122+0000 7ff56bfff640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c102570 0x7ff56c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff570d63640 1 -- 172.21.15.2:0/519659110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c102570 msgr2=0x7ff56c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff570d63640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c102570 0x7ff56c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff570d63640 1 -- 172.21.15.2:0/519659110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c102ef0 msgr2=0x7ff56c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff570d63640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c102ef0 0x7ff56c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff570d63640 1 -- 172.21.15.2:0/519659110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c1a6870 con 0x7ff56c100e20 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff570d63640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c100e20 0x7ff56c0fcc80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00e9f0 tx=0x7ff55c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff569ffb640 1 -- 172.21.15.2:0/519659110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00cd80 con 0x7ff56c100e20 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff569ffb640 1 -- 172.21.15.2:0/519659110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55c010910 con 0x7ff56c100e20 2024-09-12T00:50:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56c1a6b60 con 0x7ff56c100e20 2024-09-12T00:50:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff569ffb640 1 -- 172.21.15.2:0/519659110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c018990 con 0x7ff56c100e20 2024-09-12T00:50:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.123+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56c1a70f0 con 0x7ff56c100e20 2024-09-12T00:50:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.124+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff56c101200 con 0x7ff56c100e20 2024-09-12T00:50:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.125+0000 7ff569ffb640 1 -- 172.21.15.2:0/519659110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff55c010ac0 con 0x7ff56c100e20 2024-09-12T00:50:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.126+0000 7ff569ffb640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff5540a2c00 0x7ff5540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.126+0000 7ff56bfff640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff5540a2c00 0x7ff5540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.126+0000 7ff569ffb640 1 -- 172.21.15.2:0/519659110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7ff55c0ceec0 con 0x7ff56c100e20 2024-09-12T00:50:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.127+0000 7ff56bfff640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff5540a2c00 0x7ff5540a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0fe710 tx=0x7ff56000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.130+0000 7ff569ffb640 1 -- 172.21.15.2:0/519659110 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff55c09c2c0 con 0x7ff56c100e20 2024-09-12T00:50:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.343+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff56c02d7c0 con 0x7ff56c100e20 2024-09-12T00:50:41.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:41.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:41.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:41.344 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: Deploying daemon mds.e on smithi071 2024-09-12T00:50:41.344 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.2:6836/2798785367,v1:172.21.15.2:6837/2798785367] up:boot 2024-09-12T00:50:41.344 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: fsmap 4 up:standby 2024-09-12T00:50:41.344 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:41 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T00:50:41.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.343+0000 7ff569ffb640 1 -- 172.21.15.2:0/519659110 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7ff55c09bbc0 con 0x7ff56c100e20 2024-09-12T00:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"btime":"2024-09-12T00:50:40:890145+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T00:50:41.345 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2024-09-12T00:50:41.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff5540a2c00 msgr2=0x7ff5540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:41.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff5540a2c00 0x7ff5540a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0fe710 tx=0x7ff56000c4a0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c100e20 msgr2=0x7ff56c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:41.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c100e20 0x7ff56c0fcc80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00e9f0 tx=0x7ff55c00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 shutdown_connections 2024-09-12T00:50:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff5540a2c00 0x7ff5540a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c102ef0 0x7ff56c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c102570 0x7ff56c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 --2- 172.21.15.2:0/519659110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56c100e20 0x7ff56c0fcc80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 >> 172.21.15.2:0/519659110 conn(0x7ff56c0fc7d0 msgr2=0x7ff56c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 shutdown_connections 2024-09-12T00:50:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:41.346+0000 7ff572fc7640 1 -- 172.21.15.2:0/519659110 wait complete. 2024-09-12T00:50:41.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:41.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:41.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:41.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: Deploying daemon mds.e on smithi071 2024-09-12T00:50:41.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.2:6836/2798785367,v1:172.21.15.2:6837/2798785367] up:boot 2024-09-12T00:50:41.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: fsmap 4 up:standby 2024-09-12T00:50:41.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:41 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T00:50:41.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:41.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:41.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:41.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:41.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: Deploying daemon mds.e on smithi071 2024-09-12T00:50:41.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.2:6836/2798785367,v1:172.21.15.2:6837/2798785367] up:boot 2024-09-12T00:50:41.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: fsmap 4 up:standby 2024-09-12T00:50:41.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:41 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T00:50:42.338 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:42 smithi071 ceph-mon[35276]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:42.339 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:42 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/519659110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:42.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:42 smithi002 ceph-mon[31210]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:42.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:42 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/519659110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:42.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:42 smithi167 ceph-mon[35234]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:42.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:42 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/519659110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:42.653 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 00:50:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e[65361]: starting mds.e at 2024-09-12T00:50:42.941 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 00:50:42 smithi071 bash[65346]: cebaae80313190f28687987c3e666a5504c010457a8696397dcea3935d668442 2024-09-12T00:50:42.941 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 00:50:42 smithi071 systemd[1]: Started Ceph mds.e for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: Deploying daemon mds.f on smithi167 2024-09-12T00:50:43.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6834/659790149,v1:172.21.15.71:6835/659790149] up:boot 2024-09-12T00:50:43.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: fsmap 5 up:standby 2024-09-12T00:50:43.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:43 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:50:43.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: Deploying daemon mds.f on smithi167 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6834/659790149,v1:172.21.15.71:6835/659790149] up:boot 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: fsmap 5 up:standby 2024-09-12T00:50:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:43 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:50:44.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:44.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:44.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: Deploying daemon mds.f on smithi167 2024-09-12T00:50:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6834/659790149,v1:172.21.15.71:6835/659790149] up:boot 2024-09-12T00:50:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: fsmap 5 up:standby 2024-09-12T00:50:44.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:43 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:50:44.334 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:44.719 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:44 smithi167 systemd[1]: Starting Ceph mds.f for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:50:44.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 -- 172.21.15.2:0/201444357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c101420 msgr2=0x7fad3c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:44.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 --2- 172.21.15.2:0/201444357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c101420 0x7fad3c10d950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad34009cd0 tx=0x7fad3402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 -- 172.21.15.2:0/201444357 shutdown_connections 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 --2- 172.21.15.2:0/201444357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c101420 0x7fad3c10d950 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 --2- 172.21.15.2:0/201444357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad3c100a80 0x7fad3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 --2- 172.21.15.2:0/201444357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad3c106a80 0x7fad3c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 -- 172.21.15.2:0/201444357 >> 172.21.15.2:0/201444357 conn(0x7fad3c0fc7a0 msgr2=0x7fad3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 -- 172.21.15.2:0/201444357 shutdown_connections 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 -- 172.21.15.2:0/201444357 wait complete. 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.804+0000 7fad4340a640 1 Processor -- start 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad4340a640 1 -- start start 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad4340a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad3c100a80 0x7fad3c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad4340a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad3c101420 0x7fad3c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad4340a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c106a80 0x7fad3c19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad4340a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c110e80 con 0x7fad3c106a80 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad4340a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c110d00 con 0x7fad3c101420 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad4340a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c111000 con 0x7fad3c100a80 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad3c100a80 0x7fad3c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad3c100a80 0x7fad3c19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:50912/0 (socket says 172.21.15.2:50912) 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 -- 172.21.15.2:0/3788473952 learned_addr learned my addr 172.21.15.2:0/3788473952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad419a7640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c106a80 0x7fad3c19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad409a5640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad3c101420 0x7fad3c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 -- 172.21.15.2:0/3788473952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad3c101420 msgr2=0x7fad3c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad3c101420 0x7fad3c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 -- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c106a80 msgr2=0x7fad3c19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c106a80 0x7fad3c19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 -- 172.21.15.2:0/3788473952 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c19f5a0 con 0x7fad3c100a80 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad409a5640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad3c101420 0x7fad3c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad419a7640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c106a80 0x7fad3c19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.805+0000 7fad411a6640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad3c100a80 0x7fad3c19a5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad3800d770 tx=0x7fad3800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.806+0000 7fad327fc640 1 -- 172.21.15.2:0/3788473952 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38017070 con 0x7fad3c100a80 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.806+0000 7fad327fc640 1 -- 172.21.15.2:0/3788473952 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad38005500 con 0x7fad3c100a80 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.806+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3c19f890 con 0x7fad3c100a80 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.806+0000 7fad327fc640 1 -- 172.21.15.2:0/3788473952 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38004e00 con 0x7fad3c100a80 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.806+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3c1a7170 con 0x7fad3c100a80 2024-09-12T00:50:44.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.807+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3c100ee0 con 0x7fad3c100a80 2024-09-12T00:50:44.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.808+0000 7fad327fc640 1 -- 172.21.15.2:0/3788473952 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fad38004fa0 con 0x7fad3c100a80 2024-09-12T00:50:44.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.808+0000 7fad327fc640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fad280a2b80 0x7fad280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:44.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.809+0000 7fad327fc640 1 -- 172.21.15.2:0/3788473952 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fad380ce640 con 0x7fad3c100a80 2024-09-12T00:50:44.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.809+0000 7fad409a5640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fad280a2b80 0x7fad280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:44.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.809+0000 7fad409a5640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fad280a2b80 0x7fad280a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0fecc0 tx=0x7fad2c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:44.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:44.812+0000 7fad327fc640 1 -- 172.21.15.2:0/3788473952 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad3809b9a0 con 0x7fad3c100a80 2024-09-12T00:50:44.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:44 smithi002 ceph-mon[31210]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:45.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.024+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad3c1a7340 con 0x7fad3c100a80 2024-09-12T00:50:45.024 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:44 smithi167 ceph-mon[35234]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:45.025 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:44 smithi167 podman[64978]: 2024-09-12 00:50:44.654362202 +0000 UTC m=+0.015937464 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:50:45.025 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:44 smithi167 podman[64978]: 2024-09-12 00:50:44.78239399 +0000 UTC m=+0.143969253 container create 375bd601d563c94298dc0cb43a94197edde8092588c26c523a4b50005bedc6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T00:50:45.025 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:45 smithi167 podman[64978]: 2024-09-12 00:50:45.026458475 +0000 UTC m=+0.388033735 container init 375bd601d563c94298dc0cb43a94197edde8092588c26c523a4b50005bedc6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T00:50:45.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.025+0000 7fad327fc640 1 -- 172.21.15.2:0/3788473952 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4729 (secure 0 0 0) 0x7fad3809b2a0 con 0x7fad3c100a80 2024-09-12T00:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"btime":"2024-09-12T00:50:43:184400+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T00:50:45.028 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fad280a2b80 msgr2=0x7fad280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fad280a2b80 0x7fad280a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0fecc0 tx=0x7fad2c00a5c0 comp rx=0 tx=0).stop 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad3c100a80 msgr2=0x7fad3c19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad3c100a80 0x7fad3c19a5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad3800d770 tx=0x7fad3800dc30 comp rx=0 tx=0).stop 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 shutdown_connections 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fad280a2b80 0x7fad280a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c106a80 0x7fad3c19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad3c101420 0x7fad3c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 --2- 172.21.15.2:0/3788473952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad3c100a80 0x7fad3c19a5f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 >> 172.21.15.2:0/3788473952 conn(0x7fad3c0fc7a0 msgr2=0x7fad3c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 shutdown_connections 2024-09-12T00:50:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:45.027+0000 7fad4340a640 1 -- 172.21.15.2:0/3788473952 wait complete. 2024-09-12T00:50:45.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:44 smithi071 ceph-mon[35276]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:45.287 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:45 smithi167 podman[64978]: 2024-09-12 00:50:45.029556434 +0000 UTC m=+0.391131695 container start 375bd601d563c94298dc0cb43a94197edde8092588c26c523a4b50005bedc6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-12T00:50:45.287 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-mds[64997]: -- 172.21.15.167:0/774703805 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562f339ed860 con 0x562f339ca800 2024-09-12T00:50:45.287 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f[64993]: starting mds.f at 2024-09-12T00:50:45.287 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:45 smithi167 bash[64978]: 375bd601d563c94298dc0cb43a94197edde8092588c26c523a4b50005bedc6d8 2024-09-12T00:50:45.287 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 00:50:45 smithi167 systemd[1]: Started Ceph mds.f for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:45.937 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3788473952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:45.937 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:45.937 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:45.937 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:45.937 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:45.937 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:45.937 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:45 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:45 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3788473952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:45.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:45 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:46.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:45 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3788473952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:46.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:46.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:46.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:46.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:46.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:46.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:45 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:46.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:46 smithi167 ceph-mon[35234]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:46.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:46 smithi167 ceph-mon[35234]: Deploying daemon mds.c on smithi167 2024-09-12T00:50:46.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:46 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.167:6834/3315294973,v1:172.21.15.167:6835/3315294973] up:boot 2024-09-12T00:50:46.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:46 smithi167 ceph-mon[35234]: fsmap 6 up:standby 2024-09-12T00:50:46.886 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:46 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:50:46.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:46 smithi002 ceph-mon[31210]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:46.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:46 smithi002 ceph-mon[31210]: Deploying daemon mds.c on smithi167 2024-09-12T00:50:46.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:46 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.167:6834/3315294973,v1:172.21.15.167:6835/3315294973] up:boot 2024-09-12T00:50:46.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:46 smithi002 ceph-mon[31210]: fsmap 6 up:standby 2024-09-12T00:50:46.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:46 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:50:47.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:46 smithi071 ceph-mon[35276]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:47.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:46 smithi071 ceph-mon[35276]: Deploying daemon mds.c on smithi167 2024-09-12T00:50:47.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:46 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.167:6834/3315294973,v1:172.21.15.167:6835/3315294973] up:boot 2024-09-12T00:50:47.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:46 smithi071 ceph-mon[35276]: fsmap 6 up:standby 2024-09-12T00:50:47.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:46 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:50:47.282 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 systemd[1]: Starting Ceph mds.c for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:50:47.537 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 podman[65280]: 2024-09-12 00:50:47.186866748 +0000 UTC m=+0.016042539 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:50:47.537 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 podman[65280]: 2024-09-12 00:50:47.32762635 +0000 UTC m=+0.156802122 container create 88ed62cf89f6159203a3dd8d5964e182e7fee4066aa43e995e98c3b50d2543d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T00:50:47.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:48.037 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 podman[65280]: 2024-09-12 00:50:47.588787421 +0000 UTC m=+0.417963194 container init 88ed62cf89f6159203a3dd8d5964e182e7fee4066aa43e995e98c3b50d2543d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T00:50:48.037 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 podman[65280]: 2024-09-12 00:50:47.591708085 +0000 UTC m=+0.420883865 container start 88ed62cf89f6159203a3dd8d5964e182e7fee4066aa43e995e98c3b50d2543d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T00:50:48.037 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 ceph-mds[65299]: -- 172.21.15.167:0/3151377759 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56538d039860 con 0x56538d017400 2024-09-12T00:50:48.037 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c[65295]: starting mds.c at 2024-09-12T00:50:48.037 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 bash[65280]: 88ed62cf89f6159203a3dd8d5964e182e7fee4066aa43e995e98c3b50d2543d7 2024-09-12T00:50:48.037 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 00:50:47 smithi167 systemd[1]: Started Ceph mds.c for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 -- 172.21.15.2:0/671976891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c101400 msgr2=0x7f8d8c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 --2- 172.21.15.2:0/671976891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c101400 0x7f8d8c10d930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009cd0 tx=0x7f8d8402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 -- 172.21.15.2:0/671976891 shutdown_connections 2024-09-12T00:50:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 --2- 172.21.15.2:0/671976891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c101400 0x7f8d8c10d930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 --2- 172.21.15.2:0/671976891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8c100a60 0x7f8d8c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 --2- 172.21.15.2:0/671976891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d8c106a60 0x7f8d8c106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 -- 172.21.15.2:0/671976891 >> 172.21.15.2:0/671976891 conn(0x7f8d8c0fc780 msgr2=0x7f8d8c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 -- 172.21.15.2:0/671976891 shutdown_connections 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.485+0000 7f8d934ab640 1 -- 172.21.15.2:0/671976891 wait complete. 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d934ab640 1 Processor -- start 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d934ab640 1 -- start start 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d934ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c100a60 0x7f8d8c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d934ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8c101400 0x7f8d8c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d934ab640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d8c106a60 0x7f8d8c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d934ab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c110e60 con 0x7f8d8c100a60 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d934ab640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c110ce0 con 0x7f8d8c106a60 2024-09-12T00:50:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d934ab640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c110fe0 con 0x7f8d8c101400 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d91247640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c100a60 0x7f8d8c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d91247640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c100a60 0x7f8d8c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36534/0 (socket says 172.21.15.2:36534) 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d91247640 1 -- 172.21.15.2:0/3121679111 learned_addr learned my addr 172.21.15.2:0/3121679111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d91a48640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d8c106a60 0x7f8d8c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.486+0000 7f8d90a46640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8c101400 0x7f8d8c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d91247640 1 -- 172.21.15.2:0/3121679111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8c101400 msgr2=0x7f8d8c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d91247640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8c101400 0x7f8d8c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d91247640 1 -- 172.21.15.2:0/3121679111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d8c106a60 msgr2=0x7f8d8c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d91247640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d8c106a60 0x7f8d8c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d91247640 1 -- 172.21.15.2:0/3121679111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c19d3a0 con 0x7f8d8c100a60 2024-09-12T00:50:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d91247640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c100a60 0x7f8d8c1983f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800e9f0 tx=0x7f8d8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:48.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d827fc640 1 -- 172.21.15.2:0/3121679111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800cd80 con 0x7f8d8c100a60 2024-09-12T00:50:48.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8c19d690 con 0x7f8d8c100a60 2024-09-12T00:50:48.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d827fc640 1 -- 172.21.15.2:0/3121679111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d88010910 con 0x7f8d8c100a60 2024-09-12T00:50:48.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d827fc640 1 -- 172.21.15.2:0/3121679111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d880188f0 con 0x7f8d8c100a60 2024-09-12T00:50:48.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.487+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8c1a4f70 con 0x7f8d8c100a60 2024-09-12T00:50:48.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.488+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8c100ec0 con 0x7f8d8c100a60 2024-09-12T00:50:48.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.489+0000 7f8d827fc640 1 -- 172.21.15.2:0/3121679111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8d88010ac0 con 0x7f8d8c100a60 2024-09-12T00:50:48.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.490+0000 7f8d827fc640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d780a2b80 0x7f8d780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:48.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.490+0000 7f8d90a46640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d780a2b80 0x7f8d780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:48.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.490+0000 7f8d827fc640 1 -- 172.21.15.2:0/3121679111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f8d880cf2e0 con 0x7f8d8c100a60 2024-09-12T00:50:48.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.491+0000 7f8d90a46640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d780a2b80 0x7f8d780a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0fece0 tx=0x7f8d7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:48.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.493+0000 7f8d827fc640 1 -- 172.21.15.2:0/3121679111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d8809bff0 con 0x7f8d8c100a60 2024-09-12T00:50:48.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.705+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d8c1a5200 con 0x7f8d8c100a60 2024-09-12T00:50:48.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.705+0000 7f8d827fc640 1 -- 172.21.15.2:0/3121679111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7f8d880a02f0 con 0x7f8d8c100a60 2024-09-12T00:50:48.706 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-09-12T00:50:48.706 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:48.706 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"btime":"2024-09-12T00:50:47:729486+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T00:50:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d780a2b80 msgr2=0x7f8d780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d780a2b80 0x7f8d780a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0fece0 tx=0x7f8d7c00a2d0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c100a60 msgr2=0x7f8d8c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c100a60 0x7f8d8c1983f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800e9f0 tx=0x7f8d8800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 shutdown_connections 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d780a2b80 0x7f8d780a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d8c106a60 0x7f8d8c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8c101400 0x7f8d8c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 --2- 172.21.15.2:0/3121679111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8c100a60 0x7f8d8c1983f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 >> 172.21.15.2:0/3121679111 conn(0x7f8d8c0fc780 msgr2=0x7f8d8c06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 shutdown_connections 2024-09-12T00:50:48.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:48.708+0000 7f8d934ab640 1 -- 172.21.15.2:0/3121679111 wait complete. 2024-09-12T00:50:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.167:6836/2094252120,v1:172.21.15.167:6837/2094252120] up:boot 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: fsmap 7 up:standby 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: Deploying daemon mds.h on smithi071 2024-09-12T00:50:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:48 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3121679111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:48.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.167:6836/2094252120,v1:172.21.15.167:6837/2094252120] up:boot 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: fsmap 7 up:standby 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: Deploying daemon mds.h on smithi071 2024-09-12T00:50:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:48 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3121679111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.167:6836/2094252120,v1:172.21.15.167:6837/2094252120] up:boot 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: fsmap 7 up:standby 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:49.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: Deploying daemon mds.h on smithi071 2024-09-12T00:50:49.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:48 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3121679111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:49.941 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:49 smithi071 systemd[1]: Starting Ceph mds.h for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:50:50.274 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:49 smithi071 podman[65647]: 2024-09-12 00:50:49.867186945 +0000 UTC m=+0.016099451 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:50:50.274 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:49 smithi071 podman[65647]: 2024-09-12 00:50:49.964957283 +0000 UTC m=+0.113869789 container create e482ee7a27a0191bb4ae7ff85bdd9ea481ba965f4580363e2614a96c4c3216d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T00:50:50.274 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:50 smithi071 podman[65647]: 2024-09-12 00:50:50.17596513 +0000 UTC m=+0.324877650 container init e482ee7a27a0191bb4ae7ff85bdd9ea481ba965f4580363e2614a96c4c3216d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T00:50:50.274 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:50 smithi071 podman[65647]: 2024-09-12 00:50:50.178619478 +0000 UTC m=+0.327531997 container start e482ee7a27a0191bb4ae7ff85bdd9ea481ba965f4580363e2614a96c4c3216d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T00:50:50.275 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-mds[65666]: -- 172.21.15.71:0/3586896755 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fffa86f860 con 0x55fffa84d400 2024-09-12T00:50:50.275 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h[65662]: starting mds.h at 2024-09-12T00:50:50.275 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:50 smithi071 bash[65647]: e482ee7a27a0191bb4ae7ff85bdd9ea481ba965f4580363e2614a96c4c3216d7 2024-09-12T00:50:50.691 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 00:50:50 smithi071 systemd[1]: Started Ceph mds.h for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:50 smithi002 ceph-mon[31210]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:50 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:50.998 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:50 smithi167 ceph-mon[35234]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:50.998 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:50.998 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:50.998 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:50.998 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:50.998 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:50.999 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:50 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:51.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-mon[35276]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:51.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:51.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:51.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:51.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:51.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:51.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:50 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:51.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:51.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:51 smithi002 ceph-mon[31210]: Deploying daemon mds.i on smithi167 2024-09-12T00:50:51.951 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:51 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] up:boot 2024-09-12T00:50:51.951 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:51 smithi002 ceph-mon[31210]: fsmap 8 up:standby 2024-09-12T00:50:51.951 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:51 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:50:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:51 smithi167 ceph-mon[35234]: Deploying daemon mds.i on smithi167 2024-09-12T00:50:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:51 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] up:boot 2024-09-12T00:50:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:51 smithi167 ceph-mon[35234]: fsmap 8 up:standby 2024-09-12T00:50:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:51 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:50:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 -- 172.21.15.2:0/3143412956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 msgr2=0x7f010410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 --2- 172.21.15.2:0/3143412956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 0x7f010410df40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009900 tx=0x7f00f402a410 comp rx=0 tx=0).stop 2024-09-12T00:50:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 -- 172.21.15.2:0/3143412956 shutdown_connections 2024-09-12T00:50:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 --2- 172.21.15.2:0/3143412956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f010410e480 0x7f0104110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 --2- 172.21.15.2:0/3143412956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 0x7f010410df40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 --2- 172.21.15.2:0/3143412956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01041008d0 0x7f0104100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 -- 172.21.15.2:0/3143412956 >> 172.21.15.2:0/3143412956 conn(0x7f01040fc7a0 msgr2=0x7f01040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 -- 172.21.15.2:0/3143412956 shutdown_connections 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 -- 172.21.15.2:0/3143412956 wait complete. 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.034+0000 7f010bd8e640 1 Processor -- start 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f010bd8e640 1 -- start start 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f010bd8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01041008d0 0x7f010419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f010bd8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 0x7f010419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f010bd8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f010410e480 0x7f010419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f010bd8e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0104114190 con 0x7f0104101280 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f010bd8e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0104114010 con 0x7f01041008d0 2024-09-12T00:50:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f010bd8e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0104114310 con 0x7f010410e480 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 0x7f010419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 0x7f010419ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36554/0 (socket says 172.21.15.2:36554) 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 -- 172.21.15.2:0/614326932 learned_addr learned my addr 172.21.15.2:0/614326932 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f010a32b640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f010410e480 0x7f010419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109b2a640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01041008d0 0x7f010419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 -- 172.21.15.2:0/614326932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f010410e480 msgr2=0x7f010419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f010410e480 0x7f010419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 -- 172.21.15.2:0/614326932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01041008d0 msgr2=0x7f010419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01041008d0 0x7f010419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 -- 172.21.15.2:0/614326932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010419f680 con 0x7f0104101280 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.035+0000 7f0109329640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 0x7f010419ac10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00f4006010 tx=0x7f00f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.036+0000 7f00faffd640 1 -- 172.21.15.2:0/614326932 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f403f030 con 0x7f0104101280 2024-09-12T00:50:52.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.036+0000 7f00faffd640 1 -- 172.21.15.2:0/614326932 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00f4003ce0 con 0x7f0104101280 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.036+0000 7f00faffd640 1 -- 172.21.15.2:0/614326932 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4035070 con 0x7f0104101280 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.036+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010419f910 con 0x7f0104101280 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.036+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010419fda0 con 0x7f0104101280 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.037+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0104100cb0 con 0x7f0104101280 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.038+0000 7f00faffd640 1 -- 172.21.15.2:0/614326932 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f00f4042030 con 0x7f0104101280 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.038+0000 7f00faffd640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00f00a2c00 0x7f00f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.039+0000 7f0109b2a640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00f00a2c00 0x7f00f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.039+0000 7f00faffd640 1 -- 172.21.15.2:0/614326932 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f00f40ef060 con 0x7f0104101280 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.039+0000 7f0109b2a640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00f00a2c00 0x7f00f00a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0100005fd0 tx=0x7f0100005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.043+0000 7f00faffd640 1 -- 172.21.15.2:0/614326932 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00f40bc520 con 0x7f0104101280 2024-09-12T00:50:52.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:51 smithi071 ceph-mon[35276]: Deploying daemon mds.i on smithi167 2024-09-12T00:50:52.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:51 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] up:boot 2024-09-12T00:50:52.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:51 smithi071 ceph-mon[35276]: fsmap 8 up:standby 2024-09-12T00:50:52.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:51 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:50:52.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.255+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f010402d7c0 con 0x7f0104101280 2024-09-12T00:50:52.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.255+0000 7f00faffd640 1 -- 172.21.15.2:0/614326932 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f00f40bbe20 con 0x7f0104101280 2024-09-12T00:50:52.255 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:52.255 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-12T00:50:50:736821+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T00:50:52.255 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-12T00:50:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00f00a2c00 msgr2=0x7f00f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00f00a2c00 0x7f00f00a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0100005fd0 tx=0x7f0100005850 comp rx=0 tx=0).stop 2024-09-12T00:50:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 msgr2=0x7f010419ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 0x7f010419ac10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00f4006010 tx=0x7f00f40042f0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 shutdown_connections 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00f00a2c00 0x7f00f00a50c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f010410e480 0x7f010419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0104101280 0x7f010419ac10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 --2- 172.21.15.2:0/614326932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01041008d0 0x7f010419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.257+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 >> 172.21.15.2:0/614326932 conn(0x7f01040fc7a0 msgr2=0x7f01040feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.258+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 shutdown_connections 2024-09-12T00:50:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:52.258+0000 7f010bd8e640 1 -- 172.21.15.2:0/614326932 wait complete. 2024-09-12T00:50:52.500 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 systemd[1]: Starting Ceph mds.i for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:50:52.751 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:52 smithi167 ceph-mon[35234]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:52.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:52 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/614326932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:52.752 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 podman[65590]: 2024-09-12 00:50:52.403949489 +0000 UTC m=+0.016679288 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:50:52.752 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 podman[65590]: 2024-09-12 00:50:52.523486882 +0000 UTC m=+0.136216705 container create 25c0a1a4d5ac73a003675b95632405d6cafcf5ffa16eccdcf40dfe5a5d6798e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T00:50:52.752 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 podman[65590]: 2024-09-12 00:50:52.750806376 +0000 UTC m=+0.363536157 container init 25c0a1a4d5ac73a003675b95632405d6cafcf5ffa16eccdcf40dfe5a5d6798e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:50:52.752 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 podman[65590]: 2024-09-12 00:50:52.753788455 +0000 UTC m=+0.366518245 container start 25c0a1a4d5ac73a003675b95632405d6cafcf5ffa16eccdcf40dfe5a5d6798e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T00:50:52.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:52 smithi002 ceph-mon[31210]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:52.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:52 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/614326932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:53.037 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 ceph-mds[65609]: -- 172.21.15.167:0/811899421 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562417ccf860 con 0x562417cac800 2024-09-12T00:50:53.037 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i[65605]: starting mds.i at 2024-09-12T00:50:53.037 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 bash[65590]: 25c0a1a4d5ac73a003675b95632405d6cafcf5ffa16eccdcf40dfe5a5d6798e3 2024-09-12T00:50:53.037 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 00:50:52 smithi167 systemd[1]: Started Ceph mds.i for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:53.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:52 smithi071 ceph-mon[35276]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:53.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:52 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/614326932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:53.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:53.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: Deploying daemon mds.g on smithi002 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] up:boot 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: fsmap 9 up:standby 2024-09-12T00:50:53.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:53 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:50:54.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: Deploying daemon mds.g on smithi002 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] up:boot 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: fsmap 9 up:standby 2024-09-12T00:50:54.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:53 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: Deploying daemon mds.g on smithi002 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] up:boot 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: fsmap 9 up:standby 2024-09-12T00:50:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:53 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:50:54.923 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:54.948 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:54 smithi002 systemd[1]: Starting Ceph mds.g for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T00:50:55.245 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:54 smithi002 podman[72043]: 2024-09-12 00:50:54.896675479 +0000 UTC m=+0.017010974 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:50:55.245 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:55 smithi002 podman[72043]: 2024-09-12 00:50:55.006953647 +0000 UTC m=+0.127289128 container create 391f4f72709ec860332d2e426d6a2d211d1f2f7427c31ee78e222cb01f737c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:50:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:55.517 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:55 smithi002 podman[72043]: 2024-09-12 00:50:55.251226637 +0000 UTC m=+0.371562122 container init 391f4f72709ec860332d2e426d6a2d211d1f2f7427c31ee78e222cb01f737c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:50:55.518 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:55 smithi002 podman[72043]: 2024-09-12 00:50:55.254473499 +0000 UTC m=+0.374808984 container start 391f4f72709ec860332d2e426d6a2d211d1f2f7427c31ee78e222cb01f737c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T00:50:55.518 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:55 smithi002 ceph-mds[72108]: -- 172.21.15.2:0/1770318169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e68e051860 con 0x55e68e02e800 2024-09-12T00:50:55.518 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g[72102]: starting mds.g at 2024-09-12T00:50:55.518 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:55 smithi002 bash[72043]: 391f4f72709ec860332d2e426d6a2d211d1f2f7427c31ee78e222cb01f737c60 2024-09-12T00:50:55.518 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 00:50:55 smithi002 systemd[1]: Started Ceph mds.g for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:55.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 -- 172.21.15.2:0/4110522220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac10c170 msgr2=0x7f6dac10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:55.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 --2- 172.21.15.2:0/4110522220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac10c170 0x7f6dac10e610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009ca0 tx=0x7f6da402a950 comp rx=0 tx=0).stop 2024-09-12T00:50:55.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 -- 172.21.15.2:0/4110522220 shutdown_connections 2024-09-12T00:50:55.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 --2- 172.21.15.2:0/4110522220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac10c170 0x7f6dac10e610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:55.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 --2- 172.21.15.2:0/4110522220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac103660 0x7f6dac10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:55.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 --2- 172.21.15.2:0/4110522220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6dac102d40 0x7f6dac103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:55.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 -- 172.21.15.2:0/4110522220 >> 172.21.15.2:0/4110522220 conn(0x7f6dac0fc7a0 msgr2=0x7f6dac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 -- 172.21.15.2:0/4110522220 shutdown_connections 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 -- 172.21.15.2:0/4110522220 wait complete. 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 Processor -- start 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.862+0000 7f6db3e76640 1 -- start start 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db3e76640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6dac102d40 0x7f6dac198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db3e76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac103660 0x7f6dac1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db3e76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac10c170 0x7f6dac19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db3e76640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac111fd0 con 0x7f6dac103660 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db3e76640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac111e50 con 0x7f6dac102d40 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db3e76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac112150 con 0x7f6dac10c170 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac103660 0x7f6dac1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac103660 0x7f6dac1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36580/0 (socket says 172.21.15.2:36580) 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 -- 172.21.15.2:0/212307589 learned_addr learned my addr 172.21.15.2:0/212307589 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1c12640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6dac102d40 0x7f6dac198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db2413640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac10c170 0x7f6dac19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 -- 172.21.15.2:0/212307589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac10c170 msgr2=0x7f6dac19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac10c170 0x7f6dac19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 -- 172.21.15.2:0/212307589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6dac102d40 msgr2=0x7f6dac198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6dac102d40 0x7f6dac198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 -- 172.21.15.2:0/212307589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac19d420 con 0x7f6dac103660 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db2413640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac10c170 0x7f6dac19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1c12640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6dac102d40 0x7f6dac198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db1411640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac103660 0x7f6dac1989b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00c970 tx=0x7f6d9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6da2ffd640 1 -- 172.21.15.2:0/212307589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c007bb0 con 0x7f6dac103660 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6da2ffd640 1 -- 172.21.15.2:0/212307589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d9c007d50 con 0x7f6dac103660 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac19d710 con 0x7f6dac103660 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.863+0000 7f6da2ffd640 1 -- 172.21.15.2:0/212307589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00f450 con 0x7f6dac103660 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.864+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac1a4ff0 con 0x7f6dac103660 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.864+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac103120 con 0x7f6dac103660 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.866+0000 7f6da2ffd640 1 -- 172.21.15.2:0/212307589 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f6d9c004f60 con 0x7f6dac103660 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.866+0000 7f6da2ffd640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d980a2c00 0x7f6d980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.866+0000 7f6db1c12640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d980a2c00 0x7f6d980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.866+0000 7f6da2ffd640 1 -- 172.21.15.2:0/212307589 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f6d9c0ce8e0 con 0x7f6dac103660 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.867+0000 7f6db1c12640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d980a2c00 0x7f6d980a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009930 tx=0x7f6da8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:55.870+0000 7f6da2ffd640 1 -- 172.21.15.2:0/212307589 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d9c014030 con 0x7f6dac103660 2024-09-12T00:50:56.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.088+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dac02d7c0 con 0x7f6dac103660 2024-09-12T00:50:56.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.089+0000 7f6da2ffd640 1 -- 172.21.15.2:0/212307589 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8863 (secure 0 0 0) 0x7f6d9c09bce0 con 0x7f6dac103660 2024-09-12T00:50:56.089 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:56.089 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":11,"btime":"2024-09-12T00:50:55:905394+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T00:50:56.090 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 11 2024-09-12T00:50:56.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d980a2c00 msgr2=0x7f6d980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:56.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d980a2c00 0x7f6d980a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009930 tx=0x7f6da8008040 comp rx=0 tx=0).stop 2024-09-12T00:50:56.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac103660 msgr2=0x7f6dac1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:56.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac103660 0x7f6dac1989b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00c970 tx=0x7f6d9c00ce30 comp rx=0 tx=0).stop 2024-09-12T00:50:56.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 shutdown_connections 2024-09-12T00:50:56.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d980a2c00 0x7f6d980a50c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:56.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac10c170 0x7f6dac19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:56.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dac103660 0x7f6dac1989b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:56.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 --2- 172.21.15.2:0/212307589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6dac102d40 0x7f6dac198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:56.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 >> 172.21.15.2:0/212307589 conn(0x7f6dac0fc7a0 msgr2=0x7f6dac0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:56.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 shutdown_connections 2024-09-12T00:50:56.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:56.091+0000 7f6db3e76640 1 -- 172.21.15.2:0/212307589 wait complete. 2024-09-12T00:50:56.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: Deploying daemon mds.a on smithi002 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.2:6838/2069649482,v1:172.21.15.2:6839/2069649482] up:boot 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: fsmap 10 up:standby 2024-09-12T00:50:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:50:56.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:56 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/212307589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:56.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: Deploying daemon mds.a on smithi002 2024-09-12T00:50:56.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.2:6838/2069649482,v1:172.21.15.2:6839/2069649482] up:boot 2024-09-12T00:50:56.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: fsmap 10 up:standby 2024-09-12T00:50:56.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:50:56.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:56 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/212307589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: Deploying daemon mds.a on smithi002 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.2:6838/2069649482,v1:172.21.15.2:6839/2069649482] up:boot 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: fsmap 10 up:standby 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:50:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:56 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/212307589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:50:58.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:58 smithi071 ceph-mon[35276]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:58.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:58 smithi002 ceph-mon[31210]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:58.745 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 12 00:50:58 smithi002 systemd[1]: Started Ceph mds.a for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:50:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:58 smithi167 ceph-mon[35234]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:50:58.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:50:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:50:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 -- 172.21.15.2:0/2761325901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff15810e480 msgr2=0x7ff158110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2761325901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff15810e480 0x7ff158110870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ca0 tx=0x7ff15002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 -- 172.21.15.2:0/2761325901 shutdown_connections 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2761325901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff15810e480 0x7ff158110870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2761325901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff158101280 0x7ff15810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2761325901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1581008d0 0x7ff158100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 -- 172.21.15.2:0/2761325901 >> 172.21.15.2:0/2761325901 conn(0x7ff1580fc7a0 msgr2=0x7ff1580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 -- 172.21.15.2:0/2761325901 shutdown_connections 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.543+0000 7ff15f79a640 1 -- 172.21.15.2:0/2761325901 wait complete. 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15f79a640 1 Processor -- start 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15f79a640 1 -- start start 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15f79a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1581008d0 0x7ff15819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15f79a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff158101280 0x7ff15819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15f79a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15810e480 0x7ff15819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15f79a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff158114170 con 0x7ff1581008d0 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15f79a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff158113ff0 con 0x7ff15810e480 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15f79a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581142f0 con 0x7ff158101280 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.544+0000 7ff15d536640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1581008d0 0x7ff15819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15d536640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1581008d0 0x7ff15819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45428/0 (socket says 172.21.15.2:45428) 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15d536640 1 -- 172.21.15.2:0/2288686819 learned_addr learned my addr 172.21.15.2:0/2288686819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15cd35640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff158101280 0x7ff15819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15d536640 1 -- 172.21.15.2:0/2288686819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff158101280 msgr2=0x7ff15819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15d536640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff158101280 0x7ff15819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15d536640 1 -- 172.21.15.2:0/2288686819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15810e480 msgr2=0x7ff15819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15d536640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15810e480 0x7ff15819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15d536640 1 -- 172.21.15.2:0/2288686819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15819f600 con 0x7ff1581008d0 2024-09-12T00:50:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15d536640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1581008d0 0x7ff15819a650 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff15400d770 tx=0x7ff15400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff14e7fc640 1 -- 172.21.15.2:0/2288686819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154017070 con 0x7ff1581008d0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff14e7fc640 1 -- 172.21.15.2:0/2288686819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff154005500 con 0x7ff1581008d0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15819f8f0 con 0x7ff1581008d0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff14e7fc640 1 -- 172.21.15.2:0/2288686819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154004e00 con 0x7ff1581008d0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.545+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1581a71d0 con 0x7ff1581008d0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.546+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff158100cb0 con 0x7ff1581008d0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.547+0000 7ff14e7fc640 1 -- 172.21.15.2:0/2288686819 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff154004fa0 con 0x7ff1581008d0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.548+0000 7ff14e7fc640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff1440a2b80 0x7ff1440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.548+0000 7ff14e7fc640 1 -- 172.21.15.2:0/2288686819 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7ff1540ceb00 con 0x7ff1581008d0 2024-09-12T00:50:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.548+0000 7ff15cd35640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff1440a2b80 0x7ff1440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:50:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.549+0000 7ff15cd35640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff1440a2b80 0x7ff1440a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff15810ed80 tx=0x7ff148005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:50:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.551+0000 7ff14e7fc640 1 -- 172.21.15.2:0/2288686819 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff15409bf00 con 0x7ff1581008d0 2024-09-12T00:50:59.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: Deploying daemon mds.b on smithi071 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.2:6840/3604590372,v1:172.21.15.2:6841/3604590372] up:boot 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: fsmap 11 up:standby 2024-09-12T00:50:59.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:50:59 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: Deploying daemon mds.b on smithi071 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.2:6840/3604590372,v1:172.21.15.2:6841/3604590372] up:boot 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: fsmap 11 up:standby 2024-09-12T00:50:59.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:50:59 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:50:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.764+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff15819b9b0 con 0x7ff1581008d0 2024-09-12T00:50:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.765+0000 7ff14e7fc640 1 -- 172.21.15.2:0/2288686819 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7ff15409b800 con 0x7ff1581008d0 2024-09-12T00:50:59.765 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:50:59.765 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":12,"btime":"2024-09-12T00:50:59:432032+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T00:50:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 12 2024-09-12T00:50:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff1440a2b80 msgr2=0x7ff1440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff1440a2b80 0x7ff1440a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff15810ed80 tx=0x7ff148005be0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1581008d0 msgr2=0x7ff15819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:50:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1581008d0 0x7ff15819a650 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff15400d770 tx=0x7ff15400dc30 comp rx=0 tx=0).stop 2024-09-12T00:50:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 shutdown_connections 2024-09-12T00:50:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ff1440a2b80 0x7ff1440a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15810e480 0x7ff15819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff158101280 0x7ff15819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 --2- 172.21.15.2:0/2288686819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1581008d0 0x7ff15819a650 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:50:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.767+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 >> 172.21.15.2:0/2288686819 conn(0x7ff1580fc7a0 msgr2=0x7ff1580feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:50:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.768+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 shutdown_connections 2024-09-12T00:50:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:50:59.768+0000 7ff15f79a640 1 -- 172.21.15.2:0/2288686819 wait complete. 2024-09-12T00:51:00.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:00.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:00.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:00.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T00:51:00.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T00:51:00.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:51:00.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: Deploying daemon mds.b on smithi071 2024-09-12T00:51:00.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.2:6840/3604590372,v1:172.21.15.2:6841/3604590372] up:boot 2024-09-12T00:51:00.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: fsmap 11 up:standby 2024-09-12T00:51:00.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:50:59 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:51:00.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:00 smithi002 ceph-mon[31210]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:00 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2288686819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:00.842 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:00 smithi071 ceph-mon[35276]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:00.842 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:00 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2288686819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:01.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:00 smithi167 ceph-mon[35234]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:01.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:00 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2288686819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:01.113 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 00:51:01 smithi071 podman[65949]: 2024-09-12 00:51:01.091914373 +0000 UTC m=+0.356565516 container start d739c7e0398b056a52d2d4c22e48893c5eb90a6eea9ed4dafba6a407be0c46b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-12T00:51:01.113 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 00:51:01 smithi071 ceph-mds[65969]: -- 172.21.15.71:0/2938940736 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da82c73860 con 0x55da82c51000 2024-09-12T00:51:01.441 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 00:51:01 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: starting mds.b at 2024-09-12T00:51:01.441 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 00:51:01 smithi071 bash[65949]: d739c7e0398b056a52d2d4c22e48893c5eb90a6eea9ed4dafba6a407be0c46b7 2024-09-12T00:51:01.441 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 00:51:01 smithi071 systemd[1]: Started Ceph mds.b for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T00:51:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:51:02.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] up:boot 2024-09-12T00:51:02.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: fsmap 12 up:standby 2024-09-12T00:51:02.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:02 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:51:02.306 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:02.306 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.306 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:51:02.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] up:boot 2024-09-12T00:51:02.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: fsmap 12 up:standby 2024-09-12T00:51:02.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:02 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:51:02.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:51:02.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] up:boot 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: fsmap 12 up:standby 2024-09-12T00:51:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:02 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:51:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:03.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.228+0000 7fd74d4fa640 1 -- 172.21.15.2:0/2060435957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748101de0 msgr2=0x7fd7481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:03.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.228+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/2060435957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748101de0 0x7fd7481021c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd738009900 tx=0x7fd73802a410 comp rx=0 tx=0).stop 2024-09-12T00:51:03.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.228+0000 7fd74d4fa640 1 -- 172.21.15.2:0/2060435957 shutdown_connections 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.228+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/2060435957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748106f10 0x7fd74810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.228+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/2060435957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd748102790 0x7fd7481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.228+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/2060435957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748101de0 0x7fd7481021c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.228+0000 7fd74d4fa640 1 -- 172.21.15.2:0/2060435957 >> 172.21.15.2:0/2060435957 conn(0x7fd7480fd8c0 msgr2=0x7fd7480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.229+0000 7fd74d4fa640 1 -- 172.21.15.2:0/2060435957 shutdown_connections 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.229+0000 7fd74d4fa640 1 -- 172.21.15.2:0/2060435957 wait complete. 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.229+0000 7fd74d4fa640 1 Processor -- start 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.229+0000 7fd74d4fa640 1 -- start start 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.229+0000 7fd74d4fa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748101de0 0x7fd7481984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd74d4fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748102790 0x7fd7481989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd74d4fa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd748106f10 0x7fd74819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd74d4fa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd748111f70 con 0x7fd748102790 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd74d4fa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd748111df0 con 0x7fd748101de0 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd74d4fa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd7481120f0 con 0x7fd748106f10 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748102790 0x7fd7481989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748102790 0x7fd7481989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45440/0 (socket says 172.21.15.2:45440) 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd746ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748101de0 0x7fd7481984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 -- 172.21.15.2:0/1750520183 learned_addr learned my addr 172.21.15.2:0/1750520183 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd7477fe640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd748106f10 0x7fd74819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 -- 172.21.15.2:0/1750520183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd748106f10 msgr2=0x7fd74819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd748106f10 0x7fd74819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 -- 172.21.15.2:0/1750520183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748101de0 msgr2=0x7fd7481984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748101de0 0x7fd7481984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 -- 172.21.15.2:0/1750520183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74819d460 con 0x7fd748102790 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd746ffd640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748101de0 0x7fd7481984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd73ffff640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748102790 0x7fd7481989f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd73000d770 tx=0x7fd73000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd744ff9640 1 -- 172.21.15.2:0/1750520183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730017070 con 0x7fd748102790 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.230+0000 7fd744ff9640 1 -- 172.21.15.2:0/1750520183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd730005500 con 0x7fd748102790 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.231+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74819d750 con 0x7fd748102790 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.231+0000 7fd744ff9640 1 -- 172.21.15.2:0/1750520183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730004e00 con 0x7fd748102790 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.231+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7481a5030 con 0x7fd748102790 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.232+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7481021c0 con 0x7fd748102790 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.233+0000 7fd744ff9640 1 -- 172.21.15.2:0/1750520183 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fd730004fa0 con 0x7fd748102790 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.233+0000 7fd744ff9640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd7340a2c00 0x7fd7340a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.233+0000 7fd746ffd640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd7340a2c00 0x7fd7340a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.233+0000 7fd744ff9640 1 -- 172.21.15.2:0/1750520183 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd7300ce4c0 con 0x7fd748102790 2024-09-12T00:51:03.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.234+0000 7fd746ffd640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd7340a2c00 0x7fd7340a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd738009230 tx=0x7fd7380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:03.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.238+0000 7fd744ff9640 1 -- 172.21.15.2:0/1750520183 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd73009b270 con 0x7fd748102790 2024-09-12T00:51:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.456+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd748109b60 con 0x7fd748102790 2024-09-12T00:51:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.457+0000 7fd744ff9640 1 -- 172.21.15.2:0/1750520183 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10512 (secure 0 0 0) 0x7fd73009f570 con 0x7fd748102790 2024-09-12T00:51:03.456 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:03.456 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"btime":"2024-09-12T00:51:01:680498+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T00:51:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 13 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd7340a2c00 msgr2=0x7fd7340a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd7340a2c00 0x7fd7340a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd738009230 tx=0x7fd7380058d0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748102790 msgr2=0x7fd7481989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748102790 0x7fd7481989f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd73000d770 tx=0x7fd73000dc30 comp rx=0 tx=0).stop 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 shutdown_connections 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd7340a2c00 0x7fd7340a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd748106f10 0x7fd74819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd748102790 0x7fd7481989f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 --2- 172.21.15.2:0/1750520183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748101de0 0x7fd7481984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 >> 172.21.15.2:0/1750520183 conn(0x7fd7480fd8c0 msgr2=0x7fd7480fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 shutdown_connections 2024-09-12T00:51:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:03.459+0000 7fd74d4fa640 1 -- 172.21.15.2:0/1750520183 wait complete. 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:51:04.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.083 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1750520183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:04.083 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:03 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:51:04.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T00:51:04.164 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.164 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.164 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.164 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.164 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.164 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.164 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:51:04.164 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:51:04.165 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.165 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1750520183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:04.165 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:03 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:51:04.169 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1750520183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:04.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:03 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:51:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:05.144 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:04 smithi002 ceph-mon[31210]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:05.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:04 smithi071 ceph-mon[35276]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:05.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:04 smithi167 ceph-mon[35234]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 -- 172.21.15.2:0/2580856024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 msgr2=0x7f387410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 --2- 172.21.15.2:0/2580856024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 0x7f387410d950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f386c009cd0 tx=0x7f386c02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 -- 172.21.15.2:0/2580856024 shutdown_connections 2024-09-12T00:51:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 --2- 172.21.15.2:0/2580856024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 0x7f387410d950 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 --2- 172.21.15.2:0/2580856024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874100a80 0x7f3874100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 --2- 172.21.15.2:0/2580856024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3874106a80 0x7f3874106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 -- 172.21.15.2:0/2580856024 >> 172.21.15.2:0/2580856024 conn(0x7f38740fc7a0 msgr2=0x7f38740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 -- 172.21.15.2:0/2580856024 shutdown_connections 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.454+0000 7f3878aa8640 1 -- 172.21.15.2:0/2580856024 wait complete. 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.455+0000 7f3878aa8640 1 Processor -- start 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.455+0000 7f3878aa8640 1 -- start start 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3878aa8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874100a80 0x7f38741984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3878aa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 0x7f38741989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3878aa8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3874106a80 0x7f387419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3878aa8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3874110e80 con 0x7f3874101420 2024-09-12T00:51:05.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3878aa8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3874110d00 con 0x7f3874106a80 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3878aa8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3874111000 con 0x7f3874100a80 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 0x7f38741989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 0x7f38741989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45452/0 (socket says 172.21.15.2:45452) 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 -- 172.21.15.2:0/567526581 learned_addr learned my addr 172.21.15.2:0/567526581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f387259c640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874100a80 0x7f38741984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3872d9d640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3874106a80 0x7f387419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 -- 172.21.15.2:0/567526581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874100a80 msgr2=0x7f38741984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874100a80 0x7f38741984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 -- 172.21.15.2:0/567526581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3874106a80 msgr2=0x7f387419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3874106a80 0x7f387419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 -- 172.21.15.2:0/567526581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387419d450 con 0x7f3874101420 2024-09-12T00:51:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3872d9d640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3874106a80 0x7f387419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3871d9b640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 0x7f38741989e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f386800d770 tx=0x7f386800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f38637fe640 1 -- 172.21.15.2:0/567526581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868017070 con 0x7f3874101420 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f38637fe640 1 -- 172.21.15.2:0/567526581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3868005500 con 0x7f3874101420 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387419d740 con 0x7f3874101420 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.456+0000 7f38637fe640 1 -- 172.21.15.2:0/567526581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868004e00 con 0x7f3874101420 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.457+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38741a5020 con 0x7f3874101420 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.458+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3874100ee0 con 0x7f3874101420 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.459+0000 7f38637fe640 1 -- 172.21.15.2:0/567526581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3868004fa0 con 0x7f3874101420 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.459+0000 7f38637fe640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f385c0a2b80 0x7f385c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.460+0000 7f387259c640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f385c0a2b80 0x7f385c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.460+0000 7f38637fe640 1 -- 172.21.15.2:0/567526581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f38680ce6c0 con 0x7f3874101420 2024-09-12T00:51:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.460+0000 7f387259c640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f385c0a2b80 0x7f385c0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3864005d00 tx=0x7f386400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:05.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.464+0000 7f38637fe640 1 -- 172.21.15.2:0/567526581 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f386809ba20 con 0x7f3874101420 2024-09-12T00:51:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.691+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f387410a020 con 0x7f3874101420 2024-09-12T00:51:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.692+0000 7f38637fe640 1 -- 172.21.15.2:0/567526581 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f386809b320 con 0x7f3874101420 2024-09-12T00:51:05.691 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:05.691 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-09-12T00:51:05.691 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T00:51:05.691 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-09-12T00:51:05.691 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-09-12T00:51:05.691 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:51:05.691 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f385c0a2b80 msgr2=0x7f385c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f385c0a2b80 0x7f385c0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3864005d00 tx=0x7f386400b410 comp rx=0 tx=0).stop 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 msgr2=0x7f38741989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 0x7f38741989e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f386800d770 tx=0x7f386800dc30 comp rx=0 tx=0).stop 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 shutdown_connections 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f385c0a2b80 0x7f385c0a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3874106a80 0x7f387419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3874101420 0x7f38741989e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 --2- 172.21.15.2:0/567526581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874100a80 0x7f38741984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 >> 172.21.15.2:0/567526581 conn(0x7f38740fc7a0 msgr2=0x7f387406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:05.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 shutdown_connections 2024-09-12T00:51:05.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:05.695+0000 7f3878aa8640 1 -- 172.21.15.2:0/567526581 wait complete. 2024-09-12T00:51:06.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/567526581' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:05 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/567526581' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:51:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:51:06.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:05 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.421 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T00:51:06.422 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T00:51:06.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:06.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/567526581' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:51:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:05 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:51:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:07.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.126+0000 7f0eb8af1640 1 -- 172.21.15.2:0/4291873722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4100a80 msgr2=0x7f0eb4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:07.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.126+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/4291873722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4100a80 0x7f0eb4100ee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009930 tx=0x7f0e9c02a420 comp rx=0 tx=0).stop 2024-09-12T00:51:07.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.126+0000 7f0eb8af1640 1 -- 172.21.15.2:0/4291873722 shutdown_connections 2024-09-12T00:51:07.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.126+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/4291873722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb4101420 0x7f0eb410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.126+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/4291873722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4100a80 0x7f0eb4100ee0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.126+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/4291873722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb4106a80 0x7f0eb4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.126+0000 7f0eb8af1640 1 -- 172.21.15.2:0/4291873722 >> 172.21.15.2:0/4291873722 conn(0x7f0eb40fc7a0 msgr2=0x7f0eb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.127+0000 7f0eb8af1640 1 -- 172.21.15.2:0/4291873722 shutdown_connections 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.127+0000 7f0eb8af1640 1 -- 172.21.15.2:0/4291873722 wait complete. 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.127+0000 7f0eb8af1640 1 Processor -- start 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.127+0000 7f0eb8af1640 1 -- start start 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb8af1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb4100a80 0x7f0eb4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb8af1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4101420 0x7f0eb4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb8af1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb4106a80 0x7f0eb41a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:07.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb8af1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4110e80 con 0x7f0eb4101420 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb8af1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4110d00 con 0x7f0eb4106a80 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb8af1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4111000 con 0x7f0eb4100a80 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4101420 0x7f0eb4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4101420 0x7f0eb4199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36582/0 (socket says 172.21.15.2:36582) 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 -- 172.21.15.2:0/473623060 learned_addr learned my addr 172.21.15.2:0/473623060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb259c640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb4100a80 0x7f0eb4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb2d9d640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb4106a80 0x7f0eb41a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 -- 172.21.15.2:0/473623060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb4100a80 msgr2=0x7f0eb4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb4100a80 0x7f0eb4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 -- 172.21.15.2:0/473623060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb4106a80 msgr2=0x7f0eb41a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:07.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb4106a80 0x7f0eb41a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 -- 172.21.15.2:0/473623060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb41a48d0 con 0x7f0eb4101420 2024-09-12T00:51:07.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eabfff640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4101420 0x7f0eb4199850 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009230 tx=0x7f0e9c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:07.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eab7fe640 1 -- 172.21.15.2:0/473623060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c03f030 con 0x7f0eb4101420 2024-09-12T00:51:07.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eab7fe640 1 -- 172.21.15.2:0/473623060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e9c003ad0 con 0x7f0eb4101420 2024-09-12T00:51:07.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.128+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb41a4aa0 con 0x7f0eb4101420 2024-09-12T00:51:07.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.129+0000 7f0eab7fe640 1 -- 172.21.15.2:0/473623060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c035070 con 0x7f0eb4101420 2024-09-12T00:51:07.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.129+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb41a4f50 con 0x7f0eb4101420 2024-09-12T00:51:07.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.130+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb4100ee0 con 0x7f0eb4101420 2024-09-12T00:51:07.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.131+0000 7f0eab7fe640 1 -- 172.21.15.2:0/473623060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f0e9c042030 con 0x7f0eb4101420 2024-09-12T00:51:07.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.131+0000 7f0eab7fe640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0ea00a2c00 0x7f0ea00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:07.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.132+0000 7f0eb259c640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0ea00a2c00 0x7f0ea00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:07.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.132+0000 7f0eab7fe640 1 -- 172.21.15.2:0/473623060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0e9c0ef010 con 0x7f0eb4101420 2024-09-12T00:51:07.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.132+0000 7f0eb259c640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0ea00a2c00 0x7f0ea00a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4005fd0 tx=0x7f0ea400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:07.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.136+0000 7f0eab7fe640 1 -- 172.21.15.2:0/473623060 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e9c0bc410 con 0x7f0eb4101420 2024-09-12T00:51:07.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.313+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0eb4108ff0 con 0x7f0eb4101420 2024-09-12T00:51:07.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.987+0000 7f0eab7fe640 1 -- 172.21.15.2:0/473623060 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7f0e9c0bbd10 con 0x7f0eb4101420 2024-09-12T00:51:07.986 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0ea00a2c00 msgr2=0x7f0ea00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0ea00a2c00 0x7f0ea00a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4005fd0 tx=0x7f0ea400b390 comp rx=0 tx=0).stop 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4101420 msgr2=0x7f0eb4199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4101420 0x7f0eb4199850 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009230 tx=0x7f0e9c004270 comp rx=0 tx=0).stop 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 shutdown_connections 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0ea00a2c00 0x7f0ea00a50c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb4106a80 0x7f0eb41a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eb4101420 0x7f0eb4199850 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 --2- 172.21.15.2:0/473623060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb4100a80 0x7f0eb4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 >> 172.21.15.2:0/473623060 conn(0x7f0eb40fc7a0 msgr2=0x7f0eb40fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 shutdown_connections 2024-09-12T00:51:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:07.990+0000 7f0eb8af1640 1 -- 172.21.15.2:0/473623060 wait complete. 2024-09-12T00:51:08.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:07 smithi002 ceph-mon[31210]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:08.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:07 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/473623060' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T00:51:08.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:07 smithi167 ceph-mon[35234]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:08.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:07 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/473623060' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T00:51:08.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:07 smithi071 ceph-mon[35276]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:08.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:07 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/473623060' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T00:51:08.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T00:51:08.855 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:09.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:08 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/473623060' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T00:51:09.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:08 smithi002 ceph-mon[31210]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T00:51:09.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:08 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/473623060' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T00:51:09.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:08 smithi167 ceph-mon[35234]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T00:51:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 -- 172.21.15.2:0/3836487881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 msgr2=0x7f164010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 --2- 172.21.15.2:0/3836487881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 0x7f164010ea90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1638009ca0 tx=0x7f163802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 -- 172.21.15.2:0/3836487881 shutdown_connections 2024-09-12T00:51:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 --2- 172.21.15.2:0/3836487881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 0x7f164010ea90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 --2- 172.21.15.2:0/3836487881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1640102790 0x7f16401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 --2- 172.21.15.2:0/3836487881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1640101de0 0x7f16401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 -- 172.21.15.2:0/3836487881 >> 172.21.15.2:0/3836487881 conn(0x7f16400fd8c0 msgr2=0x7f16400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 -- 172.21.15.2:0/3836487881 shutdown_connections 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.356+0000 7f16448d6640 1 -- 172.21.15.2:0/3836487881 wait complete. 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f16448d6640 1 Processor -- start 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f16448d6640 1 -- start start 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f16448d6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1640101de0 0x7f16400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f16448d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1640102790 0x7f1640074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f16448d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 0x7f1640074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f16448d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1640111f70 con 0x7f1640106f10 2024-09-12T00:51:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f16448d6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1640111df0 con 0x7f1640101de0 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f16448d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16401120f0 con 0x7f1640102790 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f163ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 0x7f1640074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f163ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 0x7f1640074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36592/0 (socket says 172.21.15.2:36592) 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f163ed9d640 1 -- 172.21.15.2:0/353581108 learned_addr learned my addr 172.21.15.2:0/353581108 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f163e59c640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1640101de0 0x7f16400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.357+0000 7f1637fff640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1640102790 0x7f1640074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f163ed9d640 1 -- 172.21.15.2:0/353581108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1640102790 msgr2=0x7f1640074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f163ed9d640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1640102790 0x7f1640074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f163ed9d640 1 -- 172.21.15.2:0/353581108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1640101de0 msgr2=0x7f16400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f163ed9d640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1640101de0 0x7f16400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f163ed9d640 1 -- 172.21.15.2:0/353581108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16401a6900 con 0x7f1640106f10 2024-09-12T00:51:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f163e59c640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1640101de0 0x7f16400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f163ed9d640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 0x7f1640074f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1638031a20 tx=0x7f1638031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f16377fe640 1 -- 172.21.15.2:0/353581108 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638003c30 con 0x7f1640106f10 2024-09-12T00:51:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16401a6b90 con 0x7f1640106f10 2024-09-12T00:51:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f16377fe640 1 -- 172.21.15.2:0/353581108 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1638003dd0 con 0x7f1640106f10 2024-09-12T00:51:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f16377fe640 1 -- 172.21.15.2:0/353581108 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163802fc40 con 0x7f1640106f10 2024-09-12T00:51:09.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.358+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16401a7120 con 0x7f1640106f10 2024-09-12T00:51:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.359+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16401021c0 con 0x7f1640106f10 2024-09-12T00:51:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.360+0000 7f16377fe640 1 -- 172.21.15.2:0/353581108 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1638004b40 con 0x7f1640106f10 2024-09-12T00:51:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.361+0000 7f16377fe640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f162c0a2b80 0x7f162c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.361+0000 7f163e59c640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f162c0a2b80 0x7f162c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.361+0000 7f16377fe640 1 -- 172.21.15.2:0/353581108 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7f16380f01e0 con 0x7f1640106f10 2024-09-12T00:51:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.362+0000 7f163e59c640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f162c0a2b80 0x7f162c0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1630009c20 tx=0x7f1630005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.364+0000 7f16377fe640 1 -- 172.21.15.2:0/353581108 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16380bd460 con 0x7f1640106f10 2024-09-12T00:51:09.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:08 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/473623060' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T00:51:09.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:08 smithi071 ceph-mon[35276]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T00:51:09.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.542+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f164010a0f0 con 0x7f1640106f10 2024-09-12T00:51:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.997+0000 7f16377fe640 1 -- 172.21.15.2:0/353581108 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7f16380bcd60 con 0x7f1640106f10 2024-09-12T00:51:09.996 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-09-12T00:51:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f162c0a2b80 msgr2=0x7f162c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f162c0a2b80 0x7f162c0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1630009c20 tx=0x7f1630005f90 comp rx=0 tx=0).stop 2024-09-12T00:51:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 msgr2=0x7f1640074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 0x7f1640074f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1638031a20 tx=0x7f1638031a50 comp rx=0 tx=0).stop 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 shutdown_connections 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f162c0a2b80 0x7f162c0a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1640106f10 0x7f1640074f70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1640102790 0x7f1640074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 --2- 172.21.15.2:0/353581108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1640101de0 0x7f16400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 >> 172.21.15.2:0/353581108 conn(0x7f16400fd8c0 msgr2=0x7f16400fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 shutdown_connections 2024-09-12T00:51:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:09.999+0000 7f16448d6640 1 -- 172.21.15.2:0/353581108 wait complete. 2024-09-12T00:51:10.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:10 smithi167 ceph-mon[35234]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:10.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:10 smithi167 ceph-mon[35234]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T00:51:10.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:10 smithi167 ceph-mon[35234]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T00:51:10.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:10 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/353581108' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T00:51:10.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:10 smithi002 ceph-mon[31210]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:10.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:10 smithi002 ceph-mon[31210]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T00:51:10.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:10 smithi002 ceph-mon[31210]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T00:51:10.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:10 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/353581108' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T00:51:10.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:10 smithi071 ceph-mon[35276]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:10.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:10 smithi071 ceph-mon[35276]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T00:51:10.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:10 smithi071 ceph-mon[35276]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T00:51:10.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:10 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/353581108' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T00:51:10.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T00:51:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:11.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:11 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/353581108' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T00:51:11.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:11 smithi167 ceph-mon[35234]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T00:51:11.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:11 smithi167 ceph-mon[35234]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T00:51:11.293 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:11 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/353581108' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T00:51:11.293 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:11 smithi002 ceph-mon[31210]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T00:51:11.293 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:11 smithi002 ceph-mon[31210]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T00:51:11.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 -- 172.21.15.2:0/753893791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc10e480 msgr2=0x7f36bc110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:11.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/753893791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc10e480 0x7f36bc110870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009ca0 tx=0x7f36b402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:51:11.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 -- 172.21.15.2:0/753893791 shutdown_connections 2024-09-12T00:51:11.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/753893791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc10e480 0x7f36bc110870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/753893791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36bc101280 0x7f36bc10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/753893791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36bc1008d0 0x7f36bc100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 -- 172.21.15.2:0/753893791 >> 172.21.15.2:0/753893791 conn(0x7f36bc0fc7a0 msgr2=0x7f36bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 -- 172.21.15.2:0/753893791 shutdown_connections 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.379+0000 7f36c3cd0640 1 -- 172.21.15.2:0/753893791 wait complete. 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c3cd0640 1 Processor -- start 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c3cd0640 1 -- start start 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c3cd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc1008d0 0x7f36bc19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c3cd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36bc101280 0x7f36bc19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:11.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c3cd0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36bc10e480 0x7f36bc19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c3cd0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1141c0 con 0x7f36bc1008d0 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c3cd0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc114040 con 0x7f36bc10e480 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c3cd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc114340 con 0x7f36bc101280 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c1a6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc1008d0 0x7f36bc19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c1a6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc1008d0 0x7f36bc19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36614/0 (socket says 172.21.15.2:36614) 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c1a6c640 1 -- 172.21.15.2:0/2873718375 learned_addr learned my addr 172.21.15.2:0/2873718375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c226d640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36bc10e480 0x7f36bc19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.380+0000 7f36c126b640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36bc101280 0x7f36bc19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c1a6c640 1 -- 172.21.15.2:0/2873718375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36bc101280 msgr2=0x7f36bc19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c1a6c640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36bc101280 0x7f36bc19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c1a6c640 1 -- 172.21.15.2:0/2873718375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36bc10e480 msgr2=0x7f36bc19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c1a6c640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36bc10e480 0x7f36bc19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c1a6c640 1 -- 172.21.15.2:0/2873718375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc19f690 con 0x7f36bc1008d0 2024-09-12T00:51:11.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c226d640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36bc10e480 0x7f36bc19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c1a6c640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc1008d0 0x7f36bc19a6e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f36b800d950 tx=0x7f36b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36b2ffd640 1 -- 172.21.15.2:0/2873718375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8017070 con 0x7f36bc1008d0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36b2ffd640 1 -- 172.21.15.2:0/2873718375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b8009c30 con 0x7f36bc1008d0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc19f980 con 0x7f36bc1008d0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36b2ffd640 1 -- 172.21.15.2:0/2873718375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b800f6b0 con 0x7f36bc1008d0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.381+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc1a7260 con 0x7f36bc1008d0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.382+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc100cb0 con 0x7f36bc1008d0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.383+0000 7f36b2ffd640 1 -- 172.21.15.2:0/2873718375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f36b80109d0 con 0x7f36bc1008d0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.384+0000 7f36b2ffd640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36a80a2b80 0x7f36a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.384+0000 7f36c126b640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36a80a2b80 0x7f36a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.385+0000 7f36b2ffd640 1 -- 172.21.15.2:0/2873718375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f36b80cec10 con 0x7f36bc1008d0 2024-09-12T00:51:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.385+0000 7f36c126b640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36a80a2b80 0x7f36a80a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36bc10ed30 tx=0x7f36ac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:11.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.388+0000 7f36b2ffd640 1 -- 172.21.15.2:0/2873718375 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36b8009de0 con 0x7f36bc1008d0 2024-09-12T00:51:11.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:11 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/353581108' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T00:51:11.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:11 smithi071 ceph-mon[35276]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T00:51:11.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:11 smithi071 ceph-mon[35276]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T00:51:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:11.598+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f36bc19ba40 con 0x7f36bc1008d0 2024-09-12T00:51:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.023+0000 7f36b2ffd640 1 -- 172.21.15.2:0/2873718375 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f36bc19ba40 con 0x7f36bc1008d0 2024-09-12T00:51:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T00:51:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36a80a2b80 msgr2=0x7f36a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36a80a2b80 0x7f36a80a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36bc10ed30 tx=0x7f36ac008040 comp rx=0 tx=0).stop 2024-09-12T00:51:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc1008d0 msgr2=0x7f36bc19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc1008d0 0x7f36bc19a6e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f36b800d950 tx=0x7f36b800de10 comp rx=0 tx=0).stop 2024-09-12T00:51:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 shutdown_connections 2024-09-12T00:51:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36a80a2b80 0x7f36a80a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36bc10e480 0x7f36bc19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36bc101280 0x7f36bc19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 --2- 172.21.15.2:0/2873718375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36bc1008d0 0x7f36bc19a6e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 >> 172.21.15.2:0/2873718375 conn(0x7f36bc0fc7a0 msgr2=0x7f36bc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 shutdown_connections 2024-09-12T00:51:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:12.026+0000 7f36c3cd0640 1 -- 172.21.15.2:0/2873718375 wait complete. 2024-09-12T00:51:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:12 smithi167 ceph-mon[35234]: pgmap v272: 97 pgs: 36 creating+peering, 13 active+clean, 48 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:12 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2873718375' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T00:51:12.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:12 smithi167 ceph-mon[35234]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T00:51:12.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:12 smithi002 ceph-mon[31210]: pgmap v272: 97 pgs: 36 creating+peering, 13 active+clean, 48 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:12.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:12 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2873718375' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T00:51:12.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:12 smithi002 ceph-mon[31210]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T00:51:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:12 smithi071 ceph-mon[35276]: pgmap v272: 97 pgs: 36 creating+peering, 13 active+clean, 48 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:51:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:12 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2873718375' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T00:51:12.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:12 smithi071 ceph-mon[35276]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T00:51:12.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:51:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:13.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:13 smithi167 ceph-mon[35234]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T00:51:13.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:13 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2873718375' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T00:51:13.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:13 smithi167 ceph-mon[35234]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T00:51:13.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:13 smithi167 ceph-mon[35234]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T00:51:13.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:13 smithi002 ceph-mon[31210]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T00:51:13.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:13 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2873718375' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T00:51:13.317 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:13 smithi002 ceph-mon[31210]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T00:51:13.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:13 smithi002 ceph-mon[31210]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T00:51:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 -- 172.21.15.2:0/2022628412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8103760 msgr2=0x7f71a8107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 --2- 172.21.15.2:0/2022628412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8103760 0x7f71a8107ba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f719c009930 tx=0x7f719c02a420 comp rx=0 tx=0).stop 2024-09-12T00:51:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 -- 172.21.15.2:0/2022628412 shutdown_connections 2024-09-12T00:51:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 --2- 172.21.15.2:0/2022628412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71a81082e0 0x7f71a810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 --2- 172.21.15.2:0/2022628412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8103760 0x7f71a8107ba0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 --2- 172.21.15.2:0/2022628412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71a8102db0 0x7f71a8103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 -- 172.21.15.2:0/2022628412 >> 172.21.15.2:0/2022628412 conn(0x7f71a80fc7d0 msgr2=0x7f71a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 -- 172.21.15.2:0/2022628412 shutdown_connections 2024-09-12T00:51:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.402+0000 7f71b0172640 1 -- 172.21.15.2:0/2022628412 wait complete. 2024-09-12T00:51:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71b0172640 1 Processor -- start 2024-09-12T00:51:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71b0172640 1 -- start start 2024-09-12T00:51:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71b0172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8102db0 0x7f71a8100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71b0172640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71a8103760 0x7f71a8100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71b0172640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71a81082e0 0x7f71a8101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71b0172640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f71a81120f0 con 0x7f71a8102db0 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71b0172640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8111f70 con 0x7f71a81082e0 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71b0172640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8112270 con 0x7f71a8103760 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.403+0000 7f71adf0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8102db0 0x7f71a8100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71adf0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8102db0 0x7f71a8100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36638/0 (socket says 172.21.15.2:36638) 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71adf0e640 1 -- 172.21.15.2:0/755085113 learned_addr learned my addr 172.21.15.2:0/755085113 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71ad70d640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71a8103760 0x7f71a8100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71ae70f640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71a81082e0 0x7f71a8101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71adf0e640 1 -- 172.21.15.2:0/755085113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71a8103760 msgr2=0x7f71a8100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71adf0e640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71a8103760 0x7f71a8100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71adf0e640 1 -- 172.21.15.2:0/755085113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71a81082e0 msgr2=0x7f71a8101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71adf0e640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71a81082e0 0x7f71a8101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71adf0e640 1 -- 172.21.15.2:0/755085113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a81a6b30 con 0x7f71a8102db0 2024-09-12T00:51:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71adf0e640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8102db0 0x7f71a8100a10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f719800c970 tx=0x7f719800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71a6ffd640 1 -- 172.21.15.2:0/755085113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198007bb0 con 0x7f71a8102db0 2024-09-12T00:51:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a81a6e20 con 0x7f71a8102db0 2024-09-12T00:51:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71a6ffd640 1 -- 172.21.15.2:0/755085113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7198007d50 con 0x7f71a8102db0 2024-09-12T00:51:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71a6ffd640 1 -- 172.21.15.2:0/755085113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719800f450 con 0x7f71a8102db0 2024-09-12T00:51:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.404+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a81a7280 con 0x7f71a8102db0 2024-09-12T00:51:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.405+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a8103190 con 0x7f71a8102db0 2024-09-12T00:51:13.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.406+0000 7f71a6ffd640 1 -- 172.21.15.2:0/755085113 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7198005020 con 0x7f71a8102db0 2024-09-12T00:51:13.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.407+0000 7f71a6ffd640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71900a2b80 0x7f71900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:13.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.408+0000 7f71ad70d640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71900a2b80 0x7f71900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:13.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.408+0000 7f71a6ffd640 1 -- 172.21.15.2:0/755085113 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f71980cece0 con 0x7f71a8102db0 2024-09-12T00:51:13.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.408+0000 7f71ad70d640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71900a2b80 0x7f71900a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f719c005940 tx=0x7f719c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:13.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.412+0000 7f71a6ffd640 1 -- 172.21.15.2:0/755085113 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7198014030 con 0x7f71a8102db0 2024-09-12T00:51:13.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:13 smithi071 ceph-mon[35276]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T00:51:13.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:13 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2873718375' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T00:51:13.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:13 smithi071 ceph-mon[35276]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T00:51:13.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:13 smithi071 ceph-mon[35276]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T00:51:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.590+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71a810a2c0 con 0x7f71a8102db0 2024-09-12T00:51:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.591+0000 7f71a6ffd640 1 -- 172.21.15.2:0/755085113 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22183 (secure 0 0 0) 0x7f719809bd90 con 0x7f71a8102db0 2024-09-12T00:51:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:13.591 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":79,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:51:11.599764+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:51:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71900a2b80 msgr2=0x7f71900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71900a2b80 0x7f71900a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f719c005940 tx=0x7f719c0058d0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8102db0 msgr2=0x7f71a8100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8102db0 0x7f71a8100a10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f719800c970 tx=0x7f719800ce30 comp rx=0 tx=0).stop 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 shutdown_connections 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71900a2b80 0x7f71900a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71a81082e0 0x7f71a8101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71a8103760 0x7f71a8100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 --2- 172.21.15.2:0/755085113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8102db0 0x7f71a8100a10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 >> 172.21.15.2:0/755085113 conn(0x7f71a80fc7d0 msgr2=0x7f71a8105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 shutdown_connections 2024-09-12T00:51:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:13.594+0000 7f71b0172640 1 -- 172.21.15.2:0/755085113 wait complete. 2024-09-12T00:51:14.180 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:14 smithi002 ceph-mon[31210]: pgmap v275: 97 pgs: 36 creating+peering, 61 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 5 op/s 2024-09-12T00:51:14.180 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:14 smithi002 ceph-mon[31210]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T00:51:14.180 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:14 smithi002 ceph-mon[31210]: Cluster is now healthy 2024-09-12T00:51:14.180 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:14 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] up:active 2024-09-12T00:51:14.180 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:14 smithi002 ceph-mon[31210]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:14.180 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:14 smithi002 ceph-mon[31210]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:14.180 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:14 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/755085113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:14.215 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:51:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:14 smithi167 ceph-mon[35234]: pgmap v275: 97 pgs: 36 creating+peering, 61 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 5 op/s 2024-09-12T00:51:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:14 smithi167 ceph-mon[35234]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T00:51:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:14 smithi167 ceph-mon[35234]: Cluster is now healthy 2024-09-12T00:51:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:14 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] up:active 2024-09-12T00:51:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:14 smithi167 ceph-mon[35234]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:14 smithi167 ceph-mon[35234]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:14 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/755085113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:14.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:14 smithi071 ceph-mon[35276]: pgmap v275: 97 pgs: 36 creating+peering, 61 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 5 op/s 2024-09-12T00:51:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:14 smithi071 ceph-mon[35276]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T00:51:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:14 smithi071 ceph-mon[35276]: Cluster is now healthy 2024-09-12T00:51:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:14 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] up:active 2024-09-12T00:51:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:14 smithi071 ceph-mon[35276]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:14 smithi071 ceph-mon[35276]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:14 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/755085113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 -- 172.21.15.2:0/943659018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 msgr2=0x7f2700106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 --2- 172.21.15.2:0/943659018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 0x7f2700106e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009930 tx=0x7f26fc02a420 comp rx=0 tx=0).stop 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 -- 172.21.15.2:0/943659018 shutdown_connections 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 --2- 172.21.15.2:0/943659018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2700101420 0x7f270010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 --2- 172.21.15.2:0/943659018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2700100a80 0x7f2700100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 --2- 172.21.15.2:0/943659018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 0x7f2700106e60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 -- 172.21.15.2:0/943659018 >> 172.21.15.2:0/943659018 conn(0x7f27000fc7a0 msgr2=0x7f27000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 -- 172.21.15.2:0/943659018 shutdown_connections 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 -- 172.21.15.2:0/943659018 wait complete. 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 Processor -- start 2024-09-12T00:51:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.875+0000 7f270850b640 1 -- start start 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f270850b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2700100a80 0x7f27000fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f270850b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2700101420 0x7f27000fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f270850b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 0x7f27000fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f270850b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2700110e40 con 0x7f2700106a80 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f270850b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2700110cc0 con 0x7f2700101420 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f270850b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2700110fc0 con 0x7f2700100a80 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 0x7f27000fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 0x7f27000fd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36660/0 (socket says 172.21.15.2:36660) 2024-09-12T00:51:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 -- 172.21.15.2:0/1331867535 learned_addr learned my addr 172.21.15.2:0/1331867535 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2705aa6640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2700101420 0x7f27000fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f27062a7640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2700100a80 0x7f27000fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 -- 172.21.15.2:0/1331867535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2700100a80 msgr2=0x7f27000fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2700100a80 0x7f27000fce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 -- 172.21.15.2:0/1331867535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2700101420 msgr2=0x7f27000fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2700101420 0x7f27000fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 -- 172.21.15.2:0/1331867535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27001a6880 con 0x7f2700106a80 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f2706aa8640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 0x7f27000fd8d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f26f800eaa0 tx=0x7f26f800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.876+0000 7f26f77fe640 1 -- 172.21.15.2:0/1331867535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8004d20 con 0x7f2700106a80 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.877+0000 7f26f77fe640 1 -- 172.21.15.2:0/1331867535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26f8005020 con 0x7f2700106a80 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.877+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27001a6b70 con 0x7f2700106a80 2024-09-12T00:51:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.877+0000 7f26f77fe640 1 -- 172.21.15.2:0/1331867535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80116d0 con 0x7f2700106a80 2024-09-12T00:51:14.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.877+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27001a7060 con 0x7f2700106a80 2024-09-12T00:51:14.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.878+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2700100ee0 con 0x7f2700106a80 2024-09-12T00:51:14.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.879+0000 7f26f77fe640 1 -- 172.21.15.2:0/1331867535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f26f80051d0 con 0x7f2700106a80 2024-09-12T00:51:14.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.879+0000 7f26f77fe640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f26ec0a2b80 0x7f26ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:14.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.880+0000 7f27062a7640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f26ec0a2b80 0x7f26ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:14.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.880+0000 7f26f77fe640 1 -- 172.21.15.2:0/1331867535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f26f80cf000 con 0x7f2700106a80 2024-09-12T00:51:14.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.880+0000 7f27062a7640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f26ec0a2b80 0x7f26ec0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009900 tx=0x7f26fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:14.884+0000 7f26f77fe640 1 -- 172.21.15.2:0/1331867535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26f8016030 con 0x7f2700106a80 2024-09-12T00:51:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.060+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f270010a000 con 0x7f2700106a80 2024-09-12T00:51:15.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.061+0000 7f26f77fe640 1 -- 172.21.15.2:0/1331867535 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22183 (secure 0 0 0) 0x7f26f809c0b0 con 0x7f2700106a80 2024-09-12T00:51:15.060 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:15.061 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":79,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:51:11.599764+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:51:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f26ec0a2b80 msgr2=0x7f26ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f26ec0a2b80 0x7f26ec0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009900 tx=0x7f26fc0058d0 comp rx=0 tx=0).stop 2024-09-12T00:51:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 msgr2=0x7f27000fd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 0x7f27000fd8d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f26f800eaa0 tx=0x7f26f800eea0 comp rx=0 tx=0).stop 2024-09-12T00:51:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 shutdown_connections 2024-09-12T00:51:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f26ec0a2b80 0x7f26ec0a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700106a80 0x7f27000fd8d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2700101420 0x7f27000fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 --2- 172.21.15.2:0/1331867535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2700100a80 0x7f27000fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 >> 172.21.15.2:0/1331867535 conn(0x7f27000fc7a0 msgr2=0x7f270006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.063+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 shutdown_connections 2024-09-12T00:51:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:15.064+0000 7f270850b640 1 -- 172.21.15.2:0/1331867535 wait complete. 2024-09-12T00:51:15.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T00:51:15.933 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:16.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:16 smithi167 ceph-mon[35234]: pgmap v276: 97 pgs: 36 creating+peering, 61 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 349 B/s wr, 4 op/s 2024-09-12T00:51:16.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:16 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1331867535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:16.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:16 smithi002 ceph-mon[31210]: pgmap v276: 97 pgs: 36 creating+peering, 61 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 349 B/s wr, 4 op/s 2024-09-12T00:51:16.358 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:16 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1331867535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:16.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:16 smithi071 ceph-mon[35276]: pgmap v276: 97 pgs: 36 creating+peering, 61 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 349 B/s wr, 4 op/s 2024-09-12T00:51:16.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:16 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1331867535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.585+0000 7fc553167640 1 -- 172.21.15.2:0/539122964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 msgr2=0x7fc54c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.585+0000 7fc553167640 1 --2- 172.21.15.2:0/539122964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 0x7fc54c1067e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009900 tx=0x7fc53c02a3f0 comp rx=0 tx=0).stop 2024-09-12T00:51:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 -- 172.21.15.2:0/539122964 shutdown_connections 2024-09-12T00:51:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 --2- 172.21.15.2:0/539122964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c106f10 0x7fc54c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 --2- 172.21.15.2:0/539122964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 0x7fc54c1067e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 --2- 172.21.15.2:0/539122964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c101de0 0x7fc54c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 -- 172.21.15.2:0/539122964 >> 172.21.15.2:0/539122964 conn(0x7fc54c0fd8c0 msgr2=0x7fc54c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 -- 172.21.15.2:0/539122964 shutdown_connections 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 -- 172.21.15.2:0/539122964 wait complete. 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 Processor -- start 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 -- start start 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c101de0 0x7fc54c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 0x7fc54c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c106f10 0x7fc54c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c111f30 con 0x7fc54c102790 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c111db0 con 0x7fc54c101de0 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.586+0000 7fc553167640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1120b0 con 0x7fc54c106f10 2024-09-12T00:51:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 0x7fc54c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 0x7fc54c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47882/0 (socket says 172.21.15.2:47882) 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 -- 172.21.15.2:0/869195419 learned_addr learned my addr 172.21.15.2:0/869195419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc551704640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c106f10 0x7fc54c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc550f03640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c101de0 0x7fc54c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 -- 172.21.15.2:0/869195419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c106f10 msgr2=0x7fc54c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c106f10 0x7fc54c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 -- 172.21.15.2:0/869195419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c101de0 msgr2=0x7fc54c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c101de0 0x7fc54c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 -- 172.21.15.2:0/869195419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c19d3c0 con 0x7fc54c102790 2024-09-12T00:51:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc551704640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c106f10 0x7fc54c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc550f03640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c101de0 0x7fc54c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc543fff640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 0x7fc54c198950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc53c005ab0 tx=0x7fc53c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc541ffb640 1 -- 172.21.15.2:0/869195419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c03f030 con 0x7fc54c102790 2024-09-12T00:51:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc541ffb640 1 -- 172.21.15.2:0/869195419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc53c003ce0 con 0x7fc54c102790 2024-09-12T00:51:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c19d650 con 0x7fc54c102790 2024-09-12T00:51:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.587+0000 7fc541ffb640 1 -- 172.21.15.2:0/869195419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c035070 con 0x7fc54c102790 2024-09-12T00:51:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.588+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c1a4f90 con 0x7fc54c102790 2024-09-12T00:51:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.589+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54c1021c0 con 0x7fc54c102790 2024-09-12T00:51:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.590+0000 7fc541ffb640 1 -- 172.21.15.2:0/869195419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc53c042030 con 0x7fc54c102790 2024-09-12T00:51:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.590+0000 7fc541ffb640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5340a2b80 0x7fc5340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.590+0000 7fc550f03640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5340a2b80 0x7fc5340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.590+0000 7fc541ffb640 1 -- 172.21.15.2:0/869195419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fc53c0ef870 con 0x7fc54c102790 2024-09-12T00:51:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.591+0000 7fc550f03640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5340a2b80 0x7fc5340a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc54800baa0 tx=0x7fc548005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.595+0000 7fc541ffb640 1 -- 172.21.15.2:0/869195419 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc53c0bc920 con 0x7fc54c102790 2024-09-12T00:51:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:16.808+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc54c10a0f0 con 0x7fc54c102790 2024-09-12T00:51:17.021 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 00:51:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: 2024-09-12T00:51:16.692+0000 7f34d034d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T00:51:17.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.029+0000 7fc541ffb640 1 -- 172.21.15.2:0/869195419 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc53c0bc220 con 0x7fc54c102790 2024-09-12T00:51:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5340a2b80 msgr2=0x7fc5340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5340a2b80 0x7fc5340a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc54800baa0 tx=0x7fc548005d90 comp rx=0 tx=0).stop 2024-09-12T00:51:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 msgr2=0x7fc54c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 0x7fc54c198950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc53c005ab0 tx=0x7fc53c0042f0 comp rx=0 tx=0).stop 2024-09-12T00:51:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 shutdown_connections 2024-09-12T00:51:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5340a2b80 0x7fc5340a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c106f10 0x7fc54c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc54c102790 0x7fc54c198950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 --2- 172.21.15.2:0/869195419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c101de0 0x7fc54c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 >> 172.21.15.2:0/869195419 conn(0x7fc54c0fd8c0 msgr2=0x7fc54c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.031+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 shutdown_connections 2024-09-12T00:51:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:17.032+0000 7fc553167640 1 -- 172.21.15.2:0/869195419 wait complete. 2024-09-12T00:51:17.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:17 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/869195419' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T00:51:17.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:17 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/869195419' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T00:51:17.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:17 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/869195419' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T00:51:17.662 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T00:51:17.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-12T00:51:17.923 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:18.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:18 smithi167 ceph-mon[35234]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T00:51:18.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:18 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/869195419' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T00:51:18.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:18 smithi167 ceph-mon[35234]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:18.296 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:18 smithi002 ceph-mon[31210]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T00:51:18.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:18 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/869195419' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T00:51:18.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:18 smithi002 ceph-mon[31210]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 -- 172.21.15.2:0/1365602035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 msgr2=0x7f13bc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 --2- 172.21.15.2:0/1365602035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 0x7f13bc1029b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009900 tx=0x7f13a402a480 comp rx=0 tx=0).stop 2024-09-12T00:51:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 -- 172.21.15.2:0/1365602035 shutdown_connections 2024-09-12T00:51:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 --2- 172.21.15.2:0/1365602035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13bc102ef0 0x7f13bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 --2- 172.21.15.2:0/1365602035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 0x7f13bc1029b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 --2- 172.21.15.2:0/1365602035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13bc100e20 0x7f13bc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 -- 172.21.15.2:0/1365602035 >> 172.21.15.2:0/1365602035 conn(0x7f13bc0fc7d0 msgr2=0x7f13bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 -- 172.21.15.2:0/1365602035 shutdown_connections 2024-09-12T00:51:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.383+0000 7f13c0f42640 1 -- 172.21.15.2:0/1365602035 wait complete. 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13c0f42640 1 Processor -- start 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13c0f42640 1 -- start start 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13c0f42640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13bc100e20 0x7f13bc10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13c0f42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 0x7f13bc10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13c0f42640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13bc102ef0 0x7f13bc10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13c0f42640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc1120a0 con 0x7f13bc102570 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13c0f42640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc111f20 con 0x7f13bc102ef0 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13c0f42640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc112220 con 0x7f13bc100e20 2024-09-12T00:51:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13b3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 0x7f13bc10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13b3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 0x7f13bc10ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47908/0 (socket says 172.21.15.2:47908) 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13b3fff640 1 -- 172.21.15.2:0/2432336832 learned_addr learned my addr 172.21.15.2:0/2432336832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13bad9d640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13bc102ef0 0x7f13bc10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13ba59c640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13bc100e20 0x7f13bc10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13b3fff640 1 -- 172.21.15.2:0/2432336832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13bc100e20 msgr2=0x7f13bc10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.384+0000 7f13b3fff640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13bc100e20 0x7f13bc10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13b3fff640 1 -- 172.21.15.2:0/2432336832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13bc102ef0 msgr2=0x7f13bc10ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13b3fff640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13bc102ef0 0x7f13bc10ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13b3fff640 1 -- 172.21.15.2:0/2432336832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc1a6a20 con 0x7f13bc102570 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13b3fff640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 0x7f13bc10ea10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13a4006010 tx=0x7f13a4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13b37fe640 1 -- 172.21.15.2:0/2432336832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a403f070 con 0x7f13bc102570 2024-09-12T00:51:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc1a6cb0 con 0x7f13bc102570 2024-09-12T00:51:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13b37fe640 1 -- 172.21.15.2:0/2432336832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a4031c30 con 0x7f13bc102570 2024-09-12T00:51:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13b37fe640 1 -- 172.21.15.2:0/2432336832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4035030 con 0x7f13bc102570 2024-09-12T00:51:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.385+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc1a7190 con 0x7f13bc102570 2024-09-12T00:51:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.386+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc101200 con 0x7f13bc102570 2024-09-12T00:51:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.387+0000 7f13b37fe640 1 -- 172.21.15.2:0/2432336832 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f13a4042070 con 0x7f13bc102570 2024-09-12T00:51:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.388+0000 7f13b37fe640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13a80a2b80 0x7f13a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.388+0000 7f13ba59c640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13a80a2b80 0x7f13a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.388+0000 7f13b37fe640 1 -- 172.21.15.2:0/2432336832 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f13a40ef750 con 0x7f13bc102570 2024-09-12T00:51:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.388+0000 7f13ba59c640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13a80a2b80 0x7f13a80a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009890 tx=0x7f13ac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.392+0000 7f13b37fe640 1 -- 172.21.15.2:0/2432336832 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13a4031de0 con 0x7f13bc102570 2024-09-12T00:51:18.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:18 smithi071 ceph-mon[35276]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T00:51:18.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:18 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/869195419' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T00:51:18.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:18 smithi071 ceph-mon[35276]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:18.604+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f13bc109090 con 0x7f13bc102570 2024-09-12T00:51:19.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.035+0000 7f13b37fe640 1 -- 172.21.15.2:0/2432336832 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f13a40bc800 con 0x7f13bc102570 2024-09-12T00:51:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13a80a2b80 msgr2=0x7f13a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13a80a2b80 0x7f13a80a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009890 tx=0x7f13ac008040 comp rx=0 tx=0).stop 2024-09-12T00:51:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 msgr2=0x7f13bc10ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 0x7f13bc10ea10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13a4006010 tx=0x7f13a4003c10 comp rx=0 tx=0).stop 2024-09-12T00:51:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 shutdown_connections 2024-09-12T00:51:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13a80a2b80 0x7f13a80a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13bc102ef0 0x7f13bc10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc102570 0x7f13bc10ea10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 --2- 172.21.15.2:0/2432336832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13bc100e20 0x7f13bc10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.037+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 >> 172.21.15.2:0/2432336832 conn(0x7f13bc0fc7d0 msgr2=0x7f13bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.038+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 shutdown_connections 2024-09-12T00:51:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:19.038+0000 7f13c0f42640 1 -- 172.21.15.2:0/2432336832 wait complete. 2024-09-12T00:51:19.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:19 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2432336832' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T00:51:19.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:19 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2432336832' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T00:51:19.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:19 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2432336832' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T00:51:19.681 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T00:51:19.945 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:20.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:20 smithi167 ceph-mon[35234]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T00:51:20.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:20 smithi167 ceph-mon[35234]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T00:51:20.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:20 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2432336832' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T00:51:20.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:20 smithi167 ceph-mon[35234]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T00:51:20.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:20 smithi167 ceph-mon[35234]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:20.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:20 smithi167 ceph-mon[35234]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T00:51:20.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:20 smithi167 ceph-mon[35234]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T00:51:20.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:20 smithi002 ceph-mon[31210]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T00:51:20.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:20 smithi002 ceph-mon[31210]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T00:51:20.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:20 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2432336832' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T00:51:20.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:20 smithi002 ceph-mon[31210]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T00:51:20.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:20 smithi002 ceph-mon[31210]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:20.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:20 smithi002 ceph-mon[31210]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T00:51:20.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:20 smithi002 ceph-mon[31210]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T00:51:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 -- 172.21.15.2:0/2265023817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4106f10 msgr2=0x7f18b410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 --2- 172.21.15.2:0/2265023817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4106f10 0x7f18b410ea90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009ca0 tx=0x7f18ac02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:51:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 -- 172.21.15.2:0/2265023817 shutdown_connections 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 --2- 172.21.15.2:0/2265023817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4106f10 0x7f18b410ea90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 --2- 172.21.15.2:0/2265023817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b4102790 0x7f18b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 --2- 172.21.15.2:0/2265023817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18b4101de0 0x7f18b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 -- 172.21.15.2:0/2265023817 >> 172.21.15.2:0/2265023817 conn(0x7f18b40fd8c0 msgr2=0x7f18b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 -- 172.21.15.2:0/2265023817 shutdown_connections 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 -- 172.21.15.2:0/2265023817 wait complete. 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 Processor -- start 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.409+0000 7f18bb635640 1 -- start start 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18bb635640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4101de0 0x7f18b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18bb635640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18b4102790 0x7f18b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18bb635640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b4106f10 0x7f18b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18bb635640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4111fb0 con 0x7f18b4101de0 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18bb635640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4111e30 con 0x7f18b4106f10 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18bb635640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4112130 con 0x7f18b4102790 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4101de0 0x7f18b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4101de0 0x7f18b40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47920/0 (socket says 172.21.15.2:47920) 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 -- 172.21.15.2:0/3724749674 learned_addr learned my addr 172.21.15.2:0/3724749674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b8bd0640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18b4102790 0x7f18b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 -- 172.21.15.2:0/3724749674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18b4102790 msgr2=0x7f18b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18b4102790 0x7f18b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 -- 172.21.15.2:0/3724749674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b4106f10 msgr2=0x7f18b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b4106f10 0x7f18b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 -- 172.21.15.2:0/3724749674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b41a68f0 con 0x7f18b4101de0 2024-09-12T00:51:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18b93d1640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4101de0 0x7f18b40744f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18b000d770 tx=0x7f18b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18aa7fc640 1 -- 172.21.15.2:0/3724749674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0017070 con 0x7f18b4101de0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18aa7fc640 1 -- 172.21.15.2:0/3724749674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b0005500 con 0x7f18b4101de0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.410+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b41a6be0 con 0x7f18b4101de0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.411+0000 7f18aa7fc640 1 -- 172.21.15.2:0/3724749674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0004e00 con 0x7f18b4101de0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.411+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b41a7120 con 0x7f18b4101de0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.412+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b41021c0 con 0x7f18b4101de0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.413+0000 7f18aa7fc640 1 -- 172.21.15.2:0/3724749674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f18b0004fa0 con 0x7f18b4101de0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.413+0000 7f18aa7fc640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f18a00a2c00 0x7f18a00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.414+0000 7f18b8bd0640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f18a00a2c00 0x7f18a00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.414+0000 7f18aa7fc640 1 -- 172.21.15.2:0/3724749674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f18b00ce9f0 con 0x7f18b4101de0 2024-09-12T00:51:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.414+0000 7f18b8bd0640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f18a00a2c00 0x7f18a00a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f18b4075f80 tx=0x7f18a4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.418+0000 7f18aa7fc640 1 -- 172.21.15.2:0/3724749674 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18b009ba00 con 0x7f18b4101de0 2024-09-12T00:51:20.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:20 smithi071 ceph-mon[35276]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T00:51:20.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:20 smithi071 ceph-mon[35276]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T00:51:20.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:20 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2432336832' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T00:51:20.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:20 smithi071 ceph-mon[35276]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T00:51:20.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:20 smithi071 ceph-mon[35276]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T00:51:20.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:20 smithi071 ceph-mon[35276]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T00:51:20.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:20 smithi071 ceph-mon[35276]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T00:51:20.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:20.632+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f18b4109b60 con 0x7f18b4101de0 2024-09-12T00:51:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.051+0000 7f18aa7fc640 1 -- 172.21.15.2:0/3724749674 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f18b009b300 con 0x7f18b4101de0 2024-09-12T00:51:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f18a00a2c00 msgr2=0x7f18a00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f18a00a2c00 0x7f18a00a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f18b4075f80 tx=0x7f18a4008040 comp rx=0 tx=0).stop 2024-09-12T00:51:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4101de0 msgr2=0x7f18b40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4101de0 0x7f18b40744f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18b000d770 tx=0x7f18b000dc30 comp rx=0 tx=0).stop 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 shutdown_connections 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f18a00a2c00 0x7f18a00a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b4106f10 0x7f18b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18b4102790 0x7f18b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 --2- 172.21.15.2:0/3724749674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b4101de0 0x7f18b40744f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.054+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 >> 172.21.15.2:0/3724749674 conn(0x7f18b40fd8c0 msgr2=0x7f18b40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.055+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 shutdown_connections 2024-09-12T00:51:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:21.055+0000 7f18bb635640 1 -- 172.21.15.2:0/3724749674 wait complete. 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] up:active 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: Cluster is now healthy 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3724749674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T00:51:21.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2024-09-12T00:51:21.434 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] up:active 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: Cluster is now healthy 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3724749674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-12T00:51:21.435 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-12T00:51:21.436 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-12T00:51:21.436 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]: dispatch 2024-09-12T00:51:21.436 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-12T00:51:21.436 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T00:51:21.436 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T00:51:21.436 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2024-09-12T00:51:21.436 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-12T00:51:21.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] up:active 2024-09-12T00:51:21.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T00:51:21.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T00:51:21.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: Cluster is now healthy 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3724749674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]: dispatch 2024-09-12T00:51:21.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-12T00:51:21.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T00:51:21.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T00:51:21.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2024-09-12T00:51:21.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-12T00:51:21.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T00:51:22.051 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: 2024-09-12T00:51:21.693+0000 7f34d034d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T00:51:22.051 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 00:51:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: 2024-09-12T00:51:21.693+0000 7f34d034d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T00:51:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3724749674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-12T00:51:22.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-12T00:51:22.305 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] up:active 2024-09-12T00:51:22.305 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T00:51:22.305 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T00:51:22.305 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:22 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:51:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-12T00:51:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3724749674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T00:51:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-12T00:51:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-12T00:51:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-12T00:51:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-12T00:51:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]': finished 2024-09-12T00:51:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-12T00:51:22.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T00:51:22.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T00:51:22.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-12T00:51:22.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-12T00:51:22.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] up:active 2024-09-12T00:51:22.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T00:51:22.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T00:51:22.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:22 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:51:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 -- 172.21.15.2:0/4115273583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba0103660 msgr2=0x7f2ba010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/4115273583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba0103660 0x7f2ba010bb50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009900 tx=0x7f2b9002a480 comp rx=0 tx=0).stop 2024-09-12T00:51:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 -- 172.21.15.2:0/4115273583 shutdown_connections 2024-09-12T00:51:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/4115273583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ba010c170 0x7f2ba010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/4115273583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba0103660 0x7f2ba010bb50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/4115273583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba0102d40 0x7f2ba0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 -- 172.21.15.2:0/4115273583 >> 172.21.15.2:0/4115273583 conn(0x7f2ba00fc7a0 msgr2=0x7f2ba00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 -- 172.21.15.2:0/4115273583 shutdown_connections 2024-09-12T00:51:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.498+0000 7f2ba6abe640 1 -- 172.21.15.2:0/4115273583 wait complete. 2024-09-12T00:51:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba6abe640 1 Processor -- start 2024-09-12T00:51:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba6abe640 1 -- start start 2024-09-12T00:51:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba6abe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba0102d40 0x7f2ba01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba6abe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ba0103660 0x7f2ba01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba6abe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba010c170 0x7f2ba019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba6abe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba0111fd0 con 0x7f2ba010c170 2024-09-12T00:51:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba6abe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba0111e50 con 0x7f2ba0103660 2024-09-12T00:51:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba6abe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba0112150 con 0x7f2ba0102d40 2024-09-12T00:51:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba505b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba010c170 0x7f2ba019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba505b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba010c170 0x7f2ba019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47930/0 (socket says 172.21.15.2:47930) 2024-09-12T00:51:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba485a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba0102d40 0x7f2ba01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba505b640 1 -- 172.21.15.2:0/1324959675 learned_addr learned my addr 172.21.15.2:0/1324959675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2b97fff640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ba0103660 0x7f2ba01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba505b640 1 -- 172.21.15.2:0/1324959675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba0102d40 msgr2=0x7f2ba01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba505b640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba0102d40 0x7f2ba01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:22.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba505b640 1 -- 172.21.15.2:0/1324959675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ba0103660 msgr2=0x7f2ba01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:22.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba505b640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ba0103660 0x7f2ba01989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:22.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.499+0000 7f2ba505b640 1 -- 172.21.15.2:0/1324959675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba019d450 con 0x7f2ba010c170 2024-09-12T00:51:22.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.500+0000 7f2ba505b640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba010c170 0x7f2ba019cd70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800b970 tx=0x7f2b9800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:22.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.500+0000 7f2b95ffb640 1 -- 172.21.15.2:0/1324959675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98019070 con 0x7f2ba010c170 2024-09-12T00:51:22.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.500+0000 7f2b95ffb640 1 -- 172.21.15.2:0/1324959675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b9800cb40 con 0x7f2ba010c170 2024-09-12T00:51:22.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.500+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba019d740 con 0x7f2ba010c170 2024-09-12T00:51:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.500+0000 7f2b95ffb640 1 -- 172.21.15.2:0/1324959675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98007650 con 0x7f2ba010c170 2024-09-12T00:51:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.500+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba01a5020 con 0x7f2ba010c170 2024-09-12T00:51:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.501+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba0103120 con 0x7f2ba010c170 2024-09-12T00:51:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.502+0000 7f2b95ffb640 1 -- 172.21.15.2:0/1324959675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2b9801c070 con 0x7f2ba010c170 2024-09-12T00:51:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.503+0000 7f2b95ffb640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2b880a2c00 0x7f2b880a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.503+0000 7f2ba485a640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2b880a2c00 0x7f2b880a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.503+0000 7f2b95ffb640 1 -- 172.21.15.2:0/1324959675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2b980ce5e0 con 0x7f2ba010c170 2024-09-12T00:51:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.504+0000 7f2ba485a640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2b880a2c00 0x7f2b880a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c005fd0 tx=0x7f2b9c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:22.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.508+0000 7f2b95ffb640 1 -- 172.21.15.2:0/1324959675 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b9809aed0 con 0x7f2ba010c170 2024-09-12T00:51:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-12T00:51:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3724749674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T00:51:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-12T00:51:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-12T00:51:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-12T00:51:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-12T00:51:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 7]}]': finished 2024-09-12T00:51:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-12T00:51:22.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T00:51:22.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T00:51:22.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-12T00:51:22.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-12T00:51:22.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] up:active 2024-09-12T00:51:22.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T00:51:22.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T00:51:22.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:22 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:51:22.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:22.720+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f2ba0106c50 con 0x7f2ba010c170 2024-09-12T00:51:23.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.062+0000 7f2b95ffb640 1 -- 172.21.15.2:0/1324959675 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f2b9809f1d0 con 0x7f2ba010c170 2024-09-12T00:51:23.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2b880a2c00 msgr2=0x7f2b880a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:23.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2b880a2c00 0x7f2b880a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c005fd0 tx=0x7f2b9c00b390 comp rx=0 tx=0).stop 2024-09-12T00:51:23.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba010c170 msgr2=0x7f2ba019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba010c170 0x7f2ba019cd70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800b970 tx=0x7f2b9800be30 comp rx=0 tx=0).stop 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 shutdown_connections 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2b880a2c00 0x7f2b880a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba010c170 0x7f2ba019cd70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ba0103660 0x7f2ba01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 --2- 172.21.15.2:0/1324959675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba0102d40 0x7f2ba01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.064+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 >> 172.21.15.2:0/1324959675 conn(0x7f2ba00fc7a0 msgr2=0x7f2ba00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.065+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 shutdown_connections 2024-09-12T00:51:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:23.065+0000 7f2ba6abe640 1 -- 172.21.15.2:0/1324959675 wait complete. 2024-09-12T00:51:23.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:23 smithi002 ceph-mon[31210]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T00:51:23.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:23 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1324959675' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T00:51:23.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:23 smithi071 ceph-mon[35276]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T00:51:23.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:23 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1324959675' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T00:51:23.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:23 smithi167 ceph-mon[35234]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T00:51:23.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:23 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1324959675' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T00:51:23.750 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T00:51:23.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T00:51:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:24.368 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:24 smithi002 ceph-mon[31210]: pgmap v282: 97 pgs: 1 activating, 4 peering, 92 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.5 KiB/s wr, 14 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T00:51:24.368 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:24 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1324959675' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T00:51:24.368 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:24 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:51:24.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:24 smithi071 ceph-mon[35276]: pgmap v282: 97 pgs: 1 activating, 4 peering, 92 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.5 KiB/s wr, 14 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T00:51:24.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:24 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1324959675' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T00:51:24.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:24 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:51:24.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 -- 172.21.15.2:0/362490938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c100e20 msgr2=0x7fa51c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:24.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 --2- 172.21.15.2:0/362490938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c100e20 0x7fa51c101200 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009900 tx=0x7fa50c02a480 comp rx=0 tx=0).stop 2024-09-12T00:51:24.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 -- 172.21.15.2:0/362490938 shutdown_connections 2024-09-12T00:51:24.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 --2- 172.21.15.2:0/362490938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa51c102ef0 0x7fa51c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 --2- 172.21.15.2:0/362490938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c102570 0x7fa51c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 --2- 172.21.15.2:0/362490938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c100e20 0x7fa51c101200 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 -- 172.21.15.2:0/362490938 >> 172.21.15.2:0/362490938 conn(0x7fa51c0fc7d0 msgr2=0x7fa51c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 -- 172.21.15.2:0/362490938 shutdown_connections 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 -- 172.21.15.2:0/362490938 wait complete. 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.455+0000 7fa5217c5640 1 Processor -- start 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa5217c5640 1 -- start start 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa5217c5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c100e20 0x7fa51c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa5217c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa51c102570 0x7fa51c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa5217c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c102ef0 0x7fa51c1a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa5217c5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c110f80 con 0x7fa51c102ef0 2024-09-12T00:51:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa5217c5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c110e00 con 0x7fa51c100e20 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa5217c5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c111100 con 0x7fa51c102570 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c102ef0 0x7fa51c1a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c102ef0 0x7fa51c1a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47940/0 (socket says 172.21.15.2:47940) 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3149580870 learned_addr learned my addr 172.21.15.2:0/3149580870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51a7fc640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa51c102570 0x7fa51c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51affd640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c100e20 0x7fa51c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3149580870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa51c102570 msgr2=0x7fa51c199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51b7fe640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa51c102570 0x7fa51c199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3149580870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c100e20 msgr2=0x7fa51c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51b7fe640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c100e20 0x7fa51c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3149580870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c1a4890 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.456+0000 7fa51affd640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c100e20 0x7fa51c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.457+0000 7fa51b7fe640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c102ef0 0x7fa51c1a4350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa51400cce0 tx=0x7fa51400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.457+0000 7fa503fff640 1 -- 172.21.15.2:0/3149580870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51400f450 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.457+0000 7fa503fff640 1 -- 172.21.15.2:0/3149580870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51400fad0 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.457+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c1a4a60 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.457+0000 7fa503fff640 1 -- 172.21.15.2:0/3149580870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514018c10 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.457+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c1a4f70 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.458+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51c101200 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.459+0000 7fa503fff640 1 -- 172.21.15.2:0/3149580870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa51400f5f0 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.460+0000 7fa503fff640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa5040a2c00 0x7fa5040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.460+0000 7fa51affd640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa5040a2c00 0x7fa5040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.460+0000 7fa503fff640 1 -- 172.21.15.2:0/3149580870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa5140cf610 con 0x7fa51c102ef0 2024-09-12T00:51:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.461+0000 7fa51affd640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa5040a2c00 0x7fa5040a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa50c005ab0 tx=0x7fa50c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:24.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.465+0000 7fa503fff640 1 -- 172.21.15.2:0/3149580870 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa514014030 con 0x7fa51c102ef0 2024-09-12T00:51:24.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:24 smithi167 ceph-mon[35234]: pgmap v282: 97 pgs: 1 activating, 4 peering, 92 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.5 KiB/s wr, 14 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T00:51:24.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:24 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1324959675' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T00:51:24.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:24 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.662+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa51c0fe770 con 0x7fa5040a2c00 2024-09-12T00:51:24.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.688+0000 7fa503fff640 1 -- 172.21.15.2:0/3149580870 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa51c0fe770 con 0x7fa5040a2c00 2024-09-12T00:51:24.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa5040a2c00 msgr2=0x7fa5040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa5040a2c00 0x7fa5040a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa50c005ab0 tx=0x7fa50c005a20 comp rx=0 tx=0).stop 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c102ef0 msgr2=0x7fa51c1a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c102ef0 0x7fa51c1a4350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa51400cce0 tx=0x7fa51400a620 comp rx=0 tx=0).stop 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 shutdown_connections 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa5040a2c00 0x7fa5040a50c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa51c102ef0 0x7fa51c1a4350 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa51c102570 0x7fa51c199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 --2- 172.21.15.2:0/3149580870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c100e20 0x7fa51c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.690+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 >> 172.21.15.2:0/3149580870 conn(0x7fa51c0fc7d0 msgr2=0x7fa51c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.691+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 shutdown_connections 2024-09-12T00:51:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:24.691+0000 7fa5217c5640 1 -- 172.21.15.2:0/3149580870 wait complete. 2024-09-12T00:51:24.994 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:51:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:51:24.668+0000 7fb5278ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:51:24.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:51:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:51:24.668+0000 7fb5278ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:51:24.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:51:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:51:24.668+0000 7fb5278ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:51:24.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:51:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:51:24.668+0000 7fb5278ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:51:24.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:51:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:51:24.668+0000 7fb5278ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:51:25.364 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:25 smithi002 ceph-mon[31210]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:25.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T00:51:25.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:25 smithi071 ceph-mon[35276]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:25.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:25 smithi167 ceph-mon[35234]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:25.653 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 -- 172.21.15.2:0/3435720901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102570 msgr2=0x7fa1941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/3435720901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102570 0x7fa1941029b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa188009900 tx=0x7fa18802a480 comp rx=0 tx=0).stop 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 -- 172.21.15.2:0/3435720901 shutdown_connections 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/3435720901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa194102ef0 0x7fa19410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/3435720901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102570 0x7fa1941029b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/3435720901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa194100e20 0x7fa194101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 -- 172.21.15.2:0/3435720901 >> 172.21.15.2:0/3435720901 conn(0x7fa1940fc7d0 msgr2=0x7fa1940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 -- 172.21.15.2:0/3435720901 shutdown_connections 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 -- 172.21.15.2:0/3435720901 wait complete. 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.106+0000 7fa19a9d4640 1 Processor -- start 2024-09-12T00:51:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa19a9d4640 1 -- start start 2024-09-12T00:51:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa19a9d4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa194100e20 0x7fa194198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa19a9d4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa194102570 0x7fa194198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa19a9d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102ef0 0x7fa19419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa19a9d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa194111020 con 0x7fa194102ef0 2024-09-12T00:51:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa19a9d4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa194110ea0 con 0x7fa194100e20 2024-09-12T00:51:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa19a9d4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa1941111a0 con 0x7fa194102570 2024-09-12T00:51:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa198f71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102ef0 0x7fa19419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa198f71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102ef0 0x7fa19419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50894/0 (socket says 172.21.15.2:50894) 2024-09-12T00:51:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa198f71640 1 -- 172.21.15.2:0/130258449 learned_addr learned my addr 172.21.15.2:0/130258449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa193fff640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa194100e20 0x7fa194198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa1937fe640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa194102570 0x7fa194198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa198f71640 1 -- 172.21.15.2:0/130258449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa194102570 msgr2=0x7fa194198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa198f71640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa194102570 0x7fa194198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa198f71640 1 -- 172.21.15.2:0/130258449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa194100e20 msgr2=0x7fa194198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa198f71640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa194100e20 0x7fa194198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.107+0000 7fa198f71640 1 -- 172.21.15.2:0/130258449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19419d620 con 0x7fa194102ef0 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.108+0000 7fa198f71640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102ef0 0x7fa19419cf40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00b970 tx=0x7fa18c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.108+0000 7fa1917fa640 1 -- 172.21.15.2:0/130258449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c019070 con 0x7fa194102ef0 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.108+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19419d910 con 0x7fa194102ef0 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.108+0000 7fa1917fa640 1 -- 172.21.15.2:0/130258449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa18c014440 con 0x7fa194102ef0 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.108+0000 7fa1917fa640 1 -- 172.21.15.2:0/130258449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0075d0 con 0x7fa194102ef0 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.108+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1941a51f0 con 0x7fa194102ef0 2024-09-12T00:51:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.109+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa194101280 con 0x7fa194102ef0 2024-09-12T00:51:26.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.110+0000 7fa1917fa640 1 -- 172.21.15.2:0/130258449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fa18c01c070 con 0x7fa194102ef0 2024-09-12T00:51:26.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.111+0000 7fa1917fa640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa17c0a2c10 0x7fa17c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.111+0000 7fa193fff640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa17c0a2c10 0x7fa17c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.111+0000 7fa1917fa640 1 -- 172.21.15.2:0/130258449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa18c0cebe0 con 0x7fa194102ef0 2024-09-12T00:51:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.111+0000 7fa193fff640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa17c0a2c10 0x7fa17c0a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa184009990 tx=0x7fa184009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.114+0000 7fa1917fa640 1 -- 172.21.15.2:0/130258449 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa18c09bad0 con 0x7fa194102ef0 2024-09-12T00:51:26.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.314+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa194106f10 con 0x7fa17c0a2c10 2024-09-12T00:51:26.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.339+0000 7fa1917fa640 1 -- 172.21.15.2:0/130258449 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa194106f10 con 0x7fa17c0a2c10 2024-09-12T00:51:26.339 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:26 smithi002 ceph-mon[31210]: pgmap v283: 97 pgs: 1 activating, 4 peering, 92 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T00:51:26.339 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:26 smithi002 ceph-mon[31210]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T00:51:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa17c0a2c10 msgr2=0x7fa17c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa17c0a2c10 0x7fa17c0a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa184009990 tx=0x7fa184009110 comp rx=0 tx=0).stop 2024-09-12T00:51:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102ef0 msgr2=0x7fa19419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102ef0 0x7fa19419cf40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00b970 tx=0x7fa18c00bd70 comp rx=0 tx=0).stop 2024-09-12T00:51:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 shutdown_connections 2024-09-12T00:51:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa17c0a2c10 0x7fa17c0a50d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa194102ef0 0x7fa19419cf40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa194102570 0x7fa194198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 --2- 172.21.15.2:0/130258449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa194100e20 0x7fa194198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 >> 172.21.15.2:0/130258449 conn(0x7fa1940fc7d0 msgr2=0x7fa194069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 shutdown_connections 2024-09-12T00:51:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:26.341+0000 7fa19a9d4640 1 -- 172.21.15.2:0/130258449 wait complete. 2024-09-12T00:51:26.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:26 smithi071 ceph-mon[35276]: pgmap v283: 97 pgs: 1 activating, 4 peering, 92 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T00:51:26.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:26 smithi071 ceph-mon[35276]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T00:51:26.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:26 smithi167 ceph-mon[35234]: pgmap v283: 97 pgs: 1 activating, 4 peering, 92 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T00:51:26.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:26 smithi167 ceph-mon[35234]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T00:51:27.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T00:51:27.275 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:27 smithi002 ceph-mon[31210]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:27.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:27 smithi071 ceph-mon[35276]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:27.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:27 smithi167 ceph-mon[35234]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:27.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 -- 172.21.15.2:0/2452694666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c100a80 msgr2=0x7f737c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:27.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 --2- 172.21.15.2:0/2452694666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c100a80 0x7f737c100ee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7370009930 tx=0x7f737002a420 comp rx=0 tx=0).stop 2024-09-12T00:51:27.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 -- 172.21.15.2:0/2452694666 shutdown_connections 2024-09-12T00:51:27.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 --2- 172.21.15.2:0/2452694666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f737c101420 0x7f737c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 --2- 172.21.15.2:0/2452694666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c100a80 0x7f737c100ee0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 --2- 172.21.15.2:0/2452694666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f737c106a80 0x7f737c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 -- 172.21.15.2:0/2452694666 >> 172.21.15.2:0/2452694666 conn(0x7f737c0fc7a0 msgr2=0x7f737c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 -- 172.21.15.2:0/2452694666 shutdown_connections 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 -- 172.21.15.2:0/2452694666 wait complete. 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 Processor -- start 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.770+0000 7f73835ca640 1 -- start start 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f73835ca640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f737c100a80 0x7f737c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f73835ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c101420 0x7f737c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f73835ca640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f737c106a80 0x7f737c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f73835ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f737c110ea0 con 0x7f737c101420 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f73835ca640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f737c110d20 con 0x7f737c106a80 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f73835ca640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f737c111020 con 0x7f737c100a80 2024-09-12T00:51:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c101420 0x7f737c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c101420 0x7f737c198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50914/0 (socket says 172.21.15.2:50914) 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 -- 172.21.15.2:0/2275757471 learned_addr learned my addr 172.21.15.2:0/2275757471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7381366640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f737c100a80 0x7f737c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7381b67640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f737c106a80 0x7f737c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 -- 172.21.15.2:0/2275757471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f737c100a80 msgr2=0x7f737c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f737c100a80 0x7f737c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 -- 172.21.15.2:0/2275757471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f737c106a80 msgr2=0x7f737c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f737c106a80 0x7f737c19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 -- 172.21.15.2:0/2275757471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c19d470 con 0x7f737c101420 2024-09-12T00:51:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7381b67640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f737c106a80 0x7f737c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:27.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f7380b65640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c101420 0x7f737c198a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7370009a50 tx=0x7f7370004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:27.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f737a7fc640 1 -- 172.21.15.2:0/2275757471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737003f030 con 0x7f737c101420 2024-09-12T00:51:27.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f737a7fc640 1 -- 172.21.15.2:0/2275757471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7370003ce0 con 0x7f737c101420 2024-09-12T00:51:27.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.771+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c19d700 con 0x7f737c101420 2024-09-12T00:51:27.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.772+0000 7f737a7fc640 1 -- 172.21.15.2:0/2275757471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370035070 con 0x7f737c101420 2024-09-12T00:51:27.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.772+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c1a5040 con 0x7f737c101420 2024-09-12T00:51:27.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.772+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737c1021c0 con 0x7f737c101420 2024-09-12T00:51:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.774+0000 7f737a7fc640 1 -- 172.21.15.2:0/2275757471 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7370042030 con 0x7f737c101420 2024-09-12T00:51:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.774+0000 7f737a7fc640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f73640a2c10 0x7f73640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.775+0000 7f7381366640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f73640a2c10 0x7f73640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.775+0000 7f737a7fc640 1 -- 172.21.15.2:0/2275757471 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f73700efc90 con 0x7f737c101420 2024-09-12T00:51:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.775+0000 7f7381366640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f73640a2c10 0x7f73640a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f736c009890 tx=0x7f736c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.778+0000 7f737a7fc640 1 -- 172.21.15.2:0/2275757471 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73700bca70 con 0x7f737c101420 2024-09-12T00:51:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.980+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f737c062630 con 0x7f73640a2c10 2024-09-12T00:51:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.985+0000 7f737a7fc640 1 -- 172.21.15.2:0/2275757471 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f737c062630 con 0x7f73640a2c10 2024-09-12T00:51:27.985 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_0/2759cb4f-9a0a-41ab-b40e-4b604bca2e8d 2024-09-12T00:51:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.987+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f73640a2c10 msgr2=0x7f73640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.987+0000 7f73835ca640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f73640a2c10 0x7f73640a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f736c009890 tx=0x7f736c008040 comp rx=0 tx=0).stop 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.987+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c101420 msgr2=0x7f737c198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.987+0000 7f73835ca640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c101420 0x7f737c198a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7370009a50 tx=0x7f7370004270 comp rx=0 tx=0).stop 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.988+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 shutdown_connections 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.988+0000 7f73835ca640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f73640a2c10 0x7f73640a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.988+0000 7f73835ca640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f737c106a80 0x7f737c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.988+0000 7f73835ca640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f737c101420 0x7f737c198a00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.988+0000 7f73835ca640 1 --2- 172.21.15.2:0/2275757471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f737c100a80 0x7f737c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.988+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 >> 172.21.15.2:0/2275757471 conn(0x7f737c0fc7a0 msgr2=0x7f737c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.988+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 shutdown_connections 2024-09-12T00:51:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:27.988+0000 7f73835ca640 1 -- 172.21.15.2:0/2275757471 wait complete. 2024-09-12T00:51:28.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:28 smithi002 ceph-mon[31210]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 KiB/s wr, 17 op/s; 86 B/s, 1 objects/s recovering 2024-09-12T00:51:28.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:28 smithi071 ceph-mon[35276]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 KiB/s wr, 17 op/s; 86 B/s, 1 objects/s recovering 2024-09-12T00:51:28.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:28 smithi167 ceph-mon[35234]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 KiB/s wr, 17 op/s; 86 B/s, 1 objects/s recovering 2024-09-12T00:51:28.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T00:51:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:29.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:29 smithi002 ceph-mon[31210]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 -- 172.21.15.2:0/2071785815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 msgr2=0x7f42b810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 --2- 172.21.15.2:0/2071785815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 0x7f42b810e610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009ca0 tx=0x7f42b002a950 comp rx=0 tx=0).stop 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 -- 172.21.15.2:0/2071785815 shutdown_connections 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 --2- 172.21.15.2:0/2071785815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 0x7f42b810e610 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 --2- 172.21.15.2:0/2071785815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8103660 0x7f42b810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 --2- 172.21.15.2:0/2071785815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42b8102d40 0x7f42b8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 -- 172.21.15.2:0/2071785815 >> 172.21.15.2:0/2071785815 conn(0x7f42b80fc7a0 msgr2=0x7f42b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 -- 172.21.15.2:0/2071785815 shutdown_connections 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.277+0000 7f42bc814640 1 -- 172.21.15.2:0/2071785815 wait complete. 2024-09-12T00:51:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42bc814640 1 Processor -- start 2024-09-12T00:51:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42bc814640 1 -- start start 2024-09-12T00:51:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42bc814640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8102d40 0x7f42b8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42bc814640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42b8103660 0x7f42b8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42bc814640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 0x7f42b819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42bc814640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8111f70 con 0x7f42b810c170 2024-09-12T00:51:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42bc814640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8111df0 con 0x7f42b8102d40 2024-09-12T00:51:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42bc814640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42b81120f0 con 0x7f42b8103660 2024-09-12T00:51:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 0x7f42b819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 0x7f42b819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50940/0 (socket says 172.21.15.2:50940) 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b6d9d640 1 -- 172.21.15.2:0/2712322657 learned_addr learned my addr 172.21.15.2:0/2712322657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b5d9b640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42b8103660 0x7f42b8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b659c640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8102d40 0x7f42b8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b6d9d640 1 -- 172.21.15.2:0/2712322657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42b8103660 msgr2=0x7f42b8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b6d9d640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42b8103660 0x7f42b8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b6d9d640 1 -- 172.21.15.2:0/2712322657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8102d40 msgr2=0x7f42b8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b6d9d640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8102d40 0x7f42b8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b6d9d640 1 -- 172.21.15.2:0/2712322657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b819d3c0 con 0x7f42b810c170 2024-09-12T00:51:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.278+0000 7f42b5d9b640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42b8103660 0x7f42b8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.279+0000 7f42b6d9d640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 0x7f42b819cce0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f42b0004af0 tx=0x7f42b002f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.279+0000 7f42a77fe640 1 -- 172.21.15.2:0/2712322657 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0034040 con 0x7f42b810c170 2024-09-12T00:51:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.279+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b819d650 con 0x7f42b810c170 2024-09-12T00:51:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.279+0000 7f42a77fe640 1 -- 172.21.15.2:0/2712322657 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42b0030920 con 0x7f42b810c170 2024-09-12T00:51:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.279+0000 7f42a77fe640 1 -- 172.21.15.2:0/2712322657 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0004670 con 0x7f42b810c170 2024-09-12T00:51:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.279+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b81008d0 con 0x7f42b810c170 2024-09-12T00:51:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.280+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b806b070 con 0x7f42b810c170 2024-09-12T00:51:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.281+0000 7f42a77fe640 1 -- 172.21.15.2:0/2712322657 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f42b0037020 con 0x7f42b810c170 2024-09-12T00:51:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.282+0000 7f42a77fe640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f42a00a2c10 0x7f42a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.282+0000 7f42b659c640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f42a00a2c10 0x7f42a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.282+0000 7f42a77fe640 1 -- 172.21.15.2:0/2712322657 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f42b00eff30 con 0x7f42b810c170 2024-09-12T00:51:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.282+0000 7f42b659c640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f42a00a2c10 0x7f42a00a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009b60 tx=0x7f42a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.286+0000 7f42a77fe640 1 -- 172.21.15.2:0/2712322657 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42b00bcdc0 con 0x7f42b810c170 2024-09-12T00:51:29.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:29 smithi071 ceph-mon[35276]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.486+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f42b81997d0 con 0x7f42a00a2c10 2024-09-12T00:51:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.511+0000 7f42a77fe640 1 -- 172.21.15.2:0/2712322657 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f42b81997d0 con 0x7f42a00a2c10 2024-09-12T00:51:29.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f42a00a2c10 msgr2=0x7f42a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:29.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f42a00a2c10 0x7f42a00a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009b60 tx=0x7f42a8005f90 comp rx=0 tx=0).stop 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 msgr2=0x7f42b819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 0x7f42b819cce0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f42b0004af0 tx=0x7f42b002f3a0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 shutdown_connections 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f42a00a2c10 0x7f42a00a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42b810c170 0x7f42b819cce0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42b8103660 0x7f42b8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 --2- 172.21.15.2:0/2712322657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8102d40 0x7f42b8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 >> 172.21.15.2:0/2712322657 conn(0x7f42b80fc7a0 msgr2=0x7f42b80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 shutdown_connections 2024-09-12T00:51:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:29.513+0000 7f42bc814640 1 -- 172.21.15.2:0/2712322657 wait complete. 2024-09-12T00:51:29.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:29 smithi167 ceph-mon[35234]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:30.136 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:30 smithi002 ceph-mon[31210]: pgmap v285: 97 pgs: 97 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 13 op/s; 86 B/s, 1 objects/s recovering 2024-09-12T00:51:30.136 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:30 smithi002 ceph-mon[31210]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:30.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T00:51:30.422 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:30.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:30 smithi071 ceph-mon[35276]: pgmap v285: 97 pgs: 97 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 13 op/s; 86 B/s, 1 objects/s recovering 2024-09-12T00:51:30.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:30 smithi071 ceph-mon[35276]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:30.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:30 smithi167 ceph-mon[35234]: pgmap v285: 97 pgs: 97 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 13 op/s; 86 B/s, 1 objects/s recovering 2024-09-12T00:51:30.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:30 smithi167 ceph-mon[35234]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:30.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 -- 172.21.15.2:0/599896069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c102d30 msgr2=0x7f366c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 --2- 172.21.15.2:0/599896069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c102d30 0x7f366c103110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f365c009cd0 tx=0x7f365c02a910 comp rx=0 tx=0).stop 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 -- 172.21.15.2:0/599896069 shutdown_connections 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 --2- 172.21.15.2:0/599896069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c1082a0 0x7f366c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 --2- 172.21.15.2:0/599896069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f366c1036e0 0x7f366c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 --2- 172.21.15.2:0/599896069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c102d30 0x7f366c103110 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 -- 172.21.15.2:0/599896069 >> 172.21.15.2:0/599896069 conn(0x7f366c0fc7d0 msgr2=0x7f366c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 -- 172.21.15.2:0/599896069 shutdown_connections 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 -- 172.21.15.2:0/599896069 wait complete. 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.856+0000 7f3671aeb640 1 Processor -- start 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f3671aeb640 1 -- start start 2024-09-12T00:51:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f3671aeb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f366c102d30 0x7f366c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f3671aeb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c1036e0 0x7f366c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f3671aeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c1082a0 0x7f366c19cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f3671aeb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f366c112160 con 0x7f366c1082a0 2024-09-12T00:51:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f3671aeb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f366c111fe0 con 0x7f366c102d30 2024-09-12T00:51:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f3671aeb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1122e0 con 0x7f366c1036e0 2024-09-12T00:51:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c1082a0 0x7f366c19cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c1082a0 0x7f366c19cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50962/0 (socket says 172.21.15.2:50962) 2024-09-12T00:51:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 -- 172.21.15.2:0/1599174303 learned_addr learned my addr 172.21.15.2:0/1599174303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366affd640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c1036e0 0x7f366c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366b7fe640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f366c102d30 0x7f366c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 -- 172.21.15.2:0/1599174303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c1036e0 msgr2=0x7f366c198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c1036e0 0x7f366c198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 -- 172.21.15.2:0/1599174303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f366c102d30 msgr2=0x7f366c198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f366c102d30 0x7f366c198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 -- 172.21.15.2:0/1599174303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c19d6d0 con 0x7f366c1082a0 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366affd640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c1036e0 0x7f366c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366b7fe640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f366c102d30 0x7f366c198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.857+0000 7f366bfff640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c1082a0 0x7f366c19cff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3664009fd0 tx=0x7f366400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.858+0000 7f3668ff9640 1 -- 172.21.15.2:0/1599174303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664011830 con 0x7f366c1082a0 2024-09-12T00:51:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.858+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c19d9c0 con 0x7f366c1082a0 2024-09-12T00:51:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.858+0000 7f3668ff9640 1 -- 172.21.15.2:0/1599174303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3664016070 con 0x7f366c1082a0 2024-09-12T00:51:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.858+0000 7f3668ff9640 1 -- 172.21.15.2:0/1599174303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366400f2e0 con 0x7f366c1082a0 2024-09-12T00:51:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.858+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c1a52a0 con 0x7f366c1082a0 2024-09-12T00:51:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.859+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366c06a850 con 0x7f366c1082a0 2024-09-12T00:51:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.860+0000 7f3668ff9640 1 -- 172.21.15.2:0/1599174303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f36640119d0 con 0x7f366c1082a0 2024-09-12T00:51:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.861+0000 7f3668ff9640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36580a2c10 0x7f36580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.861+0000 7f366b7fe640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36580a2c10 0x7f36580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.861+0000 7f3668ff9640 1 -- 172.21.15.2:0/1599174303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f36640ceee0 con 0x7f366c1082a0 2024-09-12T00:51:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.861+0000 7f366b7fe640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36580a2c10 0x7f36580a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f365c000f80 tx=0x7f365c005f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:30.864+0000 7f3668ff9640 1 -- 172.21.15.2:0/1599174303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f366409bdd0 con 0x7f366c1082a0 2024-09-12T00:51:31.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.066+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f366c10a320 con 0x7f36580a2c10 2024-09-12T00:51:31.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.070+0000 7f3668ff9640 1 -- 172.21.15.2:0/1599174303 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f365c036050 con 0x7f36580a2c10 2024-09-12T00:51:31.070 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_1/ebe3e7ee-7918-4d89-bd93-a3a036ffddab 2024-09-12T00:51:31.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36580a2c10 msgr2=0x7f36580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:31.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36580a2c10 0x7f36580a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f365c000f80 tx=0x7f365c005f40 comp rx=0 tx=0).stop 2024-09-12T00:51:31.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c1082a0 msgr2=0x7f366c19cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:31.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c1082a0 0x7f366c19cff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3664009fd0 tx=0x7f366400b8e0 comp rx=0 tx=0).stop 2024-09-12T00:51:31.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 shutdown_connections 2024-09-12T00:51:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f36580a2c10 0x7f36580a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f366c1082a0 0x7f366c19cff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c1036e0 0x7f366c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 --2- 172.21.15.2:0/1599174303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f366c102d30 0x7f366c198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 >> 172.21.15.2:0/1599174303 conn(0x7f366c0fc7d0 msgr2=0x7f366c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 shutdown_connections 2024-09-12T00:51:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:31.072+0000 7f3671aeb640 1 -- 172.21.15.2:0/1599174303 wait complete. 2024-09-12T00:51:31.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:51:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:32.401 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:32 smithi002 ceph-mon[31210]: pgmap v286: 97 pgs: 97 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s; 70 B/s, 1 objects/s recovering 2024-09-12T00:51:32.401 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:32 smithi002 ceph-mon[31210]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:32.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:32 smithi071 ceph-mon[35276]: pgmap v286: 97 pgs: 97 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s; 70 B/s, 1 objects/s recovering 2024-09-12T00:51:32.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:32 smithi071 ceph-mon[35276]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:32 smithi167 ceph-mon[35234]: pgmap v286: 97 pgs: 97 active+clean; 589 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s; 70 B/s, 1 objects/s recovering 2024-09-12T00:51:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:32 smithi167 ceph-mon[35234]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:51:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.547+0000 7fed281ef640 1 -- 172.21.15.2:0/3566218623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 msgr2=0x7fed2010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.547+0000 7fed281ef640 1 --2- 172.21.15.2:0/3566218623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 0x7fed2010df40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fed10009900 tx=0x7fed1002a410 comp rx=0 tx=0).stop 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 -- 172.21.15.2:0/3566218623 shutdown_connections 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 --2- 172.21.15.2:0/3566218623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2010e480 0x7fed20110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 --2- 172.21.15.2:0/3566218623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 0x7fed2010df40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 --2- 172.21.15.2:0/3566218623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed201008d0 0x7fed20100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 -- 172.21.15.2:0/3566218623 >> 172.21.15.2:0/3566218623 conn(0x7fed200fc7a0 msgr2=0x7fed200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 -- 172.21.15.2:0/3566218623 shutdown_connections 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 -- 172.21.15.2:0/3566218623 wait complete. 2024-09-12T00:51:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 Processor -- start 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 -- start start 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.548+0000 7fed281ef640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed201008d0 0x7fed2019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed281ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 0x7fed2019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed281ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2010e480 0x7fed2019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed281ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed20114190 con 0x7fed20101280 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed281ef640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed20114010 con 0x7fed201008d0 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed281ef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed20114310 con 0x7fed2010e480 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 0x7fed2019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 0x7fed2019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50988/0 (socket says 172.21.15.2:50988) 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 -- 172.21.15.2:0/2921878027 learned_addr learned my addr 172.21.15.2:0/2921878027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed25f8b640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed201008d0 0x7fed2019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2678c640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2010e480 0x7fed2019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 -- 172.21.15.2:0/2921878027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2010e480 msgr2=0x7fed2019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2010e480 0x7fed2019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 -- 172.21.15.2:0/2921878027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed201008d0 msgr2=0x7fed2019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed201008d0 0x7fed2019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 -- 172.21.15.2:0/2921878027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2019f5e0 con 0x7fed20101280 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2678c640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2010e480 0x7fed2019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed2578a640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 0x7fed2019ab70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed10006010 tx=0x7fed100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed16ffd640 1 -- 172.21.15.2:0/2921878027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1003f030 con 0x7fed20101280 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed16ffd640 1 -- 172.21.15.2:0/2921878027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed10003ce0 con 0x7fed20101280 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2019f870 con 0x7fed20101280 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed16ffd640 1 -- 172.21.15.2:0/2921878027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10035070 con 0x7fed20101280 2024-09-12T00:51:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.549+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed201a71b0 con 0x7fed20101280 2024-09-12T00:51:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.550+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed20100cb0 con 0x7fed20101280 2024-09-12T00:51:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.551+0000 7fed16ffd640 1 -- 172.21.15.2:0/2921878027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fed10042030 con 0x7fed20101280 2024-09-12T00:51:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.552+0000 7fed16ffd640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fed0c0a2c90 0x7fed0c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.552+0000 7fed25f8b640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fed0c0a2c90 0x7fed0c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.553+0000 7fed16ffd640 1 -- 172.21.15.2:0/2921878027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fed100ef420 con 0x7fed20101280 2024-09-12T00:51:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.553+0000 7fed25f8b640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fed0c0a2c90 0x7fed0c0a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00bbe0 tx=0x7fed1c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.557+0000 7fed16ffd640 1 -- 172.21.15.2:0/2921878027 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed100bc1a0 con 0x7fed20101280 2024-09-12T00:51:32.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.768+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed20109080 con 0x7fed20101280 2024-09-12T00:51:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.769+0000 7fed16ffd640 1 -- 172.21.15.2:0/2921878027 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7fed100bbaa0 con 0x7fed20101280 2024-09-12T00:51:32.769 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:32.769 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"btime":"2024-09-12T00:51:23:057392+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:51:22.721078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:51:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-12T00:51:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fed0c0a2c90 msgr2=0x7fed0c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fed0c0a2c90 0x7fed0c0a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00bbe0 tx=0x7fed1c00b390 comp rx=0 tx=0).stop 2024-09-12T00:51:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 msgr2=0x7fed2019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 0x7fed2019ab70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed10006010 tx=0x7fed100042f0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 shutdown_connections 2024-09-12T00:51:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fed0c0a2c90 0x7fed0c0a5150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2010e480 0x7fed2019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed20101280 0x7fed2019ab70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 --2- 172.21.15.2:0/2921878027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed201008d0 0x7fed2019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 >> 172.21.15.2:0/2921878027 conn(0x7fed200fc7a0 msgr2=0x7fed200feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 shutdown_connections 2024-09-12T00:51:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:32.771+0000 7fed281ef640 1 -- 172.21.15.2:0/2921878027 wait complete. 2024-09-12T00:51:33.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:33 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2921878027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:33.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:33 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2921878027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:33.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:51:33.536 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:33 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2921878027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:51:33.786 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:34.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 -- 172.21.15.2:0/1030689698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 msgr2=0x7ffaa0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:34.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/1030689698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 0x7ffaa0106e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009930 tx=0x7ffa9002a420 comp rx=0 tx=0).stop 2024-09-12T00:51:34.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 -- 172.21.15.2:0/1030689698 shutdown_connections 2024-09-12T00:51:34.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/1030689698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaa0101420 0x7ffaa010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/1030689698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaa0100a80 0x7ffaa0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/1030689698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 0x7ffaa0106e60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 -- 172.21.15.2:0/1030689698 >> 172.21.15.2:0/1030689698 conn(0x7ffaa00fc7a0 msgr2=0x7ffaa00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:34.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 -- 172.21.15.2:0/1030689698 shutdown_connections 2024-09-12T00:51:34.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.221+0000 7ffaa67b7640 1 -- 172.21.15.2:0/1030689698 wait complete. 2024-09-12T00:51:34.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa67b7640 1 Processor -- start 2024-09-12T00:51:34.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa67b7640 1 -- start start 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa67b7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaa0100a80 0x7ffaa01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa67b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaa0101420 0x7ffaa0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa67b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 0x7ffaa019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa67b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0110ea0 con 0x7ffaa0106a80 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa67b7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0110d20 con 0x7ffaa0100a80 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa67b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0111020 con 0x7ffaa0101420 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaa0100a80 0x7ffaa01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa4d54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 0x7ffaa019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:34.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaa0100a80 0x7ffaa01984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:42218/0 (socket says 172.21.15.2:42218) 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffa9ffff640 1 -- 172.21.15.2:0/3258854346 learned_addr learned my addr 172.21.15.2:0/3258854346 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffa9f7fe640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaa0101420 0x7ffaa0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.222+0000 7ffaa4d54640 1 -- 172.21.15.2:0/3258854346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaa0101420 msgr2=0x7ffaa0198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffaa4d54640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaa0101420 0x7ffaa0198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffaa4d54640 1 -- 172.21.15.2:0/3258854346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaa0100a80 msgr2=0x7ffaa01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffaa4d54640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaa0100a80 0x7ffaa01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffaa4d54640 1 -- 172.21.15.2:0/3258854346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa019d470 con 0x7ffaa0106a80 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffa9f7fe640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaa0101420 0x7ffaa0198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:34.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffa9ffff640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaa0100a80 0x7ffaa01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:51:34.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffaa4d54640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 0x7ffaa019cd90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009fd0 tx=0x7ffa9800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:34.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffa9d7fa640 1 -- 172.21.15.2:0/3258854346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800ce20 con 0x7ffaa0106a80 2024-09-12T00:51:34.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffa9d7fa640 1 -- 172.21.15.2:0/3258854346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa98005020 con 0x7ffaa0106a80 2024-09-12T00:51:34.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa019d760 con 0x7ffaa0106a80 2024-09-12T00:51:34.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffa9d7fa640 1 -- 172.21.15.2:0/3258854346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98010720 con 0x7ffaa0106a80 2024-09-12T00:51:34.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.223+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa01a5040 con 0x7ffaa0106a80 2024-09-12T00:51:34.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.224+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa0100ee0 con 0x7ffaa0106a80 2024-09-12T00:51:34.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.225+0000 7ffa9d7fa640 1 -- 172.21.15.2:0/3258854346 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ffa98005540 con 0x7ffaa0106a80 2024-09-12T00:51:34.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.226+0000 7ffa9d7fa640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ffa880a2c10 0x7ffa880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:34.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.226+0000 7ffa9ffff640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ffa880a2c10 0x7ffa880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:34.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.226+0000 7ffa9d7fa640 1 -- 172.21.15.2:0/3258854346 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffa980cfa00 con 0x7ffaa0106a80 2024-09-12T00:51:34.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.227+0000 7ffa9ffff640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ffa880a2c10 0x7ffa880a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa90000c00 tx=0x7ffa90009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:34.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.231+0000 7ffa9d7fa640 1 -- 172.21.15.2:0/3258854346 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa9809c780 con 0x7ffaa0106a80 2024-09-12T00:51:34.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.407+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaa010a060 con 0x7ffaa0106a80 2024-09-12T00:51:34.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.409+0000 7ffa9d7fa640 1 -- 172.21.15.2:0/3258854346 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22708 (secure 0 0 0) 0x7ffa9809c080 con 0x7ffaa0106a80 2024-09-12T00:51:34.409 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:34.409 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:51:22.051895+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ffa880a2c10 msgr2=0x7ffa880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ffa880a2c10 0x7ffa880a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa90000c00 tx=0x7ffa90009560 comp rx=0 tx=0).stop 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 msgr2=0x7ffaa019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 0x7ffaa019cd90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009fd0 tx=0x7ffa9800ef10 comp rx=0 tx=0).stop 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 shutdown_connections 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7ffa880a2c10 0x7ffa880a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa0106a80 0x7ffaa019cd90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaa0101420 0x7ffaa0198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 --2- 172.21.15.2:0/3258854346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaa0100a80 0x7ffaa01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 >> 172.21.15.2:0/3258854346 conn(0x7ffaa00fc7a0 msgr2=0x7ffaa006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 shutdown_connections 2024-09-12T00:51:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:34.411+0000 7ffaa67b7640 1 -- 172.21.15.2:0/3258854346 wait complete. 2024-09-12T00:51:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:34 smithi002 ceph-mon[31210]: pgmap v287: 97 pgs: 97 active+clean; 627 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 KiB/s wr, 11 op/s; 64 B/s, 1 objects/s recovering 2024-09-12T00:51:34.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:34 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3258854346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:34 smithi167 ceph-mon[35234]: pgmap v287: 97 pgs: 97 active+clean; 627 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 KiB/s wr, 11 op/s; 64 B/s, 1 objects/s recovering 2024-09-12T00:51:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:34 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3258854346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:34.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:34 smithi071 ceph-mon[35276]: pgmap v287: 97 pgs: 97 active+clean; 627 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 KiB/s wr, 11 op/s; 64 B/s, 1 objects/s recovering 2024-09-12T00:51:34.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:34 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3258854346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:35.024 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T00:51:35.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T00:51:35.282 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:35.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 -- 172.21.15.2:0/1526391237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec1027a0 msgr2=0x7f12ec1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:35.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 --2- 172.21.15.2:0/1526391237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec1027a0 0x7f12ec1067f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009900 tx=0x7f12d402a410 comp rx=0 tx=0).stop 2024-09-12T00:51:35.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 -- 172.21.15.2:0/1526391237 shutdown_connections 2024-09-12T00:51:35.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 --2- 172.21.15.2:0/1526391237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ec106f20 0x7f12ec10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 --2- 172.21.15.2:0/1526391237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec1027a0 0x7f12ec1067f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 --2- 172.21.15.2:0/1526391237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12ec101df0 0x7f12ec1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 -- 172.21.15.2:0/1526391237 >> 172.21.15.2:0/1526391237 conn(0x7f12ec0fd8f0 msgr2=0x7f12ec0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:35.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 -- 172.21.15.2:0/1526391237 shutdown_connections 2024-09-12T00:51:35.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.745+0000 7f12f0eae640 1 -- 172.21.15.2:0/1526391237 wait complete. 2024-09-12T00:51:35.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12f0eae640 1 Processor -- start 2024-09-12T00:51:35.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12f0eae640 1 -- start start 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12f0eae640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ec101df0 0x7f12ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12f0eae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12ec1027a0 0x7f12ec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12f0eae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec106f20 0x7f12ec074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12f0eae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec111f40 con 0x7f12ec106f20 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12f0eae640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec111dc0 con 0x7f12ec101df0 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12f0eae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec1120c0 con 0x7f12ec1027a0 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec106f20 0x7f12ec074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec106f20 0x7f12ec074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51030/0 (socket says 172.21.15.2:51030) 2024-09-12T00:51:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ead9d640 1 -- 172.21.15.2:0/2399602050 learned_addr learned my addr 172.21.15.2:0/2399602050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ea59c640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ec101df0 0x7f12ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12e9d9b640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12ec1027a0 0x7f12ec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ead9d640 1 -- 172.21.15.2:0/2399602050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12ec1027a0 msgr2=0x7f12ec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ead9d640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12ec1027a0 0x7f12ec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ead9d640 1 -- 172.21.15.2:0/2399602050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ec101df0 msgr2=0x7f12ec0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ead9d640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ec101df0 0x7f12ec0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.746+0000 7f12ead9d640 1 -- 172.21.15.2:0/2399602050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec1a6900 con 0x7f12ec106f20 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.747+0000 7f12ead9d640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec106f20 0x7f12ec074f70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00d750 tx=0x7f12dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.747+0000 7f12e37fe640 1 -- 172.21.15.2:0/2399602050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc017070 con 0x7f12ec106f20 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.747+0000 7f12e37fe640 1 -- 172.21.15.2:0/2399602050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12dc005500 con 0x7f12ec106f20 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.747+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ec1a6bf0 con 0x7f12ec106f20 2024-09-12T00:51:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.747+0000 7f12e37fe640 1 -- 172.21.15.2:0/2399602050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc004d90 con 0x7f12ec106f20 2024-09-12T00:51:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.747+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ec1a7130 con 0x7f12ec106f20 2024-09-12T00:51:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.748+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ec1021d0 con 0x7f12ec106f20 2024-09-12T00:51:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.749+0000 7f12e37fe640 1 -- 172.21.15.2:0/2399602050 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f12dc004f30 con 0x7f12ec106f20 2024-09-12T00:51:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.750+0000 7f12e37fe640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f12d80a2c90 0x7f12d80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.750+0000 7f12e37fe640 1 -- 172.21.15.2:0/2399602050 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f12dc0ceae0 con 0x7f12ec106f20 2024-09-12T00:51:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.750+0000 7f12ea59c640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f12d80a2c90 0x7f12d80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.750+0000 7f12ea59c640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f12d80a2c90 0x7f12d80a5150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12e4007ec0 tx=0x7f12e40075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.754+0000 7f12e37fe640 1 -- 172.21.15.2:0/2399602050 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12dc09b8c0 con 0x7f12ec106f20 2024-09-12T00:51:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.929+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12ec10a170 con 0x7f12d80a2c90 2024-09-12T00:51:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.936+0000 7f12e37fe640 1 -- 172.21.15.2:0/2399602050 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258718 (secure 0 0 0) 0x7f12e4007b10 con 0x7f12d80a2c90 2024-09-12T00:51:35.938 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:51:35.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f12d80a2c90 msgr2=0x7f12d80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f12d80a2c90 0x7f12d80a5150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12e4007ec0 tx=0x7f12e40075b0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec106f20 msgr2=0x7f12ec074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec106f20 0x7f12ec074f70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00d750 tx=0x7f12dc00dc10 comp rx=0 tx=0).stop 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 shutdown_connections 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f12d80a2c90 0x7f12d80a5150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12ec106f20 0x7f12ec074f70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12ec1027a0 0x7f12ec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 --2- 172.21.15.2:0/2399602050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ec101df0 0x7f12ec0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 >> 172.21.15.2:0/2399602050 conn(0x7f12ec0fd8f0 msgr2=0x7f12ec0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.940+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 shutdown_connections 2024-09-12T00:51:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:35.941+0000 7f12f0eae640 1 -- 172.21.15.2:0/2399602050 wait complete. 2024-09-12T00:51:36.717 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:36 smithi002 ceph-mon[31210]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T00:51:36.751 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-12T00:51:34.848882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641800,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":333,"num_write_kb":3033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370020,"kb_used_data":12432,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571804,"statfs":{"total":1151940427776,"available":1151561527296,"internally_reserved":0,"allocated":12730368,"data_stored":7036809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46210,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":81,"num_write":27,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002885"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060010+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:51:22.060010+0000","last_peered":"2024-09-12T00:51:22.060010+0000","last_clean":"2024-09-12T00:51:22.060010+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:51:22.060010+0000","last_undegraded":"2024-09-12T00:51:22.060010+0000","last_fullsized":"2024-09-12T00:51:22.060010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062033+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:51:22.062033+0000","last_peered":"2024-09-12T00:51:22.062033+0000","last_clean":"2024-09-12T00:51:22.062033+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:51:22.062033+0000","last_undegraded":"2024-09-12T00:51:22.062033+0000","last_fullsized":"2024-09-12T00:51:22.062033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062029+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:51:22.062029+0000","last_peered":"2024-09-12T00:51:22.062029+0000","last_clean":"2024-09-12T00:51:22.062029+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:51:22.062029+0000","last_undegraded":"2024-09-12T00:51:22.062029+0000","last_fullsized":"2024-09-12T00:51:22.062029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065039+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:51:22.065039+0000","last_peered":"2024-09-12T00:51:22.065039+0000","last_clean":"2024-09-12T00:51:22.065039+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:51:22.065039+0000","last_undegraded":"2024-09-12T00:51:22.065039+0000","last_fullsized":"2024-09-12T00:51:22.065039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061872+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:51:22.061872+0000","last_peered":"2024-09-12T00:51:22.061872+0000","last_clean":"2024-09-12T00:51:22.061872+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:51:22.061872+0000","last_undegraded":"2024-09-12T00:51:22.061872+0000","last_fullsized":"2024-09-12T00:51:22.061872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063297+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:51:22.063297+0000","last_peered":"2024-09-12T00:51:22.063297+0000","last_clean":"2024-09-12T00:51:22.063297+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:51:22.063297+0000","last_undegraded":"2024-09-12T00:51:22.063297+0000","last_fullsized":"2024-09-12T00:51:22.063297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062840+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:51:22.062840+0000","last_peered":"2024-09-12T00:51:22.062840+0000","last_clean":"2024-09-12T00:51:22.062840+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:51:22.062840+0000","last_undegraded":"2024-09-12T00:51:22.062840+0000","last_fullsized":"2024-09-12T00:51:22.062840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295623+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:51:22.295623+0000","last_peered":"2024-09-12T00:51:22.295623+0000","last_clean":"2024-09-12T00:51:22.295623+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:51:22.295623+0000","last_undegraded":"2024-09-12T00:51:22.295623+0000","last_fullsized":"2024-09-12T00:51:22.295623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179780+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:51:22.179780+0000","last_peered":"2024-09-12T00:51:22.179780+0000","last_clean":"2024-09-12T00:51:22.179780+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:51:22.179780+0000","last_undegraded":"2024-09-12T00:51:22.179780+0000","last_fullsized":"2024-09-12T00:51:22.179780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.066285+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:51:22.066285+0000","last_peered":"2024-09-12T00:51:22.066285+0000","last_clean":"2024-09-12T00:51:22.066285+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:51:22.066285+0000","last_undegraded":"2024-09-12T00:51:22.066285+0000","last_fullsized":"2024-09-12T00:51:22.066285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063530+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:51:22.063530+0000","last_peered":"2024-09-12T00:51:22.063530+0000","last_clean":"2024-09-12T00:51:22.063530+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:51:22.063530+0000","last_undegraded":"2024-09-12T00:51:22.063530+0000","last_fullsized":"2024-09-12T00:51:22.063530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065156+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:51:22.065156+0000","last_peered":"2024-09-12T00:51:22.065156+0000","last_clean":"2024-09-12T00:51:22.065156+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:51:22.065156+0000","last_undegraded":"2024-09-12T00:51:22.065156+0000","last_fullsized":"2024-09-12T00:51:22.065156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065720+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:51:22.065720+0000","last_peered":"2024-09-12T00:51:22.065720+0000","last_clean":"2024-09-12T00:51:22.065720+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:51:22.065720+0000","last_undegraded":"2024-09-12T00:51:22.065720+0000","last_fullsized":"2024-09-12T00:51:22.065720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061730+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:51:22.061730+0000","last_peered":"2024-09-12T00:51:22.061730+0000","last_clean":"2024-09-12T00:51:22.061730+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:51:22.061730+0000","last_undegraded":"2024-09-12T00:51:22.061730+0000","last_fullsized":"2024-09-12T00:51:22.061730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064358+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:51:22.064358+0000","last_peered":"2024-09-12T00:51:22.064358+0000","last_clean":"2024-09-12T00:51:22.064358+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:51:22.064358+0000","last_undegraded":"2024-09-12T00:51:22.064358+0000","last_fullsized":"2024-09-12T00:51:22.064358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179263+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:51:22.179263+0000","last_peered":"2024-09-12T00:51:22.179263+0000","last_clean":"2024-09-12T00:51:22.179263+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:51:22.179263+0000","last_undegraded":"2024-09-12T00:51:22.179263+0000","last_fullsized":"2024-09-12T00:51:22.179263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060068+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:51:22.060068+0000","last_peered":"2024-09-12T00:51:22.060068+0000","last_clean":"2024-09-12T00:51:22.060068+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:51:22.060068+0000","last_undegraded":"2024-09-12T00:51:22.060068+0000","last_fullsized":"2024-09-12T00:51:22.060068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063035+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:51:22.063035+0000","last_peered":"2024-09-12T00:51:22.063035+0000","last_clean":"2024-09-12T00:51:22.063035+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:51:22.063035+0000","last_undegraded":"2024-09-12T00:51:22.063035+0000","last_fullsized":"2024-09-12T00:51:22.063035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062895+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:51:22.062895+0000","last_peered":"2024-09-12T00:51:22.062895+0000","last_clean":"2024-09-12T00:51:22.062895+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:51:22.062895+0000","last_undegraded":"2024-09-12T00:51:22.062895+0000","last_fullsized":"2024-09-12T00:51:22.062895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059895+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:51:22.059895+0000","last_peered":"2024-09-12T00:51:22.059895+0000","last_clean":"2024-09-12T00:51:22.059895+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:51:22.059895+0000","last_undegraded":"2024-09-12T00:51:22.059895+0000","last_fullsized":"2024-09-12T00:51:22.059895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058853+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:51:22.058853+0000","last_peered":"2024-09-12T00:51:22.058853+0000","last_clean":"2024-09-12T00:51:22.058853+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:51:22.058853+0000","last_undegraded":"2024-09-12T00:51:22.058853+0000","last_fullsized":"2024-09-12T00:51:22.058853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179724+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:51:22.179724+0000","last_peered":"2024-09-12T00:51:22.179724+0000","last_clean":"2024-09-12T00:51:22.179724+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:51:22.179724+0000","last_undegraded":"2024-09-12T00:51:22.179724+0000","last_fullsized":"2024-09-12T00:51:22.179724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295696+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:51:22.295696+0000","last_peered":"2024-09-12T00:51:22.295696+0000","last_clean":"2024-09-12T00:51:22.295696+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:51:22.295696+0000","last_undegraded":"2024-09-12T00:51:22.295696+0000","last_fullsized":"2024-09-12T00:51:22.295696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063888+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:51:22.063888+0000","last_peered":"2024-09-12T00:51:22.063888+0000","last_clean":"2024-09-12T00:51:22.063888+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:51:22.063888+0000","last_undegraded":"2024-09-12T00:51:22.063888+0000","last_fullsized":"2024-09-12T00:51:22.063888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296199+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:51:22.296199+0000","last_peered":"2024-09-12T00:51:22.296199+0000","last_clean":"2024-09-12T00:51:22.296199+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:51:22.296199+0000","last_undegraded":"2024-09-12T00:51:22.296199+0000","last_fullsized":"2024-09-12T00:51:22.296199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063171+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:51:22.063171+0000","last_peered":"2024-09-12T00:51:22.063171+0000","last_clean":"2024-09-12T00:51:22.063171+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:51:22.063171+0000","last_undegraded":"2024-09-12T00:51:22.063171+0000","last_fullsized":"2024-09-12T00:51:22.063171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060024+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:51:22.060024+0000","last_peered":"2024-09-12T00:51:22.060024+0000","last_clean":"2024-09-12T00:51:22.060024+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:51:22.060024+0000","last_undegraded":"2024-09-12T00:51:22.060024+0000","last_fullsized":"2024-09-12T00:51:22.060024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058915+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:51:22.058915+0000","last_peered":"2024-09-12T00:51:22.058915+0000","last_clean":"2024-09-12T00:51:22.058915+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:51:22.058915+0000","last_undegraded":"2024-09-12T00:51:22.058915+0000","last_fullsized":"2024-09-12T00:51:22.058915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061970+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:51:22.061970+0000","last_peered":"2024-09-12T00:51:22.061970+0000","last_clean":"2024-09-12T00:51:22.061970+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:51:22.061970+0000","last_undegraded":"2024-09-12T00:51:22.061970+0000","last_fullsized":"2024-09-12T00:51:22.061970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062523+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:51:22.062523+0000","last_peered":"2024-09-12T00:51:22.062523+0000","last_clean":"2024-09-12T00:51:22.062523+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:51:22.062523+0000","last_undegraded":"2024-09-12T00:51:22.062523+0000","last_fullsized":"2024-09-12T00:51:22.062523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062859+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:51:22.062859+0000","last_peered":"2024-09-12T00:51:22.062859+0000","last_clean":"2024-09-12T00:51:22.062859+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:51:22.062859+0000","last_undegraded":"2024-09-12T00:51:22.062859+0000","last_fullsized":"2024-09-12T00:51:22.062859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059762+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:51:22.059762+0000","last_peered":"2024-09-12T00:51:22.059762+0000","last_clean":"2024-09-12T00:51:22.059762+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:51:22.059762+0000","last_undegraded":"2024-09-12T00:51:22.059762+0000","last_fullsized":"2024-09-12T00:51:22.059762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061604+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:51:22.061604+0000","last_peered":"2024-09-12T00:51:22.061604+0000","last_clean":"2024-09-12T00:51:22.061604+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:51:22.061604+0000","last_undegraded":"2024-09-12T00:51:22.061604+0000","last_fullsized":"2024-09-12T00:51:22.061604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.082782+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:51:30.082782+0000","last_peered":"2024-09-12T00:51:30.082782+0000","last_clean":"2024-09-12T00:51:30.082782+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:51:30.082782+0000","last_undegraded":"2024-09-12T00:51:30.082782+0000","last_fullsized":"2024-09-12T00:51:30.082782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.297202+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:51:22.297202+0000","last_peered":"2024-09-12T00:51:22.297202+0000","last_clean":"2024-09-12T00:51:22.297202+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:51:22.297202+0000","last_undegraded":"2024-09-12T00:51:22.297202+0000","last_fullsized":"2024-09-12T00:51:22.297202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.183506+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:51:22.183506+0000","last_peered":"2024-09-12T00:51:22.183506+0000","last_clean":"2024-09-12T00:51:22.183506+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:51:22.183506+0000","last_undegraded":"2024-09-12T00:51:22.183506+0000","last_fullsized":"2024-09-12T00:51:22.183506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058459+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:51:22.058459+0000","last_peered":"2024-09-12T00:51:22.058459+0000","last_clean":"2024-09-12T00:51:22.058459+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:51:22.058459+0000","last_undegraded":"2024-09-12T00:51:22.058459+0000","last_fullsized":"2024-09-12T00:51:22.058459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295684+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:51:22.295684+0000","last_peered":"2024-09-12T00:51:22.295684+0000","last_clean":"2024-09-12T00:51:22.295684+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:51:22.295684+0000","last_undegraded":"2024-09-12T00:51:22.295684+0000","last_fullsized":"2024-09-12T00:51:22.295684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064178+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:51:22.064178+0000","last_peered":"2024-09-12T00:51:22.064178+0000","last_clean":"2024-09-12T00:51:22.064178+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:51:22.064178+0000","last_undegraded":"2024-09-12T00:51:22.064178+0000","last_fullsized":"2024-09-12T00:51:22.064178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063404+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:51:22.063404+0000","last_peered":"2024-09-12T00:51:22.063404+0000","last_clean":"2024-09-12T00:51:22.063404+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:51:22.063404+0000","last_undegraded":"2024-09-12T00:51:22.063404+0000","last_fullsized":"2024-09-12T00:51:22.063404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.082045+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:51:30.082045+0000","last_peered":"2024-09-12T00:51:30.082045+0000","last_clean":"2024-09-12T00:51:30.082045+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:51:30.082045+0000","last_undegraded":"2024-09-12T00:51:30.082045+0000","last_fullsized":"2024-09-12T00:51:30.082045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179676+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:51:22.179676+0000","last_peered":"2024-09-12T00:51:22.179676+0000","last_clean":"2024-09-12T00:51:22.179676+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:51:22.179676+0000","last_undegraded":"2024-09-12T00:51:22.179676+0000","last_fullsized":"2024-09-12T00:51:22.179676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063816+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:51:22.063816+0000","last_peered":"2024-09-12T00:51:22.063816+0000","last_clean":"2024-09-12T00:51:22.063816+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:51:22.063816+0000","last_undegraded":"2024-09-12T00:51:22.063816+0000","last_fullsized":"2024-09-12T00:51:22.063816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062400+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:51:22.062400+0000","last_peered":"2024-09-12T00:51:22.062400+0000","last_clean":"2024-09-12T00:51:22.062400+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:51:22.062400+0000","last_undegraded":"2024-09-12T00:51:22.062400+0000","last_fullsized":"2024-09-12T00:51:22.062400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064353+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:51:22.064353+0000","last_peered":"2024-09-12T00:51:22.064353+0000","last_clean":"2024-09-12T00:51:22.064353+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:51:22.064353+0000","last_undegraded":"2024-09-12T00:51:22.064353+0000","last_fullsized":"2024-09-12T00:51:22.064353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179421+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:51:22.179421+0000","last_peered":"2024-09-12T00:51:22.179421+0000","last_clean":"2024-09-12T00:51:22.179421+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:51:22.179421+0000","last_undegraded":"2024-09-12T00:51:22.179421+0000","last_fullsized":"2024-09-12T00:51:22.179421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'22","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.122291+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:51:31.122291+0000","last_peered":"2024-09-12T00:51:31.122291+0000","last_clean":"2024-09-12T00:51:31.122291+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:51:31.122291+0000","last_undegraded":"2024-09-12T00:51:31.122291+0000","last_fullsized":"2024-09-12T00:51:31.122291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":52,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061910+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:51:22.061910+0000","last_peered":"2024-09-12T00:51:22.061910+0000","last_clean":"2024-09-12T00:51:22.061910+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:51:22.061910+0000","last_undegraded":"2024-09-12T00:51:22.061910+0000","last_fullsized":"2024-09-12T00:51:22.061910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062859+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:51:22.062859+0000","last_peered":"2024-09-12T00:51:22.062859+0000","last_clean":"2024-09-12T00:51:22.062859+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:51:22.062859+0000","last_undegraded":"2024-09-12T00:51:22.062859+0000","last_fullsized":"2024-09-12T00:51:22.062859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058500+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:51:22.058500+0000","last_peered":"2024-09-12T00:51:22.058500+0000","last_clean":"2024-09-12T00:51:22.058500+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:51:22.058500+0000","last_undegraded":"2024-09-12T00:51:22.058500+0000","last_fullsized":"2024-09-12T00:51:22.058500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064284+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:51:22.064284+0000","last_peered":"2024-09-12T00:51:22.064284+0000","last_clean":"2024-09-12T00:51:22.064284+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:51:22.064284+0000","last_undegraded":"2024-09-12T00:51:22.064284+0000","last_fullsized":"2024-09-12T00:51:22.064284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065694+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:51:22.065694+0000","last_peered":"2024-09-12T00:51:22.065694+0000","last_clean":"2024-09-12T00:51:22.065694+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:51:22.065694+0000","last_undegraded":"2024-09-12T00:51:22.065694+0000","last_fullsized":"2024-09-12T00:51:22.065694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:29.084550+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:51:29.084550+0000","last_peered":"2024-09-12T00:51:29.084550+0000","last_clean":"2024-09-12T00:51:29.084550+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:51:29.084550+0000","last_undegraded":"2024-09-12T00:51:29.084550+0000","last_fullsized":"2024-09-12T00:51:29.084550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063243+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:51:22.063243+0000","last_peered":"2024-09-12T00:51:22.063243+0000","last_clean":"2024-09-12T00:51:22.063243+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:51:22.063243+0000","last_undegraded":"2024-09-12T00:51:22.063243+0000","last_fullsized":"2024-09-12T00:51:22.063243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.082529+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:51:22.082529+0000","last_peered":"2024-09-12T00:51:22.082529+0000","last_clean":"2024-09-12T00:51:22.082529+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:51:22.082529+0000","last_undegraded":"2024-09-12T00:51:22.082529+0000","last_fullsized":"2024-09-12T00:51:22.082529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063885+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:51:22.063885+0000","last_peered":"2024-09-12T00:51:22.063885+0000","last_clean":"2024-09-12T00:51:22.063885+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:51:22.063885+0000","last_undegraded":"2024-09-12T00:51:22.063885+0000","last_fullsized":"2024-09-12T00:51:22.063885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062347+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:51:22.062347+0000","last_peered":"2024-09-12T00:51:22.062347+0000","last_clean":"2024-09-12T00:51:22.062347+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:51:22.062347+0000","last_undegraded":"2024-09-12T00:51:22.062347+0000","last_fullsized":"2024-09-12T00:51:22.062347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060117+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:51:22.060117+0000","last_peered":"2024-09-12T00:51:22.060117+0000","last_clean":"2024-09-12T00:51:22.060117+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:51:22.060117+0000","last_undegraded":"2024-09-12T00:51:22.060117+0000","last_fullsized":"2024-09-12T00:51:22.060117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058717+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:51:22.058717+0000","last_peered":"2024-09-12T00:51:22.058717+0000","last_clean":"2024-09-12T00:51:22.058717+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:51:22.058717+0000","last_undegraded":"2024-09-12T00:51:22.058717+0000","last_fullsized":"2024-09-12T00:51:22.058717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064005+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:51:22.064005+0000","last_peered":"2024-09-12T00:51:22.064005+0000","last_clean":"2024-09-12T00:51:22.064005+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:51:22.064005+0000","last_undegraded":"2024-09-12T00:51:22.064005+0000","last_fullsized":"2024-09-12T00:51:22.064005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064424+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:51:22.064424+0000","last_peered":"2024-09-12T00:51:22.064424+0000","last_clean":"2024-09-12T00:51:22.064424+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:51:22.064424+0000","last_undegraded":"2024-09-12T00:51:22.064424+0000","last_fullsized":"2024-09-12T00:51:22.064424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.067896+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:51:22.067896+0000","last_peered":"2024-09-12T00:51:22.067896+0000","last_clean":"2024-09-12T00:51:22.067896+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:51:22.067896+0000","last_undegraded":"2024-09-12T00:51:22.067896+0000","last_fullsized":"2024-09-12T00:51:22.067896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.072829+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:51:22.072829+0000","last_peered":"2024-09-12T00:51:22.072829+0000","last_clean":"2024-09-12T00:51:22.072829+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:51:22.072829+0000","last_undegraded":"2024-09-12T00:51:22.072829+0000","last_fullsized":"2024-09-12T00:51:22.072829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063612+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:51:22.063612+0000","last_peered":"2024-09-12T00:51:22.063612+0000","last_clean":"2024-09-12T00:51:22.063612+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:51:22.063612+0000","last_undegraded":"2024-09-12T00:51:22.063612+0000","last_fullsized":"2024-09-12T00:51:22.063612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063475+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:51:22.063475+0000","last_peered":"2024-09-12T00:51:22.063475+0000","last_clean":"2024-09-12T00:51:22.063475+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:51:22.063475+0000","last_undegraded":"2024-09-12T00:51:22.063475+0000","last_fullsized":"2024-09-12T00:51:22.063475+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064877+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:51:22.064877+0000","last_peered":"2024-09-12T00:51:22.064877+0000","last_clean":"2024-09-12T00:51:22.064877+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:51:22.064877+0000","last_undegraded":"2024-09-12T00:51:22.064877+0000","last_fullsized":"2024-09-12T00:51:22.064877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295855+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:51:22.295855+0000","last_peered":"2024-09-12T00:51:22.295855+0000","last_clean":"2024-09-12T00:51:22.295855+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:51:22.295855+0000","last_undegraded":"2024-09-12T00:51:22.295855+0000","last_fullsized":"2024-09-12T00:51:22.295855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063383+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:51:22.063383+0000","last_peered":"2024-09-12T00:51:22.063383+0000","last_clean":"2024-09-12T00:51:22.063383+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:51:22.063383+0000","last_undegraded":"2024-09-12T00:51:22.063383+0000","last_fullsized":"2024-09-12T00:51:22.063383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058455+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:51:22.058455+0000","last_peered":"2024-09-12T00:51:22.058455+0000","last_clean":"2024-09-12T00:51:22.058455+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:51:22.058455+0000","last_undegraded":"2024-09-12T00:51:22.058455+0000","last_fullsized":"2024-09-12T00:51:22.058455+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.085053+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:51:30.085053+0000","last_peered":"2024-09-12T00:51:30.085053+0000","last_clean":"2024-09-12T00:51:30.085053+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:51:30.085053+0000","last_undegraded":"2024-09-12T00:51:30.085053+0000","last_fullsized":"2024-09-12T00:51:30.085053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.068072+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:51:22.068072+0000","last_peered":"2024-09-12T00:51:22.068072+0000","last_clean":"2024-09-12T00:51:22.068072+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:51:22.068072+0000","last_undegraded":"2024-09-12T00:51:22.068072+0000","last_fullsized":"2024-09-12T00:51:22.068072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063364+0000","last_change":"2024-09-12T00:51:09.003409+0000","last_active":"2024-09-12T00:51:22.063364+0000","last_peered":"2024-09-12T00:51:22.063364+0000","last_clean":"2024-09-12T00:51:22.063364+0000","last_became_active":"2024-09-12T00:51:09.003073+0000","last_became_peered":"2024-09-12T00:51:09.003073+0000","last_unstale":"2024-09-12T00:51:22.063364+0000","last_undegraded":"2024-09-12T00:51:22.063364+0000","last_fullsized":"2024-09-12T00:51:22.063364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:36.540715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063423+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:51:22.063423+0000","last_peered":"2024-09-12T00:51:22.063423+0000","last_clean":"2024-09-12T00:51:22.063423+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:51:22.063423+0000","last_undegraded":"2024-09-12T00:51:22.063423+0000","last_fullsized":"2024-09-12T00:51:22.063423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063330+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:51:22.063330+0000","last_peered":"2024-09-12T00:51:22.063330+0000","last_clean":"2024-09-12T00:51:22.063330+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:51:22.063330+0000","last_undegraded":"2024-09-12T00:51:22.063330+0000","last_fullsized":"2024-09-12T00:51:22.063330+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065393+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:51:22.065393+0000","last_peered":"2024-09-12T00:51:22.065393+0000","last_clean":"2024-09-12T00:51:22.065393+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:51:22.065393+0000","last_undegraded":"2024-09-12T00:51:22.065393+0000","last_fullsized":"2024-09-12T00:51:22.065393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062116+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:51:22.062116+0000","last_peered":"2024-09-12T00:51:22.062116+0000","last_clean":"2024-09-12T00:51:22.062116+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:51:22.062116+0000","last_undegraded":"2024-09-12T00:51:22.062116+0000","last_fullsized":"2024-09-12T00:51:22.062116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058928+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:51:22.058928+0000","last_peered":"2024-09-12T00:51:22.058928+0000","last_clean":"2024-09-12T00:51:22.058928+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:51:22.058928+0000","last_undegraded":"2024-09-12T00:51:22.058928+0000","last_fullsized":"2024-09-12T00:51:22.058928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.032715+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:51:30.032715+0000","last_peered":"2024-09-12T00:51:30.032715+0000","last_clean":"2024-09-12T00:51:30.032715+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:51:30.032715+0000","last_undegraded":"2024-09-12T00:51:30.032715+0000","last_fullsized":"2024-09-12T00:51:30.032715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296199+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:51:22.296199+0000","last_peered":"2024-09-12T00:51:22.296199+0000","last_clean":"2024-09-12T00:51:22.296199+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:51:22.296199+0000","last_undegraded":"2024-09-12T00:51:22.296199+0000","last_fullsized":"2024-09-12T00:51:22.296199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064366+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:51:22.064366+0000","last_peered":"2024-09-12T00:51:22.064366+0000","last_clean":"2024-09-12T00:51:22.064366+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:51:22.064366+0000","last_undegraded":"2024-09-12T00:51:22.064366+0000","last_fullsized":"2024-09-12T00:51:22.064366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062144+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:51:22.062144+0000","last_peered":"2024-09-12T00:51:22.062144+0000","last_clean":"2024-09-12T00:51:22.062144+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:51:22.062144+0000","last_undegraded":"2024-09-12T00:51:22.062144+0000","last_fullsized":"2024-09-12T00:51:22.062144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179343+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:51:22.179343+0000","last_peered":"2024-09-12T00:51:22.179343+0000","last_clean":"2024-09-12T00:51:22.179343+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:51:22.179343+0000","last_undegraded":"2024-09-12T00:51:22.179343+0000","last_fullsized":"2024-09-12T00:51:22.179343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061520+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:51:22.061520+0000","last_peered":"2024-09-12T00:51:22.061520+0000","last_clean":"2024-09-12T00:51:22.061520+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:51:22.061520+0000","last_undegraded":"2024-09-12T00:51:22.061520+0000","last_fullsized":"2024-09-12T00:51:22.061520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295835+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:51:22.295835+0000","last_peered":"2024-09-12T00:51:22.295835+0000","last_clean":"2024-09-12T00:51:22.295835+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:51:22.295835+0000","last_undegraded":"2024-09-12T00:51:22.295835+0000","last_fullsized":"2024-09-12T00:51:22.295835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059814+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:51:22.059814+0000","last_peered":"2024-09-12T00:51:22.059814+0000","last_clean":"2024-09-12T00:51:22.059814+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:51:22.059814+0000","last_undegraded":"2024-09-12T00:51:22.059814+0000","last_fullsized":"2024-09-12T00:51:22.059814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062964+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:51:22.062964+0000","last_peered":"2024-09-12T00:51:22.062964+0000","last_clean":"2024-09-12T00:51:22.062964+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:51:22.062964+0000","last_undegraded":"2024-09-12T00:51:22.062964+0000","last_fullsized":"2024-09-12T00:51:22.062964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295934+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:51:22.295934+0000","last_peered":"2024-09-12T00:51:22.295934+0000","last_clean":"2024-09-12T00:51:22.295934+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:51:22.295934+0000","last_undegraded":"2024-09-12T00:51:22.295934+0000","last_fullsized":"2024-09-12T00:51:22.295934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.071628+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:51:22.071628+0000","last_peered":"2024-09-12T00:51:22.071628+0000","last_clean":"2024-09-12T00:51:22.071628+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:51:22.071628+0000","last_undegraded":"2024-09-12T00:51:22.071628+0000","last_fullsized":"2024-09-12T00:51:22.071628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063199+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:51:22.063199+0000","last_peered":"2024-09-12T00:51:22.063199+0000","last_clean":"2024-09-12T00:51:22.063199+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:51:22.063199+0000","last_undegraded":"2024-09-12T00:51:22.063199+0000","last_fullsized":"2024-09-12T00:51:22.063199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.180241+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:51:22.180241+0000","last_peered":"2024-09-12T00:51:22.180241+0000","last_clean":"2024-09-12T00:51:22.180241+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:51:22.180241+0000","last_undegraded":"2024-09-12T00:51:22.180241+0000","last_fullsized":"2024-09-12T00:51:22.180241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062042+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:51:22.062042+0000","last_peered":"2024-09-12T00:51:22.062042+0000","last_clean":"2024-09-12T00:51:22.062042+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:51:22.062042+0000","last_undegraded":"2024-09-12T00:51:22.062042+0000","last_fullsized":"2024-09-12T00:51:22.062042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179347+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:51:22.179347+0000","last_peered":"2024-09-12T00:51:22.179347+0000","last_clean":"2024-09-12T00:51:22.179347+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:51:22.179347+0000","last_undegraded":"2024-09-12T00:51:22.179347+0000","last_fullsized":"2024-09-12T00:51:22.179347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062006+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:51:22.062006+0000","last_peered":"2024-09-12T00:51:22.062006+0000","last_clean":"2024-09-12T00:51:22.062006+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:51:22.062006+0000","last_undegraded":"2024-09-12T00:51:22.062006+0000","last_fullsized":"2024-09-12T00:51:22.062006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062364+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:51:22.062364+0000","last_peered":"2024-09-12T00:51:22.062364+0000","last_clean":"2024-09-12T00:51:22.062364+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:51:22.062364+0000","last_undegraded":"2024-09-12T00:51:22.062364+0000","last_fullsized":"2024-09-12T00:51:22.062364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296287+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:51:22.296287+0000","last_peered":"2024-09-12T00:51:22.296287+0000","last_clean":"2024-09-12T00:51:22.296287+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:51:22.296287+0000","last_undegraded":"2024-09-12T00:51:22.296287+0000","last_fullsized":"2024-09-12T00:51:22.296287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296178+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:51:22.296178+0000","last_peered":"2024-09-12T00:51:22.296178+0000","last_clean":"2024-09-12T00:51:22.296178+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:51:22.296178+0000","last_undegraded":"2024-09-12T00:51:22.296178+0000","last_fullsized":"2024-09-12T00:51:22.296178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063503+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:51:22.063503+0000","last_peered":"2024-09-12T00:51:22.063503+0000","last_clean":"2024-09-12T00:51:22.063503+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:51:22.063503+0000","last_undegraded":"2024-09-12T00:51:22.063503+0000","last_fullsized":"2024-09-12T00:51:22.063503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51198,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":86,"num_read_kb":93,"num_write":150,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":142120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612624,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":427967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1060906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972378,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40388,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704764,"statfs":{"total":95995035648,"available":95953678336,"internally_reserved":0,"allocated":905216,"data_stored":428320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201311,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":428123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430244,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1495040,"data_stored":1020448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":427592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1019739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":429116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":427786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":468450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":428863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":42114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:51:36.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T00:51:36.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:36 smithi167 ceph-mon[35234]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T00:51:36.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:36 smithi071 ceph-mon[35276]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T00:51:37.018 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:37.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 -- 172.21.15.2:0/3430717553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec102790 msgr2=0x7fefec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:37.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 --2- 172.21.15.2:0/3430717553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec102790 0x7fefec1067e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009900 tx=0x7fefdc02a410 comp rx=0 tx=0).stop 2024-09-12T00:51:37.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 -- 172.21.15.2:0/3430717553 shutdown_connections 2024-09-12T00:51:37.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 --2- 172.21.15.2:0/3430717553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefec106f10 0x7fefec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 --2- 172.21.15.2:0/3430717553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec102790 0x7fefec1067e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 --2- 172.21.15.2:0/3430717553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefec101de0 0x7fefec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 -- 172.21.15.2:0/3430717553 >> 172.21.15.2:0/3430717553 conn(0x7fefec0fd8c0 msgr2=0x7fefec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 -- 172.21.15.2:0/3430717553 shutdown_connections 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.462+0000 7feff46aa640 1 -- 172.21.15.2:0/3430717553 wait complete. 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff46aa640 1 Processor -- start 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff46aa640 1 -- start start 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff46aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec101de0 0x7fefec19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff46aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefec102790 0x7fefec19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff46aa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefec106f10 0x7fefec19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff46aa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fefec111f70 con 0x7fefec101de0 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff46aa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fefec111df0 con 0x7fefec106f10 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff46aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fefec1120f0 con 0x7fefec102790 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff2446640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec101de0 0x7fefec19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff2446640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec101de0 0x7fefec19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50236/0 (socket says 172.21.15.2:50236) 2024-09-12T00:51:37.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff2446640 1 -- 172.21.15.2:0/3185814193 learned_addr learned my addr 172.21.15.2:0/3185814193 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff1c45640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefec102790 0x7fefec19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.463+0000 7feff2c47640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefec106f10 0x7fefec19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.464+0000 7feff2446640 1 -- 172.21.15.2:0/3185814193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefec102790 msgr2=0x7fefec19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.464+0000 7feff2446640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefec102790 0x7fefec19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.464+0000 7feff2446640 1 -- 172.21.15.2:0/3185814193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefec106f10 msgr2=0x7fefec19efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.464+0000 7feff2446640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefec106f10 0x7fefec19efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.464+0000 7feff2446640 1 -- 172.21.15.2:0/3185814193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec19f6c0 con 0x7fefec101de0 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.464+0000 7feff2446640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec101de0 0x7fefec19a710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fefe800d950 tx=0x7fefe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.465+0000 7fefe37fe640 1 -- 172.21.15.2:0/3185814193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8017070 con 0x7fefec101de0 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.465+0000 7fefe37fe640 1 -- 172.21.15.2:0/3185814193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefe8009c30 con 0x7fefec101de0 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.465+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefec19f9b0 con 0x7fefec101de0 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.465+0000 7fefe37fe640 1 -- 172.21.15.2:0/3185814193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe800f6b0 con 0x7fefec101de0 2024-09-12T00:51:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.465+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec1a7290 con 0x7fefec101de0 2024-09-12T00:51:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.466+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefec1021c0 con 0x7fefec101de0 2024-09-12T00:51:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.467+0000 7fefe37fe640 1 -- 172.21.15.2:0/3185814193 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fefe80109d0 con 0x7fefec101de0 2024-09-12T00:51:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.468+0000 7fefe37fe640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fefd80a2c10 0x7fefd80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.468+0000 7feff1c45640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fefd80a2c10 0x7fefd80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.469+0000 7fefe37fe640 1 -- 172.21.15.2:0/3185814193 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fefe80cedd0 con 0x7fefec101de0 2024-09-12T00:51:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.469+0000 7feff1c45640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fefd80a2c10 0x7fefd80a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009230 tx=0x7fefdc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.473+0000 7fefe37fe640 1 -- 172.21.15.2:0/3185814193 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fefe8009de0 con 0x7fefec101de0 2024-09-12T00:51:37.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.644+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fefec10de60 con 0x7fefd80a2c10 2024-09-12T00:51:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.650+0000 7fefe37fe640 1 -- 172.21.15.2:0/3185814193 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258723 (secure 0 0 0) 0x7fefec10de60 con 0x7fefd80a2c10 2024-09-12T00:51:37.652 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:51:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fefd80a2c10 msgr2=0x7fefd80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fefd80a2c10 0x7fefd80a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009230 tx=0x7fefdc0058d0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec101de0 msgr2=0x7fefec19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec101de0 0x7fefec19a710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fefe800d950 tx=0x7fefe800de10 comp rx=0 tx=0).stop 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 shutdown_connections 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fefd80a2c10 0x7fefd80a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefec106f10 0x7fefec19efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefec102790 0x7fefec19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 --2- 172.21.15.2:0/3185814193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefec101de0 0x7fefec19a710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.654+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 >> 172.21.15.2:0/3185814193 conn(0x7fefec0fd8c0 msgr2=0x7fefec0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.655+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 shutdown_connections 2024-09-12T00:51:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:37.655+0000 7feff46aa640 1 -- 172.21.15.2:0/3185814193 wait complete. 2024-09-12T00:51:37.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:37 smithi002 ceph-mon[31210]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:51:37.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:37 smithi167 ceph-mon[35234]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:51:37.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:37 smithi071 ceph-mon[35276]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:51:38.319 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-12T00:51:36.849359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649952,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":253,"num_read_kb":233,"num_write":336,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370044,"kb_used_data":12456,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571780,"statfs":{"total":1151940427776,"available":1151561502720,"internally_reserved":0,"allocated":12754944,"data_stored":7054020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54362,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002924"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060010+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:51:22.060010+0000","last_peered":"2024-09-12T00:51:22.060010+0000","last_clean":"2024-09-12T00:51:22.060010+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:51:22.060010+0000","last_undegraded":"2024-09-12T00:51:22.060010+0000","last_fullsized":"2024-09-12T00:51:22.060010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062033+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:51:22.062033+0000","last_peered":"2024-09-12T00:51:22.062033+0000","last_clean":"2024-09-12T00:51:22.062033+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:51:22.062033+0000","last_undegraded":"2024-09-12T00:51:22.062033+0000","last_fullsized":"2024-09-12T00:51:22.062033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062029+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:51:22.062029+0000","last_peered":"2024-09-12T00:51:22.062029+0000","last_clean":"2024-09-12T00:51:22.062029+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:51:22.062029+0000","last_undegraded":"2024-09-12T00:51:22.062029+0000","last_fullsized":"2024-09-12T00:51:22.062029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065039+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:51:22.065039+0000","last_peered":"2024-09-12T00:51:22.065039+0000","last_clean":"2024-09-12T00:51:22.065039+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:51:22.065039+0000","last_undegraded":"2024-09-12T00:51:22.065039+0000","last_fullsized":"2024-09-12T00:51:22.065039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061872+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:51:22.061872+0000","last_peered":"2024-09-12T00:51:22.061872+0000","last_clean":"2024-09-12T00:51:22.061872+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:51:22.061872+0000","last_undegraded":"2024-09-12T00:51:22.061872+0000","last_fullsized":"2024-09-12T00:51:22.061872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063297+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:51:22.063297+0000","last_peered":"2024-09-12T00:51:22.063297+0000","last_clean":"2024-09-12T00:51:22.063297+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:51:22.063297+0000","last_undegraded":"2024-09-12T00:51:22.063297+0000","last_fullsized":"2024-09-12T00:51:22.063297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062840+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:51:22.062840+0000","last_peered":"2024-09-12T00:51:22.062840+0000","last_clean":"2024-09-12T00:51:22.062840+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:51:22.062840+0000","last_undegraded":"2024-09-12T00:51:22.062840+0000","last_fullsized":"2024-09-12T00:51:22.062840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295623+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:51:22.295623+0000","last_peered":"2024-09-12T00:51:22.295623+0000","last_clean":"2024-09-12T00:51:22.295623+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:51:22.295623+0000","last_undegraded":"2024-09-12T00:51:22.295623+0000","last_fullsized":"2024-09-12T00:51:22.295623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179780+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:51:22.179780+0000","last_peered":"2024-09-12T00:51:22.179780+0000","last_clean":"2024-09-12T00:51:22.179780+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:51:22.179780+0000","last_undegraded":"2024-09-12T00:51:22.179780+0000","last_fullsized":"2024-09-12T00:51:22.179780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.066285+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:51:22.066285+0000","last_peered":"2024-09-12T00:51:22.066285+0000","last_clean":"2024-09-12T00:51:22.066285+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:51:22.066285+0000","last_undegraded":"2024-09-12T00:51:22.066285+0000","last_fullsized":"2024-09-12T00:51:22.066285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063530+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:51:22.063530+0000","last_peered":"2024-09-12T00:51:22.063530+0000","last_clean":"2024-09-12T00:51:22.063530+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:51:22.063530+0000","last_undegraded":"2024-09-12T00:51:22.063530+0000","last_fullsized":"2024-09-12T00:51:22.063530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065156+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:51:22.065156+0000","last_peered":"2024-09-12T00:51:22.065156+0000","last_clean":"2024-09-12T00:51:22.065156+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:51:22.065156+0000","last_undegraded":"2024-09-12T00:51:22.065156+0000","last_fullsized":"2024-09-12T00:51:22.065156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065720+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:51:22.065720+0000","last_peered":"2024-09-12T00:51:22.065720+0000","last_clean":"2024-09-12T00:51:22.065720+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:51:22.065720+0000","last_undegraded":"2024-09-12T00:51:22.065720+0000","last_fullsized":"2024-09-12T00:51:22.065720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061730+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:51:22.061730+0000","last_peered":"2024-09-12T00:51:22.061730+0000","last_clean":"2024-09-12T00:51:22.061730+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:51:22.061730+0000","last_undegraded":"2024-09-12T00:51:22.061730+0000","last_fullsized":"2024-09-12T00:51:22.061730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064358+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:51:22.064358+0000","last_peered":"2024-09-12T00:51:22.064358+0000","last_clean":"2024-09-12T00:51:22.064358+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:51:22.064358+0000","last_undegraded":"2024-09-12T00:51:22.064358+0000","last_fullsized":"2024-09-12T00:51:22.064358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179263+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:51:22.179263+0000","last_peered":"2024-09-12T00:51:22.179263+0000","last_clean":"2024-09-12T00:51:22.179263+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:51:22.179263+0000","last_undegraded":"2024-09-12T00:51:22.179263+0000","last_fullsized":"2024-09-12T00:51:22.179263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060068+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:51:22.060068+0000","last_peered":"2024-09-12T00:51:22.060068+0000","last_clean":"2024-09-12T00:51:22.060068+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:51:22.060068+0000","last_undegraded":"2024-09-12T00:51:22.060068+0000","last_fullsized":"2024-09-12T00:51:22.060068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063035+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:51:22.063035+0000","last_peered":"2024-09-12T00:51:22.063035+0000","last_clean":"2024-09-12T00:51:22.063035+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:51:22.063035+0000","last_undegraded":"2024-09-12T00:51:22.063035+0000","last_fullsized":"2024-09-12T00:51:22.063035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062895+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:51:22.062895+0000","last_peered":"2024-09-12T00:51:22.062895+0000","last_clean":"2024-09-12T00:51:22.062895+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:51:22.062895+0000","last_undegraded":"2024-09-12T00:51:22.062895+0000","last_fullsized":"2024-09-12T00:51:22.062895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059895+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:51:22.059895+0000","last_peered":"2024-09-12T00:51:22.059895+0000","last_clean":"2024-09-12T00:51:22.059895+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:51:22.059895+0000","last_undegraded":"2024-09-12T00:51:22.059895+0000","last_fullsized":"2024-09-12T00:51:22.059895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058853+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:51:22.058853+0000","last_peered":"2024-09-12T00:51:22.058853+0000","last_clean":"2024-09-12T00:51:22.058853+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:51:22.058853+0000","last_undegraded":"2024-09-12T00:51:22.058853+0000","last_fullsized":"2024-09-12T00:51:22.058853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179724+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:51:22.179724+0000","last_peered":"2024-09-12T00:51:22.179724+0000","last_clean":"2024-09-12T00:51:22.179724+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:51:22.179724+0000","last_undegraded":"2024-09-12T00:51:22.179724+0000","last_fullsized":"2024-09-12T00:51:22.179724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295696+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:51:22.295696+0000","last_peered":"2024-09-12T00:51:22.295696+0000","last_clean":"2024-09-12T00:51:22.295696+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:51:22.295696+0000","last_undegraded":"2024-09-12T00:51:22.295696+0000","last_fullsized":"2024-09-12T00:51:22.295696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063888+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:51:22.063888+0000","last_peered":"2024-09-12T00:51:22.063888+0000","last_clean":"2024-09-12T00:51:22.063888+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:51:22.063888+0000","last_undegraded":"2024-09-12T00:51:22.063888+0000","last_fullsized":"2024-09-12T00:51:22.063888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296199+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:51:22.296199+0000","last_peered":"2024-09-12T00:51:22.296199+0000","last_clean":"2024-09-12T00:51:22.296199+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:51:22.296199+0000","last_undegraded":"2024-09-12T00:51:22.296199+0000","last_fullsized":"2024-09-12T00:51:22.296199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063171+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:51:22.063171+0000","last_peered":"2024-09-12T00:51:22.063171+0000","last_clean":"2024-09-12T00:51:22.063171+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:51:22.063171+0000","last_undegraded":"2024-09-12T00:51:22.063171+0000","last_fullsized":"2024-09-12T00:51:22.063171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060024+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:51:22.060024+0000","last_peered":"2024-09-12T00:51:22.060024+0000","last_clean":"2024-09-12T00:51:22.060024+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:51:22.060024+0000","last_undegraded":"2024-09-12T00:51:22.060024+0000","last_fullsized":"2024-09-12T00:51:22.060024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058915+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:51:22.058915+0000","last_peered":"2024-09-12T00:51:22.058915+0000","last_clean":"2024-09-12T00:51:22.058915+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:51:22.058915+0000","last_undegraded":"2024-09-12T00:51:22.058915+0000","last_fullsized":"2024-09-12T00:51:22.058915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061970+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:51:22.061970+0000","last_peered":"2024-09-12T00:51:22.061970+0000","last_clean":"2024-09-12T00:51:22.061970+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:51:22.061970+0000","last_undegraded":"2024-09-12T00:51:22.061970+0000","last_fullsized":"2024-09-12T00:51:22.061970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062523+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:51:22.062523+0000","last_peered":"2024-09-12T00:51:22.062523+0000","last_clean":"2024-09-12T00:51:22.062523+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:51:22.062523+0000","last_undegraded":"2024-09-12T00:51:22.062523+0000","last_fullsized":"2024-09-12T00:51:22.062523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062859+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:51:22.062859+0000","last_peered":"2024-09-12T00:51:22.062859+0000","last_clean":"2024-09-12T00:51:22.062859+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:51:22.062859+0000","last_undegraded":"2024-09-12T00:51:22.062859+0000","last_fullsized":"2024-09-12T00:51:22.062859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059762+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:51:22.059762+0000","last_peered":"2024-09-12T00:51:22.059762+0000","last_clean":"2024-09-12T00:51:22.059762+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:51:22.059762+0000","last_undegraded":"2024-09-12T00:51:22.059762+0000","last_fullsized":"2024-09-12T00:51:22.059762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061604+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:51:22.061604+0000","last_peered":"2024-09-12T00:51:22.061604+0000","last_clean":"2024-09-12T00:51:22.061604+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:51:22.061604+0000","last_undegraded":"2024-09-12T00:51:22.061604+0000","last_fullsized":"2024-09-12T00:51:22.061604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.090079+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:51:35.090079+0000","last_peered":"2024-09-12T00:51:35.090079+0000","last_clean":"2024-09-12T00:51:35.090079+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:51:35.090079+0000","last_undegraded":"2024-09-12T00:51:35.090079+0000","last_fullsized":"2024-09-12T00:51:35.090079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.297202+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:51:22.297202+0000","last_peered":"2024-09-12T00:51:22.297202+0000","last_clean":"2024-09-12T00:51:22.297202+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:51:22.297202+0000","last_undegraded":"2024-09-12T00:51:22.297202+0000","last_fullsized":"2024-09-12T00:51:22.297202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.183506+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:51:22.183506+0000","last_peered":"2024-09-12T00:51:22.183506+0000","last_clean":"2024-09-12T00:51:22.183506+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:51:22.183506+0000","last_undegraded":"2024-09-12T00:51:22.183506+0000","last_fullsized":"2024-09-12T00:51:22.183506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058459+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:51:22.058459+0000","last_peered":"2024-09-12T00:51:22.058459+0000","last_clean":"2024-09-12T00:51:22.058459+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:51:22.058459+0000","last_undegraded":"2024-09-12T00:51:22.058459+0000","last_fullsized":"2024-09-12T00:51:22.058459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295684+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:51:22.295684+0000","last_peered":"2024-09-12T00:51:22.295684+0000","last_clean":"2024-09-12T00:51:22.295684+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:51:22.295684+0000","last_undegraded":"2024-09-12T00:51:22.295684+0000","last_fullsized":"2024-09-12T00:51:22.295684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064178+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:51:22.064178+0000","last_peered":"2024-09-12T00:51:22.064178+0000","last_clean":"2024-09-12T00:51:22.064178+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:51:22.064178+0000","last_undegraded":"2024-09-12T00:51:22.064178+0000","last_fullsized":"2024-09-12T00:51:22.064178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063404+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:51:22.063404+0000","last_peered":"2024-09-12T00:51:22.063404+0000","last_clean":"2024-09-12T00:51:22.063404+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:51:22.063404+0000","last_undegraded":"2024-09-12T00:51:22.063404+0000","last_fullsized":"2024-09-12T00:51:22.063404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.089419+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:51:35.089419+0000","last_peered":"2024-09-12T00:51:35.089419+0000","last_clean":"2024-09-12T00:51:35.089419+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:51:35.089419+0000","last_undegraded":"2024-09-12T00:51:35.089419+0000","last_fullsized":"2024-09-12T00:51:35.089419+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179676+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:51:22.179676+0000","last_peered":"2024-09-12T00:51:22.179676+0000","last_clean":"2024-09-12T00:51:22.179676+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:51:22.179676+0000","last_undegraded":"2024-09-12T00:51:22.179676+0000","last_fullsized":"2024-09-12T00:51:22.179676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063816+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:51:22.063816+0000","last_peered":"2024-09-12T00:51:22.063816+0000","last_clean":"2024-09-12T00:51:22.063816+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:51:22.063816+0000","last_undegraded":"2024-09-12T00:51:22.063816+0000","last_fullsized":"2024-09-12T00:51:22.063816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062400+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:51:22.062400+0000","last_peered":"2024-09-12T00:51:22.062400+0000","last_clean":"2024-09-12T00:51:22.062400+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:51:22.062400+0000","last_undegraded":"2024-09-12T00:51:22.062400+0000","last_fullsized":"2024-09-12T00:51:22.062400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064353+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:51:22.064353+0000","last_peered":"2024-09-12T00:51:22.064353+0000","last_clean":"2024-09-12T00:51:22.064353+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:51:22.064353+0000","last_undegraded":"2024-09-12T00:51:22.064353+0000","last_fullsized":"2024-09-12T00:51:22.064353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179421+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:51:22.179421+0000","last_peered":"2024-09-12T00:51:22.179421+0000","last_clean":"2024-09-12T00:51:22.179421+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:51:22.179421+0000","last_undegraded":"2024-09-12T00:51:22.179421+0000","last_fullsized":"2024-09-12T00:51:22.179421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.123386+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:51:36.123386+0000","last_peered":"2024-09-12T00:51:36.123386+0000","last_clean":"2024-09-12T00:51:36.123386+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:51:36.123386+0000","last_undegraded":"2024-09-12T00:51:36.123386+0000","last_fullsized":"2024-09-12T00:51:36.123386+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54954,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":63,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061910+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:51:22.061910+0000","last_peered":"2024-09-12T00:51:22.061910+0000","last_clean":"2024-09-12T00:51:22.061910+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:51:22.061910+0000","last_undegraded":"2024-09-12T00:51:22.061910+0000","last_fullsized":"2024-09-12T00:51:22.061910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062859+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:51:22.062859+0000","last_peered":"2024-09-12T00:51:22.062859+0000","last_clean":"2024-09-12T00:51:22.062859+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:51:22.062859+0000","last_undegraded":"2024-09-12T00:51:22.062859+0000","last_fullsized":"2024-09-12T00:51:22.062859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058500+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:51:22.058500+0000","last_peered":"2024-09-12T00:51:22.058500+0000","last_clean":"2024-09-12T00:51:22.058500+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:51:22.058500+0000","last_undegraded":"2024-09-12T00:51:22.058500+0000","last_fullsized":"2024-09-12T00:51:22.058500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064284+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:51:22.064284+0000","last_peered":"2024-09-12T00:51:22.064284+0000","last_clean":"2024-09-12T00:51:22.064284+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:51:22.064284+0000","last_undegraded":"2024-09-12T00:51:22.064284+0000","last_fullsized":"2024-09-12T00:51:22.064284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065694+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:51:22.065694+0000","last_peered":"2024-09-12T00:51:22.065694+0000","last_clean":"2024-09-12T00:51:22.065694+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:51:22.065694+0000","last_undegraded":"2024-09-12T00:51:22.065694+0000","last_fullsized":"2024-09-12T00:51:22.065694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.090217+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:51:34.090217+0000","last_peered":"2024-09-12T00:51:34.090217+0000","last_clean":"2024-09-12T00:51:34.090217+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:51:34.090217+0000","last_undegraded":"2024-09-12T00:51:34.090217+0000","last_fullsized":"2024-09-12T00:51:34.090217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063243+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:51:22.063243+0000","last_peered":"2024-09-12T00:51:22.063243+0000","last_clean":"2024-09-12T00:51:22.063243+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:51:22.063243+0000","last_undegraded":"2024-09-12T00:51:22.063243+0000","last_fullsized":"2024-09-12T00:51:22.063243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.082529+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:51:22.082529+0000","last_peered":"2024-09-12T00:51:22.082529+0000","last_clean":"2024-09-12T00:51:22.082529+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:51:22.082529+0000","last_undegraded":"2024-09-12T00:51:22.082529+0000","last_fullsized":"2024-09-12T00:51:22.082529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063885+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:51:22.063885+0000","last_peered":"2024-09-12T00:51:22.063885+0000","last_clean":"2024-09-12T00:51:22.063885+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:51:22.063885+0000","last_undegraded":"2024-09-12T00:51:22.063885+0000","last_fullsized":"2024-09-12T00:51:22.063885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062347+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:51:22.062347+0000","last_peered":"2024-09-12T00:51:22.062347+0000","last_clean":"2024-09-12T00:51:22.062347+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:51:22.062347+0000","last_undegraded":"2024-09-12T00:51:22.062347+0000","last_fullsized":"2024-09-12T00:51:22.062347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060117+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:51:22.060117+0000","last_peered":"2024-09-12T00:51:22.060117+0000","last_clean":"2024-09-12T00:51:22.060117+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:51:22.060117+0000","last_undegraded":"2024-09-12T00:51:22.060117+0000","last_fullsized":"2024-09-12T00:51:22.060117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058717+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:51:22.058717+0000","last_peered":"2024-09-12T00:51:22.058717+0000","last_clean":"2024-09-12T00:51:22.058717+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:51:22.058717+0000","last_undegraded":"2024-09-12T00:51:22.058717+0000","last_fullsized":"2024-09-12T00:51:22.058717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064005+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:51:22.064005+0000","last_peered":"2024-09-12T00:51:22.064005+0000","last_clean":"2024-09-12T00:51:22.064005+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:51:22.064005+0000","last_undegraded":"2024-09-12T00:51:22.064005+0000","last_fullsized":"2024-09-12T00:51:22.064005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064424+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:51:22.064424+0000","last_peered":"2024-09-12T00:51:22.064424+0000","last_clean":"2024-09-12T00:51:22.064424+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:51:22.064424+0000","last_undegraded":"2024-09-12T00:51:22.064424+0000","last_fullsized":"2024-09-12T00:51:22.064424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.067896+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:51:22.067896+0000","last_peered":"2024-09-12T00:51:22.067896+0000","last_clean":"2024-09-12T00:51:22.067896+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:51:22.067896+0000","last_undegraded":"2024-09-12T00:51:22.067896+0000","last_fullsized":"2024-09-12T00:51:22.067896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.072829+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:51:22.072829+0000","last_peered":"2024-09-12T00:51:22.072829+0000","last_clean":"2024-09-12T00:51:22.072829+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:51:22.072829+0000","last_undegraded":"2024-09-12T00:51:22.072829+0000","last_fullsized":"2024-09-12T00:51:22.072829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063612+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:51:22.063612+0000","last_peered":"2024-09-12T00:51:22.063612+0000","last_clean":"2024-09-12T00:51:22.063612+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:51:22.063612+0000","last_undegraded":"2024-09-12T00:51:22.063612+0000","last_fullsized":"2024-09-12T00:51:22.063612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063475+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:51:22.063475+0000","last_peered":"2024-09-12T00:51:22.063475+0000","last_clean":"2024-09-12T00:51:22.063475+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:51:22.063475+0000","last_undegraded":"2024-09-12T00:51:22.063475+0000","last_fullsized":"2024-09-12T00:51:22.063475+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064877+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:51:22.064877+0000","last_peered":"2024-09-12T00:51:22.064877+0000","last_clean":"2024-09-12T00:51:22.064877+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:51:22.064877+0000","last_undegraded":"2024-09-12T00:51:22.064877+0000","last_fullsized":"2024-09-12T00:51:22.064877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295855+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:51:22.295855+0000","last_peered":"2024-09-12T00:51:22.295855+0000","last_clean":"2024-09-12T00:51:22.295855+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:51:22.295855+0000","last_undegraded":"2024-09-12T00:51:22.295855+0000","last_fullsized":"2024-09-12T00:51:22.295855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063383+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:51:22.063383+0000","last_peered":"2024-09-12T00:51:22.063383+0000","last_clean":"2024-09-12T00:51:22.063383+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:51:22.063383+0000","last_undegraded":"2024-09-12T00:51:22.063383+0000","last_fullsized":"2024-09-12T00:51:22.063383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058455+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:51:22.058455+0000","last_peered":"2024-09-12T00:51:22.058455+0000","last_clean":"2024-09-12T00:51:22.058455+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:51:22.058455+0000","last_undegraded":"2024-09-12T00:51:22.058455+0000","last_fullsized":"2024-09-12T00:51:22.058455+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.090721+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:51:35.090721+0000","last_peered":"2024-09-12T00:51:35.090721+0000","last_clean":"2024-09-12T00:51:35.090721+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:51:35.090721+0000","last_undegraded":"2024-09-12T00:51:35.090721+0000","last_fullsized":"2024-09-12T00:51:35.090721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.068072+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:51:22.068072+0000","last_peered":"2024-09-12T00:51:22.068072+0000","last_clean":"2024-09-12T00:51:22.068072+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:51:22.068072+0000","last_undegraded":"2024-09-12T00:51:22.068072+0000","last_fullsized":"2024-09-12T00:51:22.068072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063364+0000","last_change":"2024-09-12T00:51:09.003409+0000","last_active":"2024-09-12T00:51:22.063364+0000","last_peered":"2024-09-12T00:51:22.063364+0000","last_clean":"2024-09-12T00:51:22.063364+0000","last_became_active":"2024-09-12T00:51:09.003073+0000","last_became_peered":"2024-09-12T00:51:09.003073+0000","last_unstale":"2024-09-12T00:51:22.063364+0000","last_undegraded":"2024-09-12T00:51:22.063364+0000","last_fullsized":"2024-09-12T00:51:22.063364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:36.540715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063423+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:51:22.063423+0000","last_peered":"2024-09-12T00:51:22.063423+0000","last_clean":"2024-09-12T00:51:22.063423+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:51:22.063423+0000","last_undegraded":"2024-09-12T00:51:22.063423+0000","last_fullsized":"2024-09-12T00:51:22.063423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063330+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:51:22.063330+0000","last_peered":"2024-09-12T00:51:22.063330+0000","last_clean":"2024-09-12T00:51:22.063330+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:51:22.063330+0000","last_undegraded":"2024-09-12T00:51:22.063330+0000","last_fullsized":"2024-09-12T00:51:22.063330+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065393+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:51:22.065393+0000","last_peered":"2024-09-12T00:51:22.065393+0000","last_clean":"2024-09-12T00:51:22.065393+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:51:22.065393+0000","last_undegraded":"2024-09-12T00:51:22.065393+0000","last_fullsized":"2024-09-12T00:51:22.065393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062116+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:51:22.062116+0000","last_peered":"2024-09-12T00:51:22.062116+0000","last_clean":"2024-09-12T00:51:22.062116+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:51:22.062116+0000","last_undegraded":"2024-09-12T00:51:22.062116+0000","last_fullsized":"2024-09-12T00:51:22.062116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058928+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:51:22.058928+0000","last_peered":"2024-09-12T00:51:22.058928+0000","last_clean":"2024-09-12T00:51:22.058928+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:51:22.058928+0000","last_undegraded":"2024-09-12T00:51:22.058928+0000","last_fullsized":"2024-09-12T00:51:22.058928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.032715+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:51:30.032715+0000","last_peered":"2024-09-12T00:51:30.032715+0000","last_clean":"2024-09-12T00:51:30.032715+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:51:30.032715+0000","last_undegraded":"2024-09-12T00:51:30.032715+0000","last_fullsized":"2024-09-12T00:51:30.032715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296199+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:51:22.296199+0000","last_peered":"2024-09-12T00:51:22.296199+0000","last_clean":"2024-09-12T00:51:22.296199+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:51:22.296199+0000","last_undegraded":"2024-09-12T00:51:22.296199+0000","last_fullsized":"2024-09-12T00:51:22.296199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064366+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:51:22.064366+0000","last_peered":"2024-09-12T00:51:22.064366+0000","last_clean":"2024-09-12T00:51:22.064366+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:51:22.064366+0000","last_undegraded":"2024-09-12T00:51:22.064366+0000","last_fullsized":"2024-09-12T00:51:22.064366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062144+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:51:22.062144+0000","last_peered":"2024-09-12T00:51:22.062144+0000","last_clean":"2024-09-12T00:51:22.062144+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:51:22.062144+0000","last_undegraded":"2024-09-12T00:51:22.062144+0000","last_fullsized":"2024-09-12T00:51:22.062144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179343+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:51:22.179343+0000","last_peered":"2024-09-12T00:51:22.179343+0000","last_clean":"2024-09-12T00:51:22.179343+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:51:22.179343+0000","last_undegraded":"2024-09-12T00:51:22.179343+0000","last_fullsized":"2024-09-12T00:51:22.179343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061520+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:51:22.061520+0000","last_peered":"2024-09-12T00:51:22.061520+0000","last_clean":"2024-09-12T00:51:22.061520+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:51:22.061520+0000","last_undegraded":"2024-09-12T00:51:22.061520+0000","last_fullsized":"2024-09-12T00:51:22.061520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295835+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:51:22.295835+0000","last_peered":"2024-09-12T00:51:22.295835+0000","last_clean":"2024-09-12T00:51:22.295835+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:51:22.295835+0000","last_undegraded":"2024-09-12T00:51:22.295835+0000","last_fullsized":"2024-09-12T00:51:22.295835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059814+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:51:22.059814+0000","last_peered":"2024-09-12T00:51:22.059814+0000","last_clean":"2024-09-12T00:51:22.059814+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:51:22.059814+0000","last_undegraded":"2024-09-12T00:51:22.059814+0000","last_fullsized":"2024-09-12T00:51:22.059814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062964+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:51:22.062964+0000","last_peered":"2024-09-12T00:51:22.062964+0000","last_clean":"2024-09-12T00:51:22.062964+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:51:22.062964+0000","last_undegraded":"2024-09-12T00:51:22.062964+0000","last_fullsized":"2024-09-12T00:51:22.062964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295934+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:51:22.295934+0000","last_peered":"2024-09-12T00:51:22.295934+0000","last_clean":"2024-09-12T00:51:22.295934+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:51:22.295934+0000","last_undegraded":"2024-09-12T00:51:22.295934+0000","last_fullsized":"2024-09-12T00:51:22.295934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.071628+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:51:22.071628+0000","last_peered":"2024-09-12T00:51:22.071628+0000","last_clean":"2024-09-12T00:51:22.071628+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:51:22.071628+0000","last_undegraded":"2024-09-12T00:51:22.071628+0000","last_fullsized":"2024-09-12T00:51:22.071628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063199+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:51:22.063199+0000","last_peered":"2024-09-12T00:51:22.063199+0000","last_clean":"2024-09-12T00:51:22.063199+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:51:22.063199+0000","last_undegraded":"2024-09-12T00:51:22.063199+0000","last_fullsized":"2024-09-12T00:51:22.063199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.180241+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:51:22.180241+0000","last_peered":"2024-09-12T00:51:22.180241+0000","last_clean":"2024-09-12T00:51:22.180241+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:51:22.180241+0000","last_undegraded":"2024-09-12T00:51:22.180241+0000","last_fullsized":"2024-09-12T00:51:22.180241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062042+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:51:22.062042+0000","last_peered":"2024-09-12T00:51:22.062042+0000","last_clean":"2024-09-12T00:51:22.062042+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:51:22.062042+0000","last_undegraded":"2024-09-12T00:51:22.062042+0000","last_fullsized":"2024-09-12T00:51:22.062042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179347+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:51:22.179347+0000","last_peered":"2024-09-12T00:51:22.179347+0000","last_clean":"2024-09-12T00:51:22.179347+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:51:22.179347+0000","last_undegraded":"2024-09-12T00:51:22.179347+0000","last_fullsized":"2024-09-12T00:51:22.179347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062006+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:51:22.062006+0000","last_peered":"2024-09-12T00:51:22.062006+0000","last_clean":"2024-09-12T00:51:22.062006+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:51:22.062006+0000","last_undegraded":"2024-09-12T00:51:22.062006+0000","last_fullsized":"2024-09-12T00:51:22.062006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062364+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:51:22.062364+0000","last_peered":"2024-09-12T00:51:22.062364+0000","last_clean":"2024-09-12T00:51:22.062364+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:51:22.062364+0000","last_undegraded":"2024-09-12T00:51:22.062364+0000","last_fullsized":"2024-09-12T00:51:22.062364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296287+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:51:22.296287+0000","last_peered":"2024-09-12T00:51:22.296287+0000","last_clean":"2024-09-12T00:51:22.296287+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:51:22.296287+0000","last_undegraded":"2024-09-12T00:51:22.296287+0000","last_fullsized":"2024-09-12T00:51:22.296287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296178+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:51:22.296178+0000","last_peered":"2024-09-12T00:51:22.296178+0000","last_clean":"2024-09-12T00:51:22.296178+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:51:22.296178+0000","last_undegraded":"2024-09-12T00:51:22.296178+0000","last_fullsized":"2024-09-12T00:51:22.296178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063503+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:51:22.063503+0000","last_peered":"2024-09-12T00:51:22.063503+0000","last_clean":"2024-09-12T00:51:22.063503+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:51:22.063503+0000","last_undegraded":"2024-09-12T00:51:22.063503+0000","last_fullsized":"2024-09-12T00:51:22.063503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59350,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":117,"num_read_kb":114,"num_write":153,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":161746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612624,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":427967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1066643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972378,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40388,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704764,"statfs":{"total":95995035648,"available":95953678336,"internally_reserved":0,"allocated":905216,"data_stored":428320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201311,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":428123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1495040,"data_stored":1020448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":427592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1019739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":429116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":427786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":475236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":474187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":428863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":47851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:51:38.323 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T00:51:38.324 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T00:51:38.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T00:51:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:38.702 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:38 smithi002 ceph-mon[31210]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 11 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T00:51:38.702 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:38 smithi002 ceph-mon[31210]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:51:38.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:38 smithi167 ceph-mon[35234]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 11 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T00:51:38.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:38 smithi167 ceph-mon[35234]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:51:38.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:38 smithi071 ceph-mon[35276]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 11 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T00:51:38.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:38 smithi071 ceph-mon[35276]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:51:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 -- 172.21.15.2:0/3753061519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e88101c00 msgr2=0x7f5e88102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 --2- 172.21.15.2:0/3753061519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e88101c00 0x7f5e88102000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009900 tx=0x7f5e7802a410 comp rx=0 tx=0).stop 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 -- 172.21.15.2:0/3753061519 shutdown_connections 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 --2- 172.21.15.2:0/3753061519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e881037c0 0x7f5e8810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 --2- 172.21.15.2:0/3753061519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88102e00 0x7f5e88103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 --2- 172.21.15.2:0/3753061519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e88101c00 0x7f5e88102000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 -- 172.21.15.2:0/3753061519 >> 172.21.15.2:0/3753061519 conn(0x7f5e880fd390 msgr2=0x7f5e880ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 -- 172.21.15.2:0/3753061519 shutdown_connections 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.044+0000 7f5e8e838640 1 -- 172.21.15.2:0/3753061519 wait complete. 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.045+0000 7f5e8e838640 1 Processor -- start 2024-09-12T00:51:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.045+0000 7f5e8e838640 1 -- start start 2024-09-12T00:51:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.045+0000 7f5e8e838640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88101c00 0x7f5e88075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.045+0000 7f5e8e838640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88102e00 0x7f5e880745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.045+0000 7f5e8e838640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e881037c0 0x7f5e88074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.045+0000 7f5e8e838640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8810d860 con 0x7f5e881037c0 2024-09-12T00:51:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.045+0000 7f5e8e838640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8810d6e0 con 0x7f5e88101c00 2024-09-12T00:51:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.045+0000 7f5e8e838640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8810d9e0 con 0x7f5e88102e00 2024-09-12T00:51:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e881037c0 0x7f5e88074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e881037c0 0x7f5e88074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50256/0 (socket says 172.21.15.2:50256) 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 -- 172.21.15.2:0/4230794640 learned_addr learned my addr 172.21.15.2:0/4230794640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e877fe640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88102e00 0x7f5e880745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e87fff640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88101c00 0x7f5e88075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 -- 172.21.15.2:0/4230794640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88102e00 msgr2=0x7f5e880745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88102e00 0x7f5e880745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 -- 172.21.15.2:0/4230794640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88101c00 msgr2=0x7f5e88075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88101c00 0x7f5e88075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 -- 172.21.15.2:0/4230794640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e880753e0 con 0x7f5e881037c0 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8cdd5640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e881037c0 0x7f5e88074b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000eaa0 tx=0x7f5e8000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e857fa640 1 -- 172.21.15.2:0/4230794640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000cdb0 con 0x7f5e881037c0 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e857fa640 1 -- 172.21.15.2:0/4230794640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e80005020 con 0x7f5e881037c0 2024-09-12T00:51:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e881a2090 con 0x7f5e881037c0 2024-09-12T00:51:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e857fa640 1 -- 172.21.15.2:0/4230794640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e800116b0 con 0x7f5e881037c0 2024-09-12T00:51:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.046+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e881a2550 con 0x7f5e881037c0 2024-09-12T00:51:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.047+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e88109000 con 0x7f5e881037c0 2024-09-12T00:51:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.049+0000 7f5e857fa640 1 -- 172.21.15.2:0/4230794640 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5e80005560 con 0x7f5e881037c0 2024-09-12T00:51:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.049+0000 7f5e857fa640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5e700a2c10 0x7f5e700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.049+0000 7f5e87fff640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5e700a2c10 0x7f5e700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.049+0000 7f5e857fa640 1 -- 172.21.15.2:0/4230794640 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5e800cf3c0 con 0x7f5e881037c0 2024-09-12T00:51:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.050+0000 7f5e87fff640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5e700a2c10 0x7f5e700a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e78005ab0 tx=0x7f5e78000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.054+0000 7f5e857fa640 1 -- 172.21.15.2:0/4230794640 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e80016030 con 0x7f5e881037c0 2024-09-12T00:51:39.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.298+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f5e88062df0 con 0x7f5e881037c0 2024-09-12T00:51:39.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.300+0000 7f5e857fa640 1 -- 172.21.15.2:0/4230794640 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f5e8009bb50 con 0x7f5e881037c0 2024-09-12T00:51:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-12T00:51:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAbO+JmGEvkERAAQ7PxtHN9cE1M+HwOXp5LTg== 2024-09-12T00:51:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5e700a2c10 msgr2=0x7f5e700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5e700a2c10 0x7f5e700a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e78005ab0 tx=0x7f5e78000bc0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e881037c0 msgr2=0x7f5e88074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:39.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e881037c0 0x7f5e88074b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000eaa0 tx=0x7f5e8000ef60 comp rx=0 tx=0).stop 2024-09-12T00:51:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 shutdown_connections 2024-09-12T00:51:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5e700a2c10 0x7f5e700a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e881037c0 0x7f5e88074b20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88102e00 0x7f5e880745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 --2- 172.21.15.2:0/4230794640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88101c00 0x7f5e88075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.302+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 >> 172.21.15.2:0/4230794640 conn(0x7f5e880fd390 msgr2=0x7f5e881061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.303+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 shutdown_connections 2024-09-12T00:51:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:39.303+0000 7f5e8e838640 1 -- 172.21.15.2:0/4230794640 wait complete. 2024-09-12T00:51:39.711 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:39 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4230794640' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T00:51:39.711 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:39 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4230794640' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T00:51:39.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:39 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4230794640' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T00:51:39.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:39 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4230794640' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T00:51:39.937 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:51:39.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T00:51:39.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:51:39.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:39 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4230794640' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T00:51:39.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:39 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4230794640' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T00:51:39.978 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:51:39.978 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:51:39.978 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T00:51:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:40.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:40 smithi002 ceph-mon[31210]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-12T00:51:40.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 -- 172.21.15.2:0/285372981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc53010e480 msgr2=0x7fc530110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 --2- 172.21.15.2:0/285372981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc53010e480 0x7fc530110870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc528009ca0 tx=0x7fc52802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 -- 172.21.15.2:0/285372981 shutdown_connections 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 --2- 172.21.15.2:0/285372981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc53010e480 0x7fc530110870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 --2- 172.21.15.2:0/285372981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc530101280 0x7fc53010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 --2- 172.21.15.2:0/285372981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5301008d0 0x7fc530100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 -- 172.21.15.2:0/285372981 >> 172.21.15.2:0/285372981 conn(0x7fc5300fc7a0 msgr2=0x7fc5300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 -- 172.21.15.2:0/285372981 shutdown_connections 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.726+0000 7fc5374b9640 1 -- 172.21.15.2:0/285372981 wait complete. 2024-09-12T00:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.727+0000 7fc5374b9640 1 Processor -- start 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.727+0000 7fc5374b9640 1 -- start start 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.727+0000 7fc5374b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5301008d0 0x7fc53019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.727+0000 7fc5374b9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc530101280 0x7fc53019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.727+0000 7fc5374b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53010e480 0x7fc53019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.727+0000 7fc5374b9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc530114170 con 0x7fc5301008d0 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.727+0000 7fc5374b9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc530113ff0 con 0x7fc530101280 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.727+0000 7fc5374b9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc5301142f0 con 0x7fc53010e480 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5301008d0 0x7fc53019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5301008d0 0x7fc53019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50276/0 (socket says 172.21.15.2:50276) 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 -- 172.21.15.2:0/1451242796 learned_addr learned my addr 172.21.15.2:0/1451242796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535a56640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53010e480 0x7fc53019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc534a54640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc530101280 0x7fc53019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 -- 172.21.15.2:0/1451242796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53010e480 msgr2=0x7fc53019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53010e480 0x7fc53019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 -- 172.21.15.2:0/1451242796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc530101280 msgr2=0x7fc53019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc530101280 0x7fc53019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 -- 172.21.15.2:0/1451242796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53019f620 con 0x7fc5301008d0 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc535255640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5301008d0 0x7fc53019a670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00d770 tx=0x7fc52c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc5267fc640 1 -- 172.21.15.2:0/1451242796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c017070 con 0x7fc5301008d0 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc5267fc640 1 -- 172.21.15.2:0/1451242796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc52c005500 con 0x7fc5301008d0 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc5267fc640 1 -- 172.21.15.2:0/1451242796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c004e00 con 0x7fc5301008d0 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53019f910 con 0x7fc5301008d0 2024-09-12T00:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.728+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5301a71f0 con 0x7fc5301008d0 2024-09-12T00:51:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.729+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc530100cb0 con 0x7fc5301008d0 2024-09-12T00:51:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.730+0000 7fc5267fc640 1 -- 172.21.15.2:0/1451242796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc52c004fa0 con 0x7fc5301008d0 2024-09-12T00:51:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.731+0000 7fc5267fc640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc51c0a2c10 0x7fc51c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.731+0000 7fc534a54640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc51c0a2c10 0x7fc51c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.731+0000 7fc5267fc640 1 -- 172.21.15.2:0/1451242796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc52c0cebc0 con 0x7fc5301008d0 2024-09-12T00:51:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.732+0000 7fc534a54640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc51c0a2c10 0x7fc51c0a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc530102370 tx=0x7fc52000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.735+0000 7fc5267fc640 1 -- 172.21.15.2:0/1451242796 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc52c09b350 con 0x7fc5301008d0 2024-09-12T00:51:40.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:40 smithi167 ceph-mon[35234]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-12T00:51:40.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:40 smithi071 ceph-mon[35276]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-12T00:51:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.958+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc53019b9d0 con 0x7fc5301008d0 2024-09-12T00:51:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.964+0000 7fc5267fc640 1 -- 172.21.15.2:0/1451242796 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263184 (secure 0 0 0) 0x7fc52c09f650 con 0x7fc5301008d0 2024-09-12T00:51:40.967 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.966+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc51c0a2c10 msgr2=0x7fc51c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.966+0000 7fc5374b9640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc51c0a2c10 0x7fc51c0a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc530102370 tx=0x7fc52000b390 comp rx=0 tx=0).stop 2024-09-12T00:51:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.966+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5301008d0 msgr2=0x7fc53019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.966+0000 7fc5374b9640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5301008d0 0x7fc53019a670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00d770 tx=0x7fc52c00dc30 comp rx=0 tx=0).stop 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.967+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 shutdown_connections 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.967+0000 7fc5374b9640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc51c0a2c10 0x7fc51c0a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.967+0000 7fc5374b9640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53010e480 0x7fc53019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.967+0000 7fc5374b9640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc530101280 0x7fc53019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.967+0000 7fc5374b9640 1 --2- 172.21.15.2:0/1451242796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5301008d0 0x7fc53019a670 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.967+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 >> 172.21.15.2:0/1451242796 conn(0x7fc5300fc7a0 msgr2=0x7fc5300feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.967+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 shutdown_connections 2024-09-12T00:51:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:40.967+0000 7fc5374b9640 1 -- 172.21.15.2:0/1451242796 wait complete. 2024-09-12T00:51:41.555 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:41 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1451242796' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T00:51:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":288268916},{"type":"v1","addr":"172.21.15.2:6801","nonce":288268916}]},"active_addr":"172.21.15.2:6801/288268916","active_change":"2024-09-12T00:44:20.763543+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":838113285}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":780422410}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":17217547}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3529963366}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":761407779}]}]} 2024-09-12T00:51:41.590 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T00:51:41.590 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T00:51:41.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:51:41.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:41 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1451242796' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T00:51:41.846 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:41.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:41 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1451242796' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 -- 172.21.15.2:0/1313861909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 msgr2=0x7f04f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1313861909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 0x7f04f81067e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009900 tx=0x7f04e002a410 comp rx=0 tx=0).stop 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 -- 172.21.15.2:0/1313861909 shutdown_connections 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1313861909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f8106f10 0x7f04f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1313861909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 0x7f04f81067e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1313861909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f8101de0 0x7f04f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 -- 172.21.15.2:0/1313861909 >> 172.21.15.2:0/1313861909 conn(0x7f04f80fd8c0 msgr2=0x7f04f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 -- 172.21.15.2:0/1313861909 shutdown_connections 2024-09-12T00:51:42.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.334+0000 7f04fccd6640 1 -- 172.21.15.2:0/1313861909 wait complete. 2024-09-12T00:51:42.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04fccd6640 1 Processor -- start 2024-09-12T00:51:42.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04fccd6640 1 -- start start 2024-09-12T00:51:42.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04fccd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f8101de0 0x7f04f819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:42.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04fccd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 0x7f04f819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04fccd6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f8106f10 0x7f04f819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04fccd6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8111f70 con 0x7f04f8102790 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04fccd6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8111df0 con 0x7f04f8106f10 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04fccd6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81120f0 con 0x7f04f8101de0 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 0x7f04f819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 0x7f04f819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50290/0 (socket says 172.21.15.2:50290) 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04effff640 1 -- 172.21.15.2:0/1054955457 learned_addr learned my addr 172.21.15.2:0/1054955457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04f659c640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f8101de0 0x7f04f819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04f6d9d640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f8106f10 0x7f04f819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04effff640 1 -- 172.21.15.2:0/1054955457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f8101de0 msgr2=0x7f04f819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04effff640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f8101de0 0x7f04f819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04effff640 1 -- 172.21.15.2:0/1054955457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f8106f10 msgr2=0x7f04f819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:42.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04effff640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f8106f10 0x7f04f819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.335+0000 7f04effff640 1 -- 172.21.15.2:0/1054955457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f819f5c0 con 0x7f04f8102790 2024-09-12T00:51:42.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.336+0000 7f04effff640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 0x7f04f819ab50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f04e0006010 tx=0x7f04e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:42.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.336+0000 7f04ef7fe640 1 -- 172.21.15.2:0/1054955457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e003f030 con 0x7f04f8102790 2024-09-12T00:51:42.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.336+0000 7f04ef7fe640 1 -- 172.21.15.2:0/1054955457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04e0003ce0 con 0x7f04f8102790 2024-09-12T00:51:42.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.336+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f819f850 con 0x7f04f8102790 2024-09-12T00:51:42.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.336+0000 7f04ef7fe640 1 -- 172.21.15.2:0/1054955457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0035070 con 0x7f04f8102790 2024-09-12T00:51:42.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.336+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f81a7190 con 0x7f04f8102790 2024-09-12T00:51:42.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.337+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f81032c0 con 0x7f04f8102790 2024-09-12T00:51:42.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.338+0000 7f04ef7fe640 1 -- 172.21.15.2:0/1054955457 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f04e0042030 con 0x7f04f8102790 2024-09-12T00:51:42.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.339+0000 7f04ef7fe640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f04e40a2c10 0x7f04e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:42.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.339+0000 7f04f659c640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f04e40a2c10 0x7f04e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:42.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.339+0000 7f04ef7fe640 1 -- 172.21.15.2:0/1054955457 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f04e00ef670 con 0x7f04f8102790 2024-09-12T00:51:42.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.339+0000 7f04f659c640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f04e40a2c10 0x7f04e40a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f04e800abe0 tx=0x7f04e800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:42.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.343+0000 7f04ef7fe640 1 -- 172.21.15.2:0/1054955457 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f04e00bc3f0 con 0x7f04f8102790 2024-09-12T00:51:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.526+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04f81a7360 con 0x7f04f8102790 2024-09-12T00:51:42.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:42 smithi002 ceph-mon[31210]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-12T00:51:42.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.527+0000 7f04ef7fe640 1 -- 172.21.15.2:0/1054955457 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22708 (secure 0 0 0) 0x7f04e00bbcf0 con 0x7f04f8102790 2024-09-12T00:51:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:51:22.051895+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:51:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f04e40a2c10 msgr2=0x7f04e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f04e40a2c10 0x7f04e40a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f04e800abe0 tx=0x7f04e800a2d0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 msgr2=0x7f04f819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 0x7f04f819ab50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f04e0006010 tx=0x7f04e00042f0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 shutdown_connections 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f04e40a2c10 0x7f04e40a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f8106f10 0x7f04f819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f8102790 0x7f04f819ab50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 --2- 172.21.15.2:0/1054955457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f8101de0 0x7f04f819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.529+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 >> 172.21.15.2:0/1054955457 conn(0x7f04f80fd8c0 msgr2=0x7f04f80feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.530+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 shutdown_connections 2024-09-12T00:51:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:42.530+0000 7f04fccd6640 1 -- 172.21.15.2:0/1054955457 wait complete. 2024-09-12T00:51:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:42 smithi167 ceph-mon[35234]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-12T00:51:42.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:42 smithi071 ceph-mon[35276]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-12T00:51:43.260 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T00:51:43.260 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:51:43.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:43 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1054955457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:43.517 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:43 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1054955457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:43.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:43 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1054955457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 -- 172.21.15.2:0/2981225318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80103660 msgr2=0x7f0b8010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 --2- 172.21.15.2:0/2981225318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80103660 0x7f0b8010bb50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009900 tx=0x7f0b7402a480 comp rx=0 tx=0).stop 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 -- 172.21.15.2:0/2981225318 shutdown_connections 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 --2- 172.21.15.2:0/2981225318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8010c170 0x7f0b8010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 --2- 172.21.15.2:0/2981225318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80103660 0x7f0b8010bb50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 --2- 172.21.15.2:0/2981225318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b80102d40 0x7f0b80103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 -- 172.21.15.2:0/2981225318 >> 172.21.15.2:0/2981225318 conn(0x7f0b800fc7a0 msgr2=0x7f0b800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 -- 172.21.15.2:0/2981225318 shutdown_connections 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.007+0000 7f0b869ef640 1 -- 172.21.15.2:0/2981225318 wait complete. 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.008+0000 7f0b869ef640 1 Processor -- start 2024-09-12T00:51:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.008+0000 7f0b869ef640 1 -- start start 2024-09-12T00:51:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.008+0000 7f0b869ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80102d40 0x7f0b80198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b869ef640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b80103660 0x7f0b80198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b869ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b8010c170 0x7f0b8019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b869ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80111f70 con 0x7f0b80102d40 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b869ef640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80111df0 con 0x7f0b80103660 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b869ef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0b801120f0 con 0x7f0b8010c170 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80102d40 0x7f0b80198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80102d40 0x7f0b80198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50300/0 (socket says 172.21.15.2:50300) 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 -- 172.21.15.2:0/1308462991 learned_addr learned my addr 172.21.15.2:0/1308462991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b84f8c640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b8010c170 0x7f0b8019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7f7fe640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b80103660 0x7f0b80198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 -- 172.21.15.2:0/1308462991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b8010c170 msgr2=0x7f0b8019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b8010c170 0x7f0b8019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 -- 172.21.15.2:0/1308462991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b80103660 msgr2=0x7f0b80198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b80103660 0x7f0b80198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 -- 172.21.15.2:0/1308462991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8019d400 con 0x7f0b80102d40 2024-09-12T00:51:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7ffff640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80102d40 0x7f0b80198450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000d770 tx=0x7f0b7000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:44.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7d7fa640 1 -- 172.21.15.2:0/1308462991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70017070 con 0x7f0b80102d40 2024-09-12T00:51:44.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7d7fa640 1 -- 172.21.15.2:0/1308462991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b70005500 con 0x7f0b80102d40 2024-09-12T00:51:44.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8019d6f0 con 0x7f0b80102d40 2024-09-12T00:51:44.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.009+0000 7f0b7d7fa640 1 -- 172.21.15.2:0/1308462991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70004e00 con 0x7f0b80102d40 2024-09-12T00:51:44.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.010+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b801a4fd0 con 0x7f0b80102d40 2024-09-12T00:51:44.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.010+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b80103120 con 0x7f0b80102d40 2024-09-12T00:51:44.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.012+0000 7f0b7d7fa640 1 -- 172.21.15.2:0/1308462991 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0b70004fa0 con 0x7f0b80102d40 2024-09-12T00:51:44.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.012+0000 7f0b7d7fa640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0b680a2c90 0x7f0b680a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:44.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.012+0000 7f0b7f7fe640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0b680a2c90 0x7f0b680a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:44.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.012+0000 7f0b7d7fa640 1 -- 172.21.15.2:0/1308462991 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0b700ceb10 con 0x7f0b80102d40 2024-09-12T00:51:44.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.013+0000 7f0b7f7fe640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0b680a2c90 0x7f0b680a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009230 tx=0x7f0b740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:44.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.017+0000 7f0b7d7fa640 1 -- 172.21.15.2:0/1308462991 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b7009b2a0 con 0x7f0b80102d40 2024-09-12T00:51:44.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.197+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b801071e0 con 0x7f0b80102d40 2024-09-12T00:51:44.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.199+0000 7f0b7d7fa640 1 -- 172.21.15.2:0/1308462991 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22708 (secure 0 0 0) 0x7f0b7009f5a0 con 0x7f0b80102d40 2024-09-12T00:51:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:51:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:51:22.051895+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:51:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0b680a2c90 msgr2=0x7f0b680a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0b680a2c90 0x7f0b680a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009230 tx=0x7f0b740058d0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80102d40 msgr2=0x7f0b80198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80102d40 0x7f0b80198450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000d770 tx=0x7f0b7000dc30 comp rx=0 tx=0).stop 2024-09-12T00:51:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 shutdown_connections 2024-09-12T00:51:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f0b680a2c90 0x7f0b680a5150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b8010c170 0x7f0b8019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b80103660 0x7f0b80198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 --2- 172.21.15.2:0/1308462991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b80102d40 0x7f0b80198450 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 >> 172.21.15.2:0/1308462991 conn(0x7f0b800fc7a0 msgr2=0x7f0b800fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 shutdown_connections 2024-09-12T00:51:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:44.201+0000 7f0b869ef640 1 -- 172.21.15.2:0/1308462991 wait complete. 2024-09-12T00:51:44.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:44 smithi002 ceph-mon[31210]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-12T00:51:44.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:44 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1308462991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:44 smithi167 ceph-mon[35234]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-12T00:51:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:44 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1308462991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:44.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T00:51:44.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T00:51:44.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T00:51:44.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T00:51:44.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T00:51:44.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T00:51:44.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T00:51:44.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T00:51:44.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T00:51:44.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T00:51:44.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T00:51:44.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T00:51:44.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:44 smithi071 ceph-mon[35276]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-12T00:51:44.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:44 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1308462991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:51:45.690 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.695 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.695 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.696 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.699 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.699 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.699 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.707 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.707 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.714 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.714 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:45.718 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 -- 172.21.15.2:0/4021979853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f41036c0 msgr2=0x7f76f410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 --2- 172.21.15.2:0/4021979853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f41036c0 0x7f76f410bbb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009900 tx=0x7f76e002a480 comp rx=0 tx=0).stop 2024-09-12T00:51:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 -- 172.21.15.2:0/4021979853 shutdown_connections 2024-09-12T00:51:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 --2- 172.21.15.2:0/4021979853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f410c180 0x7f76f410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 --2- 172.21.15.2:0/4021979853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f41036c0 0x7f76f410bbb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 --2- 172.21.15.2:0/4021979853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f4102da0 0x7f76f4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 -- 172.21.15.2:0/4021979853 >> 172.21.15.2:0/4021979853 conn(0x7f76f40fc7a0 msgr2=0x7f76f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 -- 172.21.15.2:0/4021979853 shutdown_connections 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.296+0000 7f76fad7c640 1 -- 172.21.15.2:0/4021979853 wait complete. 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76fad7c640 1 Processor -- start 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76fad7c640 1 -- start start 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76fad7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4102da0 0x7f76f4100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76fad7c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f41036c0 0x7f76f4100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76fad7c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f410c180 0x7f76f4101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76fad7c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4111f60 con 0x7f76f4102da0 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76fad7c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4111de0 con 0x7f76f41036c0 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76fad7c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76f41120e0 con 0x7f76f410c180 2024-09-12T00:51:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f8b18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4102da0 0x7f76f4100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f8b18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4102da0 0x7f76f4100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41906/0 (socket says 172.21.15.2:41906) 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f8b18640 1 -- 172.21.15.2:0/3003814497 learned_addr learned my addr 172.21.15.2:0/3003814497 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f9319640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f410c180 0x7f76f4101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f3fff640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f41036c0 0x7f76f4100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f8b18640 1 -- 172.21.15.2:0/3003814497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f410c180 msgr2=0x7f76f4101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f8b18640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f410c180 0x7f76f4101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f8b18640 1 -- 172.21.15.2:0/3003814497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f41036c0 msgr2=0x7f76f4100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f8b18640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f41036c0 0x7f76f4100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f8b18640 1 -- 172.21.15.2:0/3003814497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f41a68f0 con 0x7f76f4102da0 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.297+0000 7f76f3fff640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f41036c0 0x7f76f4100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.298+0000 7f76f8b18640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4102da0 0x7f76f4100a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f76e800d950 tx=0x7f76e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.298+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8017070 con 0x7f76f4102da0 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.298+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e8009c30 con 0x7f76f4102da0 2024-09-12T00:51:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.298+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f41a6be0 con 0x7f76f4102da0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.298+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e800f6b0 con 0x7f76f4102da0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.298+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f41a7120 con 0x7f76f4102da0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.299+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76f4062900 con 0x7f76f4102da0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.300+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f76e80109d0 con 0x7f76f4102da0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.301+0000 7f76f1ffb640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f76e40a2c10 0x7f76e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.301+0000 7f76f3fff640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f76e40a2c10 0x7f76e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.301+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f76e80cf260 con 0x7f76f4102da0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.301+0000 7f76f1ffb640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] conn(0x7f76e40ac8c0 0x7f76e40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.301+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 --> [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76e8016ec0 con 0x7f76e40ac8c0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.301+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f76e80cf610 con 0x7f76f4102da0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.301+0000 7f76f9319640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] conn(0x7f76e40ac8c0 0x7f76e40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.301+0000 7f76f3fff640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f76e40a2c10 0x7f76e40a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76f4102490 tx=0x7f76e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.302+0000 7f76f9319640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] conn(0x7f76e40ac8c0 0x7f76e40aed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:46.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.302+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 <== osd.0 v2:172.21.15.2:6802/791585591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76e8016ec0 con 0x7f76e40ac8c0 2024-09-12T00:51:46.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.316+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 --> [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76f4062d80 con 0x7f76e40ac8c0 2024-09-12T00:51:46.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.316+0000 7f76f1ffb640 1 -- 172.21.15.2:0/3003814497 <== osd.0 v2:172.21.15.2:6802/791585591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f76f4062d80 con 0x7f76e40ac8c0 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] conn(0x7f76e40ac8c0 msgr2=0x7f76e40aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] conn(0x7f76e40ac8c0 0x7f76e40aed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f76e40a2c10 msgr2=0x7f76e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f76e40a2c10 0x7f76e40a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76f4102490 tx=0x7f76e0005a20 comp rx=0 tx=0).stop 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4102da0 msgr2=0x7f76f4100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 --2- 172.21.15.2:0/3003814497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4102da0 0x7f76f4100a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f76e800d950 tx=0x7f76e800de10 comp rx=0 tx=0).stop 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76f9319640 1 -- 172.21.15.2:0/3003814497 reap_dead start 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 shutdown_connections 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 >> 172.21.15.2:0/3003814497 conn(0x7f76f40fc7a0 msgr2=0x7f76f40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:46.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 shutdown_connections 2024-09-12T00:51:46.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:46.317+0000 7f76fad7c640 1 -- 172.21.15.2:0/3003814497 wait complete. 2024-09-12T00:51:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:46 smithi002 ceph-mon[31210]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-12T00:51:46.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:46 smithi167 ceph-mon[35234]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-12T00:51:46.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:46 smithi071 ceph-mon[35276]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-12T00:51:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 -- 172.21.15.2:0/3094494195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d01009d0 msgr2=0x7fb7d0100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 --2- 172.21.15.2:0/3094494195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d01009d0 0x7fb7d0100db0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009900 tx=0x7fb7cc02a3f0 comp rx=0 tx=0).stop 2024-09-12T00:51:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 -- 172.21.15.2:0/3094494195 shutdown_connections 2024-09-12T00:51:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 --2- 172.21.15.2:0/3094494195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7d010e4f0 0x7fb7d0110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 --2- 172.21.15.2:0/3094494195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7d0101380 0x7fb7d010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 --2- 172.21.15.2:0/3094494195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d01009d0 0x7fb7d0100db0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 -- 172.21.15.2:0/3094494195 >> 172.21.15.2:0/3094494195 conn(0x7fb7d00fc7d0 msgr2=0x7fb7d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 -- 172.21.15.2:0/3094494195 shutdown_connections 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 -- 172.21.15.2:0/3094494195 wait complete. 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.383+0000 7fb7d860e640 1 Processor -- start 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d860e640 1 -- start start 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d860e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7d01009d0 0x7fb7d019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d860e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d0101380 0x7fb7d019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d860e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7d010e4f0 0x7fb7d019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d860e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d0114250 con 0x7fb7d0101380 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d860e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d01140d0 con 0x7fb7d010e4f0 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d860e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d01143d0 con 0x7fb7d01009d0 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d5ba9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d0101380 0x7fb7d019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d5ba9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d0101380 0x7fb7d019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41924/0 (socket says 172.21.15.2:41924) 2024-09-12T00:51:47.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d5ba9640 1 -- 172.21.15.2:0/330604735 learned_addr learned my addr 172.21.15.2:0/330604735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:47.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d63aa640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7d01009d0 0x7fb7d019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:47.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d6bab640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7d010e4f0 0x7fb7d019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:47.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d5ba9640 1 -- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7d01009d0 msgr2=0x7fb7d019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:47.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d5ba9640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7d01009d0 0x7fb7d019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:47.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d5ba9640 1 -- 172.21.15.2:0/330604735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7d010e4f0 msgr2=0x7fb7d019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d5ba9640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7d010e4f0 0x7fb7d019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d5ba9640 1 -- 172.21.15.2:0/330604735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d019f6a0 con 0x7fb7d0101380 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d63aa640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7d01009d0 0x7fb7d019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.384+0000 7fb7d6bab640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7d010e4f0 0x7fb7d019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.385+0000 7fb7d5ba9640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d0101380 0x7fb7d019ac30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000c920 tx=0x7fb7c000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.385+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0007c70 con 0x7fb7d0101380 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.385+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d019f990 con 0x7fb7d0101380 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.385+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7c0007e10 con 0x7fb7d0101380 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.385+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0018890 con 0x7fb7d0101380 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.385+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d01a7270 con 0x7fb7d0101380 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.386+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7d0062900 con 0x7fb7d0101380 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.387+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fb7c0018a30 con 0x7fb7d0101380 2024-09-12T00:51:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.388+0000 7fb7c77fe640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb7bc0a2c10 0x7fb7bc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.388+0000 7fb7d63aa640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb7bc0a2c10 0x7fb7bc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.388+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb7c00cf890 con 0x7fb7d0101380 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.388+0000 7fb7c77fe640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] conn(0x7fb7bc0ac8c0 0x7fb7bc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.388+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 --> [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7bc0af430 con 0x7fb7bc0ac8c0 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.388+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb7c00cfc40 con 0x7fb7d0101380 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.388+0000 7fb7d63aa640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb7bc0a2c10 0x7fb7bc0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc000c00 tx=0x7fb7cc032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.388+0000 7fb7d6bab640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] conn(0x7fb7bc0ac8c0 0x7fb7bc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.389+0000 7fb7d6bab640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] conn(0x7fb7bc0ac8c0 0x7fb7bc0aed60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.390+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 <== osd.8 v2:172.21.15.167:6816/4071602175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7bc0af430 con 0x7fb7bc0ac8c0 2024-09-12T00:51:47.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.403+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 --> [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb7d0062d80 con 0x7fb7bc0ac8c0 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7c77fe640 1 -- 172.21.15.2:0/330604735 <== osd.8 v2:172.21.15.167:6816/4071602175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb7d0062d80 con 0x7fb7bc0ac8c0 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] conn(0x7fb7bc0ac8c0 msgr2=0x7fb7bc0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] conn(0x7fb7bc0ac8c0 0x7fb7bc0aed60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb7bc0a2c10 msgr2=0x7fb7bc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb7bc0a2c10 0x7fb7bc0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc000c00 tx=0x7fb7cc032d50 comp rx=0 tx=0).stop 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d0101380 msgr2=0x7fb7d019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 --2- 172.21.15.2:0/330604735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7d0101380 0x7fb7d019ac30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000c920 tx=0x7fb7c000cde0 comp rx=0 tx=0).stop 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d6bab640 1 -- 172.21.15.2:0/330604735 reap_dead start 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 shutdown_connections 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 >> 172.21.15.2:0/330604735 conn(0x7fb7d00fc7d0 msgr2=0x7fb7d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 shutdown_connections 2024-09-12T00:51:47.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:47.404+0000 7fb7d860e640 1 -- 172.21.15.2:0/330604735 wait complete. 2024-09-12T00:51:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 -- 172.21.15.2:0/1258782890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac1012c0 msgr2=0x7f68ac10df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 --2- 172.21.15.2:0/1258782890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac1012c0 0x7f68ac10df80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009900 tx=0x7f68a002a410 comp rx=0 tx=0).stop 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 -- 172.21.15.2:0/1258782890 shutdown_connections 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 --2- 172.21.15.2:0/1258782890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ac10e4c0 0x7f68ac1108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 --2- 172.21.15.2:0/1258782890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac1012c0 0x7f68ac10df80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 --2- 172.21.15.2:0/1258782890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68ac100910 0x7f68ac100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 -- 172.21.15.2:0/1258782890 >> 172.21.15.2:0/1258782890 conn(0x7f68ac0fc7a0 msgr2=0x7f68ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 -- 172.21.15.2:0/1258782890 shutdown_connections 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.466+0000 7f68b3a25640 1 -- 172.21.15.2:0/1258782890 wait complete. 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b3a25640 1 Processor -- start 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b3a25640 1 -- start start 2024-09-12T00:51:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b3a25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac100910 0x7f68ac19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b3a25640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68ac1012c0 0x7f68ac19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b3a25640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ac10e4c0 0x7f68ac19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b3a25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac114190 con 0x7f68ac100910 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b3a25640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac114010 con 0x7f68ac10e4c0 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b3a25640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac114310 con 0x7f68ac1012c0 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b17c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac100910 0x7f68ac19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b17c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac100910 0x7f68ac19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41972/0 (socket says 172.21.15.2:41972) 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b17c1640 1 -- 172.21.15.2:0/3739782696 learned_addr learned my addr 172.21.15.2:0/3739782696 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.467+0000 7f68b1fc2640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ac10e4c0 0x7f68ac19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68b17c1640 1 -- 172.21.15.2:0/3739782696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68ac1012c0 msgr2=0x7f68ac19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68b17c1640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68ac1012c0 0x7f68ac19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68b17c1640 1 -- 172.21.15.2:0/3739782696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ac10e4c0 msgr2=0x7f68ac19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68b17c1640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ac10e4c0 0x7f68ac19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68b17c1640 1 -- 172.21.15.2:0/3739782696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac19f6a0 con 0x7f68ac100910 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68b17c1640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac100910 0x7f68ac19a6f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f68a400d770 tx=0x7f68a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4017070 con 0x7f68ac100910 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ac19f990 con 0x7f68ac100910 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a4005500 con 0x7f68ac100910 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4004e00 con 0x7f68ac100910 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.468+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ac1a7270 con 0x7f68ac100910 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.469+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68ac062900 con 0x7f68ac100910 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.470+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f68a4004fa0 con 0x7f68ac100910 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.471+0000 7f68aa7fc640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68940a2c10 0x7f68940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.471+0000 7f68b0fc0640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68940a2c10 0x7f68940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.471+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f68a40cf140 con 0x7f68ac100910 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.471+0000 7f68aa7fc640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] conn(0x7f68940ac8c0 0x7f68940aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.471+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 --> [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68940af430 con 0x7f68940ac8c0 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.471+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f68a40cf4f0 con 0x7f68ac100910 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.471+0000 7f68b1fc2640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] conn(0x7f68940ac8c0 0x7f68940aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.471+0000 7f68b0fc0640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68940a2c10 0x7f68940a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f68a002a930 tx=0x7f68a0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.472+0000 7f68b1fc2640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] conn(0x7f68940ac8c0 0x7f68940aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.472+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 <== osd.3 v2:172.21.15.2:6810/1194146354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68940af430 con 0x7f68940ac8c0 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.486+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 --> [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68ac062d80 con 0x7f68940ac8c0 2024-09-12T00:51:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.486+0000 7f68aa7fc640 1 -- 172.21.15.2:0/3739782696 <== osd.3 v2:172.21.15.2:6810/1194146354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f68ac062d80 con 0x7f68940ac8c0 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.486+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] conn(0x7f68940ac8c0 msgr2=0x7f68940aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.486+0000 7f68b3a25640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] conn(0x7f68940ac8c0 0x7f68940aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.486+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68940a2c10 msgr2=0x7f68940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.487+0000 7f68b3a25640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f68940a2c10 0x7f68940a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f68a002a930 tx=0x7f68a0000bc0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.487+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac100910 msgr2=0x7f68ac19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.487+0000 7f68b3a25640 1 --2- 172.21.15.2:0/3739782696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68ac100910 0x7f68ac19a6f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f68a400d770 tx=0x7f68a400dc30 comp rx=0 tx=0).stop 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.487+0000 7f68b1fc2640 1 -- 172.21.15.2:0/3739782696 reap_dead start 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.487+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 shutdown_connections 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.487+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 >> 172.21.15.2:0/3739782696 conn(0x7f68ac0fc7a0 msgr2=0x7f68ac0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.487+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 shutdown_connections 2024-09-12T00:51:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.487+0000 7f68b3a25640 1 -- 172.21.15.2:0/3739782696 wait complete. 2024-09-12T00:51:48.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:48 smithi002 ceph-mon[31210]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-12T00:51:48.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:48 smithi167 ceph-mon[35234]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-12T00:51:48.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.856+0000 7fcacfabf640 1 -- 172.21.15.2:0/3725355617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 msgr2=0x7fcac810eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.856+0000 7fcacfabf640 1 --2- 172.21.15.2:0/3725355617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 0x7fcac810eac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009ca0 tx=0x7fcac002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 -- 172.21.15.2:0/3725355617 shutdown_connections 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 --2- 172.21.15.2:0/3725355617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 0x7fcac810eac0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 --2- 172.21.15.2:0/3725355617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcac81027c0 0x7fcac8106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 --2- 172.21.15.2:0/3725355617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac8101e10 0x7fcac81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 -- 172.21.15.2:0/3725355617 >> 172.21.15.2:0/3725355617 conn(0x7fcac80fd8d0 msgr2=0x7fcac80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 -- 172.21.15.2:0/3725355617 shutdown_connections 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 -- 172.21.15.2:0/3725355617 wait complete. 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 Processor -- start 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 -- start start 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcac8101e10 0x7fcac819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.857+0000 7fcacfabf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac81027c0 0x7fcac819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcacfabf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 0x7fcac819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcacfabf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8111fa0 con 0x7fcac8106f40 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcacfabf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8111e20 con 0x7fcac8101e10 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcacfabf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8112120 con 0x7fcac81027c0 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 0x7fcac819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 0x7fcac819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41992/0 (socket says 172.21.15.2:41992) 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 -- 172.21.15.2:0/1494406593 learned_addr learned my addr 172.21.15.2:0/1494406593 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcacd05a640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac81027c0 0x7fcac819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcacd85b640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcac8101e10 0x7fcac819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 -- 172.21.15.2:0/1494406593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac81027c0 msgr2=0x7fcac819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac81027c0 0x7fcac819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 -- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcac8101e10 msgr2=0x7fcac819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcac8101e10 0x7fcac819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 -- 172.21.15.2:0/1494406593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac819f610 con 0x7fcac8106f40 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcacd85b640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcac8101e10 0x7fcac819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcace05c640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 0x7fcac819ef30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcac0031a60 tx=0x7fcac0031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0003c30 con 0x7fcac8106f40 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac0003dd0 con 0x7fcac8106f40 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.858+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac819f8a0 con 0x7fcac8106f40 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.859+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac00047e0 con 0x7fcac8106f40 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.859+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac81a71e0 con 0x7fcac8106f40 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.859+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcac8075700 con 0x7fcac8106f40 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.861+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fcac002f790 con 0x7fcac8106f40 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.861+0000 7fcabeffd640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcab40a2c90 0x7fcab40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.861+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fcac00f06a0 con 0x7fcac8106f40 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.861+0000 7fcacd85b640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcab40a2c90 0x7fcab40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.862+0000 7fcabeffd640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] conn(0x7fcab40ac940 0x7fcab40aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.862+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 --> [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcab40af4b0 con 0x7fcab40ac940 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.862+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fcac00f0af0 con 0x7fcac8106f40 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.862+0000 7fcacd85b640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcab40a2c90 0x7fcab40a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcac4005fd0 tx=0x7fcac4005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.862+0000 7fcacd05a640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] conn(0x7fcab40ac940 0x7fcab40aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.862+0000 7fcacd05a640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] conn(0x7fcab40ac940 0x7fcab40aede0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.863+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 <== osd.4 v2:172.21.15.71:6808/3103093163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcab40af4b0 con 0x7fcab40ac940 2024-09-12T00:51:48.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.877+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 --> [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcac81032f0 con 0x7fcab40ac940 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcabeffd640 1 -- 172.21.15.2:0/1494406593 <== osd.4 v2:172.21.15.71:6808/3103093163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcac81032f0 con 0x7fcab40ac940 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] conn(0x7fcab40ac940 msgr2=0x7fcab40aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] conn(0x7fcab40ac940 0x7fcab40aede0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcab40a2c90 msgr2=0x7fcab40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fcab40a2c90 0x7fcab40a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcac4005fd0 tx=0x7fcac4005ea0 comp rx=0 tx=0).stop 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 msgr2=0x7fcac819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 --2- 172.21.15.2:0/1494406593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8106f40 0x7fcac819ef30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcac0031a60 tx=0x7fcac0031a90 comp rx=0 tx=0).stop 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcace05c640 1 -- 172.21.15.2:0/1494406593 reap_dead start 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 shutdown_connections 2024-09-12T00:51:48.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 >> 172.21.15.2:0/1494406593 conn(0x7fcac80fd8d0 msgr2=0x7fcac80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:48.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 shutdown_connections 2024-09-12T00:51:48.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.878+0000 7fcacfabf640 1 -- 172.21.15.2:0/1494406593 wait complete. 2024-09-12T00:51:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:48 smithi071 ceph-mon[35276]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-12T00:51:49.805 INFO:teuthology.orchestra.run.smithi002.stdout:133143986231 2024-09-12T00:51:49.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T00:51:49.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 -- 172.21.15.2:0/3981670061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 msgr2=0x7f2d1c100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:49.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 --2- 172.21.15.2:0/3981670061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 0x7f2d1c100d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009900 tx=0x7f2d0c02a410 comp rx=0 tx=0).stop 2024-09-12T00:51:49.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 -- 172.21.15.2:0/3981670061 shutdown_connections 2024-09-12T00:51:49.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 --2- 172.21.15.2:0/3981670061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1c10e4d0 0x7f2d1c1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:49.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 --2- 172.21.15.2:0/3981670061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d1c101360 0x7f2d1c10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 --2- 172.21.15.2:0/3981670061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 0x7f2d1c100d90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 -- 172.21.15.2:0/3981670061 >> 172.21.15.2:0/3981670061 conn(0x7f2d1c0fc7d0 msgr2=0x7f2d1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 -- 172.21.15.2:0/3981670061 shutdown_connections 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.960+0000 7f2d2204c640 1 -- 172.21.15.2:0/3981670061 wait complete. 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d2204c640 1 Processor -- start 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d2204c640 1 -- start start 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d2204c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 0x7f2d1c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d2204c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1c101360 0x7f2d1c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d2204c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d1c10e4d0 0x7f2d1c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d2204c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c114210 con 0x7f2d1c1009b0 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d2204c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c114090 con 0x7f2d1c10e4d0 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d2204c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c114390 con 0x7f2d1c101360 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.961+0000 7f2d1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 0x7f2d1c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 0x7f2d1c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42006/0 (socket says 172.21.15.2:42006) 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1b7fe640 1 -- 172.21.15.2:0/534634823 learned_addr learned my addr 172.21.15.2:0/534634823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1bfff640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d1c10e4d0 0x7f2d1c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1affd640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1c101360 0x7f2d1c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1b7fe640 1 -- 172.21.15.2:0/534634823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1c101360 msgr2=0x7f2d1c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1b7fe640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1c101360 0x7f2d1c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1b7fe640 1 -- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d1c10e4d0 msgr2=0x7f2d1c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1b7fe640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d1c10e4d0 0x7f2d1c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1b7fe640 1 -- 172.21.15.2:0/534634823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c19f6a0 con 0x7f2d1c1009b0 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1bfff640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d1c10e4d0 0x7f2d1c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d1b7fe640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 0x7f2d1c19a6f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005ab0 tx=0x7f2d0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c03f030 con 0x7f2d1c1009b0 2024-09-12T00:51:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d0c003ce0 con 0x7f2d1c1009b0 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.962+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c035070 con 0x7f2d1c1009b0 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.963+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c19f930 con 0x7f2d1c1009b0 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.963+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c19fdc0 con 0x7f2d1c1009b0 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.964+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d1c062940 con 0x7f2d1c1009b0 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.965+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2d0c042030 con 0x7f2d1c1009b0 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.966+0000 7f2d18ff9640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d040a2c90 0x7f2d040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.966+0000 7f2d1affd640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d040a2c90 0x7f2d040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.966+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2d0c0efe40 con 0x7f2d1c1009b0 2024-09-12T00:51:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.966+0000 7f2d18ff9640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] conn(0x7f2d040ac940 0x7f2d040aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.966+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 --> [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d040af4b0 con 0x7f2d040ac940 2024-09-12T00:51:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.966+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f2d0c0f01f0 con 0x7f2d1c1009b0 2024-09-12T00:51:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.967+0000 7f2d1affd640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d040a2c90 0x7f2d040a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c10ed80 tx=0x7f2d1000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.967+0000 7f2d1bfff640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] conn(0x7f2d040ac940 0x7f2d040aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.967+0000 7f2d1bfff640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] conn(0x7f2d040ac940 0x7f2d040aede0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.968+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 <== osd.7 v2:172.21.15.71:6816/1535182996 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d040af4b0 con 0x7f2d040ac940 2024-09-12T00:51:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.982+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 --> [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d1c062e40 con 0x7f2d040ac940 2024-09-12T00:51:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d18ff9640 1 -- 172.21.15.2:0/534634823 <== osd.7 v2:172.21.15.71:6816/1535182996 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2d1c062e40 con 0x7f2d040ac940 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] conn(0x7f2d040ac940 msgr2=0x7f2d040aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] conn(0x7f2d040ac940 0x7f2d040aede0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d040a2c90 msgr2=0x7f2d040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f2d040a2c90 0x7f2d040a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c10ed80 tx=0x7f2d1000a4c0 comp rx=0 tx=0).stop 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 msgr2=0x7f2d1c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 --2- 172.21.15.2:0/534634823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1009b0 0x7f2d1c19a6f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005ab0 tx=0x7f2d0c0042f0 comp rx=0 tx=0).stop 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d1bfff640 1 -- 172.21.15.2:0/534634823 reap_dead start 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 shutdown_connections 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 >> 172.21.15.2:0/534634823 conn(0x7f2d1c0fc7d0 msgr2=0x7f2d1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 shutdown_connections 2024-09-12T00:51:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:49.983+0000 7f2d2204c640 1 -- 172.21.15.2:0/534634823 wait complete. 2024-09-12T00:51:50.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 -- 172.21.15.2:0/577152664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c101de0 msgr2=0x7f3a4c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 --2- 172.21.15.2:0/577152664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c101de0 0x7f3a4c1021c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009900 tx=0x7f3a4002a410 comp rx=0 tx=0).stop 2024-09-12T00:51:50.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 -- 172.21.15.2:0/577152664 shutdown_connections 2024-09-12T00:51:50.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 --2- 172.21.15.2:0/577152664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a4c106f10 0x7f3a4c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 --2- 172.21.15.2:0/577152664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a4c102790 0x7f3a4c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 --2- 172.21.15.2:0/577152664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c101de0 0x7f3a4c1021c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 -- 172.21.15.2:0/577152664 >> 172.21.15.2:0/577152664 conn(0x7f3a4c0fd8c0 msgr2=0x7f3a4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 -- 172.21.15.2:0/577152664 shutdown_connections 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.120+0000 7f3a52ad6640 1 -- 172.21.15.2:0/577152664 wait complete. 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a52ad6640 1 Processor -- start 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a52ad6640 1 -- start start 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a52ad6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a4c101de0 0x7f3a4c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a52ad6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a4c102790 0x7f3a4c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a52ad6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c106f10 0x7f3a4c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a52ad6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c111f70 con 0x7f3a4c106f10 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a52ad6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c111df0 con 0x7f3a4c102790 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a52ad6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c1120f0 con 0x7f3a4c101de0 2024-09-12T00:51:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a51073640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c106f10 0x7f3a4c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a51073640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c106f10 0x7f3a4c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41936/0 (socket says 172.21.15.2:41936) 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a51073640 1 -- 172.21.15.2:0/1797430631 learned_addr learned my addr 172.21.15.2:0/1797430631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a50872640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a4c101de0 0x7f3a4c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.121+0000 7f3a4bfff640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a4c102790 0x7f3a4c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a51073640 1 -- 172.21.15.2:0/1797430631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a4c101de0 msgr2=0x7f3a4c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a51073640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a4c101de0 0x7f3a4c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a51073640 1 -- 172.21.15.2:0/1797430631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a4c102790 msgr2=0x7f3a4c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a51073640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a4c102790 0x7f3a4c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a51073640 1 -- 172.21.15.2:0/1797430631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4c1a68f0 con 0x7f3a4c106f10 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a51073640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c106f10 0x7f3a4c074f70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400eb10 tx=0x7f3a4400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44004b20 con 0x7f3a4c106f10 2024-09-12T00:51:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a44004cc0 con 0x7f3a4c106f10 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4c1a6be0 con 0x7f3a4c106f10 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44010760 con 0x7f3a4c106f10 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.122+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4c1a7120 con 0x7f3a4c106f10 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.123+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a4c0628c0 con 0x7f3a4c106f10 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.124+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3a44005020 con 0x7f3a4c106f10 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.125+0000 7f3a49ffb640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3a3c0a2c10 0x7f3a3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.125+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3a440cfe50 con 0x7f3a4c106f10 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.125+0000 7f3a50872640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3a3c0a2c10 0x7f3a3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.125+0000 7f3a49ffb640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] conn(0x7f3a3c0ac8c0 0x7f3a3c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.125+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 --> [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a3c0af430 con 0x7f3a3c0ac8c0 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.125+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f3a440d0200 con 0x7f3a4c106f10 2024-09-12T00:51:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.125+0000 7f3a50872640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3a3c0a2c10 0x7f3a3c0a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009230 tx=0x7f3a400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.125+0000 7f3a4bfff640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] conn(0x7f3a3c0ac8c0 0x7f3a3c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.126+0000 7f3a4bfff640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] conn(0x7f3a3c0ac8c0 0x7f3a3c0aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.127+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 <== osd.1 v2:172.21.15.71:6800/683459479 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a3c0af430 con 0x7f3a3c0ac8c0 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.141+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 --> [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a4c062d40 con 0x7f3a3c0ac8c0 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a49ffb640 1 -- 172.21.15.2:0/1797430631 <== osd.1 v2:172.21.15.71:6800/683459479 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3a4c062d40 con 0x7f3a3c0ac8c0 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 >> [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] conn(0x7f3a3c0ac8c0 msgr2=0x7f3a3c0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] conn(0x7f3a3c0ac8c0 0x7f3a3c0aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3a3c0a2c10 msgr2=0x7f3a3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f3a3c0a2c10 0x7f3a3c0a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009230 tx=0x7f3a400058d0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c106f10 msgr2=0x7f3a4c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 --2- 172.21.15.2:0/1797430631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c106f10 0x7f3a4c074f70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400eb10 tx=0x7f3a4400c2d0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a51073640 1 -- 172.21.15.2:0/1797430631 reap_dead start 2024-09-12T00:51:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 shutdown_connections 2024-09-12T00:51:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 >> 172.21.15.2:0/1797430631 conn(0x7f3a4c0fd8c0 msgr2=0x7f3a4c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 shutdown_connections 2024-09-12T00:51:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.142+0000 7f3a52ad6640 1 -- 172.21.15.2:0/1797430631 wait complete. 2024-09-12T00:51:50.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:50 smithi002 ceph-mon[31210]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T00:51:50.721 INFO:teuthology.orchestra.run.smithi002.stdout:55834574919 2024-09-12T00:51:50.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T00:51:50.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:50 smithi167 ceph-mon[35234]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T00:51:50.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 -- 172.21.15.2:0/1829908857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74101de0 msgr2=0x7f7c741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 --2- 172.21.15.2:0/1829908857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74101de0 0x7f7c741021c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009900 tx=0x7f7c7002a410 comp rx=0 tx=0).stop 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 -- 172.21.15.2:0/1829908857 shutdown_connections 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 --2- 172.21.15.2:0/1829908857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74106f10 0x7f7c7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 --2- 172.21.15.2:0/1829908857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c74102790 0x7f7c741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 --2- 172.21.15.2:0/1829908857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74101de0 0x7f7c741021c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 -- 172.21.15.2:0/1829908857 >> 172.21.15.2:0/1829908857 conn(0x7f7c740fd8c0 msgr2=0x7f7c740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 -- 172.21.15.2:0/1829908857 shutdown_connections 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.353+0000 7f7c7c459640 1 -- 172.21.15.2:0/1829908857 wait complete. 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7c459640 1 Processor -- start 2024-09-12T00:51:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7c459640 1 -- start start 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7c459640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74101de0 0x7f7c74198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7c459640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c74102790 0x7f7c741989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7c459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74106f10 0x7f7c7419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7c459640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74111f70 con 0x7f7c74106f10 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7c459640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74111df0 con 0x7f7c74101de0 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7c459640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741120f0 con 0x7f7c74102790 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7a9f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74106f10 0x7f7c7419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7a9f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74106f10 0x7f7c7419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41954/0 (socket says 172.21.15.2:41954) 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7a9f6640 1 -- 172.21.15.2:0/411871750 learned_addr learned my addr 172.21.15.2:0/411871750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c7a1f5640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74101de0 0x7f7c74198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.354+0000 7f7c799f4640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c74102790 0x7f7c741989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c7a9f6640 1 -- 172.21.15.2:0/411871750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c74102790 msgr2=0x7f7c741989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c7a9f6640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c74102790 0x7f7c741989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c7a9f6640 1 -- 172.21.15.2:0/411871750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74101de0 msgr2=0x7f7c74198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c7a9f6640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74101de0 0x7f7c74198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c7a9f6640 1 -- 172.21.15.2:0/411871750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7419d410 con 0x7f7c74106f10 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c7a9f6640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74106f10 0x7f7c7419cd30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009fd0 tx=0x7f7c6c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c017070 con 0x7f7c74106f10 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c6c003e50 con 0x7f7c74106f10 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7419d700 con 0x7f7c74106f10 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0106c0 con 0x7f7c74106f10 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.355+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c741a4fe0 con 0x7f7c74106f10 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.356+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c74062980 con 0x7f7c74106f10 2024-09-12T00:51:50.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.357+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7c6c003970 con 0x7f7c74106f10 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.358+0000 7f7c6b7fe640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7c600a2c90 0x7f7c600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.358+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7c6c0cf1f0 con 0x7f7c74106f10 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.358+0000 7f7c7a1f5640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7c600a2c90 0x7f7c600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.358+0000 7f7c6b7fe640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] conn(0x7f7c600ac940 0x7f7c600aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.358+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 --> [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c600af4b0 con 0x7f7c600ac940 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.358+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f7c6c0cf640 con 0x7f7c74106f10 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.359+0000 7f7c799f4640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] conn(0x7f7c600ac940 0x7f7c600aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.359+0000 7f7c7a1f5640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7c600a2c90 0x7f7c600a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009230 tx=0x7f7c700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.359+0000 7f7c799f4640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] conn(0x7f7c600ac940 0x7f7c600aede0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.360+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 <== osd.10 v2:172.21.15.71:6824/2261598225 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c600af4b0 con 0x7f7c600ac940 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.373+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 --> [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c74062e00 con 0x7f7c600ac940 2024-09-12T00:51:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.374+0000 7f7c6b7fe640 1 -- 172.21.15.2:0/411871750 <== osd.10 v2:172.21.15.71:6824/2261598225 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7c74062e00 con 0x7f7c600ac940 2024-09-12T00:51:50.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.374+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 >> [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] conn(0x7f7c600ac940 msgr2=0x7f7c600aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.374+0000 7f7c7c459640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] conn(0x7f7c600ac940 0x7f7c600aede0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.374+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7c600a2c90 msgr2=0x7f7c600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.374+0000 7f7c7c459640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7c600a2c90 0x7f7c600a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009230 tx=0x7f7c700058d0 comp rx=0 tx=0).stop 2024-09-12T00:51:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.374+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74106f10 msgr2=0x7f7c7419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.374+0000 7f7c7c459640 1 --2- 172.21.15.2:0/411871750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c74106f10 0x7f7c7419cd30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009fd0 tx=0x7f7c6c00b260 comp rx=0 tx=0).stop 2024-09-12T00:51:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.375+0000 7f7c7a9f6640 1 -- 172.21.15.2:0/411871750 reap_dead start 2024-09-12T00:51:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.375+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 shutdown_connections 2024-09-12T00:51:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.375+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 >> 172.21.15.2:0/411871750 conn(0x7f7c740fd8c0 msgr2=0x7f7c740fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.375+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 shutdown_connections 2024-09-12T00:51:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:48.375+0000 7f7c7c459640 1 -- 172.21.15.2:0/411871750 wait complete. 2024-09-12T00:51:50.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:50 smithi071 ceph-mon[35276]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T00:51:51.385 INFO:teuthology.orchestra.run.smithi002.stdout:283467841561 2024-09-12T00:51:51.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T00:51:51.923 INFO:teuthology.orchestra.run.smithi002.stdout:34359738443 2024-09-12T00:51:51.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T00:51:52.699 INFO:teuthology.orchestra.run.smithi002.stdout:236223201314 2024-09-12T00:51:52.700 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T00:51:52.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:52 smithi167 ceph-mon[35234]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T00:51:52.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:52 smithi002 ceph-mon[31210]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T00:51:52.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:52 smithi071 ceph-mon[35276]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T00:51:53.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 -- 172.21.15.2:0/748991630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102570 msgr2=0x7f66741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:53.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 --2- 172.21.15.2:0/748991630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102570 0x7f66741029b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6668009900 tx=0x7f666802a480 comp rx=0 tx=0).stop 2024-09-12T00:51:53.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 -- 172.21.15.2:0/748991630 shutdown_connections 2024-09-12T00:51:53.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 --2- 172.21.15.2:0/748991630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6674102ef0 0x7f667410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:53.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 --2- 172.21.15.2:0/748991630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102570 0x7f66741029b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:53.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 --2- 172.21.15.2:0/748991630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6674100e20 0x7f6674101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 -- 172.21.15.2:0/748991630 >> 172.21.15.2:0/748991630 conn(0x7f66740fc7d0 msgr2=0x7f66740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 -- 172.21.15.2:0/748991630 shutdown_connections 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.475+0000 7f667b261640 1 -- 172.21.15.2:0/748991630 wait complete. 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f667b261640 1 Processor -- start 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f667b261640 1 -- start start 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f667b261640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6674100e20 0x7f66740fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f667b261640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6674102570 0x7f66740fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f667b261640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102ef0 0x7f66740fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f667b261640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6674111020 con 0x7f6674102ef0 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f667b261640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6674110ea0 con 0x7f6674102570 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f667b261640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f66741111a0 con 0x7f6674100e20 2024-09-12T00:51:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102ef0 0x7f66740fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102ef0 0x7f66740fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42036/0 (socket says 172.21.15.2:42036) 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 -- 172.21.15.2:0/2998579683 learned_addr learned my addr 172.21.15.2:0/2998579683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f6673fff640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6674102570 0x7f66740fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 -- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6674100e20 msgr2=0x7f66740fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f6678ffd640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6674100e20 0x7f66740fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6674100e20 0x7f66740fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 -- 172.21.15.2:0/2998579683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6674102570 msgr2=0x7f66740fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6674102570 0x7f66740fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 -- 172.21.15.2:0/2998579683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66741a6bd0 con 0x7f6674102ef0 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f6678ffd640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6674100e20 0x7f66740fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.476+0000 7f66797fe640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102ef0 0x7f66740fd700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f666c00b970 tx=0x7f666c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.477+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c019070 con 0x7f6674102ef0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.477+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f666c00cb40 con 0x7f6674102ef0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.477+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66741a6ec0 con 0x7f6674102ef0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.477+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c007650 con 0x7f6674102ef0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.477+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66741a7420 con 0x7f6674102ef0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.478+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6674062880 con 0x7f6674102ef0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.479+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f666c01c070 con 0x7f6674102ef0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.480+0000 7f6671ffb640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f665c0a2c90 0x7f665c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.480+0000 7f6678ffd640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f665c0a2c90 0x7f665c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.480+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f666c0ceee0 con 0x7f6674102ef0 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.480+0000 7f6671ffb640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] conn(0x7f665c0ac940 0x7f665c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.480+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 --> [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f666c0047d0 con 0x7f665c0ac940 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.480+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f666c0cf290 con 0x7f6674102ef0 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.480+0000 7f6678ffd640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f665c0a2c90 0x7f665c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6664006fd0 tx=0x7f6664008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.480+0000 7f6673fff640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] conn(0x7f665c0ac940 0x7f665c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.481+0000 7f6673fff640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] conn(0x7f665c0ac940 0x7f665c0aede0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.482+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 <== osd.5 v2:172.21.15.167:6808/2028440485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f666c0047d0 con 0x7f665c0ac940 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.495+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 --> [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6674062d00 con 0x7f665c0ac940 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f6671ffb640 1 -- 172.21.15.2:0/2998579683 <== osd.5 v2:172.21.15.167:6808/2028440485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6674062d00 con 0x7f665c0ac940 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] conn(0x7f665c0ac940 msgr2=0x7f665c0aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] conn(0x7f665c0ac940 0x7f665c0aede0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f665c0a2c90 msgr2=0x7f665c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f665c0a2c90 0x7f665c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6664006fd0 tx=0x7f6664008040 comp rx=0 tx=0).stop 2024-09-12T00:51:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102ef0 msgr2=0x7f66740fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 --2- 172.21.15.2:0/2998579683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674102ef0 0x7f66740fd700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f666c00b970 tx=0x7f666c00be30 comp rx=0 tx=0).stop 2024-09-12T00:51:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f66797fe640 1 -- 172.21.15.2:0/2998579683 reap_dead start 2024-09-12T00:51:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 shutdown_connections 2024-09-12T00:51:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 >> 172.21.15.2:0/2998579683 conn(0x7f66740fc7d0 msgr2=0x7f667406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 shutdown_connections 2024-09-12T00:51:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:53.496+0000 7f667b261640 1 -- 172.21.15.2:0/2998579683 wait complete. 2024-09-12T00:51:54.193 INFO:teuthology.orchestra.run.smithi002.stdout:103079215164 2024-09-12T00:51:54.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T00:51:54.571 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:54 smithi002 ceph-mon[31210]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T00:51:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2445774179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 msgr2=0x7f47f410bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 --2- 172.21.15.2:0/2445774179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 0x7f47f410bb40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009900 tx=0x7f47e802a480 comp rx=0 tx=0).stop 2024-09-12T00:51:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2445774179 shutdown_connections 2024-09-12T00:51:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 --2- 172.21.15.2:0/2445774179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f410c160 0x7f47f410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 --2- 172.21.15.2:0/2445774179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 0x7f47f410bb40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 --2- 172.21.15.2:0/2445774179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f4102d30 0x7f47f4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2445774179 >> 172.21.15.2:0/2445774179 conn(0x7f47f40fc790 msgr2=0x7f47f40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2445774179 shutdown_connections 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2445774179 wait complete. 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.661+0000 7f47f9e7b640 1 Processor -- start 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f9e7b640 1 -- start start 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f9e7b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f4102d30 0x7f47f4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f9e7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 0x7f47f4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f9e7b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f410c160 0x7f47f4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f9e7b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4111f60 con 0x7f47f4103650 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f9e7b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4111de0 con 0x7f47f410c160 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f9e7b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41120e0 con 0x7f47f4102d30 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 0x7f47f4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 0x7f47f4100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42070/0 (socket says 172.21.15.2:42070) 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 -- 172.21.15.2:0/2685107510 learned_addr learned my addr 172.21.15.2:0/2685107510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f37fe640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f4102d30 0x7f47f4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 -- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f4102d30 msgr2=0x7f47f4100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f4102d30 0x7f47f4100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f3fff640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f410c160 0x7f47f4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 -- 172.21.15.2:0/2685107510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f410c160 msgr2=0x7f47f4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f410c160 0x7f47f4101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 -- 172.21.15.2:0/2685107510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f41a69f0 con 0x7f47f4103650 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f37fe640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f4102d30 0x7f47f4100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.662+0000 7f47f2ffd640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 0x7f47f4100ed0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006010 tx=0x7f47e8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.663+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e803f030 con 0x7f47f4103650 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.663+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f41a6c80 con 0x7f47f4103650 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.663+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e8004440 con 0x7f47f4103650 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.663+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8035070 con 0x7f47f4103650 2024-09-12T00:51:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.663+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f41a71b0 con 0x7f47f4103650 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.664+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47f40628c0 con 0x7f47f4103650 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.665+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f47e8042030 con 0x7f47f4103650 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.666+0000 7f47f0ff9640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f47dc0a2c90 0x7f47dc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.666+0000 7f47f37fe640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f47dc0a2c90 0x7f47dc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.666+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f47e80efce0 con 0x7f47f4103650 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.666+0000 7f47f0ff9640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] conn(0x7f47dc0ac940 0x7f47dc0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.666+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 --> [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47e8001d30 con 0x7f47dc0ac940 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.666+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f47e80f0130 con 0x7f47f4103650 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.666+0000 7f47f37fe640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f47dc0a2c90 0x7f47dc0a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009b50 tx=0x7f47e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.666+0000 7f47f3fff640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] conn(0x7f47dc0ac940 0x7f47dc0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.667+0000 7f47f3fff640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] conn(0x7f47dc0ac940 0x7f47dc0aede0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.667+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 <== osd.11 v2:172.21.15.167:6824/792671265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47e8001d30 con 0x7f47dc0ac940 2024-09-12T00:51:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.681+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 --> [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47f4062cc0 con 0x7f47dc0ac940 2024-09-12T00:51:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f0ff9640 1 -- 172.21.15.2:0/2685107510 <== osd.11 v2:172.21.15.167:6824/792671265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f47f4062cc0 con 0x7f47dc0ac940 2024-09-12T00:51:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] conn(0x7f47dc0ac940 msgr2=0x7f47dc0aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] conn(0x7f47dc0ac940 0x7f47dc0aede0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f47dc0a2c90 msgr2=0x7f47dc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f47dc0a2c90 0x7f47dc0a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009b50 tx=0x7f47e4005f90 comp rx=0 tx=0).stop 2024-09-12T00:51:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 msgr2=0x7f47f4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 --2- 172.21.15.2:0/2685107510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f4103650 0x7f47f4100ed0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006010 tx=0x7f47e8004040 comp rx=0 tx=0).stop 2024-09-12T00:51:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f3fff640 1 -- 172.21.15.2:0/2685107510 reap_dead start 2024-09-12T00:51:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 shutdown_connections 2024-09-12T00:51:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 >> 172.21.15.2:0/2685107510 conn(0x7f47f40fc790 msgr2=0x7f47f40fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 shutdown_connections 2024-09-12T00:51:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.682+0000 7f47f9e7b640 1 -- 172.21.15.2:0/2685107510 wait complete. 2024-09-12T00:51:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:54 smithi167 ceph-mon[35234]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T00:51:54.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:54 smithi071 ceph-mon[35276]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T00:51:55.404 INFO:teuthology.orchestra.run.smithi002.stdout:206158430248 2024-09-12T00:51:55.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T00:51:55.940 INFO:teuthology.orchestra.run.smithi002.stdout:154618822707 2024-09-12T00:51:55.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T00:51:56.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 -- 172.21.15.2:0/2814240323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4102ef0 msgr2=0x7f59d410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 --2- 172.21.15.2:0/2814240323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4102ef0 0x7f59d410da40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009ca0 tx=0x7f59cc02a950 comp rx=0 tx=0).stop 2024-09-12T00:51:56.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 -- 172.21.15.2:0/2814240323 shutdown_connections 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 --2- 172.21.15.2:0/2814240323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4102ef0 0x7f59d410da40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 --2- 172.21.15.2:0/2814240323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59d4102570 0x7f59d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 --2- 172.21.15.2:0/2814240323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59d4100e20 0x7f59d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 -- 172.21.15.2:0/2814240323 >> 172.21.15.2:0/2814240323 conn(0x7f59d40fc7d0 msgr2=0x7f59d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 -- 172.21.15.2:0/2814240323 shutdown_connections 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.099+0000 7f59db751640 1 -- 172.21.15.2:0/2814240323 wait complete. 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59db751640 1 Processor -- start 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59db751640 1 -- start start 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59db751640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4100e20 0x7f59d4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59db751640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59d4102570 0x7f59d4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59db751640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59d4102ef0 0x7f59d41a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59db751640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4110fa0 con 0x7f59d4100e20 2024-09-12T00:51:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59db751640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4110e20 con 0x7f59d4102570 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59db751640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4111120 con 0x7f59d4102ef0 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d94ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4100e20 0x7f59d4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d94ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4100e20 0x7f59d4199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56476/0 (socket says 172.21.15.2:56476) 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d94ed640 1 -- 172.21.15.2:0/4235370535 learned_addr learned my addr 172.21.15.2:0/4235370535 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d8cec640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59d4102570 0x7f59d4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d9cee640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59d4102ef0 0x7f59d41a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d94ed640 1 -- 172.21.15.2:0/4235370535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59d4102ef0 msgr2=0x7f59d41a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d94ed640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59d4102ef0 0x7f59d41a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d94ed640 1 -- 172.21.15.2:0/4235370535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59d4102570 msgr2=0x7f59d4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.100+0000 7f59d94ed640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59d4102570 0x7f59d4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.101+0000 7f59d94ed640 1 -- 172.21.15.2:0/4235370535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d41a4910 con 0x7f59d4100e20 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.101+0000 7f59d9cee640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59d4102ef0 0x7f59d41a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:51:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.101+0000 7f59d94ed640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4100e20 0x7f59d4199350 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59d000d950 tx=0x7f59d000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.101+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0017070 con 0x7f59d4100e20 2024-09-12T00:51:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.101+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59d000de80 con 0x7f59d4100e20 2024-09-12T00:51:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.101+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d000f620 con 0x7f59d4100e20 2024-09-12T00:51:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.101+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d41a4ae0 con 0x7f59d4100e20 2024-09-12T00:51:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.101+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d41a4ff0 con 0x7f59d4100e20 2024-09-12T00:51:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.102+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59d41072a0 con 0x7f59d4100e20 2024-09-12T00:51:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.103+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f59d0009c30 con 0x7f59d4100e20 2024-09-12T00:51:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.104+0000 7f59ca7fc640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f59c00a2c10 0x7f59c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.104+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f59d00cf260 con 0x7f59d4100e20 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.104+0000 7f59d8cec640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f59c00a2c10 0x7f59c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.104+0000 7f59ca7fc640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] conn(0x7f59c00ac8c0 0x7f59c00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.104+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 --> [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59c00af430 con 0x7f59c00ac8c0 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.104+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f59d00cf6b0 con 0x7f59d4100e20 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.104+0000 7f59d9cee640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] conn(0x7f59c00ac8c0 0x7f59c00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.105+0000 7f59d8cec640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f59c00a2c10 0x7f59c00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f59d406aac0 tx=0x7f59c4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.105+0000 7f59d9cee640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] conn(0x7f59c00ac8c0 0x7f59c00aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.105+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 <== osd.6 v2:172.21.15.2:6818/2590876261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59c00af430 con 0x7f59c00ac8c0 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.119+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 --> [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f59d41021b0 con 0x7f59c00ac8c0 2024-09-12T00:51:56.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.119+0000 7f59ca7fc640 1 -- 172.21.15.2:0/4235370535 <== osd.6 v2:172.21.15.2:6818/2590876261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f59d41021b0 con 0x7f59c00ac8c0 2024-09-12T00:51:56.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] conn(0x7f59c00ac8c0 msgr2=0x7f59c00aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] conn(0x7f59c00ac8c0 0x7f59c00aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f59c00a2c10 msgr2=0x7f59c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f59c00a2c10 0x7f59c00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f59d406aac0 tx=0x7f59c4009110 comp rx=0 tx=0).stop 2024-09-12T00:51:56.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4100e20 msgr2=0x7f59d4199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 --2- 172.21.15.2:0/4235370535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d4100e20 0x7f59d4199350 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59d000d950 tx=0x7f59d000dd50 comp rx=0 tx=0).stop 2024-09-12T00:51:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59d9cee640 1 -- 172.21.15.2:0/4235370535 reap_dead start 2024-09-12T00:51:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 shutdown_connections 2024-09-12T00:51:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 >> 172.21.15.2:0/4235370535 conn(0x7f59d40fc7d0 msgr2=0x7f59d4106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 shutdown_connections 2024-09-12T00:51:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:56.120+0000 7f59db751640 1 -- 172.21.15.2:0/4235370535 wait complete. 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 -- 172.21.15.2:0/34822352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c102d30 msgr2=0x7f133c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 --2- 172.21.15.2:0/34822352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c102d30 0x7f133c103110 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1338009930 tx=0x7f133802a420 comp rx=0 tx=0).stop 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 -- 172.21.15.2:0/34822352 shutdown_connections 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 --2- 172.21.15.2:0/34822352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133c1082a0 0x7f133c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 --2- 172.21.15.2:0/34822352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f133c1036e0 0x7f133c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 --2- 172.21.15.2:0/34822352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c102d30 0x7f133c103110 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 -- 172.21.15.2:0/34822352 >> 172.21.15.2:0/34822352 conn(0x7f133c0fc7d0 msgr2=0x7f133c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 -- 172.21.15.2:0/34822352 shutdown_connections 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.597+0000 7f1343aa5640 1 -- 172.21.15.2:0/34822352 wait complete. 2024-09-12T00:51:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1343aa5640 1 Processor -- start 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1343aa5640 1 -- start start 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1343aa5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f133c102d30 0x7f133c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1343aa5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133c1036e0 0x7f133c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1343aa5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c1082a0 0x7f133c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1343aa5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f133c1120a0 con 0x7f133c1082a0 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1343aa5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f133c111f20 con 0x7f133c102d30 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1343aa5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f133c112220 con 0x7f133c1036e0 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1342042640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c1082a0 0x7f133c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1342042640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c1082a0 0x7f133c19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42058/0 (socket says 172.21.15.2:42058) 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1342042640 1 -- 172.21.15.2:0/3751532694 learned_addr learned my addr 172.21.15.2:0/3751532694 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1341040640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133c1036e0 0x7f133c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1341841640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f133c102d30 0x7f133c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1342042640 1 -- 172.21.15.2:0/3751532694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133c1036e0 msgr2=0x7f133c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1342042640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133c1036e0 0x7f133c198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1342042640 1 -- 172.21.15.2:0/3751532694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f133c102d30 msgr2=0x7f133c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1342042640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f133c102d30 0x7f133c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.598+0000 7f1342042640 1 -- 172.21.15.2:0/3751532694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c19d5a0 con 0x7f133c1082a0 2024-09-12T00:51:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.599+0000 7f1342042640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c1082a0 0x7f133c19cec0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f133400eaa0 tx=0x7f133400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.599+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133400cdb0 con 0x7f133c1082a0 2024-09-12T00:51:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.599+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1334005020 con 0x7f133c1082a0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.599+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13340116b0 con 0x7f133c1082a0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.599+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133c19d890 con 0x7f133c1082a0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.599+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f133c1a5170 con 0x7f133c1082a0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.600+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f133c062980 con 0x7f133c1082a0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.601+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1334005560 con 0x7f133c1082a0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.602+0000 7f132effd640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13280a2c10 0x7f13280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.602+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f13340cf3a0 con 0x7f133c1082a0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.602+0000 7f1341841640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13280a2c10 0x7f13280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.602+0000 7f132effd640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] conn(0x7f13280ac8c0 0x7f13280aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.602+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 --> [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1334018ec0 con 0x7f13280ac8c0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.602+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f13340d6050 con 0x7f133c1082a0 2024-09-12T00:51:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.602+0000 7f1341040640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] conn(0x7f13280ac8c0 0x7f13280aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.602+0000 7f1341841640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13280a2c10 0x7f13280a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1338000c00 tx=0x7f1338005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.603+0000 7f1341040640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] conn(0x7f13280ac8c0 0x7f13280aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.604+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 <== osd.2 v2:172.21.15.167:6800/1652392713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1334018ec0 con 0x7f13280ac8c0 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.617+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 --> [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f133c062e00 con 0x7f13280ac8c0 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f132effd640 1 -- 172.21.15.2:0/3751532694 <== osd.2 v2:172.21.15.167:6800/1652392713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f133c062e00 con 0x7f13280ac8c0 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 >> [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] conn(0x7f13280ac8c0 msgr2=0x7f13280aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] conn(0x7f13280ac8c0 0x7f13280aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13280a2c10 msgr2=0x7f13280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f13280a2c10 0x7f13280a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1338000c00 tx=0x7f1338005a20 comp rx=0 tx=0).stop 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c1082a0 msgr2=0x7f133c19cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 --2- 172.21.15.2:0/3751532694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f133c1082a0 0x7f133c19cec0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f133400eaa0 tx=0x7f133400ef60 comp rx=0 tx=0).stop 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1342042640 1 -- 172.21.15.2:0/3751532694 reap_dead start 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 shutdown_connections 2024-09-12T00:51:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 >> 172.21.15.2:0/3751532694 conn(0x7f133c0fc7d0 msgr2=0x7f133c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:56.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 shutdown_connections 2024-09-12T00:51:56.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:54.618+0000 7f1343aa5640 1 -- 172.21.15.2:0/3751532694 wait complete. 2024-09-12T00:51:56.782 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:56 smithi002 ceph-mon[31210]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:51:56.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:56 smithi167 ceph-mon[35234]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:51:56.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:56 smithi071 ceph-mon[35276]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:51:57.202 INFO:teuthology.orchestra.run.smithi002.stdout:77309411395 2024-09-12T00:51:57.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T00:51:57.782 INFO:teuthology.orchestra.run.smithi002.stdout:313532612629 2024-09-12T00:51:57.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T00:51:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 -- 172.21.15.2:0/1921857457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4103660 msgr2=0x7f6ad410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 --2- 172.21.15.2:0/1921857457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4103660 0x7f6ad410bb50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009900 tx=0x7f6ac802a480 comp rx=0 tx=0).stop 2024-09-12T00:51:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 -- 172.21.15.2:0/1921857457 shutdown_connections 2024-09-12T00:51:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 --2- 172.21.15.2:0/1921857457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad410c170 0x7f6ad410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 --2- 172.21.15.2:0/1921857457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4103660 0x7f6ad410bb50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 --2- 172.21.15.2:0/1921857457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ad4102d40 0x7f6ad4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 -- 172.21.15.2:0/1921857457 >> 172.21.15.2:0/1921857457 conn(0x7f6ad40fc7a0 msgr2=0x7f6ad40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 -- 172.21.15.2:0/1921857457 shutdown_connections 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.081+0000 7f6adb79a640 1 -- 172.21.15.2:0/1921857457 wait complete. 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6adb79a640 1 Processor -- start 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6adb79a640 1 -- start start 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6adb79a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ad4102d40 0x7f6ad4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6adb79a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad4103660 0x7f6ad41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6adb79a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad410c170 0x7f6ad419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6adb79a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad4111fb0 con 0x7f6ad410c170 2024-09-12T00:51:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6adb79a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad4111e30 con 0x7f6ad4102d40 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6adb79a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad4112130 con 0x7f6ad4103660 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6ad9d37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad410c170 0x7f6ad419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6ad9d37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad410c170 0x7f6ad419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56494/0 (socket says 172.21.15.2:56494) 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6ad9536640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ad4102d40 0x7f6ad4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6ad9d37640 1 -- 172.21.15.2:0/925431684 learned_addr learned my addr 172.21.15.2:0/925431684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.082+0000 7f6ad8d35640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad4103660 0x7f6ad41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad9d37640 1 -- 172.21.15.2:0/925431684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad4103660 msgr2=0x7f6ad41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad9d37640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad4103660 0x7f6ad41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad9d37640 1 -- 172.21.15.2:0/925431684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ad4102d40 msgr2=0x7f6ad4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad9d37640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ad4102d40 0x7f6ad4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad9d37640 1 -- 172.21.15.2:0/925431684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad419d420 con 0x7f6ad410c170 2024-09-12T00:51:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad9d37640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad410c170 0x7f6ad419cd40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009fd0 tx=0x7f6ac400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4011830 con 0x7f6ad410c170 2024-09-12T00:51:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad419d710 con 0x7f6ad410c170 2024-09-12T00:51:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ac4016070 con 0x7f6ad410c170 2024-09-12T00:51:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400f2e0 con 0x7f6ad410c170 2024-09-12T00:51:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.083+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad41a4ff0 con 0x7f6ad410c170 2024-09-12T00:51:58.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.084+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ad4062980 con 0x7f6ad410c170 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.085+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6ac40119d0 con 0x7f6ad410c170 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.086+0000 7f6ad27fc640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6abc0a2c10 0x7f6abc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.086+0000 7f6ad9536640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6abc0a2c10 0x7f6abc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.086+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f6ac40ce6a0 con 0x7f6ad410c170 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.086+0000 7f6ad27fc640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] conn(0x7f6abc0ac8c0 0x7f6abc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.086+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 --> [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6abc0af430 con 0x7f6abc0ac8c0 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.086+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f6ac40d5050 con 0x7f6ad410c170 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.086+0000 7f6ad8d35640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] conn(0x7f6abc0ac8c0 0x7f6abc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.087+0000 7f6ad9536640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6abc0a2c10 0x7f6abc0a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6acc005c40 tx=0x7f6acc00a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.087+0000 7f6ad8d35640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] conn(0x7f6abc0ac8c0 0x7f6abc0aed60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:51:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.087+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 <== osd.9 v2:172.21.15.2:6826/1523652680 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6abc0af430 con 0x7f6abc0ac8c0 2024-09-12T00:51:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.102+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 --> [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ad4062e30 con 0x7f6abc0ac8c0 2024-09-12T00:51:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6ad27fc640 1 -- 172.21.15.2:0/925431684 <== osd.9 v2:172.21.15.2:6826/1523652680 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6ad4062e30 con 0x7f6abc0ac8c0 2024-09-12T00:51:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] conn(0x7f6abc0ac8c0 msgr2=0x7f6abc0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] conn(0x7f6abc0ac8c0 0x7f6abc0aed60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:51:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6abc0a2c10 msgr2=0x7f6abc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6abc0a2c10 0x7f6abc0a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6acc005c40 tx=0x7f6acc00a590 comp rx=0 tx=0).stop 2024-09-12T00:51:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad410c170 msgr2=0x7f6ad419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:51:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 --2- 172.21.15.2:0/925431684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad410c170 0x7f6ad419cd40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009fd0 tx=0x7f6ac400b8e0 comp rx=0 tx=0).stop 2024-09-12T00:51:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6ad9d37640 1 -- 172.21.15.2:0/925431684 reap_dead start 2024-09-12T00:51:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 shutdown_connections 2024-09-12T00:51:58.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 >> 172.21.15.2:0/925431684 conn(0x7f6ad40fc7a0 msgr2=0x7f6ad40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:51:58.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 shutdown_connections 2024-09-12T00:51:58.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:51:58.103+0000 7f6adb79a640 1 -- 172.21.15.2:0/925431684 wait complete. 2024-09-12T00:51:58.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:51:58 smithi002 ceph-mon[31210]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-12T00:51:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:51:58 smithi167 ceph-mon[35234]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-12T00:51:58.820 INFO:teuthology.orchestra.run.smithi002.stdout:266287972384 2024-09-12T00:51:58.820 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T00:51:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:51:58 smithi071 ceph-mon[35276]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-12T00:51:59.241 INFO:teuthology.orchestra.run.smithi002.stdout:184683593775 2024-09-12T00:51:59.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T00:51:59.307 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:51:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.325+0000 7f00bc400640 1 -- 172.21.15.2:0/2011550531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4102ef0 msgr2=0x7f00b410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.325+0000 7f00bc400640 1 --2- 172.21.15.2:0/2011550531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4102ef0 0x7f00b410da40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009ca0 tx=0x7f00ac02a950 comp rx=0 tx=0).stop 2024-09-12T00:52:00.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 -- 172.21.15.2:0/2011550531 shutdown_connections 2024-09-12T00:52:00.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 --2- 172.21.15.2:0/2011550531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4102ef0 0x7f00b410da40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 --2- 172.21.15.2:0/2011550531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00b4102570 0x7f00b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 --2- 172.21.15.2:0/2011550531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b4100e20 0x7f00b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 -- 172.21.15.2:0/2011550531 >> 172.21.15.2:0/2011550531 conn(0x7f00b40fc7d0 msgr2=0x7f00b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:00.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 -- 172.21.15.2:0/2011550531 shutdown_connections 2024-09-12T00:52:00.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 -- 172.21.15.2:0/2011550531 wait complete. 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 Processor -- start 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.326+0000 7f00bc400640 1 -- start start 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00bc400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4100e20 0x7f00b41974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00bc400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b4102570 0x7f00b4197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00bc400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00b4102ef0 0x7f00b419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00bc400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4111020 con 0x7f00b4100e20 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00bc400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4110ea0 con 0x7f00b4102ef0 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00bc400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41111a0 con 0x7f00b4102570 2024-09-12T00:52:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4100e20 0x7f00b41974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4100e20 0x7f00b41974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56500/0 (socket says 172.21.15.2:56500) 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 -- 172.21.15.2:0/1190163877 learned_addr learned my addr 172.21.15.2:0/1190163877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba99d640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00b4102ef0 0x7f00b419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00b999b640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b4102570 0x7f00b4197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 -- 172.21.15.2:0/1190163877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b4102570 msgr2=0x7f00b4197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b4102570 0x7f00b4197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 -- 172.21.15.2:0/1190163877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00b4102ef0 msgr2=0x7f00b419bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00b4102ef0 0x7f00b419bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 -- 172.21.15.2:0/1190163877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b419c490 con 0x7f00b4100e20 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00b999b640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b4102570 0x7f00b4197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.327+0000 7f00ba19c640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4100e20 0x7f00b41974e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f00b000b4a0 tx=0x7f00b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.328+0000 7f00a77fe640 1 -- 172.21.15.2:0/1190163877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0014070 con 0x7f00b4100e20 2024-09-12T00:52:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.328+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b419c780 con 0x7f00b4100e20 2024-09-12T00:52:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.328+0000 7f00a77fe640 1 -- 172.21.15.2:0/1190163877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00b0010af0 con 0x7f00b4100e20 2024-09-12T00:52:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.328+0000 7f00a77fe640 1 -- 172.21.15.2:0/1190163877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0017d10 con 0x7f00b4100e20 2024-09-12T00:52:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.328+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b4069f70 con 0x7f00b4100e20 2024-09-12T00:52:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.329+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b4101280 con 0x7f00b4100e20 2024-09-12T00:52:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.330+0000 7f00a77fe640 1 -- 172.21.15.2:0/1190163877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f00b0017070 con 0x7f00b4100e20 2024-09-12T00:52:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.330+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00a00a2c20 0x7f00a00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.331+0000 7f00b999b640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00a00a2c20 0x7f00a00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.331+0000 7f00a77fe640 1 -- 172.21.15.2:0/1190163877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f00b00ce560 con 0x7f00b4100e20 2024-09-12T00:52:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.331+0000 7f00b999b640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00a00a2c20 0x7f00a00a50e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00a8006fd0 tx=0x7f00a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:00.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.335+0000 7f00a77fe640 1 -- 172.21.15.2:0/1190163877 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00b009b450 con 0x7f00b4100e20 2024-09-12T00:52:00.338 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:00.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.520+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f00b406a9c0 con 0x7f00b4100e20 2024-09-12T00:52:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.520+0000 7f00a77fe640 1 -- 172.21.15.2:0/1190163877 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f00b009ad50 con 0x7f00b4100e20 2024-09-12T00:52:00.519 INFO:teuthology.orchestra.run.smithi002.stdout:133143986233 2024-09-12T00:52:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00a00a2c20 msgr2=0x7f00a00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00a00a2c20 0x7f00a00a50e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00a8006fd0 tx=0x7f00a8008040 comp rx=0 tx=0).stop 2024-09-12T00:52:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4100e20 msgr2=0x7f00b41974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4100e20 0x7f00b41974e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f00b000b4a0 tx=0x7f00b000b960 comp rx=0 tx=0).stop 2024-09-12T00:52:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 shutdown_connections 2024-09-12T00:52:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f00a00a2c20 0x7f00a00a50e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00b4102ef0 0x7f00b419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b4102570 0x7f00b4197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 --2- 172.21.15.2:0/1190163877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b4100e20 0x7f00b41974e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 >> 172.21.15.2:0/1190163877 conn(0x7f00b40fc7d0 msgr2=0x7f00b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 shutdown_connections 2024-09-12T00:52:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.522+0000 7f00bc400640 1 -- 172.21.15.2:0/1190163877 wait complete. 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 -- 172.21.15.2:0/7456806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 msgr2=0x7f6d3c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 --2- 172.21.15.2:0/7456806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 0x7f6d3c1021b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009900 tx=0x7f6d2c02a410 comp rx=0 tx=0).stop 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 -- 172.21.15.2:0/7456806 shutdown_connections 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 --2- 172.21.15.2:0/7456806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106f00 0x7f6d3c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 --2- 172.21.15.2:0/7456806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c102780 0x7f6d3c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 --2- 172.21.15.2:0/7456806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 0x7f6d3c1021b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 -- 172.21.15.2:0/7456806 >> 172.21.15.2:0/7456806 conn(0x7f6d3c0fd8b0 msgr2=0x7f6d3c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 -- 172.21.15.2:0/7456806 shutdown_connections 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.511+0000 7f6d414ac640 1 -- 172.21.15.2:0/7456806 wait complete. 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.512+0000 7f6d414ac640 1 Processor -- start 2024-09-12T00:52:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.512+0000 7f6d414ac640 1 -- start start 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.512+0000 7f6d414ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 0x7f6d3c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.512+0000 7f6d414ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c102780 0x7f6d3c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.512+0000 7f6d414ac640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106f00 0x7f6d3c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.512+0000 7f6d414ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c111fb0 con 0x7f6d3c101dd0 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.512+0000 7f6d414ac640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c111e30 con 0x7f6d3c106f00 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.512+0000 7f6d414ac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c112130 con 0x7f6d3c102780 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 0x7f6d3c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 0x7f6d3c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56516/0 (socket says 172.21.15.2:56516) 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c102780 0x7f6d3c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106f00 0x7f6d3c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3affd640 1 -- 172.21.15.2:0/3005985884 learned_addr learned my addr 172.21.15.2:0/3005985884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3a7fc640 1 -- 172.21.15.2:0/3005985884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106f00 msgr2=0x7f6d3c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3a7fc640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106f00 0x7f6d3c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3a7fc640 1 -- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 msgr2=0x7f6d3c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3a7fc640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 0x7f6d3c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3a7fc640 1 -- 172.21.15.2:0/3005985884 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c1a6980 con 0x7f6d3c102780 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3affd640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 0x7f6d3c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d3a7fc640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c102780 0x7f6d3c074a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000e9f0 tx=0x7f6d3000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.513+0000 7f6d23fff640 1 -- 172.21.15.2:0/3005985884 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000ccc0 con 0x7f6d3c102780 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.514+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c1a6c70 con 0x7f6d3c102780 2024-09-12T00:52:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.514+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c1a71b0 con 0x7f6d3c102780 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.514+0000 7f6d23fff640 1 -- 172.21.15.2:0/3005985884 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d30010910 con 0x7f6d3c102780 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.514+0000 7f6d23fff640 1 -- 172.21.15.2:0/3005985884 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30018880 con 0x7f6d3c102780 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.515+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d28005290 con 0x7f6d3c102780 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.516+0000 7f6d23fff640 1 -- 172.21.15.2:0/3005985884 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6d30010430 con 0x7f6d3c102780 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.517+0000 7f6d23fff640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d240a2c10 0x7f6d240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.518+0000 7f6d3affd640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d240a2c10 0x7f6d240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.518+0000 7f6d23fff640 1 -- 172.21.15.2:0/3005985884 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f6d300cf420 con 0x7f6d3c102780 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.518+0000 7f6d3affd640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d240a2c10 0x7f6d240a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0096c0 tx=0x7f6d2c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.520+0000 7f6d23fff640 1 -- 172.21.15.2:0/3005985884 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d3009bbb0 con 0x7f6d3c102780 2024-09-12T00:52:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.702+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f6d28005850 con 0x7f6d3c102780 2024-09-12T00:52:00.701 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:00 smithi002 ceph-mon[31210]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:52:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.702+0000 7f6d23fff640 1 -- 172.21.15.2:0/3005985884 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6d3009feb0 con 0x7f6d3c102780 2024-09-12T00:52:00.702 INFO:teuthology.orchestra.run.smithi002.stdout:236223201317 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d240a2c10 msgr2=0x7f6d240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d240a2c10 0x7f6d240a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0096c0 tx=0x7f6d2c0046c0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c102780 msgr2=0x7f6d3c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c102780 0x7f6d3c074a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000e9f0 tx=0x7f6d3000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 shutdown_connections 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6d240a2c10 0x7f6d240a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106f00 0x7f6d3c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c102780 0x7f6d3c074a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 --2- 172.21.15.2:0/3005985884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101dd0 0x7f6d3c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 >> 172.21.15.2:0/3005985884 conn(0x7f6d3c0fd8b0 msgr2=0x7f6d3c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 shutdown_connections 2024-09-12T00:52:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:00.705+0000 7f6d414ac640 1 -- 172.21.15.2:0/3005985884 wait complete. 2024-09-12T00:52:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:00 smithi167 ceph-mon[35234]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:52:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:00 smithi071 ceph-mon[35276]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:52:00.968 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:00.968 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 -- 172.21.15.2:0/1407971321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc100e20 msgr2=0x7f7ffc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 --2- 172.21.15.2:0/1407971321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc100e20 0x7f7ffc101200 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009900 tx=0x7f7fec02a480 comp rx=0 tx=0).stop 2024-09-12T00:52:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 -- 172.21.15.2:0/1407971321 shutdown_connections 2024-09-12T00:52:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 --2- 172.21.15.2:0/1407971321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc102ef0 0x7f7ffc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 --2- 172.21.15.2:0/1407971321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ffc102570 0x7f7ffc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 --2- 172.21.15.2:0/1407971321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc100e20 0x7f7ffc101200 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 -- 172.21.15.2:0/1407971321 >> 172.21.15.2:0/1407971321 conn(0x7f7ffc0fc7d0 msgr2=0x7f7ffc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 -- 172.21.15.2:0/1407971321 shutdown_connections 2024-09-12T00:52:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.164+0000 7f8001f7f640 1 -- 172.21.15.2:0/1407971321 wait complete. 2024-09-12T00:52:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.165+0000 7f8001f7f640 1 Processor -- start 2024-09-12T00:52:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.165+0000 7f8001f7f640 1 -- start start 2024-09-12T00:52:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f8001f7f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ffc100e20 0x7f7ffc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f8001f7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc102570 0x7f7ffc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f8001f7f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc102ef0 0x7f7ffc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f7ffaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc102570 0x7f7ffc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f7ffaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc102570 0x7f7ffc198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56536/0 (socket says 172.21.15.2:56536) 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f7ffaffd640 1 -- 172.21.15.2:0/3914223522 learned_addr learned my addr 172.21.15.2:0/3914223522 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ffc100e20 0x7f7ffc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc110f50 con 0x7f7ffc102570 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc110dd0 con 0x7f7ffc100e20 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1110d0 con 0x7f7ffc102ef0 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.166+0000 7f7ffbfff640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc102ef0 0x7f7ffc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.167+0000 7f7ffaffd640 1 -- 172.21.15.2:0/3914223522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc102ef0 msgr2=0x7f7ffc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.167+0000 7f7ffaffd640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc102ef0 0x7f7ffc19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.167+0000 7f7ffaffd640 1 -- 172.21.15.2:0/3914223522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ffc100e20 msgr2=0x7f7ffc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.167+0000 7f7ffaffd640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ffc100e20 0x7f7ffc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.167+0000 7f7ffaffd640 1 -- 172.21.15.2:0/3914223522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc19d400 con 0x7f7ffc102570 2024-09-12T00:52:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.167+0000 7f7ffaffd640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc102570 0x7f7ffc198990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000d950 tx=0x7f7ff000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.168+0000 7f7ff8ff9640 1 -- 172.21.15.2:0/3914223522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0017030 con 0x7f7ffc102570 2024-09-12T00:52:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.168+0000 7f7ff8ff9640 1 -- 172.21.15.2:0/3914223522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ff0004020 con 0x7f7ffc102570 2024-09-12T00:52:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.168+0000 7f7ff8ff9640 1 -- 172.21.15.2:0/3914223522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00047a0 con 0x7f7ffc102570 2024-09-12T00:52:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.168+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc19d6f0 con 0x7f7ffc102570 2024-09-12T00:52:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.169+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc1a4fd0 con 0x7f7ffc102570 2024-09-12T00:52:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.171+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ffc101200 con 0x7f7ffc102570 2024-09-12T00:52:01.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.172+0000 7f7ff8ff9640 1 -- 172.21.15.2:0/3914223522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7ff00041d0 con 0x7f7ffc102570 2024-09-12T00:52:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.173+0000 7f7ff8ff9640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fe40a2d60 0x7f7fe40a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:01.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.173+0000 7f7ffb7fe640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fe40a2d60 0x7f7fe40a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:01.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.174+0000 7f7ff8ff9640 1 -- 172.21.15.2:0/3914223522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7ff00ce590 con 0x7f7ffc102570 2024-09-12T00:52:01.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.174+0000 7f7ffb7fe640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fe40a2d60 0x7f7fe40a5220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7fec000c00 tx=0x7f7fec009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:01.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.178+0000 7f7ff8ff9640 1 -- 172.21.15.2:0/3914223522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ff009b3f0 con 0x7f7ffc102570 2024-09-12T00:52:01.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.356+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f7ffc10a0a0 con 0x7f7ffc102570 2024-09-12T00:52:01.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.356+0000 7f7ff8ff9640 1 -- 172.21.15.2:0/3914223522 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7ff009acf0 con 0x7f7ffc102570 2024-09-12T00:52:01.355 INFO:teuthology.orchestra.run.smithi002.stdout:283467841563 2024-09-12T00:52:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fe40a2d60 msgr2=0x7f7fe40a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fe40a2d60 0x7f7fe40a5220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7fec000c00 tx=0x7f7fec009600 comp rx=0 tx=0).stop 2024-09-12T00:52:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc102570 msgr2=0x7f7ffc198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc102570 0x7f7ffc198990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000d950 tx=0x7f7ff000de10 comp rx=0 tx=0).stop 2024-09-12T00:52:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 shutdown_connections 2024-09-12T00:52:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fe40a2d60 0x7f7fe40a5220 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc102ef0 0x7f7ffc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ffc102570 0x7f7ffc198990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 --2- 172.21.15.2:0/3914223522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ffc100e20 0x7f7ffc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 >> 172.21.15.2:0/3914223522 conn(0x7f7ffc0fc7d0 msgr2=0x7f7ffc06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 shutdown_connections 2024-09-12T00:52:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:01.358+0000 7f8001f7f640 1 -- 172.21.15.2:0/3914223522 wait complete. 2024-09-12T00:52:01.537 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201314 got 236223201317 for osd.8 2024-09-12T00:52:01.538 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:01.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:01 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1190163877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T00:52:01.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:01 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3005985884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T00:52:01.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:01 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3914223522' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T00:52:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:01 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1190163877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T00:52:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:01 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3005985884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T00:52:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:01 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3914223522' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T00:52:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:01 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1190163877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T00:52:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:01 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3005985884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T00:52:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:01 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3914223522' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T00:52:02.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 -- 172.21.15.2:0/161766449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 msgr2=0x7fd058101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 --2- 172.21.15.2:0/161766449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 0x7fd058101200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd048009900 tx=0x7fd04802a480 comp rx=0 tx=0).stop 2024-09-12T00:52:02.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 -- 172.21.15.2:0/161766449 shutdown_connections 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 --2- 172.21.15.2:0/161766449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd058102ef0 0x7fd05810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 --2- 172.21.15.2:0/161766449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd058102570 0x7fd0581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 --2- 172.21.15.2:0/161766449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 0x7fd058101200 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 -- 172.21.15.2:0/161766449 >> 172.21.15.2:0/161766449 conn(0x7fd0580fc7d0 msgr2=0x7fd0580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 -- 172.21.15.2:0/161766449 shutdown_connections 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 -- 172.21.15.2:0/161766449 wait complete. 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.120+0000 7fd05dd78640 1 Processor -- start 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd05dd78640 1 -- start start 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd05dd78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 0x7fd058199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd05dd78640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd058102570 0x7fd0581999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd05dd78640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd058102ef0 0x7fd0581a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd05dd78640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd058110fa0 con 0x7fd058100e20 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd05dd78640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd058110e20 con 0x7fd058102ef0 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd05dd78640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd058111120 con 0x7fd058102570 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 0x7fd058199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 0x7fd058199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56546/0 (socket says 172.21.15.2:56546) 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 -- 172.21.15.2:0/2755993494 learned_addr learned my addr 172.21.15.2:0/2755993494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd056ffd640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd058102570 0x7fd0581999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd057fff640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd058102ef0 0x7fd0581a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 -- 172.21.15.2:0/2755993494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd058102570 msgr2=0x7fd0581999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd058102570 0x7fd0581999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 -- 172.21.15.2:0/2755993494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd058102ef0 msgr2=0x7fd0581a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd058102ef0 0x7fd0581a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 -- 172.21.15.2:0/2755993494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0581a4a30 con 0x7fd058100e20 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd056ffd640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd058102570 0x7fd0581999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd057fff640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd058102ef0 0x7fd0581a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.121+0000 7fd0577fe640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 0x7fd058199470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd048006010 tx=0x7fd048003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.122+0000 7fd054ff9640 1 -- 172.21.15.2:0/2755993494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04803f070 con 0x7fd058100e20 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.122+0000 7fd054ff9640 1 -- 172.21.15.2:0/2755993494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd048031e30 con 0x7fd058100e20 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.122+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0581a4c00 con 0x7fd058100e20 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.122+0000 7fd054ff9640 1 -- 172.21.15.2:0/2755993494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048035030 con 0x7fd058100e20 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.122+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0581a50b0 con 0x7fd058100e20 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.123+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd058101200 con 0x7fd058100e20 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.124+0000 7fd054ff9640 1 -- 172.21.15.2:0/2755993494 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd048042070 con 0x7fd058100e20 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.124+0000 7fd054ff9640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd0400a2c90 0x7fd0400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:02.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.125+0000 7fd056ffd640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd0400a2c90 0x7fd0400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:02.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.125+0000 7fd054ff9640 1 -- 172.21.15.2:0/2755993494 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd0480efbd0 con 0x7fd058100e20 2024-09-12T00:52:02.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.125+0000 7fd056ffd640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd0400a2c90 0x7fd0400a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd05806aac0 tx=0x7fd04c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:02.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.129+0000 7fd054ff9640 1 -- 172.21.15.2:0/2755993494 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0480bc950 con 0x7fd058100e20 2024-09-12T00:52:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.307+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd058109090 con 0x7fd058100e20 2024-09-12T00:52:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.308+0000 7fd054ff9640 1 -- 172.21.15.2:0/2755993494 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd0480bc250 con 0x7fd058100e20 2024-09-12T00:52:02.307 INFO:teuthology.orchestra.run.smithi002.stdout:55834574922 2024-09-12T00:52:02.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd0400a2c90 msgr2=0x7fd0400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd0400a2c90 0x7fd0400a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd05806aac0 tx=0x7fd04c008040 comp rx=0 tx=0).stop 2024-09-12T00:52:02.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 msgr2=0x7fd058199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 0x7fd058199470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd048006010 tx=0x7fd048003c80 comp rx=0 tx=0).stop 2024-09-12T00:52:02.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 shutdown_connections 2024-09-12T00:52:02.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd0400a2c90 0x7fd0400a5150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd058102ef0 0x7fd0581a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd058102570 0x7fd0581999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 --2- 172.21.15.2:0/2755993494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058100e20 0x7fd058199470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 >> 172.21.15.2:0/2755993494 conn(0x7fd0580fc7d0 msgr2=0x7fd0580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:02.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 shutdown_connections 2024-09-12T00:52:02.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.311+0000 7fd05dd78640 1 -- 172.21.15.2:0/2755993494 wait complete. 2024-09-12T00:52:02.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ec5ffb640 1 -- 172.21.15.2:0/3402446666 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80319b0 con 0x7f7ec8100a60 2024-09-12T00:52:02.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 -- 172.21.15.2:0/3402446666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8100a60 msgr2=0x7f7ec8100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/3402446666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8100a60 0x7f7ec8100ec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009930 tx=0x7f7eb802a420 comp rx=0 tx=0).stop 2024-09-12T00:52:02.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 -- 172.21.15.2:0/3402446666 shutdown_connections 2024-09-12T00:52:02.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/3402446666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ec8101400 0x7f7ec810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/3402446666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8100a60 0x7f7ec8100ec0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/3402446666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ec8106a60 0x7f7ec8106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 -- 172.21.15.2:0/3402446666 >> 172.21.15.2:0/3402446666 conn(0x7f7ec80fc780 msgr2=0x7f7ec80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 -- 172.21.15.2:0/3402446666 shutdown_connections 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 -- 172.21.15.2:0/3402446666 wait complete. 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.347+0000 7f7ecd69c640 1 Processor -- start 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ecd69c640 1 -- start start 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ecd69c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ec8100a60 0x7f7ec8197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ecd69c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ec8101400 0x7f7ec81978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ecd69c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8106a60 0x7f7ec819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ecd69c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec8110eb0 con 0x7f7ec8106a60 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ecd69c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec8110d30 con 0x7f7ec8100a60 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ecd69c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec8111030 con 0x7f7ec8101400 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8106a60 0x7f7ec819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8106a60 0x7f7ec819bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56574/0 (socket says 172.21.15.2:56574) 2024-09-12T00:52:02.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec77fe640 1 -- 172.21.15.2:0/530606143 learned_addr learned my addr 172.21.15.2:0/530606143 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec67fc640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ec8101400 0x7f7ec81978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec6ffd640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ec8100a60 0x7f7ec8197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec77fe640 1 -- 172.21.15.2:0/530606143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ec8101400 msgr2=0x7f7ec81978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec77fe640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ec8101400 0x7f7ec81978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec77fe640 1 -- 172.21.15.2:0/530606143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ec8100a60 msgr2=0x7f7ec8197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec77fe640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ec8100a60 0x7f7ec8197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.348+0000 7f7ec77fe640 1 -- 172.21.15.2:0/530606143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec819c350 con 0x7f7ec8106a60 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.349+0000 7f7ec77fe640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8106a60 0x7f7ec819bc50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000eb10 tx=0x7f7ec000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.349+0000 7f7eaffff640 1 -- 172.21.15.2:0/530606143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0004b20 con 0x7f7ec8106a60 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.349+0000 7f7eaffff640 1 -- 172.21.15.2:0/530606143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ec0004cc0 con 0x7f7ec8106a60 2024-09-12T00:52:02.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.349+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec819c640 con 0x7f7ec8106a60 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.349+0000 7f7eaffff640 1 -- 172.21.15.2:0/530606143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0010760 con 0x7f7ec8106a60 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.349+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec806a790 con 0x7f7ec8106a60 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.350+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec8100ec0 con 0x7f7ec8106a60 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.351+0000 7f7eaffff640 1 -- 172.21.15.2:0/530606143 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7ec0005000 con 0x7f7ec8106a60 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.352+0000 7f7eaffff640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7eb00a2c10 0x7f7eb00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.352+0000 7f7ec6ffd640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7eb00a2c10 0x7f7eb00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.352+0000 7f7eaffff640 1 -- 172.21.15.2:0/530606143 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7ec00cfd20 con 0x7f7ec8106a60 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.353+0000 7f7ec6ffd640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7eb00a2c10 0x7f7eb00a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc005fd0 tx=0x7f7ebc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:02.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.356+0000 7f7eaffff640 1 -- 172.21.15.2:0/530606143 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ec009caa0 con 0x7f7ec8106a60 2024-09-12T00:52:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.533+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f7ec81986e0 con 0x7f7ec8106a60 2024-09-12T00:52:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.533+0000 7f7eaffff640 1 -- 172.21.15.2:0/530606143 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7ec81986e0 con 0x7f7ec8106a60 2024-09-12T00:52:02.532 INFO:teuthology.orchestra.run.smithi002.stdout:266287972384 2024-09-12T00:52:02.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7eb00a2c10 msgr2=0x7f7eb00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7eb00a2c10 0x7f7eb00a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc005fd0 tx=0x7f7ebc005850 comp rx=0 tx=0).stop 2024-09-12T00:52:02.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8106a60 msgr2=0x7f7ec819bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:02.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8106a60 0x7f7ec819bc50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000eb10 tx=0x7f7ec000c2d0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 shutdown_connections 2024-09-12T00:52:02.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7eb00a2c10 0x7f7eb00a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ec8106a60 0x7f7ec819bc50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ec8101400 0x7f7ec81978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 --2- 172.21.15.2:0/530606143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ec8100a60 0x7f7ec8197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.535+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 >> 172.21.15.2:0/530606143 conn(0x7f7ec80fc780 msgr2=0x7f7ec80fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.536+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 shutdown_connections 2024-09-12T00:52:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:02.536+0000 7f7ecd69c640 1 -- 172.21.15.2:0/530606143 wait complete. 2024-09-12T00:52:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:02 smithi167 ceph-mon[35234]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-12T00:52:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:02 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2755993494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T00:52:02.843 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:02 smithi071 ceph-mon[35276]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-12T00:52:02.843 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:02 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2755993494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T00:52:02.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:02 smithi002 ceph-mon[31210]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-12T00:52:02.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:02 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2755993494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T00:52:03.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:03 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/530606143' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T00:52:03.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:03 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/530606143' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T00:52:03.862 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841561 got 283467841563 for osd.10 2024-09-12T00:52:03.862 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:03.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:03 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/530606143' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 -- 172.21.15.2:0/846929904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510106f10 msgr2=0x7f851010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 --2- 172.21.15.2:0/846929904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510106f10 0x7f851010ea90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8508009ca0 tx=0x7f850802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 -- 172.21.15.2:0/846929904 shutdown_connections 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 --2- 172.21.15.2:0/846929904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510106f10 0x7f851010ea90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 --2- 172.21.15.2:0/846929904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8510102790 0x7f85101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 --2- 172.21.15.2:0/846929904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8510101de0 0x7f85101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 -- 172.21.15.2:0/846929904 >> 172.21.15.2:0/846929904 conn(0x7f85100fd8c0 msgr2=0x7f85100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 -- 172.21.15.2:0/846929904 shutdown_connections 2024-09-12T00:52:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.045+0000 7f8515ad0640 1 -- 172.21.15.2:0/846929904 wait complete. 2024-09-12T00:52:04.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f8515ad0640 1 Processor -- start 2024-09-12T00:52:04.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f8515ad0640 1 -- start start 2024-09-12T00:52:04.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f8515ad0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8510101de0 0x7f8510198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:04.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f8515ad0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102790 0x7f8510198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f8515ad0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8510106f10 0x7f851019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f8515ad0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8510111fc0 con 0x7f8510102790 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f8515ad0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8510111e40 con 0x7f8510106f10 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f8515ad0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8510112140 con 0x7f8510101de0 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f850effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102790 0x7f8510198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f850effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102790 0x7f8510198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56588/0 (socket says 172.21.15.2:56588) 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f850effd640 1 -- 172.21.15.2:0/2647682502 learned_addr learned my addr 172.21.15.2:0/2647682502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.046+0000 7f850f7fe640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8510101de0 0x7f8510198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850ffff640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8510106f10 0x7f851019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850effd640 1 -- 172.21.15.2:0/2647682502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8510101de0 msgr2=0x7f8510198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850effd640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8510101de0 0x7f8510198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850effd640 1 -- 172.21.15.2:0/2647682502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8510106f10 msgr2=0x7f851019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850effd640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8510106f10 0x7f851019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850effd640 1 -- 172.21.15.2:0/2647682502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851019d3c0 con 0x7f8510102790 2024-09-12T00:52:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850effd640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102790 0x7f8510198950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f850400c920 tx=0x7f850400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850cff9640 1 -- 172.21.15.2:0/2647682502 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504007c70 con 0x7f8510102790 2024-09-12T00:52:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850cff9640 1 -- 172.21.15.2:0/2647682502 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8504007e10 con 0x7f8510102790 2024-09-12T00:52:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851019d6b0 con 0x7f8510102790 2024-09-12T00:52:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f850cff9640 1 -- 172.21.15.2:0/2647682502 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504018890 con 0x7f8510102790 2024-09-12T00:52:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.047+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85101a4f90 con 0x7f8510102790 2024-09-12T00:52:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.048+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85101021c0 con 0x7f8510102790 2024-09-12T00:52:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.049+0000 7f850cff9640 1 -- 172.21.15.2:0/2647682502 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8504018a70 con 0x7f8510102790 2024-09-12T00:52:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.050+0000 7f850cff9640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f84f80a2c10 0x7f84f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.050+0000 7f850f7fe640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f84f80a2c10 0x7f84f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.050+0000 7f850cff9640 1 -- 172.21.15.2:0/2647682502 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f85040cf2f0 con 0x7f8510102790 2024-09-12T00:52:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.051+0000 7f850f7fe640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f84f80a2c10 0x7f84f80a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f850000bbe0 tx=0x7f850000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.054+0000 7f850cff9640 1 -- 172.21.15.2:0/2647682502 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8504014030 con 0x7f8510102790 2024-09-12T00:52:04.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.235+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f85101a51c0 con 0x7f8510102790 2024-09-12T00:52:04.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.235+0000 7f850cff9640 1 -- 172.21.15.2:0/2647682502 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f850409c0d0 con 0x7f8510102790 2024-09-12T00:52:04.234 INFO:teuthology.orchestra.run.smithi002.stdout:206158430251 2024-09-12T00:52:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f84f80a2c10 msgr2=0x7f84f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f84f80a2c10 0x7f84f80a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f850000bbe0 tx=0x7f850000b390 comp rx=0 tx=0).stop 2024-09-12T00:52:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102790 msgr2=0x7f8510198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102790 0x7f8510198950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f850400c920 tx=0x7f850400cde0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 shutdown_connections 2024-09-12T00:52:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f84f80a2c10 0x7f84f80a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8510106f10 0x7f851019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8510102790 0x7f8510198950 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 --2- 172.21.15.2:0/2647682502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8510101de0 0x7f8510198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.237+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 >> 172.21.15.2:0/2647682502 conn(0x7f85100fd8c0 msgr2=0x7f85100ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.238+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 shutdown_connections 2024-09-12T00:52:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.238+0000 7f8515ad0640 1 -- 172.21.15.2:0/2647682502 wait complete. 2024-09-12T00:52:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 -- 172.21.15.2:0/3142630300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 msgr2=0x7fc9d4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/3142630300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 0x7fc9d4101200 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009900 tx=0x7fc9c402a480 comp rx=0 tx=0).stop 2024-09-12T00:52:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 -- 172.21.15.2:0/3142630300 shutdown_connections 2024-09-12T00:52:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/3142630300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9d4102ef0 0x7fc9d410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/3142630300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d4102570 0x7fc9d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/3142630300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 0x7fc9d4101200 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 -- 172.21.15.2:0/3142630300 >> 172.21.15.2:0/3142630300 conn(0x7fc9d40fc7d0 msgr2=0x7fc9d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 -- 172.21.15.2:0/3142630300 shutdown_connections 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 -- 172.21.15.2:0/3142630300 wait complete. 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.580+0000 7fc9d9b21640 1 Processor -- start 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d9b21640 1 -- start start 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d9b21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 0x7fc9d419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d9b21640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d4102570 0x7fc9d419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d9b21640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9d4102ef0 0x7fc9d419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d9b21640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4110f80 con 0x7fc9d4100e20 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d9b21640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4110e00 con 0x7fc9d4102570 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d9b21640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4111100 con 0x7fc9d4102ef0 2024-09-12T00:52:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 0x7fc9d419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 0x7fc9d419a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56598/0 (socket says 172.21.15.2:56598) 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d37fe640 1 -- 172.21.15.2:0/2275721462 learned_addr learned my addr 172.21.15.2:0/2275721462 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d3fff640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9d4102ef0 0x7fc9d419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d2ffd640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d4102570 0x7fc9d419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d37fe640 1 -- 172.21.15.2:0/2275721462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9d4102ef0 msgr2=0x7fc9d419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d37fe640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9d4102ef0 0x7fc9d419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d37fe640 1 -- 172.21.15.2:0/2275721462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d4102570 msgr2=0x7fc9d419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d37fe640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d4102570 0x7fc9d419ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d37fe640 1 -- 172.21.15.2:0/2275721462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d419f6e0 con 0x7fc9d4100e20 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d3fff640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9d4102ef0 0x7fc9d419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.581+0000 7fc9d2ffd640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d4102570 0x7fc9d419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.582+0000 7fc9d37fe640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 0x7fc9d419a730 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4006010 tx=0x7fc9c4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.582+0000 7fc9d0ff9640 1 -- 172.21.15.2:0/2275721462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c403f070 con 0x7fc9d4100e20 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.582+0000 7fc9d0ff9640 1 -- 172.21.15.2:0/2275721462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9c4031c30 con 0x7fc9d4100e20 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.582+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d419f970 con 0x7fc9d4100e20 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.582+0000 7fc9d0ff9640 1 -- 172.21.15.2:0/2275721462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4035030 con 0x7fc9d4100e20 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.582+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d41a72b0 con 0x7fc9d4100e20 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.583+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d4101200 con 0x7fc9d4100e20 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.585+0000 7fc9d0ff9640 1 -- 172.21.15.2:0/2275721462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc9c4042070 con 0x7fc9d4100e20 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.585+0000 7fc9d0ff9640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc9bc0a2c90 0x7fc9bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.585+0000 7fc9d2ffd640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc9bc0a2c90 0x7fc9bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.585+0000 7fc9d0ff9640 1 -- 172.21.15.2:0/2275721462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc9c40efef0 con 0x7fc9d4100e20 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.586+0000 7fc9d2ffd640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc9bc0a2c90 0x7fc9bc0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80058c0 tx=0x7fc9c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.589+0000 7fc9d0ff9640 1 -- 172.21.15.2:0/2275721462 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9c411f1b0 con 0x7fc9d4100e20 2024-09-12T00:52:04.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.768+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc9d41a7480 con 0x7fc9d4100e20 2024-09-12T00:52:04.767 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:04 smithi002 ceph-mon[31210]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T00:52:04.767 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:04 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2647682502' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T00:52:04.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.769+0000 7fc9d0ff9640 1 -- 172.21.15.2:0/2275721462 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc9c4031de0 con 0x7fc9d4100e20 2024-09-12T00:52:04.768 INFO:teuthology.orchestra.run.smithi002.stdout:154618822709 2024-09-12T00:52:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc9bc0a2c90 msgr2=0x7fc9bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc9bc0a2c90 0x7fc9bc0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80058c0 tx=0x7fc9c8005850 comp rx=0 tx=0).stop 2024-09-12T00:52:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 msgr2=0x7fc9d419a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 0x7fc9d419a730 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4006010 tx=0x7fc9c4003c10 comp rx=0 tx=0).stop 2024-09-12T00:52:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 shutdown_connections 2024-09-12T00:52:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc9bc0a2c90 0x7fc9bc0a5150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9d4102ef0 0x7fc9d419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d4102570 0x7fc9d419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 --2- 172.21.15.2:0/2275721462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9d4100e20 0x7fc9d419a730 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 >> 172.21.15.2:0/2275721462 conn(0x7fc9d40fc7d0 msgr2=0x7fc9d406a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 shutdown_connections 2024-09-12T00:52:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:04.771+0000 7fc9d9b21640 1 -- 172.21.15.2:0/2275721462 wait complete. 2024-09-12T00:52:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:04 smithi167 ceph-mon[35234]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T00:52:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:04 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2647682502' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T00:52:04.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:04 smithi071 ceph-mon[35276]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T00:52:04.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:04 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2647682502' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T00:52:05.444 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822709 for osd.5 2024-09-12T00:52:05.444 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:05.548 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:05 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2275721462' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T00:52:05.577 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972384 got 266287972384 for osd.9 2024-09-12T00:52:05.577 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:05.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:05 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2275721462' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T00:52:05.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:05 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2275721462' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T00:52:05.981 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986231 got 133143986233 for osd.4 2024-09-12T00:52:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:05.981 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:06.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:06 smithi002 ceph-mon[31210]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:06.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:06 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 -- 172.21.15.2:0/2681798972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 msgr2=0x7f5f88106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/2681798972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 0x7f5f88106800 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009900 tx=0x7f5f7c02a410 comp rx=0 tx=0).stop 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 -- 172.21.15.2:0/2681798972 shutdown_connections 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/2681798972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f88106f30 0x7f5f8810eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/2681798972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 0x7f5f88106800 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/2681798972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f88100310 0x7f5f881006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 -- 172.21.15.2:0/2681798972 >> 172.21.15.2:0/2681798972 conn(0x7f5f88077210 msgr2=0x7f5f880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 -- 172.21.15.2:0/2681798972 shutdown_connections 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.685+0000 7f5f8d78e640 1 -- 172.21.15.2:0/2681798972 wait complete. 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.686+0000 7f5f8d78e640 1 Processor -- start 2024-09-12T00:52:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.686+0000 7f5f8d78e640 1 -- start start 2024-09-12T00:52:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.686+0000 7f5f8d78e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f88100310 0x7f5f88198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.686+0000 7f5f8d78e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 0x7f5f88198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.686+0000 7f5f8d78e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f88106f30 0x7f5f8819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f8d78e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88111fb0 con 0x7f5f88100cc0 2024-09-12T00:52:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 0x7f5f88198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f8d78e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88111e30 con 0x7f5f88106f30 2024-09-12T00:52:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f8d78e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88112130 con 0x7f5f88100310 2024-09-12T00:52:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 0x7f5f88198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60832/0 (socket says 172.21.15.2:60832) 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 -- 172.21.15.2:0/3842188083 learned_addr learned my addr 172.21.15.2:0/3842188083 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f86ffd640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f88100310 0x7f5f88198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f877fe640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f88106f30 0x7f5f8819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 -- 172.21.15.2:0/3842188083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f88100310 msgr2=0x7f5f88198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f88100310 0x7f5f88198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 -- 172.21.15.2:0/3842188083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f88106f30 msgr2=0x7f5f8819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f88106f30 0x7f5f8819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 -- 172.21.15.2:0/3842188083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8819d520 con 0x7f5f88100cc0 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f86ffd640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f88100310 0x7f5f88198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f867fc640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 0x7f5f88198ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c006010 tx=0x7f5f7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f6ffff640 1 -- 172.21.15.2:0/3842188083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c03f030 con 0x7f5f88100cc0 2024-09-12T00:52:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8819d7b0 con 0x7f5f88100cc0 2024-09-12T00:52:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f6ffff640 1 -- 172.21.15.2:0/3842188083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f7c003ce0 con 0x7f5f88100cc0 2024-09-12T00:52:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f6ffff640 1 -- 172.21.15.2:0/3842188083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c035070 con 0x7f5f88100cc0 2024-09-12T00:52:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.687+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f881a50f0 con 0x7f5f88100cc0 2024-09-12T00:52:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.688+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f881006f0 con 0x7f5f88100cc0 2024-09-12T00:52:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.689+0000 7f5f6ffff640 1 -- 172.21.15.2:0/3842188083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5f7c042030 con 0x7f5f88100cc0 2024-09-12T00:52:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.690+0000 7f5f6ffff640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5f700a2c10 0x7f5f700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.690+0000 7f5f86ffd640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5f700a2c10 0x7f5f700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.690+0000 7f5f6ffff640 1 -- 172.21.15.2:0/3842188083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5f7c0ef930 con 0x7f5f88100cc0 2024-09-12T00:52:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.691+0000 7f5f86ffd640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5f700a2c10 0x7f5f700a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009930 tx=0x7f5f78008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:06.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.694+0000 7f5f6ffff640 1 -- 172.21.15.2:0/3842188083 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f7c0bc770 con 0x7f5f88100cc0 2024-09-12T00:52:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:06 smithi167 ceph-mon[35234]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:06 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 -- 172.21.15.2:0/50665747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c102d30 msgr2=0x7fe30c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 --2- 172.21.15.2:0/50665747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c102d30 0x7fe30c103110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009930 tx=0x7fe2fc02a420 comp rx=0 tx=0).stop 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 -- 172.21.15.2:0/50665747 shutdown_connections 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 --2- 172.21.15.2:0/50665747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c1082a0 0x7fe30c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 --2- 172.21.15.2:0/50665747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe30c1036e0 0x7fe30c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 --2- 172.21.15.2:0/50665747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c102d30 0x7fe30c103110 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 -- 172.21.15.2:0/50665747 >> 172.21.15.2:0/50665747 conn(0x7fe30c0fc7d0 msgr2=0x7fe30c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 -- 172.21.15.2:0/50665747 shutdown_connections 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 -- 172.21.15.2:0/50665747 wait complete. 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 Processor -- start 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.861+0000 7fe312449640 1 -- start start 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe312449640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe30c102d30 0x7fe30c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe312449640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1036e0 0x7fe30c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe312449640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c1082a0 0x7fe30c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe312449640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c112100 con 0x7fe30c1036e0 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe312449640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c111f80 con 0x7fe30c102d30 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe312449640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c112280 con 0x7fe30c1082a0 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1036e0 0x7fe30c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1036e0 0x7fe30c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60842/0 (socket says 172.21.15.2:60842) 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe30c102d30 0x7fe30c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 -- 172.21.15.2:0/661769488 learned_addr learned my addr 172.21.15.2:0/661769488 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe3109e6640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c1082a0 0x7fe30c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 -- 172.21.15.2:0/661769488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c1082a0 msgr2=0x7fe30c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c1082a0 0x7fe30c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 -- 172.21.15.2:0/661769488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe30c102d30 msgr2=0x7fe30c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe30c102d30 0x7fe30c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 -- 172.21.15.2:0/661769488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1a6ae0 con 0x7fe30c1036e0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.862+0000 7fe30b7fe640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1036e0 0x7fe30c100ed0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe30000e9f0 tx=0x7fe30000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.863+0000 7fe3097fa640 1 -- 172.21.15.2:0/661769488 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30000ccc0 con 0x7fe30c1036e0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.863+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c1a6dd0 con 0x7fe30c1036e0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.863+0000 7fe3097fa640 1 -- 172.21.15.2:0/661769488 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe300010910 con 0x7fe30c1036e0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.863+0000 7fe3097fa640 1 -- 172.21.15.2:0/661769488 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300018920 con 0x7fe30c1036e0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.863+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1a72d0 con 0x7fe30c1036e0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.864+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c103110 con 0x7fe30c1036e0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.865+0000 7fe3097fa640 1 -- 172.21.15.2:0/661769488 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe300010ac0 con 0x7fe30c1036e0 2024-09-12T00:52:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.866+0000 7fe3097fa640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe2f40a2c10 0x7fe2f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.866+0000 7fe30bfff640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe2f40a2c10 0x7fe2f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.866+0000 7fe3097fa640 1 -- 172.21.15.2:0/661769488 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fe3000cf4d0 con 0x7fe30c1036e0 2024-09-12T00:52:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.866+0000 7fe30bfff640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe2f40a2c10 0x7fe2f40a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009900 tx=0x7fe2fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.870+0000 7fe3097fa640 1 -- 172.21.15.2:0/661769488 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe30009bc00 con 0x7fe30c1036e0 2024-09-12T00:52:06.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.872+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5f8810a110 con 0x7f5f88100cc0 2024-09-12T00:52:06.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.872+0000 7f5f6ffff640 1 -- 172.21.15.2:0/3842188083 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f7c0bc070 con 0x7f5f88100cc0 2024-09-12T00:52:06.874 INFO:teuthology.orchestra.run.smithi002.stdout:34359738446 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5f700a2c10 msgr2=0x7f5f700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5f700a2c10 0x7f5f700a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009930 tx=0x7f5f78008040 comp rx=0 tx=0).stop 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 msgr2=0x7f5f88198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 0x7f5f88198ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c006010 tx=0x7f5f7c0042f0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 shutdown_connections 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f5f700a2c10 0x7f5f700a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f88106f30 0x7f5f8819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f88100cc0 0x7f5f88198ab0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 --2- 172.21.15.2:0/3842188083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f88100310 0x7f5f88198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 >> 172.21.15.2:0/3842188083 conn(0x7f5f88077210 msgr2=0x7f5f88105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 shutdown_connections 2024-09-12T00:52:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:06.875+0000 7f5f8d78e640 1 -- 172.21.15.2:0/3842188083 wait complete. 2024-09-12T00:52:06.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:06 smithi071 ceph-mon[35276]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:06.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:06 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:07.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.054+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe30c10a2b0 con 0x7fe30c1036e0 2024-09-12T00:52:07.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.055+0000 7fe3097fa640 1 -- 172.21.15.2:0/661769488 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe30009ff00 con 0x7fe30c1036e0 2024-09-12T00:52:07.054 INFO:teuthology.orchestra.run.smithi002.stdout:313532612631 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe2f40a2c10 msgr2=0x7fe2f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe2f40a2c10 0x7fe2f40a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009900 tx=0x7fe2fc0058d0 comp rx=0 tx=0).stop 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1036e0 msgr2=0x7fe30c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1036e0 0x7fe30c100ed0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe30000e9f0 tx=0x7fe30000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 shutdown_connections 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe2f40a2c10 0x7fe2f40a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c1082a0 0x7fe30c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1036e0 0x7fe30c100ed0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 --2- 172.21.15.2:0/661769488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe30c102d30 0x7fe30c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 >> 172.21.15.2:0/661769488 conn(0x7fe30c0fc7d0 msgr2=0x7fe30c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 shutdown_connections 2024-09-12T00:52:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:07.057+0000 7fe312449640 1 -- 172.21.15.2:0/661769488 wait complete. 2024-09-12T00:52:07.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:07 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3842188083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T00:52:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:07 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/661769488' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T00:52:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:07 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:07 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:07 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:07 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:07 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3842188083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T00:52:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:07 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/661769488' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T00:52:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:07 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:07 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:07 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:07 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.916 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612629 got 313532612631 for osd.11 2024-09-12T00:52:07.916 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:07 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3842188083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T00:52:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:07 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/661769488' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T00:52:07.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:07 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:07 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:07 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:07.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:07 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:08.556 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430248 got 206158430251 for osd.7 2024-09-12T00:52:08.556 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 -- 172.21.15.2:0/228357784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 msgr2=0x7fa888100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 --2- 172.21.15.2:0/228357784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 0x7fa888100d30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa870009930 tx=0x7fa87002a420 comp rx=0 tx=0).stop 2024-09-12T00:52:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 -- 172.21.15.2:0/228357784 shutdown_connections 2024-09-12T00:52:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 --2- 172.21.15.2:0/228357784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa888101270 0x7fa88810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 --2- 172.21.15.2:0/228357784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 0x7fa888100d30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 --2- 172.21.15.2:0/228357784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8881068d0 0x7fa888106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 -- 172.21.15.2:0/228357784 >> 172.21.15.2:0/228357784 conn(0x7fa8880fc630 msgr2=0x7fa8880fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 -- 172.21.15.2:0/228357784 shutdown_connections 2024-09-12T00:52:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.719+0000 7fa88cba0640 1 -- 172.21.15.2:0/228357784 wait complete. 2024-09-12T00:52:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.720+0000 7fa88cba0640 1 Processor -- start 2024-09-12T00:52:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.720+0000 7fa88cba0640 1 -- start start 2024-09-12T00:52:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.720+0000 7fa88cba0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 0x7fa888198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.720+0000 7fa88cba0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa888101270 0x7fa8881987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.720+0000 7fa88cba0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8881068d0 0x7fa88819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.720+0000 7fa88cba0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa888110cd0 con 0x7fa8881008d0 2024-09-12T00:52:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.720+0000 7fa88cba0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa888110b50 con 0x7fa888101270 2024-09-12T00:52:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.720+0000 7fa88cba0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa888110e50 con 0x7fa8881068d0 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 0x7fa888198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 0x7fa888198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60860/0 (socket says 172.21.15.2:60860) 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 -- 172.21.15.2:0/3100651064 learned_addr learned my addr 172.21.15.2:0/3100651064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa887fff640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8881068d0 0x7fa88819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 -- 172.21.15.2:0/3100651064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8881068d0 msgr2=0x7fa88819cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8881068d0 0x7fa88819cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 -- 172.21.15.2:0/3100651064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa888101270 msgr2=0x7fa8881987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa888101270 0x7fa8881987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 -- 172.21.15.2:0/3100651064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88819d240 con 0x7fa8881008d0 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 0x7fa888198290 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c890 tx=0x7fa87800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:08.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa884ff9640 1 -- 172.21.15.2:0/3100651064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878004220 con 0x7fa8881008d0 2024-09-12T00:52:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa884ff9640 1 -- 172.21.15.2:0/3100651064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8780043c0 con 0x7fa8881008d0 2024-09-12T00:52:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa884ff9640 1 -- 172.21.15.2:0/3100651064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8780049e0 con 0x7fa8881008d0 2024-09-12T00:52:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa88819d530 con 0x7fa8881008d0 2024-09-12T00:52:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.721+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8881a4e10 con 0x7fa8881008d0 2024-09-12T00:52:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.722+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa888100d30 con 0x7fa8881008d0 2024-09-12T00:52:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.723+0000 7fa884ff9640 1 -- 172.21.15.2:0/3100651064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fa8780079b0 con 0x7fa8881008d0 2024-09-12T00:52:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.725+0000 7fa884ff9640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa8740a2c10 0x7fa8740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.725+0000 7fa886ffd640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa8740a2c10 0x7fa8740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.725+0000 7fa884ff9640 1 -- 172.21.15.2:0/3100651064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa8780cf2a0 con 0x7fa8881008d0 2024-09-12T00:52:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.725+0000 7fa886ffd640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa8740a2c10 0x7fa8740a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa87002a940 tx=0x7fa870000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.729+0000 7fa884ff9640 1 -- 172.21.15.2:0/3100651064 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa878014030 con 0x7fa8881008d0 2024-09-12T00:52:08.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:08 smithi167 ceph-mon[35234]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:08.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:08 smithi002 ceph-mon[31210]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:08.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.908+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa8881995f0 con 0x7fa8881008d0 2024-09-12T00:52:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.908+0000 7fa884ff9640 1 -- 172.21.15.2:0/3100651064 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa87809c080 con 0x7fa8881008d0 2024-09-12T00:52:08.908 INFO:teuthology.orchestra.run.smithi002.stdout:103079215168 2024-09-12T00:52:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa8740a2c10 msgr2=0x7fa8740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa8740a2c10 0x7fa8740a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa87002a940 tx=0x7fa870000bc0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 msgr2=0x7fa888198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 0x7fa888198290 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c890 tx=0x7fa87800cd50 comp rx=0 tx=0).stop 2024-09-12T00:52:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 shutdown_connections 2024-09-12T00:52:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fa8740a2c10 0x7fa8740a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8881068d0 0x7fa88819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa888101270 0x7fa8881987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 --2- 172.21.15.2:0/3100651064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8881008d0 0x7fa888198290 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.910+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 >> 172.21.15.2:0/3100651064 conn(0x7fa8880fc630 msgr2=0x7fa88806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.911+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 shutdown_connections 2024-09-12T00:52:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:08.911+0000 7fa88cba0640 1 -- 172.21.15.2:0/3100651064 wait complete. 2024-09-12T00:52:08.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:08 smithi071 ceph-mon[35276]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:09.184 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574922 for osd.1 2024-09-12T00:52:09.184 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:09.621 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738446 for osd.0 2024-09-12T00:52:09.621 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:09.793 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:09 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3100651064' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T00:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 -- 172.21.15.2:0/2348646976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100d00 msgr2=0x7f81b0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2348646976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100d00 0x7f81b0106840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009930 tx=0x7f81a402a420 comp rx=0 tx=0).stop 2024-09-12T00:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 -- 172.21.15.2:0/2348646976 shutdown_connections 2024-09-12T00:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2348646976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81b0106fa0 0x7f81b010ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2348646976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100d00 0x7f81b0106840 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2348646976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b0100350 0x7f81b0100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 -- 172.21.15.2:0/2348646976 >> 172.21.15.2:0/2348646976 conn(0x7f81b00fbee0 msgr2=0x7f81b00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 -- 172.21.15.2:0/2348646976 shutdown_connections 2024-09-12T00:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.802+0000 7f81b66c0640 1 -- 172.21.15.2:0/2348646976 wait complete. 2024-09-12T00:52:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.803+0000 7f81b66c0640 1 Processor -- start 2024-09-12T00:52:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.803+0000 7f81b66c0640 1 -- start start 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.803+0000 7f81b66c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100350 0x7f81b0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.803+0000 7f81b66c0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81b0100d00 0x7f81b0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.803+0000 7f81b66c0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b0106fa0 0x7f81b019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.803+0000 7f81b66c0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0111fa0 con 0x7f81b0100350 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.803+0000 7f81b66c0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0111e20 con 0x7f81b0106fa0 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.803+0000 7f81b66c0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0112120 con 0x7f81b0100d00 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100350 0x7f81b0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100350 0x7f81b0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60880/0 (socket says 172.21.15.2:60880) 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 -- 172.21.15.2:0/2100298918 learned_addr learned my addr 172.21.15.2:0/2100298918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81af7fe640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81b0100d00 0x7f81b0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81b4c5d640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b0106fa0 0x7f81b019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 -- 172.21.15.2:0/2100298918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81b0100d00 msgr2=0x7f81b0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81b0100d00 0x7f81b0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 -- 172.21.15.2:0/2100298918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b0106fa0 msgr2=0x7f81b019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b0106fa0 0x7f81b019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 -- 172.21.15.2:0/2100298918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b019d3f0 con 0x7f81b0100350 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81affff640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100350 0x7f81b0198440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c920 tx=0x7f81a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81ad7fa640 1 -- 172.21.15.2:0/2100298918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0007c70 con 0x7f81b0100350 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81ad7fa640 1 -- 172.21.15.2:0/2100298918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a0007e10 con 0x7f81b0100350 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b019d6e0 con 0x7f81b0100350 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.804+0000 7f81ad7fa640 1 -- 172.21.15.2:0/2100298918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0018890 con 0x7f81b0100350 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.805+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b01a4fc0 con 0x7f81b0100350 2024-09-12T00:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.806+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b0100730 con 0x7f81b0100350 2024-09-12T00:52:09.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.808+0000 7f81ad7fa640 1 -- 172.21.15.2:0/2100298918 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f81a0018a50 con 0x7f81b0100350 2024-09-12T00:52:09.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.808+0000 7f81ad7fa640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81980a2c10 0x7f81980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:09.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.809+0000 7f81af7fe640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81980a2c10 0x7f81980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:09.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.809+0000 7f81ad7fa640 1 -- 172.21.15.2:0/2100298918 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f81a00cf690 con 0x7f81b0100350 2024-09-12T00:52:09.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.809+0000 7f81af7fe640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81980a2c10 0x7f81980a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81a4006010 tx=0x7f81a4031690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:09.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.811+0000 7f81ad7fa640 1 -- 172.21.15.2:0/2100298918 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81a0014030 con 0x7f81b0100350 2024-09-12T00:52:09.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:09 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3100651064' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T00:52:09.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.992+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f81b0109b50 con 0x7f81b0100350 2024-09-12T00:52:09.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.992+0000 7f81ad7fa640 1 -- 172.21.15.2:0/2100298918 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f81a009c500 con 0x7f81b0100350 2024-09-12T00:52:09.992 INFO:teuthology.orchestra.run.smithi002.stdout:77309411398 2024-09-12T00:52:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81980a2c10 msgr2=0x7f81980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81980a2c10 0x7f81980a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81a4006010 tx=0x7f81a4031690 comp rx=0 tx=0).stop 2024-09-12T00:52:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100350 msgr2=0x7f81b0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100350 0x7f81b0198440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c920 tx=0x7f81a000cde0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 shutdown_connections 2024-09-12T00:52:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81980a2c10 0x7f81980a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b0106fa0 0x7f81b019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81b0100d00 0x7f81b0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 --2- 172.21.15.2:0/2100298918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81b0100350 0x7f81b0198440 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.994+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 >> 172.21.15.2:0/2100298918 conn(0x7f81b00fbee0 msgr2=0x7f81b0106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.995+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 shutdown_connections 2024-09-12T00:52:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:09.995+0000 7f81b66c0640 1 -- 172.21.15.2:0/2100298918 wait complete. 2024-09-12T00:52:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:09 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3100651064' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T00:52:10.492 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215164 got 103079215168 for osd.3 2024-09-12T00:52:10.492 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:10.740 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:10.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:10 smithi002 ceph-mon[31210]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:10.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:10 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2100298918' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T00:52:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:10 smithi071 ceph-mon[35276]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:10 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2100298918' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T00:52:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:10 smithi167 ceph-mon[35234]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:10 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2100298918' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T00:52:11.162 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411398 for osd.2 2024-09-12T00:52:11.163 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 -- 172.21.15.2:0/2379480146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4100a80 msgr2=0x7f28f4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 --2- 172.21.15.2:0/2379480146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4100a80 0x7f28f4100ee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009930 tx=0x7f28e802a420 comp rx=0 tx=0).stop 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 -- 172.21.15.2:0/2379480146 shutdown_connections 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 --2- 172.21.15.2:0/2379480146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28f4101420 0x7f28f410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 --2- 172.21.15.2:0/2379480146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4100a80 0x7f28f4100ee0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 --2- 172.21.15.2:0/2379480146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4106a80 0x7f28f4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 -- 172.21.15.2:0/2379480146 >> 172.21.15.2:0/2379480146 conn(0x7f28f40fc7a0 msgr2=0x7f28f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 -- 172.21.15.2:0/2379480146 shutdown_connections 2024-09-12T00:52:11.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.629+0000 7f28f9899640 1 -- 172.21.15.2:0/2379480146 wait complete. 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f9899640 1 Processor -- start 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f9899640 1 -- start start 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f9899640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28f4100a80 0x7f28f419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f9899640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4101420 0x7f28f419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f9899640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4106a80 0x7f28f419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f9899640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28f4110ea0 con 0x7f28f4101420 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f9899640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28f4110d20 con 0x7f28f4106a80 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f9899640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28f4111020 con 0x7f28f4100a80 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4101420 0x7f28f419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4101420 0x7f28f419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60898/0 (socket says 172.21.15.2:60898) 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f27fc640 1 -- 172.21.15.2:0/3906190052 learned_addr learned my addr 172.21.15.2:0/3906190052 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:11.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f2ffd640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28f4100a80 0x7f28f419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.630+0000 7f28f37fe640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4106a80 0x7f28f419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f27fc640 1 -- 172.21.15.2:0/3906190052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28f4100a80 msgr2=0x7f28f419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f27fc640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28f4100a80 0x7f28f419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f27fc640 1 -- 172.21.15.2:0/3906190052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4106a80 msgr2=0x7f28f419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f27fc640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4106a80 0x7f28f419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f27fc640 1 -- 172.21.15.2:0/3906190052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f419f620 con 0x7f28f4101420 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f27fc640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4101420 0x7f28f419abb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009a50 tx=0x7f28e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f8897640 1 -- 172.21.15.2:0/3906190052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e803f030 con 0x7f28f4101420 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f419f8b0 con 0x7f28f4101420 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f8897640 1 -- 172.21.15.2:0/3906190052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28e8003ad0 con 0x7f28f4101420 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f8897640 1 -- 172.21.15.2:0/3906190052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8035070 con 0x7f28f4101420 2024-09-12T00:52:11.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.631+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f41a71f0 con 0x7f28f4101420 2024-09-12T00:52:11.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.632+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f4100ee0 con 0x7f28f4101420 2024-09-12T00:52:11.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.634+0000 7f28f8897640 1 -- 172.21.15.2:0/3906190052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f28e8042030 con 0x7f28f4101420 2024-09-12T00:52:11.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.634+0000 7f28f8897640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f28dc0a2c10 0x7f28dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:11.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.634+0000 7f28f2ffd640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f28dc0a2c10 0x7f28dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:11.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.634+0000 7f28f8897640 1 -- 172.21.15.2:0/3906190052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f28e80efd20 con 0x7f28f4101420 2024-09-12T00:52:11.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.635+0000 7f28f2ffd640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f28dc0a2c10 0x7f28dc0a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009990 tx=0x7f28e4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:11.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.641+0000 7f28f8897640 1 -- 172.21.15.2:0/3906190052 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28e80bcb00 con 0x7f28f4101420 2024-09-12T00:52:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.828+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f28f41a73c0 con 0x7f28f4101420 2024-09-12T00:52:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.829+0000 7f28f8897640 1 -- 172.21.15.2:0/3906190052 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f28e80bc400 con 0x7f28f4101420 2024-09-12T00:52:11.829 INFO:teuthology.orchestra.run.smithi002.stdout:184683593778 2024-09-12T00:52:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f28dc0a2c10 msgr2=0x7f28dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f28dc0a2c10 0x7f28dc0a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009990 tx=0x7f28e4009110 comp rx=0 tx=0).stop 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4101420 msgr2=0x7f28f419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4101420 0x7f28f419abb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009a50 tx=0x7f28e8004270 comp rx=0 tx=0).stop 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 shutdown_connections 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f28dc0a2c10 0x7f28dc0a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4106a80 0x7f28f419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f4101420 0x7f28f419abb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 --2- 172.21.15.2:0/3906190052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28f4100a80 0x7f28f419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 >> 172.21.15.2:0/3906190052 conn(0x7f28f40fc7a0 msgr2=0x7f28f406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 shutdown_connections 2024-09-12T00:52:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:11.831+0000 7f28f9899640 1 -- 172.21.15.2:0/3906190052 wait complete. 2024-09-12T00:52:12.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:12 smithi002 ceph-mon[31210]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:12.914 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:12 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3906190052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T00:52:12.941 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593775 got 184683593778 for osd.6 2024-09-12T00:52:12.941 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:12.942 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T00:52:12.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T00:52:12.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:12 smithi071 ceph-mon[35276]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:12.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:12 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3906190052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T00:52:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:12 smithi167 ceph-mon[35234]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:12 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3906190052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T00:52:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:13.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 -- 172.21.15.2:0/3643712983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f060810e500 msgr2=0x7f0608110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 --2- 172.21.15.2:0/3643712983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f060810e500 0x7f0608110910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0600009ca0 tx=0x7f060002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 -- 172.21.15.2:0/3643712983 shutdown_connections 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 --2- 172.21.15.2:0/3643712983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f060810e500 0x7f0608110910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 --2- 172.21.15.2:0/3643712983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0608101440 0x7f060810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 --2- 172.21.15.2:0/3643712983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0608100b20 0x7f0608100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 -- 172.21.15.2:0/3643712983 >> 172.21.15.2:0/3643712983 conn(0x7f06080fc7d0 msgr2=0x7f06080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 -- 172.21.15.2:0/3643712983 shutdown_connections 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.733+0000 7f060f2f1640 1 -- 172.21.15.2:0/3643712983 wait complete. 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060f2f1640 1 Processor -- start 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060f2f1640 1 -- start start 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060f2f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0608100b20 0x7f060819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060f2f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608101440 0x7f060819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060f2f1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060810e500 0x7f060819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060f2f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f06081142d0 con 0x7f0608101440 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060f2f1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0608114150 con 0x7f060810e500 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060f2f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0608114450 con 0x7f0608100b20 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060c88c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608101440 0x7f060819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060c88c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608101440 0x7f060819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60910/0 (socket says 172.21.15.2:60910) 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060c88c640 1 -- 172.21.15.2:0/1458486908 learned_addr learned my addr 172.21.15.2:0/1458486908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060d08d640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0608100b20 0x7f060819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.734+0000 7f060d88e640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060810e500 0x7f060819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060c88c640 1 -- 172.21.15.2:0/1458486908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0608100b20 msgr2=0x7f060819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060c88c640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0608100b20 0x7f060819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060c88c640 1 -- 172.21.15.2:0/1458486908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060810e500 msgr2=0x7f060819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060c88c640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060810e500 0x7f060819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060c88c640 1 -- 172.21.15.2:0/1458486908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060819f6a0 con 0x7f0608101440 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060d88e640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060810e500 0x7f060819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060c88c640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608101440 0x7f060819ac30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f05f800b450 tx=0x7f05f800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f05fe7fc640 1 -- 172.21.15.2:0/1458486908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8015020 con 0x7f0608101440 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f05fe7fc640 1 -- 172.21.15.2:0/1458486908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f8011d10 con 0x7f0608101440 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060819f990 con 0x7f0608101440 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f05fe7fc640 1 -- 172.21.15.2:0/1458486908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f800f2e0 con 0x7f0608101440 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.735+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06081a7270 con 0x7f0608101440 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.736+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0608100f00 con 0x7f0608101440 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.737+0000 7f05fe7fc640 1 -- 172.21.15.2:0/1458486908 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f05f8018020 con 0x7f0608101440 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.738+0000 7f05fe7fc640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f05f40a2c90 0x7f05f40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.738+0000 7f060d08d640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f05f40a2c90 0x7f05f40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.738+0000 7f05fe7fc640 1 -- 172.21.15.2:0/1458486908 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f05f80ce9e0 con 0x7f0608101440 2024-09-12T00:52:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.739+0000 7f060d08d640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f05f40a2c90 0x7f05f40a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f060400abe0 tx=0x7f060400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.742+0000 7f05fe7fc640 1 -- 172.21.15.2:0/1458486908 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05f801f020 con 0x7f0608101440 2024-09-12T00:52:13.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.918+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f060810f790 con 0x7f05f40a2c90 2024-09-12T00:52:13.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.925+0000 7f05fe7fc640 1 -- 172.21.15.2:0/1458486908 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258720 (secure 0 0 0) 0x7f060810f790 con 0x7f05f40a2c90 2024-09-12T00:52:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:13.930 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:52:13.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f05f40a2c90 msgr2=0x7f05f40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f05f40a2c90 0x7f05f40a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f060400abe0 tx=0x7f060400a2d0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608101440 msgr2=0x7f060819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608101440 0x7f060819ac30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f05f800b450 tx=0x7f05f800b850 comp rx=0 tx=0).stop 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 shutdown_connections 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f05f40a2c90 0x7f05f40a5150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060810e500 0x7f060819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608101440 0x7f060819ac30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 --2- 172.21.15.2:0/1458486908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0608100b20 0x7f060819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 >> 172.21.15.2:0/1458486908 conn(0x7f06080fc7d0 msgr2=0x7f06080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 shutdown_connections 2024-09-12T00:52:13.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:13.929+0000 7f060f2f1640 1 -- 172.21.15.2:0/1458486908 wait complete. 2024-09-12T00:52:14.648 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-12T00:52:12.868530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":466,"num_read_kb":352,"num_write":345,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370080,"kb_used_data":12492,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571744,"statfs":{"total":1151940427776,"available":1151561465856,"internally_reserved":0,"allocated":12791808,"data_stored":7092906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.012704"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060010+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:51:22.060010+0000","last_peered":"2024-09-12T00:51:22.060010+0000","last_clean":"2024-09-12T00:51:22.060010+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:51:22.060010+0000","last_undegraded":"2024-09-12T00:51:22.060010+0000","last_fullsized":"2024-09-12T00:51:22.060010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062033+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:51:22.062033+0000","last_peered":"2024-09-12T00:51:22.062033+0000","last_clean":"2024-09-12T00:51:22.062033+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:51:22.062033+0000","last_undegraded":"2024-09-12T00:51:22.062033+0000","last_fullsized":"2024-09-12T00:51:22.062033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062029+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:51:22.062029+0000","last_peered":"2024-09-12T00:51:22.062029+0000","last_clean":"2024-09-12T00:51:22.062029+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:51:22.062029+0000","last_undegraded":"2024-09-12T00:51:22.062029+0000","last_fullsized":"2024-09-12T00:51:22.062029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065039+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:51:22.065039+0000","last_peered":"2024-09-12T00:51:22.065039+0000","last_clean":"2024-09-12T00:51:22.065039+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:51:22.065039+0000","last_undegraded":"2024-09-12T00:51:22.065039+0000","last_fullsized":"2024-09-12T00:51:22.065039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061872+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:51:22.061872+0000","last_peered":"2024-09-12T00:51:22.061872+0000","last_clean":"2024-09-12T00:51:22.061872+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:51:22.061872+0000","last_undegraded":"2024-09-12T00:51:22.061872+0000","last_fullsized":"2024-09-12T00:51:22.061872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063297+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:51:22.063297+0000","last_peered":"2024-09-12T00:51:22.063297+0000","last_clean":"2024-09-12T00:51:22.063297+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:51:22.063297+0000","last_undegraded":"2024-09-12T00:51:22.063297+0000","last_fullsized":"2024-09-12T00:51:22.063297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062840+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:51:22.062840+0000","last_peered":"2024-09-12T00:51:22.062840+0000","last_clean":"2024-09-12T00:51:22.062840+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:51:22.062840+0000","last_undegraded":"2024-09-12T00:51:22.062840+0000","last_fullsized":"2024-09-12T00:51:22.062840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295623+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:51:22.295623+0000","last_peered":"2024-09-12T00:51:22.295623+0000","last_clean":"2024-09-12T00:51:22.295623+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:51:22.295623+0000","last_undegraded":"2024-09-12T00:51:22.295623+0000","last_fullsized":"2024-09-12T00:51:22.295623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179780+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:51:22.179780+0000","last_peered":"2024-09-12T00:51:22.179780+0000","last_clean":"2024-09-12T00:51:22.179780+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:51:22.179780+0000","last_undegraded":"2024-09-12T00:51:22.179780+0000","last_fullsized":"2024-09-12T00:51:22.179780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.066285+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:51:22.066285+0000","last_peered":"2024-09-12T00:51:22.066285+0000","last_clean":"2024-09-12T00:51:22.066285+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:51:22.066285+0000","last_undegraded":"2024-09-12T00:51:22.066285+0000","last_fullsized":"2024-09-12T00:51:22.066285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063530+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:51:22.063530+0000","last_peered":"2024-09-12T00:51:22.063530+0000","last_clean":"2024-09-12T00:51:22.063530+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:51:22.063530+0000","last_undegraded":"2024-09-12T00:51:22.063530+0000","last_fullsized":"2024-09-12T00:51:22.063530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065156+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:51:22.065156+0000","last_peered":"2024-09-12T00:51:22.065156+0000","last_clean":"2024-09-12T00:51:22.065156+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:51:22.065156+0000","last_undegraded":"2024-09-12T00:51:22.065156+0000","last_fullsized":"2024-09-12T00:51:22.065156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065720+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:51:22.065720+0000","last_peered":"2024-09-12T00:51:22.065720+0000","last_clean":"2024-09-12T00:51:22.065720+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:51:22.065720+0000","last_undegraded":"2024-09-12T00:51:22.065720+0000","last_fullsized":"2024-09-12T00:51:22.065720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061730+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:51:22.061730+0000","last_peered":"2024-09-12T00:51:22.061730+0000","last_clean":"2024-09-12T00:51:22.061730+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:51:22.061730+0000","last_undegraded":"2024-09-12T00:51:22.061730+0000","last_fullsized":"2024-09-12T00:51:22.061730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064358+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:51:22.064358+0000","last_peered":"2024-09-12T00:51:22.064358+0000","last_clean":"2024-09-12T00:51:22.064358+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:51:22.064358+0000","last_undegraded":"2024-09-12T00:51:22.064358+0000","last_fullsized":"2024-09-12T00:51:22.064358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179263+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:51:22.179263+0000","last_peered":"2024-09-12T00:51:22.179263+0000","last_clean":"2024-09-12T00:51:22.179263+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:51:22.179263+0000","last_undegraded":"2024-09-12T00:51:22.179263+0000","last_fullsized":"2024-09-12T00:51:22.179263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060068+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:51:22.060068+0000","last_peered":"2024-09-12T00:51:22.060068+0000","last_clean":"2024-09-12T00:51:22.060068+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:51:22.060068+0000","last_undegraded":"2024-09-12T00:51:22.060068+0000","last_fullsized":"2024-09-12T00:51:22.060068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063035+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:51:22.063035+0000","last_peered":"2024-09-12T00:51:22.063035+0000","last_clean":"2024-09-12T00:51:22.063035+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:51:22.063035+0000","last_undegraded":"2024-09-12T00:51:22.063035+0000","last_fullsized":"2024-09-12T00:51:22.063035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062895+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:51:22.062895+0000","last_peered":"2024-09-12T00:51:22.062895+0000","last_clean":"2024-09-12T00:51:22.062895+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:51:22.062895+0000","last_undegraded":"2024-09-12T00:51:22.062895+0000","last_fullsized":"2024-09-12T00:51:22.062895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059895+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:51:22.059895+0000","last_peered":"2024-09-12T00:51:22.059895+0000","last_clean":"2024-09-12T00:51:22.059895+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:51:22.059895+0000","last_undegraded":"2024-09-12T00:51:22.059895+0000","last_fullsized":"2024-09-12T00:51:22.059895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058853+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:51:22.058853+0000","last_peered":"2024-09-12T00:51:22.058853+0000","last_clean":"2024-09-12T00:51:22.058853+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:51:22.058853+0000","last_undegraded":"2024-09-12T00:51:22.058853+0000","last_fullsized":"2024-09-12T00:51:22.058853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179724+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:51:22.179724+0000","last_peered":"2024-09-12T00:51:22.179724+0000","last_clean":"2024-09-12T00:51:22.179724+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:51:22.179724+0000","last_undegraded":"2024-09-12T00:51:22.179724+0000","last_fullsized":"2024-09-12T00:51:22.179724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295696+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:51:22.295696+0000","last_peered":"2024-09-12T00:51:22.295696+0000","last_clean":"2024-09-12T00:51:22.295696+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:51:22.295696+0000","last_undegraded":"2024-09-12T00:51:22.295696+0000","last_fullsized":"2024-09-12T00:51:22.295696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063888+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:51:22.063888+0000","last_peered":"2024-09-12T00:51:22.063888+0000","last_clean":"2024-09-12T00:51:22.063888+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:51:22.063888+0000","last_undegraded":"2024-09-12T00:51:22.063888+0000","last_fullsized":"2024-09-12T00:51:22.063888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296199+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:51:22.296199+0000","last_peered":"2024-09-12T00:51:22.296199+0000","last_clean":"2024-09-12T00:51:22.296199+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:51:22.296199+0000","last_undegraded":"2024-09-12T00:51:22.296199+0000","last_fullsized":"2024-09-12T00:51:22.296199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063171+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:51:22.063171+0000","last_peered":"2024-09-12T00:51:22.063171+0000","last_clean":"2024-09-12T00:51:22.063171+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:51:22.063171+0000","last_undegraded":"2024-09-12T00:51:22.063171+0000","last_fullsized":"2024-09-12T00:51:22.063171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060024+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:51:22.060024+0000","last_peered":"2024-09-12T00:51:22.060024+0000","last_clean":"2024-09-12T00:51:22.060024+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:51:22.060024+0000","last_undegraded":"2024-09-12T00:51:22.060024+0000","last_fullsized":"2024-09-12T00:51:22.060024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058915+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:51:22.058915+0000","last_peered":"2024-09-12T00:51:22.058915+0000","last_clean":"2024-09-12T00:51:22.058915+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:51:22.058915+0000","last_undegraded":"2024-09-12T00:51:22.058915+0000","last_fullsized":"2024-09-12T00:51:22.058915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061970+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:51:22.061970+0000","last_peered":"2024-09-12T00:51:22.061970+0000","last_clean":"2024-09-12T00:51:22.061970+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:51:22.061970+0000","last_undegraded":"2024-09-12T00:51:22.061970+0000","last_fullsized":"2024-09-12T00:51:22.061970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062523+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:51:22.062523+0000","last_peered":"2024-09-12T00:51:22.062523+0000","last_clean":"2024-09-12T00:51:22.062523+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:51:22.062523+0000","last_undegraded":"2024-09-12T00:51:22.062523+0000","last_fullsized":"2024-09-12T00:51:22.062523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062859+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:51:22.062859+0000","last_peered":"2024-09-12T00:51:22.062859+0000","last_clean":"2024-09-12T00:51:22.062859+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:51:22.062859+0000","last_undegraded":"2024-09-12T00:51:22.062859+0000","last_fullsized":"2024-09-12T00:51:22.062859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059762+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:51:22.059762+0000","last_peered":"2024-09-12T00:51:22.059762+0000","last_clean":"2024-09-12T00:51:22.059762+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:51:22.059762+0000","last_undegraded":"2024-09-12T00:51:22.059762+0000","last_fullsized":"2024-09-12T00:51:22.059762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061604+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:51:22.061604+0000","last_peered":"2024-09-12T00:51:22.061604+0000","last_clean":"2024-09-12T00:51:22.061604+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:51:22.061604+0000","last_undegraded":"2024-09-12T00:51:22.061604+0000","last_fullsized":"2024-09-12T00:51:22.061604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.142849+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:52:10.142849+0000","last_peered":"2024-09-12T00:52:10.142849+0000","last_clean":"2024-09-12T00:52:10.142849+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:52:10.142849+0000","last_undegraded":"2024-09-12T00:52:10.142849+0000","last_fullsized":"2024-09-12T00:52:10.142849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.297202+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:51:22.297202+0000","last_peered":"2024-09-12T00:51:22.297202+0000","last_clean":"2024-09-12T00:51:22.297202+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:51:22.297202+0000","last_undegraded":"2024-09-12T00:51:22.297202+0000","last_fullsized":"2024-09-12T00:51:22.297202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.183506+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:51:22.183506+0000","last_peered":"2024-09-12T00:51:22.183506+0000","last_clean":"2024-09-12T00:51:22.183506+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:51:22.183506+0000","last_undegraded":"2024-09-12T00:51:22.183506+0000","last_fullsized":"2024-09-12T00:51:22.183506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058459+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:51:22.058459+0000","last_peered":"2024-09-12T00:51:22.058459+0000","last_clean":"2024-09-12T00:51:22.058459+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:51:22.058459+0000","last_undegraded":"2024-09-12T00:51:22.058459+0000","last_fullsized":"2024-09-12T00:51:22.058459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295684+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:51:22.295684+0000","last_peered":"2024-09-12T00:51:22.295684+0000","last_clean":"2024-09-12T00:51:22.295684+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:51:22.295684+0000","last_undegraded":"2024-09-12T00:51:22.295684+0000","last_fullsized":"2024-09-12T00:51:22.295684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064178+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:51:22.064178+0000","last_peered":"2024-09-12T00:51:22.064178+0000","last_clean":"2024-09-12T00:51:22.064178+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:51:22.064178+0000","last_undegraded":"2024-09-12T00:51:22.064178+0000","last_fullsized":"2024-09-12T00:51:22.064178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063404+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:51:22.063404+0000","last_peered":"2024-09-12T00:51:22.063404+0000","last_clean":"2024-09-12T00:51:22.063404+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:51:22.063404+0000","last_undegraded":"2024-09-12T00:51:22.063404+0000","last_fullsized":"2024-09-12T00:51:22.063404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.142096+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:52:10.142096+0000","last_peered":"2024-09-12T00:52:10.142096+0000","last_clean":"2024-09-12T00:52:10.142096+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:52:10.142096+0000","last_undegraded":"2024-09-12T00:52:10.142096+0000","last_fullsized":"2024-09-12T00:52:10.142096+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179676+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:51:22.179676+0000","last_peered":"2024-09-12T00:51:22.179676+0000","last_clean":"2024-09-12T00:51:22.179676+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:51:22.179676+0000","last_undegraded":"2024-09-12T00:51:22.179676+0000","last_fullsized":"2024-09-12T00:51:22.179676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063816+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:51:22.063816+0000","last_peered":"2024-09-12T00:51:22.063816+0000","last_clean":"2024-09-12T00:51:22.063816+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:51:22.063816+0000","last_undegraded":"2024-09-12T00:51:22.063816+0000","last_fullsized":"2024-09-12T00:51:22.063816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062400+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:51:22.062400+0000","last_peered":"2024-09-12T00:51:22.062400+0000","last_clean":"2024-09-12T00:51:22.062400+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:51:22.062400+0000","last_undegraded":"2024-09-12T00:51:22.062400+0000","last_fullsized":"2024-09-12T00:51:22.062400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064353+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:51:22.064353+0000","last_peered":"2024-09-12T00:51:22.064353+0000","last_clean":"2024-09-12T00:51:22.064353+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:51:22.064353+0000","last_undegraded":"2024-09-12T00:51:22.064353+0000","last_fullsized":"2024-09-12T00:51:22.064353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179421+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:51:22.179421+0000","last_peered":"2024-09-12T00:51:22.179421+0000","last_clean":"2024-09-12T00:51:22.179421+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:51:22.179421+0000","last_undegraded":"2024-09-12T00:51:22.179421+0000","last_fullsized":"2024-09-12T00:51:22.179421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'28","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:11.143564+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:52:11.143564+0000","last_peered":"2024-09-12T00:52:11.143564+0000","last_clean":"2024-09-12T00:52:11.143564+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:52:11.143564+0000","last_undegraded":"2024-09-12T00:52:11.143564+0000","last_fullsized":"2024-09-12T00:52:11.143564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061910+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:51:22.061910+0000","last_peered":"2024-09-12T00:51:22.061910+0000","last_clean":"2024-09-12T00:51:22.061910+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:51:22.061910+0000","last_undegraded":"2024-09-12T00:51:22.061910+0000","last_fullsized":"2024-09-12T00:51:22.061910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062859+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:51:22.062859+0000","last_peered":"2024-09-12T00:51:22.062859+0000","last_clean":"2024-09-12T00:51:22.062859+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:51:22.062859+0000","last_undegraded":"2024-09-12T00:51:22.062859+0000","last_fullsized":"2024-09-12T00:51:22.062859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058500+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:51:22.058500+0000","last_peered":"2024-09-12T00:51:22.058500+0000","last_clean":"2024-09-12T00:51:22.058500+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:51:22.058500+0000","last_undegraded":"2024-09-12T00:51:22.058500+0000","last_fullsized":"2024-09-12T00:51:22.058500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064284+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:51:22.064284+0000","last_peered":"2024-09-12T00:51:22.064284+0000","last_clean":"2024-09-12T00:51:22.064284+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:51:22.064284+0000","last_undegraded":"2024-09-12T00:51:22.064284+0000","last_fullsized":"2024-09-12T00:51:22.064284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065694+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:51:22.065694+0000","last_peered":"2024-09-12T00:51:22.065694+0000","last_clean":"2024-09-12T00:51:22.065694+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:51:22.065694+0000","last_undegraded":"2024-09-12T00:51:22.065694+0000","last_fullsized":"2024-09-12T00:51:22.065694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:09.140617+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:52:09.140617+0000","last_peered":"2024-09-12T00:52:09.140617+0000","last_clean":"2024-09-12T00:52:09.140617+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:52:09.140617+0000","last_undegraded":"2024-09-12T00:52:09.140617+0000","last_fullsized":"2024-09-12T00:52:09.140617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063243+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:51:22.063243+0000","last_peered":"2024-09-12T00:51:22.063243+0000","last_clean":"2024-09-12T00:51:22.063243+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:51:22.063243+0000","last_undegraded":"2024-09-12T00:51:22.063243+0000","last_fullsized":"2024-09-12T00:51:22.063243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.082529+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:51:22.082529+0000","last_peered":"2024-09-12T00:51:22.082529+0000","last_clean":"2024-09-12T00:51:22.082529+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:51:22.082529+0000","last_undegraded":"2024-09-12T00:51:22.082529+0000","last_fullsized":"2024-09-12T00:51:22.082529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063885+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:51:22.063885+0000","last_peered":"2024-09-12T00:51:22.063885+0000","last_clean":"2024-09-12T00:51:22.063885+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:51:22.063885+0000","last_undegraded":"2024-09-12T00:51:22.063885+0000","last_fullsized":"2024-09-12T00:51:22.063885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062347+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:51:22.062347+0000","last_peered":"2024-09-12T00:51:22.062347+0000","last_clean":"2024-09-12T00:51:22.062347+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:51:22.062347+0000","last_undegraded":"2024-09-12T00:51:22.062347+0000","last_fullsized":"2024-09-12T00:51:22.062347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060117+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:51:22.060117+0000","last_peered":"2024-09-12T00:51:22.060117+0000","last_clean":"2024-09-12T00:51:22.060117+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:51:22.060117+0000","last_undegraded":"2024-09-12T00:51:22.060117+0000","last_fullsized":"2024-09-12T00:51:22.060117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058717+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:51:22.058717+0000","last_peered":"2024-09-12T00:51:22.058717+0000","last_clean":"2024-09-12T00:51:22.058717+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:51:22.058717+0000","last_undegraded":"2024-09-12T00:51:22.058717+0000","last_fullsized":"2024-09-12T00:51:22.058717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064005+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:51:22.064005+0000","last_peered":"2024-09-12T00:51:22.064005+0000","last_clean":"2024-09-12T00:51:22.064005+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:51:22.064005+0000","last_undegraded":"2024-09-12T00:51:22.064005+0000","last_fullsized":"2024-09-12T00:51:22.064005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064424+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:51:22.064424+0000","last_peered":"2024-09-12T00:51:22.064424+0000","last_clean":"2024-09-12T00:51:22.064424+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:51:22.064424+0000","last_undegraded":"2024-09-12T00:51:22.064424+0000","last_fullsized":"2024-09-12T00:51:22.064424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.067896+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:51:22.067896+0000","last_peered":"2024-09-12T00:51:22.067896+0000","last_clean":"2024-09-12T00:51:22.067896+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:51:22.067896+0000","last_undegraded":"2024-09-12T00:51:22.067896+0000","last_fullsized":"2024-09-12T00:51:22.067896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.072829+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:51:22.072829+0000","last_peered":"2024-09-12T00:51:22.072829+0000","last_clean":"2024-09-12T00:51:22.072829+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:51:22.072829+0000","last_undegraded":"2024-09-12T00:51:22.072829+0000","last_fullsized":"2024-09-12T00:51:22.072829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063612+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:51:22.063612+0000","last_peered":"2024-09-12T00:51:22.063612+0000","last_clean":"2024-09-12T00:51:22.063612+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:51:22.063612+0000","last_undegraded":"2024-09-12T00:51:22.063612+0000","last_fullsized":"2024-09-12T00:51:22.063612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063475+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:51:22.063475+0000","last_peered":"2024-09-12T00:51:22.063475+0000","last_clean":"2024-09-12T00:51:22.063475+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:51:22.063475+0000","last_undegraded":"2024-09-12T00:51:22.063475+0000","last_fullsized":"2024-09-12T00:51:22.063475+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064877+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:51:22.064877+0000","last_peered":"2024-09-12T00:51:22.064877+0000","last_clean":"2024-09-12T00:51:22.064877+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:51:22.064877+0000","last_undegraded":"2024-09-12T00:51:22.064877+0000","last_fullsized":"2024-09-12T00:51:22.064877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295855+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:51:22.295855+0000","last_peered":"2024-09-12T00:51:22.295855+0000","last_clean":"2024-09-12T00:51:22.295855+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:51:22.295855+0000","last_undegraded":"2024-09-12T00:51:22.295855+0000","last_fullsized":"2024-09-12T00:51:22.295855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063383+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:51:22.063383+0000","last_peered":"2024-09-12T00:51:22.063383+0000","last_clean":"2024-09-12T00:51:22.063383+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:51:22.063383+0000","last_undegraded":"2024-09-12T00:51:22.063383+0000","last_fullsized":"2024-09-12T00:51:22.063383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058455+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:51:22.058455+0000","last_peered":"2024-09-12T00:51:22.058455+0000","last_clean":"2024-09-12T00:51:22.058455+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:51:22.058455+0000","last_undegraded":"2024-09-12T00:51:22.058455+0000","last_fullsized":"2024-09-12T00:51:22.058455+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.141382+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:52:10.141382+0000","last_peered":"2024-09-12T00:52:10.141382+0000","last_clean":"2024-09-12T00:52:10.141382+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:52:10.141382+0000","last_undegraded":"2024-09-12T00:52:10.141382+0000","last_fullsized":"2024-09-12T00:52:10.141382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.068072+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:51:22.068072+0000","last_peered":"2024-09-12T00:51:22.068072+0000","last_clean":"2024-09-12T00:51:22.068072+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:51:22.068072+0000","last_undegraded":"2024-09-12T00:51:22.068072+0000","last_fullsized":"2024-09-12T00:51:22.068072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063364+0000","last_change":"2024-09-12T00:51:09.003409+0000","last_active":"2024-09-12T00:51:22.063364+0000","last_peered":"2024-09-12T00:51:22.063364+0000","last_clean":"2024-09-12T00:51:22.063364+0000","last_became_active":"2024-09-12T00:51:09.003073+0000","last_became_peered":"2024-09-12T00:51:09.003073+0000","last_unstale":"2024-09-12T00:51:22.063364+0000","last_undegraded":"2024-09-12T00:51:22.063364+0000","last_fullsized":"2024-09-12T00:51:22.063364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:36.540715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063423+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:51:22.063423+0000","last_peered":"2024-09-12T00:51:22.063423+0000","last_clean":"2024-09-12T00:51:22.063423+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:51:22.063423+0000","last_undegraded":"2024-09-12T00:51:22.063423+0000","last_fullsized":"2024-09-12T00:51:22.063423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063330+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:51:22.063330+0000","last_peered":"2024-09-12T00:51:22.063330+0000","last_clean":"2024-09-12T00:51:22.063330+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:51:22.063330+0000","last_undegraded":"2024-09-12T00:51:22.063330+0000","last_fullsized":"2024-09-12T00:51:22.063330+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065393+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:51:22.065393+0000","last_peered":"2024-09-12T00:51:22.065393+0000","last_clean":"2024-09-12T00:51:22.065393+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:51:22.065393+0000","last_undegraded":"2024-09-12T00:51:22.065393+0000","last_fullsized":"2024-09-12T00:51:22.065393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062116+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:51:22.062116+0000","last_peered":"2024-09-12T00:51:22.062116+0000","last_clean":"2024-09-12T00:51:22.062116+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:51:22.062116+0000","last_undegraded":"2024-09-12T00:51:22.062116+0000","last_fullsized":"2024-09-12T00:51:22.062116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058928+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:51:22.058928+0000","last_peered":"2024-09-12T00:51:22.058928+0000","last_clean":"2024-09-12T00:51:22.058928+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:51:22.058928+0000","last_undegraded":"2024-09-12T00:51:22.058928+0000","last_fullsized":"2024-09-12T00:51:22.058928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.033374+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:51:35.033374+0000","last_peered":"2024-09-12T00:51:35.033374+0000","last_clean":"2024-09-12T00:51:35.033374+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:51:35.033374+0000","last_undegraded":"2024-09-12T00:51:35.033374+0000","last_fullsized":"2024-09-12T00:51:35.033374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296199+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:51:22.296199+0000","last_peered":"2024-09-12T00:51:22.296199+0000","last_clean":"2024-09-12T00:51:22.296199+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:51:22.296199+0000","last_undegraded":"2024-09-12T00:51:22.296199+0000","last_fullsized":"2024-09-12T00:51:22.296199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064366+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:51:22.064366+0000","last_peered":"2024-09-12T00:51:22.064366+0000","last_clean":"2024-09-12T00:51:22.064366+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:51:22.064366+0000","last_undegraded":"2024-09-12T00:51:22.064366+0000","last_fullsized":"2024-09-12T00:51:22.064366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062144+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:51:22.062144+0000","last_peered":"2024-09-12T00:51:22.062144+0000","last_clean":"2024-09-12T00:51:22.062144+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:51:22.062144+0000","last_undegraded":"2024-09-12T00:51:22.062144+0000","last_fullsized":"2024-09-12T00:51:22.062144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179343+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:51:22.179343+0000","last_peered":"2024-09-12T00:51:22.179343+0000","last_clean":"2024-09-12T00:51:22.179343+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:51:22.179343+0000","last_undegraded":"2024-09-12T00:51:22.179343+0000","last_fullsized":"2024-09-12T00:51:22.179343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061520+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:51:22.061520+0000","last_peered":"2024-09-12T00:51:22.061520+0000","last_clean":"2024-09-12T00:51:22.061520+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:51:22.061520+0000","last_undegraded":"2024-09-12T00:51:22.061520+0000","last_fullsized":"2024-09-12T00:51:22.061520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295835+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:51:22.295835+0000","last_peered":"2024-09-12T00:51:22.295835+0000","last_clean":"2024-09-12T00:51:22.295835+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:51:22.295835+0000","last_undegraded":"2024-09-12T00:51:22.295835+0000","last_fullsized":"2024-09-12T00:51:22.295835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059814+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:51:22.059814+0000","last_peered":"2024-09-12T00:51:22.059814+0000","last_clean":"2024-09-12T00:51:22.059814+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:51:22.059814+0000","last_undegraded":"2024-09-12T00:51:22.059814+0000","last_fullsized":"2024-09-12T00:51:22.059814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062964+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:51:22.062964+0000","last_peered":"2024-09-12T00:51:22.062964+0000","last_clean":"2024-09-12T00:51:22.062964+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:51:22.062964+0000","last_undegraded":"2024-09-12T00:51:22.062964+0000","last_fullsized":"2024-09-12T00:51:22.062964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295934+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:51:22.295934+0000","last_peered":"2024-09-12T00:51:22.295934+0000","last_clean":"2024-09-12T00:51:22.295934+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:51:22.295934+0000","last_undegraded":"2024-09-12T00:51:22.295934+0000","last_fullsized":"2024-09-12T00:51:22.295934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.071628+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:51:22.071628+0000","last_peered":"2024-09-12T00:51:22.071628+0000","last_clean":"2024-09-12T00:51:22.071628+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:51:22.071628+0000","last_undegraded":"2024-09-12T00:51:22.071628+0000","last_fullsized":"2024-09-12T00:51:22.071628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063199+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:51:22.063199+0000","last_peered":"2024-09-12T00:51:22.063199+0000","last_clean":"2024-09-12T00:51:22.063199+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:51:22.063199+0000","last_undegraded":"2024-09-12T00:51:22.063199+0000","last_fullsized":"2024-09-12T00:51:22.063199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.180241+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:51:22.180241+0000","last_peered":"2024-09-12T00:51:22.180241+0000","last_clean":"2024-09-12T00:51:22.180241+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:51:22.180241+0000","last_undegraded":"2024-09-12T00:51:22.180241+0000","last_fullsized":"2024-09-12T00:51:22.180241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062042+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:51:22.062042+0000","last_peered":"2024-09-12T00:51:22.062042+0000","last_clean":"2024-09-12T00:51:22.062042+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:51:22.062042+0000","last_undegraded":"2024-09-12T00:51:22.062042+0000","last_fullsized":"2024-09-12T00:51:22.062042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179347+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:51:22.179347+0000","last_peered":"2024-09-12T00:51:22.179347+0000","last_clean":"2024-09-12T00:51:22.179347+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:51:22.179347+0000","last_undegraded":"2024-09-12T00:51:22.179347+0000","last_fullsized":"2024-09-12T00:51:22.179347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062006+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:51:22.062006+0000","last_peered":"2024-09-12T00:51:22.062006+0000","last_clean":"2024-09-12T00:51:22.062006+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:51:22.062006+0000","last_undegraded":"2024-09-12T00:51:22.062006+0000","last_fullsized":"2024-09-12T00:51:22.062006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062364+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:51:22.062364+0000","last_peered":"2024-09-12T00:51:22.062364+0000","last_clean":"2024-09-12T00:51:22.062364+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:51:22.062364+0000","last_undegraded":"2024-09-12T00:51:22.062364+0000","last_fullsized":"2024-09-12T00:51:22.062364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296287+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:51:22.296287+0000","last_peered":"2024-09-12T00:51:22.296287+0000","last_clean":"2024-09-12T00:51:22.296287+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:51:22.296287+0000","last_undegraded":"2024-09-12T00:51:22.296287+0000","last_fullsized":"2024-09-12T00:51:22.296287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296178+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:51:22.296178+0000","last_peered":"2024-09-12T00:51:22.296178+0000","last_clean":"2024-09-12T00:51:22.296178+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:51:22.296178+0000","last_undegraded":"2024-09-12T00:51:22.296178+0000","last_fullsized":"2024-09-12T00:51:22.296178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063503+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:51:22.063503+0000","last_peered":"2024-09-12T00:51:22.063503+0000","last_clean":"2024-09-12T00:51:22.063503+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:51:22.063503+0000","last_undegraded":"2024-09-12T00:51:22.063503+0000","last_fullsized":"2024-09-12T00:51:22.063503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":330,"num_read_kb":233,"num_write":162,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612633,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":427967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841566,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1079605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40388,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704764,"statfs":{"total":95995035648,"available":95953678336,"internally_reserved":0,"allocated":905216,"data_stored":428320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201320,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":428123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430253,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1495040,"data_stored":1020448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":427592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1019739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":429116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":427786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":488198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":487149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":428863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:52:14.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T00:52:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:14.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:14 smithi071 ceph-mon[35276]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:14.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:14 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:14.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:14 smithi002 ceph-mon[31210]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:14.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:14.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:14 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:14 smithi167 ceph-mon[35234]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:14 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' 2024-09-12T00:52:15.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 -- 172.21.15.2:0/4237877564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47241002f0 msgr2=0x7f47241006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:15.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 --2- 172.21.15.2:0/4237877564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47241002f0 0x7f47241006d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4714009930 tx=0x7f471402a420 comp rx=0 tx=0).stop 2024-09-12T00:52:15.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 -- 172.21.15.2:0/4237877564 shutdown_connections 2024-09-12T00:52:15.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 --2- 172.21.15.2:0/4237877564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4724106f50 0x7f472410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 --2- 172.21.15.2:0/4237877564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4724100ca0 0x7f4724106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 --2- 172.21.15.2:0/4237877564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47241002f0 0x7f47241006d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 -- 172.21.15.2:0/4237877564 >> 172.21.15.2:0/4237877564 conn(0x7f4724077210 msgr2=0x7f47240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:15.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 -- 172.21.15.2:0/4237877564 shutdown_connections 2024-09-12T00:52:15.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.358+0000 7f472a887640 1 -- 172.21.15.2:0/4237877564 wait complete. 2024-09-12T00:52:15.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f472a887640 1 Processor -- start 2024-09-12T00:52:15.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f472a887640 1 -- start start 2024-09-12T00:52:15.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f472a887640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47241002f0 0x7f4724198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:15.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f472a887640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4724100ca0 0x7f4724198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:15.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f472a887640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4724106f50 0x7f472419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f472a887640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47241120d0 con 0x7f4724106f50 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f472a887640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4724111f50 con 0x7f4724100ca0 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f472a887640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4724112250 con 0x7f47241002f0 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f4728e24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4724106f50 0x7f472419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f4728e24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4724106f50 0x7f472419cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60930/0 (socket says 172.21.15.2:60930) 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f4728e24640 1 -- 172.21.15.2:0/315468052 learned_addr learned my addr 172.21.15.2:0/315468052 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.359+0000 7f47237fe640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4724100ca0 0x7f4724198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f4723fff640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47241002f0 0x7f4724198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f4728e24640 1 -- 172.21.15.2:0/315468052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47241002f0 msgr2=0x7f4724198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f4728e24640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47241002f0 0x7f4724198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f4728e24640 1 -- 172.21.15.2:0/315468052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4724100ca0 msgr2=0x7f4724198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f4728e24640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4724100ca0 0x7f4724198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f4728e24640 1 -- 172.21.15.2:0/315468052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472419d5e0 con 0x7f4724106f50 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f4728e24640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4724106f50 0x7f472419cf00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f471c00b970 tx=0x7f471c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f47217fa640 1 -- 172.21.15.2:0/315468052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c019070 con 0x7f4724106f50 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f47217fa640 1 -- 172.21.15.2:0/315468052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f471c014440 con 0x7f4724106f50 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472419d8d0 con 0x7f4724106f50 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f47217fa640 1 -- 172.21.15.2:0/315468052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c0075d0 con 0x7f4724106f50 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.360+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47241a51b0 con 0x7f4724106f50 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.361+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4724100750 con 0x7f4724106f50 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.362+0000 7f47217fa640 1 -- 172.21.15.2:0/315468052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f471c01c070 con 0x7f4724106f50 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.363+0000 7f47217fa640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f470c0a2c10 0x7f470c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.363+0000 7f4723fff640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f470c0a2c10 0x7f470c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.363+0000 7f47217fa640 1 -- 172.21.15.2:0/315468052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f471c0ce740 con 0x7f4724106f50 2024-09-12T00:52:15.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.363+0000 7f4723fff640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f470c0a2c10 0x7f470c0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f47140096c0 tx=0x7f4714005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:15.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.367+0000 7f47217fa640 1 -- 172.21.15.2:0/315468052 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f471c09b5d0 con 0x7f4724106f50 2024-09-12T00:52:15.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.539+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4724062630 con 0x7f470c0a2c10 2024-09-12T00:52:15.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.545+0000 7f47217fa640 1 -- 172.21.15.2:0/315468052 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258720 (secure 0 0 0) 0x7f4724062630 con 0x7f470c0a2c10 2024-09-12T00:52:15.547 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:15.548 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:52:15.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.548+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f470c0a2c10 msgr2=0x7f470c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.548+0000 7f472a887640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f470c0a2c10 0x7f470c0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f47140096c0 tx=0x7f4714005fd0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.548+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4724106f50 msgr2=0x7f472419cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.548+0000 7f472a887640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4724106f50 0x7f472419cf00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f471c00b970 tx=0x7f471c00bd70 comp rx=0 tx=0).stop 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.549+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 shutdown_connections 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.549+0000 7f472a887640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f470c0a2c10 0x7f470c0a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.549+0000 7f472a887640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4724106f50 0x7f472419cf00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.549+0000 7f472a887640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4724100ca0 0x7f4724198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.549+0000 7f472a887640 1 --2- 172.21.15.2:0/315468052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47241002f0 0x7f4724198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.549+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 >> 172.21.15.2:0/315468052 conn(0x7f4724077210 msgr2=0x7f47241052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.549+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 shutdown_connections 2024-09-12T00:52:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:15.549+0000 7f472a887640 1 -- 172.21.15.2:0/315468052 wait complete. 2024-09-12T00:52:15.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:15 smithi002 ceph-mon[31210]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:52:15.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:15 smithi071 ceph-mon[35276]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:52:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:15 smithi167 ceph-mon[35234]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:52:16.201 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-12T00:52:14.868950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":466,"num_read_kb":352,"num_write":345,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370080,"kb_used_data":12492,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571744,"statfs":{"total":1151940427776,"available":1151561465856,"internally_reserved":0,"allocated":12791808,"data_stored":7092906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.012647"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060010+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:51:22.060010+0000","last_peered":"2024-09-12T00:51:22.060010+0000","last_clean":"2024-09-12T00:51:22.060010+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:51:22.060010+0000","last_undegraded":"2024-09-12T00:51:22.060010+0000","last_fullsized":"2024-09-12T00:51:22.060010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062033+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:51:22.062033+0000","last_peered":"2024-09-12T00:51:22.062033+0000","last_clean":"2024-09-12T00:51:22.062033+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:51:22.062033+0000","last_undegraded":"2024-09-12T00:51:22.062033+0000","last_fullsized":"2024-09-12T00:51:22.062033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062029+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:51:22.062029+0000","last_peered":"2024-09-12T00:51:22.062029+0000","last_clean":"2024-09-12T00:51:22.062029+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:51:22.062029+0000","last_undegraded":"2024-09-12T00:51:22.062029+0000","last_fullsized":"2024-09-12T00:51:22.062029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065039+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:51:22.065039+0000","last_peered":"2024-09-12T00:51:22.065039+0000","last_clean":"2024-09-12T00:51:22.065039+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:51:22.065039+0000","last_undegraded":"2024-09-12T00:51:22.065039+0000","last_fullsized":"2024-09-12T00:51:22.065039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061872+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:51:22.061872+0000","last_peered":"2024-09-12T00:51:22.061872+0000","last_clean":"2024-09-12T00:51:22.061872+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:51:22.061872+0000","last_undegraded":"2024-09-12T00:51:22.061872+0000","last_fullsized":"2024-09-12T00:51:22.061872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063297+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:51:22.063297+0000","last_peered":"2024-09-12T00:51:22.063297+0000","last_clean":"2024-09-12T00:51:22.063297+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:51:22.063297+0000","last_undegraded":"2024-09-12T00:51:22.063297+0000","last_fullsized":"2024-09-12T00:51:22.063297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062840+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:51:22.062840+0000","last_peered":"2024-09-12T00:51:22.062840+0000","last_clean":"2024-09-12T00:51:22.062840+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:51:22.062840+0000","last_undegraded":"2024-09-12T00:51:22.062840+0000","last_fullsized":"2024-09-12T00:51:22.062840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295623+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:51:22.295623+0000","last_peered":"2024-09-12T00:51:22.295623+0000","last_clean":"2024-09-12T00:51:22.295623+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:51:22.295623+0000","last_undegraded":"2024-09-12T00:51:22.295623+0000","last_fullsized":"2024-09-12T00:51:22.295623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179780+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:51:22.179780+0000","last_peered":"2024-09-12T00:51:22.179780+0000","last_clean":"2024-09-12T00:51:22.179780+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:51:22.179780+0000","last_undegraded":"2024-09-12T00:51:22.179780+0000","last_fullsized":"2024-09-12T00:51:22.179780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.066285+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:51:22.066285+0000","last_peered":"2024-09-12T00:51:22.066285+0000","last_clean":"2024-09-12T00:51:22.066285+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:51:22.066285+0000","last_undegraded":"2024-09-12T00:51:22.066285+0000","last_fullsized":"2024-09-12T00:51:22.066285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063530+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:51:22.063530+0000","last_peered":"2024-09-12T00:51:22.063530+0000","last_clean":"2024-09-12T00:51:22.063530+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:51:22.063530+0000","last_undegraded":"2024-09-12T00:51:22.063530+0000","last_fullsized":"2024-09-12T00:51:22.063530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065156+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:51:22.065156+0000","last_peered":"2024-09-12T00:51:22.065156+0000","last_clean":"2024-09-12T00:51:22.065156+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:51:22.065156+0000","last_undegraded":"2024-09-12T00:51:22.065156+0000","last_fullsized":"2024-09-12T00:51:22.065156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065720+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:51:22.065720+0000","last_peered":"2024-09-12T00:51:22.065720+0000","last_clean":"2024-09-12T00:51:22.065720+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:51:22.065720+0000","last_undegraded":"2024-09-12T00:51:22.065720+0000","last_fullsized":"2024-09-12T00:51:22.065720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061730+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:51:22.061730+0000","last_peered":"2024-09-12T00:51:22.061730+0000","last_clean":"2024-09-12T00:51:22.061730+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:51:22.061730+0000","last_undegraded":"2024-09-12T00:51:22.061730+0000","last_fullsized":"2024-09-12T00:51:22.061730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064358+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:51:22.064358+0000","last_peered":"2024-09-12T00:51:22.064358+0000","last_clean":"2024-09-12T00:51:22.064358+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:51:22.064358+0000","last_undegraded":"2024-09-12T00:51:22.064358+0000","last_fullsized":"2024-09-12T00:51:22.064358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179263+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:51:22.179263+0000","last_peered":"2024-09-12T00:51:22.179263+0000","last_clean":"2024-09-12T00:51:22.179263+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:51:22.179263+0000","last_undegraded":"2024-09-12T00:51:22.179263+0000","last_fullsized":"2024-09-12T00:51:22.179263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060068+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:51:22.060068+0000","last_peered":"2024-09-12T00:51:22.060068+0000","last_clean":"2024-09-12T00:51:22.060068+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:51:22.060068+0000","last_undegraded":"2024-09-12T00:51:22.060068+0000","last_fullsized":"2024-09-12T00:51:22.060068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063035+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:51:22.063035+0000","last_peered":"2024-09-12T00:51:22.063035+0000","last_clean":"2024-09-12T00:51:22.063035+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:51:22.063035+0000","last_undegraded":"2024-09-12T00:51:22.063035+0000","last_fullsized":"2024-09-12T00:51:22.063035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062895+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:51:22.062895+0000","last_peered":"2024-09-12T00:51:22.062895+0000","last_clean":"2024-09-12T00:51:22.062895+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:51:22.062895+0000","last_undegraded":"2024-09-12T00:51:22.062895+0000","last_fullsized":"2024-09-12T00:51:22.062895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059895+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:51:22.059895+0000","last_peered":"2024-09-12T00:51:22.059895+0000","last_clean":"2024-09-12T00:51:22.059895+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:51:22.059895+0000","last_undegraded":"2024-09-12T00:51:22.059895+0000","last_fullsized":"2024-09-12T00:51:22.059895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058853+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:51:22.058853+0000","last_peered":"2024-09-12T00:51:22.058853+0000","last_clean":"2024-09-12T00:51:22.058853+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:51:22.058853+0000","last_undegraded":"2024-09-12T00:51:22.058853+0000","last_fullsized":"2024-09-12T00:51:22.058853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179724+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:51:22.179724+0000","last_peered":"2024-09-12T00:51:22.179724+0000","last_clean":"2024-09-12T00:51:22.179724+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:51:22.179724+0000","last_undegraded":"2024-09-12T00:51:22.179724+0000","last_fullsized":"2024-09-12T00:51:22.179724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295696+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:51:22.295696+0000","last_peered":"2024-09-12T00:51:22.295696+0000","last_clean":"2024-09-12T00:51:22.295696+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:51:22.295696+0000","last_undegraded":"2024-09-12T00:51:22.295696+0000","last_fullsized":"2024-09-12T00:51:22.295696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063888+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:51:22.063888+0000","last_peered":"2024-09-12T00:51:22.063888+0000","last_clean":"2024-09-12T00:51:22.063888+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:51:22.063888+0000","last_undegraded":"2024-09-12T00:51:22.063888+0000","last_fullsized":"2024-09-12T00:51:22.063888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296199+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:51:22.296199+0000","last_peered":"2024-09-12T00:51:22.296199+0000","last_clean":"2024-09-12T00:51:22.296199+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:51:22.296199+0000","last_undegraded":"2024-09-12T00:51:22.296199+0000","last_fullsized":"2024-09-12T00:51:22.296199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063171+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:51:22.063171+0000","last_peered":"2024-09-12T00:51:22.063171+0000","last_clean":"2024-09-12T00:51:22.063171+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:51:22.063171+0000","last_undegraded":"2024-09-12T00:51:22.063171+0000","last_fullsized":"2024-09-12T00:51:22.063171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060024+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:51:22.060024+0000","last_peered":"2024-09-12T00:51:22.060024+0000","last_clean":"2024-09-12T00:51:22.060024+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:51:22.060024+0000","last_undegraded":"2024-09-12T00:51:22.060024+0000","last_fullsized":"2024-09-12T00:51:22.060024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058915+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:51:22.058915+0000","last_peered":"2024-09-12T00:51:22.058915+0000","last_clean":"2024-09-12T00:51:22.058915+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:51:22.058915+0000","last_undegraded":"2024-09-12T00:51:22.058915+0000","last_fullsized":"2024-09-12T00:51:22.058915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061970+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:51:22.061970+0000","last_peered":"2024-09-12T00:51:22.061970+0000","last_clean":"2024-09-12T00:51:22.061970+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:51:22.061970+0000","last_undegraded":"2024-09-12T00:51:22.061970+0000","last_fullsized":"2024-09-12T00:51:22.061970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062523+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:51:22.062523+0000","last_peered":"2024-09-12T00:51:22.062523+0000","last_clean":"2024-09-12T00:51:22.062523+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:51:22.062523+0000","last_undegraded":"2024-09-12T00:51:22.062523+0000","last_fullsized":"2024-09-12T00:51:22.062523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062859+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:51:22.062859+0000","last_peered":"2024-09-12T00:51:22.062859+0000","last_clean":"2024-09-12T00:51:22.062859+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:51:22.062859+0000","last_undegraded":"2024-09-12T00:51:22.062859+0000","last_fullsized":"2024-09-12T00:51:22.062859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059762+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:51:22.059762+0000","last_peered":"2024-09-12T00:51:22.059762+0000","last_clean":"2024-09-12T00:51:22.059762+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:51:22.059762+0000","last_undegraded":"2024-09-12T00:51:22.059762+0000","last_fullsized":"2024-09-12T00:51:22.059762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061604+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:51:22.061604+0000","last_peered":"2024-09-12T00:51:22.061604+0000","last_clean":"2024-09-12T00:51:22.061604+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:51:22.061604+0000","last_undegraded":"2024-09-12T00:51:22.061604+0000","last_fullsized":"2024-09-12T00:51:22.061604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.142849+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:52:10.142849+0000","last_peered":"2024-09-12T00:52:10.142849+0000","last_clean":"2024-09-12T00:52:10.142849+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:52:10.142849+0000","last_undegraded":"2024-09-12T00:52:10.142849+0000","last_fullsized":"2024-09-12T00:52:10.142849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.297202+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:51:22.297202+0000","last_peered":"2024-09-12T00:51:22.297202+0000","last_clean":"2024-09-12T00:51:22.297202+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:51:22.297202+0000","last_undegraded":"2024-09-12T00:51:22.297202+0000","last_fullsized":"2024-09-12T00:51:22.297202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.183506+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:51:22.183506+0000","last_peered":"2024-09-12T00:51:22.183506+0000","last_clean":"2024-09-12T00:51:22.183506+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:51:22.183506+0000","last_undegraded":"2024-09-12T00:51:22.183506+0000","last_fullsized":"2024-09-12T00:51:22.183506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058459+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:51:22.058459+0000","last_peered":"2024-09-12T00:51:22.058459+0000","last_clean":"2024-09-12T00:51:22.058459+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:51:22.058459+0000","last_undegraded":"2024-09-12T00:51:22.058459+0000","last_fullsized":"2024-09-12T00:51:22.058459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295684+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:51:22.295684+0000","last_peered":"2024-09-12T00:51:22.295684+0000","last_clean":"2024-09-12T00:51:22.295684+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:51:22.295684+0000","last_undegraded":"2024-09-12T00:51:22.295684+0000","last_fullsized":"2024-09-12T00:51:22.295684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064178+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:51:22.064178+0000","last_peered":"2024-09-12T00:51:22.064178+0000","last_clean":"2024-09-12T00:51:22.064178+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:51:22.064178+0000","last_undegraded":"2024-09-12T00:51:22.064178+0000","last_fullsized":"2024-09-12T00:51:22.064178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063404+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:51:22.063404+0000","last_peered":"2024-09-12T00:51:22.063404+0000","last_clean":"2024-09-12T00:51:22.063404+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:51:22.063404+0000","last_undegraded":"2024-09-12T00:51:22.063404+0000","last_fullsized":"2024-09-12T00:51:22.063404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.142096+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:52:10.142096+0000","last_peered":"2024-09-12T00:52:10.142096+0000","last_clean":"2024-09-12T00:52:10.142096+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:52:10.142096+0000","last_undegraded":"2024-09-12T00:52:10.142096+0000","last_fullsized":"2024-09-12T00:52:10.142096+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179676+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:51:22.179676+0000","last_peered":"2024-09-12T00:51:22.179676+0000","last_clean":"2024-09-12T00:51:22.179676+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:51:22.179676+0000","last_undegraded":"2024-09-12T00:51:22.179676+0000","last_fullsized":"2024-09-12T00:51:22.179676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063816+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:51:22.063816+0000","last_peered":"2024-09-12T00:51:22.063816+0000","last_clean":"2024-09-12T00:51:22.063816+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:51:22.063816+0000","last_undegraded":"2024-09-12T00:51:22.063816+0000","last_fullsized":"2024-09-12T00:51:22.063816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062400+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:51:22.062400+0000","last_peered":"2024-09-12T00:51:22.062400+0000","last_clean":"2024-09-12T00:51:22.062400+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:51:22.062400+0000","last_undegraded":"2024-09-12T00:51:22.062400+0000","last_fullsized":"2024-09-12T00:51:22.062400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064353+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:51:22.064353+0000","last_peered":"2024-09-12T00:51:22.064353+0000","last_clean":"2024-09-12T00:51:22.064353+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:51:22.064353+0000","last_undegraded":"2024-09-12T00:51:22.064353+0000","last_fullsized":"2024-09-12T00:51:22.064353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179421+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:51:22.179421+0000","last_peered":"2024-09-12T00:51:22.179421+0000","last_clean":"2024-09-12T00:51:22.179421+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:51:22.179421+0000","last_undegraded":"2024-09-12T00:51:22.179421+0000","last_fullsized":"2024-09-12T00:51:22.179421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'28","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:11.143564+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:52:11.143564+0000","last_peered":"2024-09-12T00:52:11.143564+0000","last_clean":"2024-09-12T00:52:11.143564+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:52:11.143564+0000","last_undegraded":"2024-09-12T00:52:11.143564+0000","last_fullsized":"2024-09-12T00:52:11.143564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061910+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:51:22.061910+0000","last_peered":"2024-09-12T00:51:22.061910+0000","last_clean":"2024-09-12T00:51:22.061910+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:51:22.061910+0000","last_undegraded":"2024-09-12T00:51:22.061910+0000","last_fullsized":"2024-09-12T00:51:22.061910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062859+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:51:22.062859+0000","last_peered":"2024-09-12T00:51:22.062859+0000","last_clean":"2024-09-12T00:51:22.062859+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:51:22.062859+0000","last_undegraded":"2024-09-12T00:51:22.062859+0000","last_fullsized":"2024-09-12T00:51:22.062859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058500+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:51:22.058500+0000","last_peered":"2024-09-12T00:51:22.058500+0000","last_clean":"2024-09-12T00:51:22.058500+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:51:22.058500+0000","last_undegraded":"2024-09-12T00:51:22.058500+0000","last_fullsized":"2024-09-12T00:51:22.058500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064284+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:51:22.064284+0000","last_peered":"2024-09-12T00:51:22.064284+0000","last_clean":"2024-09-12T00:51:22.064284+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:51:22.064284+0000","last_undegraded":"2024-09-12T00:51:22.064284+0000","last_fullsized":"2024-09-12T00:51:22.064284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065694+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:51:22.065694+0000","last_peered":"2024-09-12T00:51:22.065694+0000","last_clean":"2024-09-12T00:51:22.065694+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:51:22.065694+0000","last_undegraded":"2024-09-12T00:51:22.065694+0000","last_fullsized":"2024-09-12T00:51:22.065694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:09.140617+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:52:09.140617+0000","last_peered":"2024-09-12T00:52:09.140617+0000","last_clean":"2024-09-12T00:52:09.140617+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:52:09.140617+0000","last_undegraded":"2024-09-12T00:52:09.140617+0000","last_fullsized":"2024-09-12T00:52:09.140617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063243+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:51:22.063243+0000","last_peered":"2024-09-12T00:51:22.063243+0000","last_clean":"2024-09-12T00:51:22.063243+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:51:22.063243+0000","last_undegraded":"2024-09-12T00:51:22.063243+0000","last_fullsized":"2024-09-12T00:51:22.063243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.082529+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:51:22.082529+0000","last_peered":"2024-09-12T00:51:22.082529+0000","last_clean":"2024-09-12T00:51:22.082529+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:51:22.082529+0000","last_undegraded":"2024-09-12T00:51:22.082529+0000","last_fullsized":"2024-09-12T00:51:22.082529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063885+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:51:22.063885+0000","last_peered":"2024-09-12T00:51:22.063885+0000","last_clean":"2024-09-12T00:51:22.063885+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:51:22.063885+0000","last_undegraded":"2024-09-12T00:51:22.063885+0000","last_fullsized":"2024-09-12T00:51:22.063885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062347+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:51:22.062347+0000","last_peered":"2024-09-12T00:51:22.062347+0000","last_clean":"2024-09-12T00:51:22.062347+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:51:22.062347+0000","last_undegraded":"2024-09-12T00:51:22.062347+0000","last_fullsized":"2024-09-12T00:51:22.062347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.060117+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:51:22.060117+0000","last_peered":"2024-09-12T00:51:22.060117+0000","last_clean":"2024-09-12T00:51:22.060117+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:51:22.060117+0000","last_undegraded":"2024-09-12T00:51:22.060117+0000","last_fullsized":"2024-09-12T00:51:22.060117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058717+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:51:22.058717+0000","last_peered":"2024-09-12T00:51:22.058717+0000","last_clean":"2024-09-12T00:51:22.058717+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:51:22.058717+0000","last_undegraded":"2024-09-12T00:51:22.058717+0000","last_fullsized":"2024-09-12T00:51:22.058717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064005+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:51:22.064005+0000","last_peered":"2024-09-12T00:51:22.064005+0000","last_clean":"2024-09-12T00:51:22.064005+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:51:22.064005+0000","last_undegraded":"2024-09-12T00:51:22.064005+0000","last_fullsized":"2024-09-12T00:51:22.064005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064424+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:51:22.064424+0000","last_peered":"2024-09-12T00:51:22.064424+0000","last_clean":"2024-09-12T00:51:22.064424+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:51:22.064424+0000","last_undegraded":"2024-09-12T00:51:22.064424+0000","last_fullsized":"2024-09-12T00:51:22.064424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.067896+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:51:22.067896+0000","last_peered":"2024-09-12T00:51:22.067896+0000","last_clean":"2024-09-12T00:51:22.067896+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:51:22.067896+0000","last_undegraded":"2024-09-12T00:51:22.067896+0000","last_fullsized":"2024-09-12T00:51:22.067896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.072829+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:51:22.072829+0000","last_peered":"2024-09-12T00:51:22.072829+0000","last_clean":"2024-09-12T00:51:22.072829+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:51:22.072829+0000","last_undegraded":"2024-09-12T00:51:22.072829+0000","last_fullsized":"2024-09-12T00:51:22.072829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063612+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:51:22.063612+0000","last_peered":"2024-09-12T00:51:22.063612+0000","last_clean":"2024-09-12T00:51:22.063612+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:51:22.063612+0000","last_undegraded":"2024-09-12T00:51:22.063612+0000","last_fullsized":"2024-09-12T00:51:22.063612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063475+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:51:22.063475+0000","last_peered":"2024-09-12T00:51:22.063475+0000","last_clean":"2024-09-12T00:51:22.063475+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:51:22.063475+0000","last_undegraded":"2024-09-12T00:51:22.063475+0000","last_fullsized":"2024-09-12T00:51:22.063475+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064877+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:51:22.064877+0000","last_peered":"2024-09-12T00:51:22.064877+0000","last_clean":"2024-09-12T00:51:22.064877+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:51:22.064877+0000","last_undegraded":"2024-09-12T00:51:22.064877+0000","last_fullsized":"2024-09-12T00:51:22.064877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295855+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:51:22.295855+0000","last_peered":"2024-09-12T00:51:22.295855+0000","last_clean":"2024-09-12T00:51:22.295855+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:51:22.295855+0000","last_undegraded":"2024-09-12T00:51:22.295855+0000","last_fullsized":"2024-09-12T00:51:22.295855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063383+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:51:22.063383+0000","last_peered":"2024-09-12T00:51:22.063383+0000","last_clean":"2024-09-12T00:51:22.063383+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:51:22.063383+0000","last_undegraded":"2024-09-12T00:51:22.063383+0000","last_fullsized":"2024-09-12T00:51:22.063383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058455+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:51:22.058455+0000","last_peered":"2024-09-12T00:51:22.058455+0000","last_clean":"2024-09-12T00:51:22.058455+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:51:22.058455+0000","last_undegraded":"2024-09-12T00:51:22.058455+0000","last_fullsized":"2024-09-12T00:51:22.058455+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.141382+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:52:10.141382+0000","last_peered":"2024-09-12T00:52:10.141382+0000","last_clean":"2024-09-12T00:52:10.141382+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:52:10.141382+0000","last_undegraded":"2024-09-12T00:52:10.141382+0000","last_fullsized":"2024-09-12T00:52:10.141382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.068072+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:51:22.068072+0000","last_peered":"2024-09-12T00:51:22.068072+0000","last_clean":"2024-09-12T00:51:22.068072+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:51:22.068072+0000","last_undegraded":"2024-09-12T00:51:22.068072+0000","last_fullsized":"2024-09-12T00:51:22.068072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063364+0000","last_change":"2024-09-12T00:51:09.003409+0000","last_active":"2024-09-12T00:51:22.063364+0000","last_peered":"2024-09-12T00:51:22.063364+0000","last_clean":"2024-09-12T00:51:22.063364+0000","last_became_active":"2024-09-12T00:51:09.003073+0000","last_became_peered":"2024-09-12T00:51:09.003073+0000","last_unstale":"2024-09-12T00:51:22.063364+0000","last_undegraded":"2024-09-12T00:51:22.063364+0000","last_fullsized":"2024-09-12T00:51:22.063364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:36.540715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063423+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:51:22.063423+0000","last_peered":"2024-09-12T00:51:22.063423+0000","last_clean":"2024-09-12T00:51:22.063423+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:51:22.063423+0000","last_undegraded":"2024-09-12T00:51:22.063423+0000","last_fullsized":"2024-09-12T00:51:22.063423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063330+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:51:22.063330+0000","last_peered":"2024-09-12T00:51:22.063330+0000","last_clean":"2024-09-12T00:51:22.063330+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:51:22.063330+0000","last_undegraded":"2024-09-12T00:51:22.063330+0000","last_fullsized":"2024-09-12T00:51:22.063330+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.065393+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:51:22.065393+0000","last_peered":"2024-09-12T00:51:22.065393+0000","last_clean":"2024-09-12T00:51:22.065393+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:51:22.065393+0000","last_undegraded":"2024-09-12T00:51:22.065393+0000","last_fullsized":"2024-09-12T00:51:22.065393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062116+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:51:22.062116+0000","last_peered":"2024-09-12T00:51:22.062116+0000","last_clean":"2024-09-12T00:51:22.062116+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:51:22.062116+0000","last_undegraded":"2024-09-12T00:51:22.062116+0000","last_fullsized":"2024-09-12T00:51:22.062116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.058928+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:51:22.058928+0000","last_peered":"2024-09-12T00:51:22.058928+0000","last_clean":"2024-09-12T00:51:22.058928+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:51:22.058928+0000","last_undegraded":"2024-09-12T00:51:22.058928+0000","last_fullsized":"2024-09-12T00:51:22.058928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.033374+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:51:35.033374+0000","last_peered":"2024-09-12T00:51:35.033374+0000","last_clean":"2024-09-12T00:51:35.033374+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:51:35.033374+0000","last_undegraded":"2024-09-12T00:51:35.033374+0000","last_fullsized":"2024-09-12T00:51:35.033374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296199+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:51:22.296199+0000","last_peered":"2024-09-12T00:51:22.296199+0000","last_clean":"2024-09-12T00:51:22.296199+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:51:22.296199+0000","last_undegraded":"2024-09-12T00:51:22.296199+0000","last_fullsized":"2024-09-12T00:51:22.296199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.064366+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:51:22.064366+0000","last_peered":"2024-09-12T00:51:22.064366+0000","last_clean":"2024-09-12T00:51:22.064366+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:51:22.064366+0000","last_undegraded":"2024-09-12T00:51:22.064366+0000","last_fullsized":"2024-09-12T00:51:22.064366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062144+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:51:22.062144+0000","last_peered":"2024-09-12T00:51:22.062144+0000","last_clean":"2024-09-12T00:51:22.062144+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:51:22.062144+0000","last_undegraded":"2024-09-12T00:51:22.062144+0000","last_fullsized":"2024-09-12T00:51:22.062144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179343+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:51:22.179343+0000","last_peered":"2024-09-12T00:51:22.179343+0000","last_clean":"2024-09-12T00:51:22.179343+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:51:22.179343+0000","last_undegraded":"2024-09-12T00:51:22.179343+0000","last_fullsized":"2024-09-12T00:51:22.179343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.061520+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:51:22.061520+0000","last_peered":"2024-09-12T00:51:22.061520+0000","last_clean":"2024-09-12T00:51:22.061520+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:51:22.061520+0000","last_undegraded":"2024-09-12T00:51:22.061520+0000","last_fullsized":"2024-09-12T00:51:22.061520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295835+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:51:22.295835+0000","last_peered":"2024-09-12T00:51:22.295835+0000","last_clean":"2024-09-12T00:51:22.295835+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:51:22.295835+0000","last_undegraded":"2024-09-12T00:51:22.295835+0000","last_fullsized":"2024-09-12T00:51:22.295835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.059814+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:51:22.059814+0000","last_peered":"2024-09-12T00:51:22.059814+0000","last_clean":"2024-09-12T00:51:22.059814+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:51:22.059814+0000","last_undegraded":"2024-09-12T00:51:22.059814+0000","last_fullsized":"2024-09-12T00:51:22.059814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062964+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:51:22.062964+0000","last_peered":"2024-09-12T00:51:22.062964+0000","last_clean":"2024-09-12T00:51:22.062964+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:51:22.062964+0000","last_undegraded":"2024-09-12T00:51:22.062964+0000","last_fullsized":"2024-09-12T00:51:22.062964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.295934+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:51:22.295934+0000","last_peered":"2024-09-12T00:51:22.295934+0000","last_clean":"2024-09-12T00:51:22.295934+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:51:22.295934+0000","last_undegraded":"2024-09-12T00:51:22.295934+0000","last_fullsized":"2024-09-12T00:51:22.295934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.071628+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:51:22.071628+0000","last_peered":"2024-09-12T00:51:22.071628+0000","last_clean":"2024-09-12T00:51:22.071628+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:51:22.071628+0000","last_undegraded":"2024-09-12T00:51:22.071628+0000","last_fullsized":"2024-09-12T00:51:22.071628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063199+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:51:22.063199+0000","last_peered":"2024-09-12T00:51:22.063199+0000","last_clean":"2024-09-12T00:51:22.063199+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:51:22.063199+0000","last_undegraded":"2024-09-12T00:51:22.063199+0000","last_fullsized":"2024-09-12T00:51:22.063199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.180241+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:51:22.180241+0000","last_peered":"2024-09-12T00:51:22.180241+0000","last_clean":"2024-09-12T00:51:22.180241+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:51:22.180241+0000","last_undegraded":"2024-09-12T00:51:22.180241+0000","last_fullsized":"2024-09-12T00:51:22.180241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062042+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:51:22.062042+0000","last_peered":"2024-09-12T00:51:22.062042+0000","last_clean":"2024-09-12T00:51:22.062042+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:51:22.062042+0000","last_undegraded":"2024-09-12T00:51:22.062042+0000","last_fullsized":"2024-09-12T00:51:22.062042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.179347+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:51:22.179347+0000","last_peered":"2024-09-12T00:51:22.179347+0000","last_clean":"2024-09-12T00:51:22.179347+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:51:22.179347+0000","last_undegraded":"2024-09-12T00:51:22.179347+0000","last_fullsized":"2024-09-12T00:51:22.179347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062006+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:51:22.062006+0000","last_peered":"2024-09-12T00:51:22.062006+0000","last_clean":"2024-09-12T00:51:22.062006+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:51:22.062006+0000","last_undegraded":"2024-09-12T00:51:22.062006+0000","last_fullsized":"2024-09-12T00:51:22.062006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.062364+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:51:22.062364+0000","last_peered":"2024-09-12T00:51:22.062364+0000","last_clean":"2024-09-12T00:51:22.062364+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:51:22.062364+0000","last_undegraded":"2024-09-12T00:51:22.062364+0000","last_fullsized":"2024-09-12T00:51:22.062364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296287+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:51:22.296287+0000","last_peered":"2024-09-12T00:51:22.296287+0000","last_clean":"2024-09-12T00:51:22.296287+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:51:22.296287+0000","last_undegraded":"2024-09-12T00:51:22.296287+0000","last_fullsized":"2024-09-12T00:51:22.296287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.296178+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:51:22.296178+0000","last_peered":"2024-09-12T00:51:22.296178+0000","last_clean":"2024-09-12T00:51:22.296178+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:51:22.296178+0000","last_undegraded":"2024-09-12T00:51:22.296178+0000","last_fullsized":"2024-09-12T00:51:22.296178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T00:51:22.063503+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:51:22.063503+0000","last_peered":"2024-09-12T00:51:22.063503+0000","last_clean":"2024-09-12T00:51:22.063503+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:51:22.063503+0000","last_undegraded":"2024-09-12T00:51:22.063503+0000","last_fullsized":"2024-09-12T00:51:22.063503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":330,"num_read_kb":233,"num_write":162,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612633,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":427967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841566,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1079605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40388,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704764,"statfs":{"total":95995035648,"available":95953678336,"internally_reserved":0,"allocated":905216,"data_stored":428320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201320,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":428123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430253,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1495040,"data_stored":1020448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":427592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1019739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":429116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":427786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":488198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":487149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":428863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:52:16.209 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T00:52:16.209 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:52:16.209 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:52:16.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T00:52:16.467 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:16.841 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:16 smithi002 ceph-mon[31210]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:16.841 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:16 smithi002 ceph-mon[31210]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:52:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 -- 172.21.15.2:0/2716535629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0100e20 msgr2=0x7f6fd0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/2716535629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0100e20 0x7f6fd0101200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009900 tx=0x7f6fcc02a480 comp rx=0 tx=0).stop 2024-09-12T00:52:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 -- 172.21.15.2:0/2716535629 shutdown_connections 2024-09-12T00:52:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/2716535629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fd0102ef0 0x7f6fd010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/2716535629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fd0102570 0x7f6fd01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/2716535629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0100e20 0x7f6fd0101200 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 -- 172.21.15.2:0/2716535629 >> 172.21.15.2:0/2716535629 conn(0x7f6fd00fc7d0 msgr2=0x7f6fd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 -- 172.21.15.2:0/2716535629 shutdown_connections 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.923+0000 7f6fd7a08640 1 -- 172.21.15.2:0/2716535629 wait complete. 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd7a08640 1 Processor -- start 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd7a08640 1 -- start start 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd7a08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fd0100e20 0x7f6fd0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd7a08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0102570 0x7f6fd01998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd7a08640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fd0102ef0 0x7f6fd01a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd7a08640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0110fa0 con 0x7f6fd0102570 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd7a08640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0110e20 con 0x7f6fd0100e20 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd7a08640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0111120 con 0x7f6fd0102ef0 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd4fa3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0102570 0x7f6fd01998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd4fa3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0102570 0x7f6fd01998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44464/0 (socket says 172.21.15.2:44464) 2024-09-12T00:52:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd4fa3640 1 -- 172.21.15.2:0/1708876730 learned_addr learned my addr 172.21.15.2:0/1708876730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.924+0000 7f6fd57a4640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fd0100e20 0x7f6fd0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fd4fa3640 1 -- 172.21.15.2:0/1708876730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fd0102ef0 msgr2=0x7f6fd01a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fd4fa3640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fd0102ef0 0x7f6fd01a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fd4fa3640 1 -- 172.21.15.2:0/1708876730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fd0100e20 msgr2=0x7f6fd0199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fd4fa3640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fd0100e20 0x7f6fd0199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fd4fa3640 1 -- 172.21.15.2:0/1708876730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd01a4930 con 0x7f6fd0102570 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fd4fa3640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0102570 0x7f6fd01998b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000b4a0 tx=0x7f6fc000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fc67fc640 1 -- 172.21.15.2:0/1708876730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0014070 con 0x7f6fd0102570 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd01a4b00 con 0x7f6fd0102570 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fc67fc640 1 -- 172.21.15.2:0/1708876730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fc0010af0 con 0x7f6fd0102570 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fc67fc640 1 -- 172.21.15.2:0/1708876730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0017d10 con 0x7f6fd0102570 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.925+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd01a4fc0 con 0x7f6fd0102570 2024-09-12T00:52:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.926+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd0101200 con 0x7f6fd0102570 2024-09-12T00:52:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.927+0000 7f6fc67fc640 1 -- 172.21.15.2:0/1708876730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6fc0017070 con 0x7f6fd0102570 2024-09-12T00:52:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.928+0000 7f6fc67fc640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6fbc0a2c10 0x7f6fbc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.928+0000 7f6fd57a4640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6fbc0a2c10 0x7f6fbc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.928+0000 7f6fc67fc640 1 -- 172.21.15.2:0/1708876730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f6fc00ce8c0 con 0x7f6fd0102570 2024-09-12T00:52:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.928+0000 7f6fd57a4640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6fbc0a2c10 0x7f6fbc0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc000c00 tx=0x7f6fcc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:16.931+0000 7f6fc67fc640 1 -- 172.21.15.2:0/1708876730 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fc009b7b0 con 0x7f6fd0102570 2024-09-12T00:52:16.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:16 smithi071 ceph-mon[35276]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:16.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:16 smithi071 ceph-mon[35276]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:52:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:16 smithi167 ceph-mon[35234]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:16 smithi167 ceph-mon[35234]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:52:17.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.143+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6fd006a560 con 0x7f6fd0102570 2024-09-12T00:52:17.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.144+0000 7f6fc67fc640 1 -- 172.21.15.2:0/1708876730 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6fd006a560 con 0x7f6fd0102570 2024-09-12T00:52:17.144 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:17.144 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6fbc0a2c10 msgr2=0x7f6fbc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6fbc0a2c10 0x7f6fbc0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc000c00 tx=0x7f6fcc0058d0 comp rx=0 tx=0).stop 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0102570 msgr2=0x7f6fd01998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0102570 0x7f6fd01998b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000b4a0 tx=0x7f6fc000b960 comp rx=0 tx=0).stop 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 shutdown_connections 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f6fbc0a2c10 0x7f6fbc0a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fd0102ef0 0x7f6fd01a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd0102570 0x7f6fd01998b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 --2- 172.21.15.2:0/1708876730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fd0100e20 0x7f6fd0199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 >> 172.21.15.2:0/1708876730 conn(0x7f6fd00fc7d0 msgr2=0x7f6fd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 shutdown_connections 2024-09-12T00:52:17.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:17.146+0000 7f6fd7a08640 1 -- 172.21.15.2:0/1708876730 wait complete. 2024-09-12T00:52:17.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:17 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1708876730' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T00:52:17.914 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:52:17.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:52:17.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:17 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1708876730' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T00:52:18.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:17 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1708876730' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T00:52:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 -- 172.21.15.2:0/1927514839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 msgr2=0x7f9d3c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 --2- 172.21.15.2:0/1927514839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 0x7f9d3c10da40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009ca0 tx=0x7f9d3402a950 comp rx=0 tx=0).stop 2024-09-12T00:52:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 -- 172.21.15.2:0/1927514839 shutdown_connections 2024-09-12T00:52:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 --2- 172.21.15.2:0/1927514839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 0x7f9d3c10da40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 --2- 172.21.15.2:0/1927514839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c102570 0x7f9d3c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 --2- 172.21.15.2:0/1927514839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d3c100e20 0x7f9d3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 -- 172.21.15.2:0/1927514839 >> 172.21.15.2:0/1927514839 conn(0x7f9d3c0fc7d0 msgr2=0x7f9d3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 -- 172.21.15.2:0/1927514839 shutdown_connections 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.654+0000 7f9d446a7640 1 -- 172.21.15.2:0/1927514839 wait complete. 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d446a7640 1 Processor -- start 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d446a7640 1 -- start start 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d446a7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c100e20 0x7f9d3c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d446a7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d3c102570 0x7f9d3c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d446a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 0x7f9d3c1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d446a7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c110f80 con 0x7f9d3c102ef0 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d446a7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c110e00 con 0x7f9d3c102570 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d446a7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c111100 con 0x7f9d3c100e20 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 0x7f9d3c1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 0x7f9d3c1a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44486/0 (socket says 172.21.15.2:44486) 2024-09-12T00:52:18.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 -- 172.21.15.2:0/911973308 learned_addr learned my addr 172.21.15.2:0/911973308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42443640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c100e20 0x7f9d3c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d41c42640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d3c102570 0x7f9d3c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 -- 172.21.15.2:0/911973308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c100e20 msgr2=0x7f9d3c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c100e20 0x7f9d3c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 -- 172.21.15.2:0/911973308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d3c102570 msgr2=0x7f9d3c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d3c102570 0x7f9d3c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 -- 172.21.15.2:0/911973308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3c1a4930 con 0x7f9d3c102ef0 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42443640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c100e20 0x7f9d3c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d41c42640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d3c102570 0x7f9d3c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.655+0000 7f9d42c44640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 0x7f9d3c1a43f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9d3402ae70 tx=0x7f9d3402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.656+0000 7f9d2f7fe640 1 -- 172.21.15.2:0/911973308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34034040 con 0x7f9d3c102ef0 2024-09-12T00:52:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.656+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3c1a4b00 con 0x7f9d3c102ef0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.656+0000 7f9d2f7fe640 1 -- 172.21.15.2:0/911973308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d34030920 con 0x7f9d3c102ef0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.656+0000 7f9d2f7fe640 1 -- 172.21.15.2:0/911973308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34045480 con 0x7f9d3c102ef0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.656+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3c1a4f50 con 0x7f9d3c102ef0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.657+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d3c101200 con 0x7f9d3c102ef0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.659+0000 7f9d2f7fe640 1 -- 172.21.15.2:0/911973308 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f9d34037020 con 0x7f9d3c102ef0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.659+0000 7f9d2f7fe640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f9d280a2c10 0x7f9d280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.659+0000 7f9d42443640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f9d280a2c10 0x7f9d280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.659+0000 7f9d2f7fe640 1 -- 172.21.15.2:0/911973308 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9d340f0200 con 0x7f9d3c102ef0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.660+0000 7f9d42443640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f9d280a2c10 0x7f9d280a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d38005fd0 tx=0x7f9d3800b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.663+0000 7f9d2f7fe640 1 -- 172.21.15.2:0/911973308 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d340811b0 con 0x7f9d3c102ef0 2024-09-12T00:52:18.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.876+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d3c1a51e0 con 0x7f9d3c102ef0 2024-09-12T00:52:18.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:18 smithi002 ceph-mon[31210]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:18.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.877+0000 7f9d2f7fe640 1 -- 172.21.15.2:0/911973308 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f9d340bd0f0 con 0x7f9d3c102ef0 2024-09-12T00:52:18.877 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:18.877 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"btime":"2024-09-12T00:51:23:057392+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:51:22.721078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:52:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f9d280a2c10 msgr2=0x7f9d280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f9d280a2c10 0x7f9d280a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d38005fd0 tx=0x7f9d3800b5f0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 msgr2=0x7f9d3c1a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 0x7f9d3c1a43f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9d3402ae70 tx=0x7f9d3402f5d0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 shutdown_connections 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f9d280a2c10 0x7f9d280a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d3c102ef0 0x7f9d3c1a43f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d3c102570 0x7f9d3c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 --2- 172.21.15.2:0/911973308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c100e20 0x7f9d3c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:18.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 >> 172.21.15.2:0/911973308 conn(0x7f9d3c0fc7d0 msgr2=0x7f9d3c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:18.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 shutdown_connections 2024-09-12T00:52:18.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:18.879+0000 7f9d446a7640 1 -- 172.21.15.2:0/911973308 wait complete. 2024-09-12T00:52:18.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:18 smithi071 ceph-mon[35276]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:18 smithi167 ceph-mon[35234]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:19.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:52:19.702 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:19.869 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:19 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/911973308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:19.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:19 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/911973308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:20.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:19 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/911973308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:20.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 -- 172.21.15.2:0/3143261545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 msgr2=0x7f1d941031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:20.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 --2- 172.21.15.2:0/3143261545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 0x7f1d941031b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009930 tx=0x7f1d8402a420 comp rx=0 tx=0).stop 2024-09-12T00:52:20.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 -- 172.21.15.2:0/3143261545 shutdown_connections 2024-09-12T00:52:20.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 --2- 172.21.15.2:0/3143261545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d94108300 0x7f1d9410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 --2- 172.21.15.2:0/3143261545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d94103780 0x7f1d94107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 --2- 172.21.15.2:0/3143261545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 0x7f1d941031b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 -- 172.21.15.2:0/3143261545 >> 172.21.15.2:0/3143261545 conn(0x7f1d940fc7d0 msgr2=0x7f1d940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 -- 172.21.15.2:0/3143261545 shutdown_connections 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.198+0000 7f1d9a829640 1 -- 172.21.15.2:0/3143261545 wait complete. 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d9a829640 1 Processor -- start 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d9a829640 1 -- start start 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d9a829640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 0x7f1d941985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d9a829640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d94103780 0x7f1d94198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d9a829640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d94108300 0x7f1d9419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d9a829640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1d941120b0 con 0x7f1d94102dd0 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d9a829640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1d94111f30 con 0x7f1d94108300 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d9a829640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1d94112230 con 0x7f1d94103780 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d93fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 0x7f1d941985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.199+0000 7f1d93fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 0x7f1d941985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44500/0 (socket says 172.21.15.2:44500) 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d93fff640 1 -- 172.21.15.2:0/1974291241 learned_addr learned my addr 172.21.15.2:0/1974291241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d8bfff640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d94103780 0x7f1d94198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d98dc6640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d94108300 0x7f1d9419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d93fff640 1 -- 172.21.15.2:0/1974291241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d94103780 msgr2=0x7f1d94198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d93fff640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d94103780 0x7f1d94198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d93fff640 1 -- 172.21.15.2:0/1974291241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d94108300 msgr2=0x7f1d9419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d93fff640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d94108300 0x7f1d9419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d93fff640 1 -- 172.21.15.2:0/1974291241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d9419d5a0 con 0x7f1d94102dd0 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d98dc6640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d94108300 0x7f1d9419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d93fff640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 0x7f1d941985f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009230 tx=0x7f1d84004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d91ffb640 1 -- 172.21.15.2:0/1974291241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8403f030 con 0x7f1d94102dd0 2024-09-12T00:52:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d91ffb640 1 -- 172.21.15.2:0/1974291241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d84003ad0 con 0x7f1d94102dd0 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d9419d830 con 0x7f1d94102dd0 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d91ffb640 1 -- 172.21.15.2:0/1974291241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84035070 con 0x7f1d94102dd0 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.200+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d941a5170 con 0x7f1d94102dd0 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.201+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d941031b0 con 0x7f1d94102dd0 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.203+0000 7f1d91ffb640 1 -- 172.21.15.2:0/1974291241 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1d84042030 con 0x7f1d94102dd0 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.203+0000 7f1d91ffb640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1d800a2c90 0x7f1d800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.204+0000 7f1d91ffb640 1 -- 172.21.15.2:0/1974291241 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f1d840efbf0 con 0x7f1d94102dd0 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.204+0000 7f1d8bfff640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1d800a2c90 0x7f1d800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.204+0000 7f1d8bfff640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1d800a2c90 0x7f1d800a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1d940feee0 tx=0x7f1d7c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.210+0000 7f1d91ffb640 1 -- 172.21.15.2:0/1974291241 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d840bc9d0 con 0x7f1d94102dd0 2024-09-12T00:52:20.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.420+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d94199950 con 0x7f1d94102dd0 2024-09-12T00:52:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.421+0000 7f1d91ffb640 1 -- 172.21.15.2:0/1974291241 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f1d840bc2d0 con 0x7f1d94102dd0 2024-09-12T00:52:20.421 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:20.421 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"btime":"2024-09-12T00:51:23:057392+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:51:22.721078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:52:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-12T00:52:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1d800a2c90 msgr2=0x7f1d800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1d800a2c90 0x7f1d800a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1d940feee0 tx=0x7f1d7c00b390 comp rx=0 tx=0).stop 2024-09-12T00:52:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 msgr2=0x7f1d941985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 0x7f1d941985f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009230 tx=0x7f1d84004270 comp rx=0 tx=0).stop 2024-09-12T00:52:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 shutdown_connections 2024-09-12T00:52:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1d800a2c90 0x7f1d800a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d94108300 0x7f1d9419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d94103780 0x7f1d94198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 --2- 172.21.15.2:0/1974291241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d94102dd0 0x7f1d941985f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 >> 172.21.15.2:0/1974291241 conn(0x7f1d940fc7d0 msgr2=0x7f1d94105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 shutdown_connections 2024-09-12T00:52:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:20.423+0000 7f1d9a829640 1 -- 172.21.15.2:0/1974291241 wait complete. 2024-09-12T00:52:20.938 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:20 smithi167 ceph-mon[35234]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:20.938 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:20 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1974291241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:20.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:20 smithi071 ceph-mon[35276]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:20.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:20 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1974291241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:20.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:20 smithi002 ceph-mon[31210]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:20.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:20 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1974291241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:21.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:52:21.321 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:21.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:21 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-09-12T00:52:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/2086780397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 msgr2=0x7f1c6410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/2086780397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 0x7f1c6410ea90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009ca0 tx=0x7f1c5c02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/2086780397 shutdown_connections 2024-09-12T00:52:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/2086780397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 0x7f1c6410ea90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/2086780397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c64102790 0x7f1c641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/2086780397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c64101de0 0x7f1c641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/2086780397 >> 172.21.15.2:0/2086780397 conn(0x7f1c640fd8c0 msgr2=0x7f1c640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/2086780397 shutdown_connections 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/2086780397 wait complete. 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.761+0000 7f1c6ac1b640 1 Processor -- start 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c6ac1b640 1 -- start start 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c6ac1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c64101de0 0x7f1c64198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c6ac1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c64102790 0x7f1c64198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c6ac1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 0x7f1c6419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c6ac1b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c64111f70 con 0x7f1c64106f10 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c6ac1b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1c64111df0 con 0x7f1c64102790 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c6ac1b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c641120f0 con 0x7f1c64101de0 2024-09-12T00:52:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 0x7f1c6419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 0x7f1c6419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44510/0 (socket says 172.21.15.2:44510) 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 -- 172.21.15.2:0/1962383038 learned_addr learned my addr 172.21.15.2:0/1962383038 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c689b7640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c64101de0 0x7f1c64198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c63fff640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c64102790 0x7f1c64198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 -- 172.21.15.2:0/1962383038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c64101de0 msgr2=0x7f1c64198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c64101de0 0x7f1c64198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 -- 172.21.15.2:0/1962383038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c64102790 msgr2=0x7f1c64198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c64102790 0x7f1c64198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 -- 172.21.15.2:0/1962383038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6419d2e0 con 0x7f1c64106f10 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c689b7640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c64101de0 0x7f1c64198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.762+0000 7f1c691b8640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 0x7f1c6419cc00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c031a20 tx=0x7f1c5c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.763+0000 7f1c61ffb640 1 -- 172.21.15.2:0/1962383038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c003b70 con 0x7f1c64106f10 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.763+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6419d570 con 0x7f1c64106f10 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.763+0000 7f1c61ffb640 1 -- 172.21.15.2:0/1962383038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c5c003d10 con 0x7f1c64106f10 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.763+0000 7f1c61ffb640 1 -- 172.21.15.2:0/1962383038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c02fc80 con 0x7f1c64106f10 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.763+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c641a4eb0 con 0x7f1c64106f10 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.764+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c641021c0 con 0x7f1c64106f10 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.765+0000 7f1c61ffb640 1 -- 172.21.15.2:0/1962383038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1c5c0046a0 con 0x7f1c64106f10 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.766+0000 7f1c61ffb640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1c4c0a2c10 0x7f1c4c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.766+0000 7f1c689b7640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1c4c0a2c10 0x7f1c4c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.766+0000 7f1c61ffb640 1 -- 172.21.15.2:0/1962383038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8298+0+0 (secure 0 0 0) 0x7f1c5c0f0470 con 0x7f1c64106f10 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.767+0000 7f1c689b7640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1c4c0a2c10 0x7f1c4c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400afb0 tx=0x7f1c5400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.770+0000 7f1c61ffb640 1 -- 172.21.15.2:0/1962383038 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c5c0bd370 con 0x7f1c64106f10 2024-09-12T00:52:21.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:21 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-09-12T00:52:21.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.947+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c64199690 con 0x7f1c64106f10 2024-09-12T00:52:21.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.948+0000 7f1c61ffb640 1 -- 172.21.15.2:0/1962383038 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22755 (secure 0 0 0) 0x7f1c64199690 con 0x7f1c64106f10 2024-09-12T00:52:21.948 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:21.948 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:52:21.579338+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:52:21.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1c4c0a2c10 msgr2=0x7f1c4c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1c4c0a2c10 0x7f1c4c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400afb0 tx=0x7f1c5400a2d0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 msgr2=0x7f1c6419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 0x7f1c6419cc00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c031a20 tx=0x7f1c5c031a50 comp rx=0 tx=0).stop 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 shutdown_connections 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f1c4c0a2c10 0x7f1c4c0a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c64106f10 0x7f1c6419cc00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c64102790 0x7f1c64198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 --2- 172.21.15.2:0/1962383038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c64101de0 0x7f1c64198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 >> 172.21.15.2:0/1962383038 conn(0x7f1c640fd8c0 msgr2=0x7f1c640febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 shutdown_connections 2024-09-12T00:52:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:21.951+0000 7f1c6ac1b640 1 -- 172.21.15.2:0/1962383038 wait complete. 2024-09-12T00:52:22.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:21 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-09-12T00:52:22.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:52:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:22 smithi071 ceph-mon[35276]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:22 smithi071 ceph-mon[35276]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-09-12T00:52:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:22 smithi071 ceph-mon[35276]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T00:52:22.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:22 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1962383038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:22.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:22 smithi002 ceph-mon[31210]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:22.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:22 smithi002 ceph-mon[31210]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-09-12T00:52:22.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:22 smithi002 ceph-mon[31210]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T00:52:22.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:22 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1962383038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:22 smithi167 ceph-mon[35234]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:22 smithi167 ceph-mon[35234]: from='mgr.14150 172.21.15.2:0/3181682375' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-09-12T00:52:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:22 smithi167 ceph-mon[35234]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T00:52:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:22 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1962383038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:23.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 -- 172.21.15.2:0/1783785937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 msgr2=0x7f237410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 --2- 172.21.15.2:0/1783785937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 0x7f237410d950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f236c009cd0 tx=0x7f236c02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 -- 172.21.15.2:0/1783785937 shutdown_connections 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 --2- 172.21.15.2:0/1783785937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 0x7f237410d950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 --2- 172.21.15.2:0/1783785937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2374100a80 0x7f2374100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 --2- 172.21.15.2:0/1783785937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2374106a80 0x7f2374106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 -- 172.21.15.2:0/1783785937 >> 172.21.15.2:0/1783785937 conn(0x7f23740fc7a0 msgr2=0x7f23740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 -- 172.21.15.2:0/1783785937 shutdown_connections 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.376+0000 7f237984f640 1 -- 172.21.15.2:0/1783785937 wait complete. 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f237984f640 1 Processor -- start 2024-09-12T00:52:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f237984f640 1 -- start start 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f237984f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2374100a80 0x7f2374198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f237984f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 0x7f2374198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f237984f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2374106a80 0x7f237419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f237984f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2374110ed0 con 0x7f2374101420 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f237984f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2374110d50 con 0x7f2374100a80 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f237984f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2374111050 con 0x7f2374106a80 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f23727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 0x7f2374198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f23727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 0x7f2374198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44538/0 (socket says 172.21.15.2:44538) 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.377+0000 7f23727fc640 1 -- 172.21.15.2:0/161876753 learned_addr learned my addr 172.21.15.2:0/161876753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.378+0000 7f2372ffd640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2374100a80 0x7f2374198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.378+0000 7f23737fe640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2374106a80 0x7f237419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.378+0000 7f2372ffd640 1 -- 172.21.15.2:0/161876753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2374106a80 msgr2=0x7f237419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.378+0000 7f2372ffd640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2374106a80 0x7f237419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.378+0000 7f2372ffd640 1 -- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 msgr2=0x7f2374198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.378+0000 7f2372ffd640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 0x7f2374198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.378+0000 7f2372ffd640 1 -- 172.21.15.2:0/161876753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237419d400 con 0x7f2374100a80 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.378+0000 7f23727fc640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 0x7f2374198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.379+0000 7f2372ffd640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2374100a80 0x7f2374198450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2364005fd0 tx=0x7f236400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.379+0000 7f237884d640 1 -- 172.21.15.2:0/161876753 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364009c30 con 0x7f2374100a80 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.379+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237419d6f0 con 0x7f2374100a80 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.379+0000 7f237884d640 1 -- 172.21.15.2:0/161876753 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2364009dd0 con 0x7f2374100a80 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.379+0000 7f237884d640 1 -- 172.21.15.2:0/161876753 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364010460 con 0x7f2374100a80 2024-09-12T00:52:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.379+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23741a4fd0 con 0x7f2374100a80 2024-09-12T00:52:23.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.380+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2374100ee0 con 0x7f2374100a80 2024-09-12T00:52:23.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.381+0000 7f237884d640 1 -- 172.21.15.2:0/161876753 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2364003f50 con 0x7f2374100a80 2024-09-12T00:52:23.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.382+0000 7f237884d640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f235c0a2c10 0x7f235c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.382+0000 7f23727fc640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f235c0a2c10 0x7f235c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.382+0000 7f237884d640 1 -- 172.21.15.2:0/161876753 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f23640cf140 con 0x7f2374100a80 2024-09-12T00:52:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.383+0000 7f23727fc640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f235c0a2c10 0x7f235c0a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23740fea50 tx=0x7f236800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:23.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.385+0000 7f237884d640 1 -- 172.21.15.2:0/161876753 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2364017020 con 0x7f2374100a80 2024-09-12T00:52:23.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.598+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23741a51d0 con 0x7f2374100a80 2024-09-12T00:52:23.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.599+0000 7f237884d640 1 -- 172.21.15.2:0/161876753 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f236409bf00 con 0x7f2374100a80 2024-09-12T00:52:23.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:23.599 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"btime":"2024-09-12T00:51:23:057392+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:51:22.721078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:52:23.599 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f235c0a2c10 msgr2=0x7f235c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f235c0a2c10 0x7f235c0a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23740fea50 tx=0x7f236800b480 comp rx=0 tx=0).stop 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2374100a80 msgr2=0x7f2374198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2374100a80 0x7f2374198450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2364005fd0 tx=0x7f236400dde0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 shutdown_connections 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f235c0a2c10 0x7f235c0a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2374106a80 0x7f237419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2374101420 0x7f2374198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 --2- 172.21.15.2:0/161876753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2374100a80 0x7f2374198450 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 >> 172.21.15.2:0/161876753 conn(0x7f23740fc7a0 msgr2=0x7f237406a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 shutdown_connections 2024-09-12T00:52:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:23.601+0000 7f237984f640 1 -- 172.21.15.2:0/161876753 wait complete. 2024-09-12T00:52:23.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:23 smithi071 ceph-mon[35276]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T00:52:23.955 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:23 smithi002 ceph-mon[31210]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T00:52:24.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:23 smithi167 ceph-mon[35234]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T00:52:24.276 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T00:51:11.599964+0000', 'modified': '2024-09-12T00:51:22.721078+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24494, 'mds_1': 24487, 'mds_2': 24470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/659790149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 659790149}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 659790149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/3315294973', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 3315294973}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 3315294973}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6837/2094252120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 2094252120}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2094252120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.71:6837/2619227560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 2619227560}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 2619227560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.167:6839/3375026686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 3375026686}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 3375026686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.71:6839/3061730891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3061730891}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3061730891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24494, 'qdb_cluster': [24470, 24487, 24494]} 2024-09-12T00:52:24.276 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T00:52:24.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T00:52:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:24.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:24 smithi002 ceph-mon[31210]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:24.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:24 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/161876753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:24.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:24 smithi071 ceph-mon[35276]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:24.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:24 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/161876753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:24 smithi167 ceph-mon[35234]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:24 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/161876753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:25.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.033+0000 7f7fbf41f640 1 -- 172.21.15.2:0/2555180850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb81008d0 msgr2=0x7f7fb8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.033+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/2555180850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb81008d0 0x7f7fb8100cb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009900 tx=0x7f7fb402a410 comp rx=0 tx=0).stop 2024-09-12T00:52:25.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 -- 172.21.15.2:0/2555180850 shutdown_connections 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/2555180850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb810e480 0x7f7fb8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/2555180850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fb8101280 0x7f7fb810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/2555180850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb81008d0 0x7f7fb8100cb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 -- 172.21.15.2:0/2555180850 >> 172.21.15.2:0/2555180850 conn(0x7f7fb80fc7a0 msgr2=0x7f7fb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 -- 172.21.15.2:0/2555180850 shutdown_connections 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 -- 172.21.15.2:0/2555180850 wait complete. 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 Processor -- start 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 -- start start 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb81008d0 0x7f7fb819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb8101280 0x7f7fb819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fb810e480 0x7f7fb819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb8114190 con 0x7f7fb8101280 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb8114010 con 0x7f7fb81008d0 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.034+0000 7f7fbf41f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb8114310 con 0x7f7fb810e480 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb8101280 0x7f7fb819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb8101280 0x7f7fb819abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44562/0 (socket says 172.21.15.2:44562) 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 -- 172.21.15.2:0/352215035 learned_addr learned my addr 172.21.15.2:0/352215035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fb810e480 0x7f7fb819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb81008d0 0x7f7fb819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 -- 172.21.15.2:0/352215035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fb810e480 msgr2=0x7f7fb819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fb810e480 0x7f7fb819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 -- 172.21.15.2:0/352215035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb81008d0 msgr2=0x7f7fb819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb81008d0 0x7f7fb819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 -- 172.21.15.2:0/352215035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb819f660 con 0x7f7fb8101280 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fb810e480 0x7f7fb819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb8101280 0x7f7fb819abf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c890 tx=0x7f7fa800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fae7fc640 1 -- 172.21.15.2:0/352215035 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8004220 con 0x7f7fb8101280 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fae7fc640 1 -- 172.21.15.2:0/352215035 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa80043c0 con 0x7f7fb8101280 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbf41f640 1 -- 172.21.15.2:0/352215035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb819f950 con 0x7f7fb8101280 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fae7fc640 1 -- 172.21.15.2:0/352215035 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80049e0 con 0x7f7fb8101280 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.035+0000 7f7fbf41f640 1 -- 172.21.15.2:0/352215035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb81a7230 con 0x7f7fb8101280 2024-09-12T00:52:25.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fae7fc640 1 -- 172.21.15.2:0/352215035 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7fa80079b0 con 0x7f7fb8101280 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fc17f8740 1 Processor -- start 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fc17f8740 1 -- start start 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ebddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 0x5599c0ecafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5599c0e24090 con 0x5599c0ebd9d0 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5599c0dcba70 con 0x5599c0ec8bb0 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5599c0e20050 con 0x5599c0ebe2f0 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fbd9bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ebddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.038+0000 7f7fbd9bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ebddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44578/0 (socket says 172.21.15.2:44578) 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/54298644 learned_addr learned my addr 172.21.15.2:0/54298644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fae7fc640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fa40a2c10 0x7f7fa40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 0x5599c0ecafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/54298644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 msgr2=0x5599c0ec8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/54298644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 msgr2=0x5599c0ecafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 0x5599c0ecafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/54298644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c0dd8130 con 0x5599c0ebd9d0 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fae7fc640 1 -- 172.21.15.2:0/352215035 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f7fa80cf320 con 0x7f7fb8101280 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ebddb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000ae20 tx=0x7f7fb000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cd18666ac6d05a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fa40a2c10 0x7f7fa40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fa37fe640 1 -- 172.21.15.2:0/54298644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0010840 con 0x5599c0ebd9d0 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fa37fe640 1 -- 172.21.15.2:0/54298644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fb0010d40 con 0x5599c0ebd9d0 2024-09-12T00:52:25.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.039+0000 7f7fa37fe640 1 -- 172.21.15.2:0/54298644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0019860 con 0x5599c0ebd9d0 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 -- 172.21.15.2:0/54298644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 msgr2=0x5599c0ebddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ebddb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000ae20 tx=0x7f7fb000e720 comp rx=0 tx=0).stop 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fa40a2c10 0x7f7fa40a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000f010 tx=0x7f7fb000f3c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 -- 172.21.15.2:0/54298644 shutdown_connections 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 0x5599c0ecafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/54298644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ebddb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 -- 172.21.15.2:0/54298644 >> 172.21.15.2:0/54298644 conn(0x5599c0eb9f60 msgr2=0x5599c0eba340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 -- 172.21.15.2:0/54298644 shutdown_connections 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.040+0000 7f7fc17f8740 1 -- 172.21.15.2:0/54298644 wait complete. 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 1 -- start start 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 1 Processor -- start 2024-09-12T00:52:25.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebd9d0 0x5599c0ec8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5599c0ecb780 con 0x5599c0ec8bb0 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5599c0ddef20 con 0x5599c0ebe2f0 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5599c0ecb900 con 0x5599c0ebd9d0 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fc17f8740 10 client.0 _ll_register_callbacks cb 0x5599c0da8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fbd9bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fbd9bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44590/0 (socket says 172.21.15.2:44590) 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/3947762548 learned_addr learned my addr 172.21.15.2:0/3947762548 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.041+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebd9d0 0x5599c0ec8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/3947762548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebd9d0 msgr2=0x5599c0ec8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebd9d0 0x5599c0ec8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebe2f0 msgr2=0x5599c0ec5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/3947762548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c0b952b0 con 0x5599c0ec8bb0 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebd9d0 0x5599c0ec8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec5ca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0019400 tx=0x7f7fb0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f7b697c60ca447 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fa0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/3947762548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0010b00 con 0x5599c0ec8bb0 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/3947762548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f7fb000fd30 con 0x5599c0ec8bb0 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3947762548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb0010d40 con 0x5599c0ec8bb0 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/3947762548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fb0004a00 con 0x5599c0ec8bb0 2024-09-12T00:52:25.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fc17f8740 10 client.14958 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3947762548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5599c0ed7070 con 0x5599c0ec8bb0 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/3947762548 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fb0010d40 con 0x5599c0ec8bb0 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/3947762548 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7fb001a410 con 0x5599c0ec8bb0 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.042+0000 7f7fc17f8740 10 client.14958 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.043+0000 7f7fc17f8740 10 client.14958 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.043+0000 7f7fc17f8740 20 client.14958 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.043+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5599c0ed9390 0x5599c0eda800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.043+0000 7f7fc17f8740 4 client.14958 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.043+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3947762548 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599c0e31600 con 0x5599c0ed9390 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.043+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5599c0ed9390 0x5599c0eda800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.043+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5599c0ed9390 0x5599c0eda800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df1d1b8ee38799af server_cookie=c1f9751439086b3d in_seq=0 out_seq=0 2024-09-12T00:52:25.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.043+0000 7f7fa0ff9640 10 client.14958 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:52:25.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.044+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/3947762548 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599c0e31600 con 0x5599c0ed9390 2024-09-12T00:52:25.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.044+0000 7f7fa0ff9640 10 client.14958 handle_command_reply: tid=0 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.044+0000 7f7fc17f8740 1 client.14958 shutdown 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.044+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3947762548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 msgr2=0x5599c0ec5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.044+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec5ca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0019400 tx=0x7f7fb0019000 comp rx=0 tx=0).stop 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.044+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3947762548 shutdown_connections 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.044+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5599c0ed9390 0x5599c0eda800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.045+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec5ca0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.045+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebe2f0 0x5599c0ec5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.045+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3947762548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebd9d0 0x5599c0ec8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.045+0000 7f7fa0ff9640 0 client.14958 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.045+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3947762548 >> 172.21.15.2:0/3947762548 conn(0x5599c0eb9f60 msgr2=0x5599c0ebfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.045+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3947762548 shutdown_connections 2024-09-12T00:52:25.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.045+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3947762548 wait complete. 2024-09-12T00:52:25.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.045+0000 7f7fc17f8740 20 client.14958 trim_cache size 0 max 16384 2024-09-12T00:52:25.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fc17f8740 1 Processor -- start 2024-09-12T00:52:25.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fc17f8740 1 -- start start 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebd9d0 0x5599c0eda800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0eb8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5599c0ed8b40 con 0x5599c0ec8bb0 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5599c0ed9210 con 0x5599c0ebd9d0 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5599c0ed98e0 con 0x5599c0ebe2f0 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd9bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd9bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44598/0 (socket says 172.21.15.2:44598) 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/3692312063 learned_addr learned my addr 172.21.15.2:0/3692312063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0eb8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebd9d0 0x5599c0eda800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/3692312063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 msgr2=0x5599c0eb8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0eb8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/3692312063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebd9d0 msgr2=0x5599c0eda800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebd9d0 0x5599c0eda800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.063+0000 7f7fbd9bc640 1 -- 172.21.15.2:0/3692312063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c0ecafa0 con 0x5599c0ec8bb0 2024-09-12T00:52:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.064+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec29e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7fb001a9d0 tx=0x7f7fb000a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3611559280c5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.064+0000 7f7fa2ffd640 1 -- 172.21.15.2:0/3692312063 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb003f030 con 0x5599c0ec8bb0 2024-09-12T00:52:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.064+0000 7f7fa2ffd640 1 -- 172.21.15.2:0/3692312063 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fb000fd30 con 0x5599c0ec8bb0 2024-09-12T00:52:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.064+0000 7f7fa2ffd640 1 -- 172.21.15.2:0/3692312063 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0004ba0 con 0x5599c0ec8bb0 2024-09-12T00:52:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.064+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3692312063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 msgr2=0x5599c0ec29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.064+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec29e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7fb001a9d0 tx=0x7f7fb000a530 comp rx=0 tx=0).stop 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3692312063 shutdown_connections 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ec8bb0 0x5599c0ec29e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0eb8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/3692312063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ebd9d0 0x5599c0eda800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3692312063 >> 172.21.15.2:0/3692312063 conn(0x5599c0eb9f60 msgr2=0x5599c0eb8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3692312063 shutdown_connections 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 -- 172.21.15.2:0/3692312063 wait complete. 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 -- start start 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 Processor -- start 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ee2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0ee32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 0x5599c0ede1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5599c0eda680 con 0x5599c0ebd9d0 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5599c0ed9fb0 con 0x5599c0ec8bb0 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.065+0000 7f7fc17f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5599c0edad50 con 0x5599c0ebe2f0 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fc17f8740 10 client.0 _ll_register_callbacks cb 0x7f7fb0014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ee2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ee2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44600/0 (socket says 172.21.15.2:44600) 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 -- 172.21.15.2:0/1971470894 learned_addr learned my addr 172.21.15.2:0/1971470894 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0ee32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd9bc640 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 0x5599c0ede1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 -- 172.21.15.2:0/1971470894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 msgr2=0x5599c0ee32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0ee32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 -- 172.21.15.2:0/1971470894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 msgr2=0x5599c0ede1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 0x5599c0ede1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 -- 172.21.15.2:0/1971470894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c0ede9d0 con 0x5599c0ebd9d0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fbd1bb640 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ee2da0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000c00 tx=0x7f7fb40041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8be4596a4d4323 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fa0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/1971470894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb404b060 con 0x5599c0ebd9d0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/1971470894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f7fb4005240 con 0x5599c0ebd9d0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fc17f8740 1 -- 172.21.15.2:0/1971470894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb000fd30 con 0x5599c0ebd9d0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/1971470894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fb4035040 con 0x5599c0ebd9d0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fc17f8740 10 client.14964 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.066+0000 7f7fc17f8740 1 -- 172.21.15.2:0/1971470894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5599c0f436a0 con 0x5599c0ebd9d0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/1971470894 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fb000fd30 con 0x5599c0ebd9d0 2024-09-12T00:52:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/1971470894 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7fb4045070 con 0x5599c0ebd9d0 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fc17f8740 10 client.14964 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fc17f8740 10 client.14964 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fc17f8740 20 client.14964 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5599c0f48280 0x5599c0f46f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fc17f8740 4 client.14964 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fc17f8740 1 -- 172.21.15.2:0/1971470894 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "status"}) -- 0x5599c0e2bb10 con 0x5599c0f48280 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.067+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5599c0f48280 0x5599c0f46f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fbc9ba640 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5599c0f48280 0x5599c0f46f90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6999a0a5a39ed4e7 server_cookie=ee917e92e9d79657 in_seq=0 out_seq=0 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fa0ff9640 10 client.14964 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fa0ff9640 1 -- 172.21.15.2:0/1971470894 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5599c0e2bb10 con 0x5599c0f48280 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fa0ff9640 10 client.14964 handle_command_reply: tid=0 2024-09-12T00:52:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 client.14964 shutdown 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 -- 172.21.15.2:0/1971470894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 msgr2=0x5599c0ee2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ee2da0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000c00 tx=0x7f7fb40041a0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 -- 172.21.15.2:0/1971470894 shutdown_connections 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5599c0f48280 0x5599c0f46f90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5599c0ec8bb0 0x5599c0ede1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599c0ebe2f0 0x5599c0ee32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 --2- 172.21.15.2:0/1971470894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5599c0ebd9d0 0x5599c0ee2da0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 -- 172.21.15.2:0/1971470894 >> 172.21.15.2:0/1971470894 conn(0x5599c0eb9f60 msgr2=0x5599c0eb9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fa0ff9640 0 client.14964 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 -- 172.21.15.2:0/1971470894 shutdown_connections 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 1 -- 172.21.15.2:0/1971470894 wait complete. 2024-09-12T00:52:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.068+0000 7f7fc17f8740 20 client.14964 trim_cache size 0 max 16384 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24470, 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 65.022382128000004, 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 24, 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 83, 2024-09-12T00:52:25.074 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T00:52:25.075 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 94.865076674999997 2024-09-12T00:52:25.075 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:52:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 -- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fa40a2c10 msgr2=0x7f7fa40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fa40a2c10 0x7f7fa40a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000f010 tx=0x7f7fb000f3c0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 -- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb8101280 msgr2=0x7f7fb819abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb8101280 0x7f7fb819abf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c890 tx=0x7f7fa800cd50 comp rx=0 tx=0).stop 2024-09-12T00:52:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 -- 172.21.15.2:0/352215035 shutdown_connections 2024-09-12T00:52:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7fa40a2c10 0x7f7fa40a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fb810e480 0x7f7fb819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fb8101280 0x7f7fb819abf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 --2- 172.21.15.2:0/352215035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb81008d0 0x7f7fb819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 -- 172.21.15.2:0/352215035 >> 172.21.15.2:0/352215035 conn(0x7f7fb80fc7a0 msgr2=0x7f7fb80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 -- 172.21.15.2:0/352215035 shutdown_connections 2024-09-12T00:52:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:25.069+0000 7f7fbf41f640 1 -- 172.21.15.2:0/352215035 wait complete. 2024-09-12T00:52:25.684 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T00:52:25.941 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:26.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 -- 172.21.15.2:0/3512441212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc102790 msgr2=0x7fb4fc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 --2- 172.21.15.2:0/3512441212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc102790 0x7fb4fc1067e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009900 tx=0x7fb4f002a410 comp rx=0 tx=0).stop 2024-09-12T00:52:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 -- 172.21.15.2:0/3512441212 shutdown_connections 2024-09-12T00:52:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 --2- 172.21.15.2:0/3512441212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4fc106f10 0x7fb4fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 --2- 172.21.15.2:0/3512441212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc102790 0x7fb4fc1067e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 --2- 172.21.15.2:0/3512441212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc101de0 0x7fb4fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 -- 172.21.15.2:0/3512441212 >> 172.21.15.2:0/3512441212 conn(0x7fb4fc0fd8c0 msgr2=0x7fb4fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 -- 172.21.15.2:0/3512441212 shutdown_connections 2024-09-12T00:52:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.433+0000 7fb500a76640 1 -- 172.21.15.2:0/3512441212 wait complete. 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb500a76640 1 Processor -- start 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb500a76640 1 -- start start 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb500a76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc101de0 0x7fb4fc1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb500a76640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4fc102790 0x7fb4fc198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb500a76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc106f10 0x7fb4fc19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb500a76640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc112010 con 0x7fb4fc106f10 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb500a76640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc111e90 con 0x7fb4fc102790 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb500a76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc112190 con 0x7fb4fc101de0 2024-09-12T00:52:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc106f10 0x7fb4fc19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc106f10 0x7fb4fc19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58878/0 (socket says 172.21.15.2:58878) 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 -- 172.21.15.2:0/752248881 learned_addr learned my addr 172.21.15.2:0/752248881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4fc102790 0x7fb4fc198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 -- 172.21.15.2:0/752248881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc101de0 msgr2=0x7fb4fc1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc101de0 0x7fb4fc1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 -- 172.21.15.2:0/752248881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4fc102790 msgr2=0x7fb4fc198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4fc102790 0x7fb4fc198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 -- 172.21.15.2:0/752248881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4fc19d560 con 0x7fb4fc106f10 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.434+0000 7fb4fad9d640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc106f10 0x7fb4fc19ce80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400b970 tx=0x7fb4f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.435+0000 7fb4eb7fe640 1 -- 172.21.15.2:0/752248881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4019070 con 0x7fb4fc106f10 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.435+0000 7fb4eb7fe640 1 -- 172.21.15.2:0/752248881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f400cb40 con 0x7fb4fc106f10 2024-09-12T00:52:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.435+0000 7fb500a76640 1 -- 172.21.15.2:0/752248881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4fc19d850 con 0x7fb4fc106f10 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.435+0000 7fb4eb7fe640 1 -- 172.21.15.2:0/752248881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4007650 con 0x7fb4fc106f10 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.435+0000 7fb500a76640 1 -- 172.21.15.2:0/752248881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4fc1a5130 con 0x7fb4fc106f10 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.437+0000 7fb4eb7fe640 1 -- 172.21.15.2:0/752248881 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fb4f401c070 con 0x7fb4fc106f10 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.437+0000 7fb502e4f740 1 Processor -- start 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.437+0000 7fb502e4f740 1 -- start start 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0065db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c0070bb0 0x5624c0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb502e4f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5624bffcc090 con 0x5624c00662f0 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb502e4f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5624bff73a70 con 0x5624c0070bb0 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb502e4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5624bffc8050 con 0x5624c00659d0 2024-09-12T00:52:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58892/0 (socket says 172.21.15.2:58892) 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 -- 172.21.15.2:0/3392692757 learned_addr learned my addr 172.21.15.2:0/3392692757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4eb7fe640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb4e40a2c10 0x7fb4e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0065db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c0070bb0 0x5624c0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 -- 172.21.15.2:0/3392692757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 msgr2=0x5624c0065db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fad9d640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb4e40a2c10 0x7fb4e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0065db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 -- 172.21.15.2:0/3392692757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c0070bb0 msgr2=0x5624c0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c0070bb0 0x5624c0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 -- 172.21.15.2:0/3392692757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bff80130 con 0x5624c00662f0 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0065db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4eb7fe640 1 -- 172.21.15.2:0/752248881 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fb4f40ce7a0 con 0x7fb4fc106f10 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.438+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0070670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009820 tx=0x7fb4ec009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c7bc822d36cfc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb4e8ff9640 1 -- 172.21.15.2:0/3392692757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec01d070 con 0x5624c00662f0 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb4e8ff9640 1 -- 172.21.15.2:0/3392692757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4ec010560 con 0x5624c00662f0 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb4e8ff9640 1 -- 172.21.15.2:0/3392692757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec018640 con 0x5624c00662f0 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb4fad9d640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb4e40a2c10 0x7fb4e40a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb4f409ac70 tx=0x7fb4f4065bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb502e4f740 1 -- 172.21.15.2:0/3392692757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 msgr2=0x5624c0070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb502e4f740 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0070670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009820 tx=0x7fb4ec009ce0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb502e4f740 1 -- 172.21.15.2:0/3392692757 shutdown_connections 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb502e4f740 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c0070bb0 0x5624c0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb502e4f740 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0070670 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb502e4f740 1 --2- 172.21.15.2:0/3392692757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0065db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.439+0000 7fb502e4f740 1 -- 172.21.15.2:0/3392692757 >> 172.21.15.2:0/3392692757 conn(0x5624c0061f60 msgr2=0x5624c0062340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 -- 172.21.15.2:0/3392692757 shutdown_connections 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 -- 172.21.15.2:0/3392692757 wait complete. 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 -- start start 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 Processor -- start 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 0x5624c006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c0070bb0 0x5624c006dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5624c0073780 con 0x5624c0070bb0 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5624bff86f20 con 0x5624c00662f0 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5624c0073900 con 0x5624c00659d0 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb502e4f740 10 client.0 _ll_register_callbacks cb 0x5624bff50030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.440+0000 7fb4f9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c0070bb0 0x5624c006dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c0070bb0 0x5624c006dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58906/0 (socket says 172.21.15.2:58906) 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 -- 172.21.15.2:0/2593072698 learned_addr learned my addr 172.21.15.2:0/2593072698 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 0x5624c006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 -- 172.21.15.2:0/2593072698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 msgr2=0x5624c0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 -- 172.21.15.2:0/2593072698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 msgr2=0x5624c006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 0x5624c006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 -- 172.21.15.2:0/2593072698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bfd3d2b0 con 0x5624c0070bb0 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c0070bb0 0x5624c006dcb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0005ab0 tx=0x7fb4f0031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9dbe63d00653497 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/2593072698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0035040 con 0x5624c0070bb0 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb502e4f740 1 -- 172.21.15.2:0/2593072698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4ec010560 con 0x5624c0070bb0 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/2593072698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fb4f0004450 con 0x5624c0070bb0 2024-09-12T00:52:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/2593072698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4f0051050 con 0x5624c0070bb0 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb502e4f740 10 client.14976 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.441+0000 7fb502e4f740 1 -- 172.21.15.2:0/2593072698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5624c007efe0 con 0x5624c0070bb0 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/2593072698 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4ec010560 con 0x5624c0070bb0 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/2593072698 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb4f003d6f0 con 0x5624c0070bb0 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb502e4f740 10 client.14976 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb502e4f740 10 client.14976 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb502e4f740 20 client.14976 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb502e4f740 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5624c0081580 0x5624c00829f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb502e4f740 4 client.14976 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:52:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb502e4f740 1 -- 172.21.15.2:0/2593072698 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624bffd9600 con 0x5624c0081580 2024-09-12T00:52:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.442+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5624c0081580 0x5624c00829f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.443+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5624c0081580 0x5624c00829f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd246c1c4fddab89 server_cookie=574d52e3cdc6020e in_seq=0 out_seq=0 2024-09-12T00:52:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.443+0000 7fb4e1ffb640 10 client.14976 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:52:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/2593072698 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624bffd9600 con 0x5624c0081580 2024-09-12T00:52:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb4e1ffb640 10 client.14976 handle_command_reply: tid=0 2024-09-12T00:52:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 client.14976 shutdown 2024-09-12T00:52:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 -- 172.21.15.2:0/2593072698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c0070bb0 msgr2=0x5624c006dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c0070bb0 0x5624c006dcb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0005ab0 tx=0x7fb4f0031510 comp rx=0 tx=0).stop 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 -- 172.21.15.2:0/2593072698 shutdown_connections 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5624c0081580 0x5624c00829f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c0070bb0 0x5624c006dcb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 0x5624c006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 --2- 172.21.15.2:0/2593072698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c00659d0 0x5624c0070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 -- 172.21.15.2:0/2593072698 >> 172.21.15.2:0/2593072698 conn(0x5624c0061f60 msgr2=0x5624c0067c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb4e1ffb640 0 client.14976 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 -- 172.21.15.2:0/2593072698 shutdown_connections 2024-09-12T00:52:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 1 -- 172.21.15.2:0/2593072698 wait complete. 2024-09-12T00:52:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.444+0000 7fb502e4f740 20 client.14976 trim_cache size 0 max 16384 2024-09-12T00:52:26.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb502e4f740 1 Processor -- start 2024-09-12T00:52:26.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb502e4f740 1 -- start start 2024-09-12T00:52:26.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00659d0 0x5624c0081c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 0x5624c006d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 0x5624c006dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb502e4f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5624c0080d30 con 0x5624c00659d0 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb502e4f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5624c0081400 con 0x5624c00662f0 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb502e4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5624c0081ad0 con 0x5624c0070bb0 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb4f9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00659d0 0x5624c0081c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb4f9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00659d0 0x5624c0081c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58908/0 (socket says 172.21.15.2:58908) 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb4f9d9b640 1 -- 172.21.15.2:0/243426432 learned_addr learned my addr 172.21.15.2:0/243426432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb4f9d9b640 1 -- 172.21.15.2:0/243426432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 msgr2=0x5624c006dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/243426432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 0x5624c006dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb4f9d9b640 1 -- 172.21.15.2:0/243426432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 msgr2=0x5624c006d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/243426432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 0x5624c006d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.462+0000 7fb4f9d9b640 1 -- 172.21.15.2:0/243426432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624c0065800 con 0x5624c00659d0 2024-09-12T00:52:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/243426432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00659d0 0x5624c0081c50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0005a80 tx=0x7fb4f0009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831fdc983519ddfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb4e3fff640 1 -- 172.21.15.2:0/243426432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0035040 con 0x5624c00659d0 2024-09-12T00:52:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb4e3fff640 1 -- 172.21.15.2:0/243426432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f0031bd0 con 0x5624c00659d0 2024-09-12T00:52:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb4e3fff640 1 -- 172.21.15.2:0/243426432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00035f0 con 0x5624c00659d0 2024-09-12T00:52:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb502e4f740 1 -- 172.21.15.2:0/243426432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00659d0 msgr2=0x5624c0081c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb502e4f740 1 --2- 172.21.15.2:0/243426432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00659d0 0x5624c0081c50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0005a80 tx=0x7fb4f0009230 comp rx=0 tx=0).stop 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb502e4f740 1 -- 172.21.15.2:0/243426432 shutdown_connections 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb502e4f740 1 --2- 172.21.15.2:0/243426432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 0x5624c006dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb502e4f740 1 --2- 172.21.15.2:0/243426432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00662f0 0x5624c006d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.463+0000 7fb502e4f740 1 --2- 172.21.15.2:0/243426432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00659d0 0x5624c0081c50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 -- 172.21.15.2:0/243426432 >> 172.21.15.2:0/243426432 conn(0x5624c0061f60 msgr2=0x5624c006ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 -- 172.21.15.2:0/243426432 shutdown_connections 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 -- 172.21.15.2:0/243426432 wait complete. 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 -- start start 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 Processor -- start 2024-09-12T00:52:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00659d0 0x5624c0085b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0086050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 0x5624c0086590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5624c0082870 con 0x5624c00662f0 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5624c00821a0 con 0x5624c00659d0 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5624c0082f40 con 0x5624c0070bb0 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb502e4f740 10 client.0 _ll_register_callbacks cb 0x7fb4f0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.464+0000 7fb4fa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0086050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4fa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0086050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58924/0 (socket says 172.21.15.2:58924) 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4fa59c640 1 -- 172.21.15.2:0/1630537431 learned_addr learned my addr 172.21.15.2:0/1630537431 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 0x5624c0086590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00659d0 0x5624c0085b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4fa59c640 1 -- 172.21.15.2:0/1630537431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 msgr2=0x5624c0086590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 0x5624c0086590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4fa59c640 1 -- 172.21.15.2:0/1630537431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00659d0 msgr2=0x5624c0085b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00659d0 0x5624c0085b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4fa59c640 1 -- 172.21.15.2:0/1630537431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624c00e9d50 con 0x5624c00662f0 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4fa59c640 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0086050 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009820 tx=0x7fb4ec009140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60949e7df84e392 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/1630537431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec028030 con 0x5624c00662f0 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/1630537431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fb4ec00bc70 con 0x5624c00662f0 2024-09-12T00:52:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb502e4f740 1 -- 172.21.15.2:0/1630537431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4f0031bd0 con 0x5624c00662f0 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/1630537431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4ec035050 con 0x5624c00662f0 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb502e4f740 10 client.14982 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.465+0000 7fb502e4f740 1 -- 172.21.15.2:0/1630537431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5624c00eb090 con 0x5624c00662f0 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/1630537431 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f0031bd0 con 0x5624c00662f0 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/1630537431 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb4ec02c070 con 0x5624c00662f0 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb502e4f740 10 client.14982 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb502e4f740 10 client.14982 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb502e4f740 20 client.14982 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb502e4f740 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5624c00ef920 0x5624c00ee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb502e4f740 4 client.14982 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb502e4f740 1 -- 172.21.15.2:0/1630537431 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "status"}) -- 0x5624bffd3b10 con 0x5624c00ef920 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.466+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5624c00ef920 0x5624c00ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb4f9d9b640 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5624c00ef920 0x5624c00ee630 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b47707de1371a679 server_cookie=f89f118bc3f987a1 in_seq=0 out_seq=0 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb4e1ffb640 10 client.14982 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb4e1ffb640 1 -- 172.21.15.2:0/1630537431 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5624bffd3b10 con 0x5624c00ef920 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb4e1ffb640 10 client.14982 handle_command_reply: tid=0 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 client.14982 shutdown 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 -- 172.21.15.2:0/1630537431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 msgr2=0x5624c0086050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0086050 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009820 tx=0x7fb4ec009140 comp rx=0 tx=0).stop 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 -- 172.21.15.2:0/1630537431 shutdown_connections 2024-09-12T00:52:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5624c00ef920 0x5624c00ee630 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5624c0070bb0 0x5624c0086590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624c00662f0 0x5624c0086050 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb4e1ffb640 0 client.14982 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:52:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 --2- 172.21.15.2:0/1630537431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5624c00659d0 0x5624c0085b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 -- 172.21.15.2:0/1630537431 >> 172.21.15.2:0/1630537431 conn(0x5624c0061f60 msgr2=0x5624c006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 -- 172.21.15.2:0/1630537431 shutdown_connections 2024-09-12T00:52:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 1 -- 172.21.15.2:0/1630537431 wait complete. 2024-09-12T00:52:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.467+0000 7fb502e4f740 20 client.14982 trim_cache size 0 max 16384 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24487, 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 67.424089179999996, 2024-09-12T00:52:26.475 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 24, 2024-09-12T00:52:26.476 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 83, 2024-09-12T00:52:26.476 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T00:52:26.476 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 93.688408549000002 2024-09-12T00:52:26.476 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:52:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 -- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb4e40a2c10 msgr2=0x7fb4e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb4e40a2c10 0x7fb4e40a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb4f409ac70 tx=0x7fb4f4065bf0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 -- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc106f10 msgr2=0x7fb4fc19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc106f10 0x7fb4fc19ce80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400b970 tx=0x7fb4f400be30 comp rx=0 tx=0).stop 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 -- 172.21.15.2:0/752248881 shutdown_connections 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fb4e40a2c10 0x7fb4e40a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc106f10 0x7fb4fc19ce80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4fc102790 0x7fb4fc198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 --2- 172.21.15.2:0/752248881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc101de0 0x7fb4fc1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 -- 172.21.15.2:0/752248881 >> 172.21.15.2:0/752248881 conn(0x7fb4fc0fd8c0 msgr2=0x7fb4fc0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 -- 172.21.15.2:0/752248881 shutdown_connections 2024-09-12T00:52:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:26.468+0000 7fb500a76640 1 -- 172.21.15.2:0/752248881 wait complete. 2024-09-12T00:52:26.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:26 smithi002 ceph-mon[31210]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-12T00:52:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:26 smithi071 ceph-mon[35276]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-12T00:52:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:26 smithi167 ceph-mon[35234]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-12T00:52:27.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T00:52:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:27.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.874+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/1412253513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68101de0 msgr2=0x7f4e681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.874+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/1412253513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68101de0 0x7f4e681021c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009900 tx=0x7f4e5802a410 comp rx=0 tx=0).stop 2024-09-12T00:52:27.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/1412253513 shutdown_connections 2024-09-12T00:52:27.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/1412253513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e68106f10 0x7f4e6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/1412253513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e68102790 0x7f4e681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/1412253513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68101de0 0x7f4e681021c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/1412253513 >> 172.21.15.2:0/1412253513 conn(0x7f4e680fd8c0 msgr2=0x7f4e680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/1412253513 shutdown_connections 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/1412253513 wait complete. 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 Processor -- start 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.875+0000 7f4e6c8b0640 1 -- start start 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e6c8b0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e68101de0 0x7f4e6819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e6c8b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e68102790 0x7f4e6819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e6c8b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68106f10 0x7f4e6819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e6c8b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68111f90 con 0x7f4e68106f10 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e6c8b0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68111e10 con 0x7f4e68101de0 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e6c8b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68112110 con 0x7f4e68102790 2024-09-12T00:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68106f10 0x7f4e6819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68106f10 0x7f4e6819f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58952/0 (socket says 172.21.15.2:58952) 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 -- 172.21.15.2:0/858508138 learned_addr learned my addr 172.21.15.2:0/858508138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e6659c640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e68101de0 0x7f4e6819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e68102790 0x7f4e6819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 -- 172.21.15.2:0/858508138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e68102790 msgr2=0x7f4e6819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e68102790 0x7f4e6819ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 -- 172.21.15.2:0/858508138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e68101de0 msgr2=0x7f4e6819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e68101de0 0x7f4e6819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 -- 172.21.15.2:0/858508138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6819f700 con 0x7f4e68106f10 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.876+0000 7f4e66d9d640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68106f10 0x7f4e6819f020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000b970 tx=0x7f4e6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.877+0000 7f4e577fe640 1 -- 172.21.15.2:0/858508138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60019070 con 0x7f4e68106f10 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.877+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/858508138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6819f9f0 con 0x7f4e68106f10 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.877+0000 7f4e577fe640 1 -- 172.21.15.2:0/858508138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e6000cb40 con 0x7f4e68106f10 2024-09-12T00:52:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.877+0000 7f4e577fe640 1 -- 172.21.15.2:0/858508138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60007650 con 0x7f4e68106f10 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.877+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/858508138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e681a72d0 con 0x7f4e68106f10 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.879+0000 7f4e577fe640 1 -- 172.21.15.2:0/858508138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4e6001c070 con 0x7f4e68106f10 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.879+0000 7f4e6ec89740 1 Processor -- start 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.879+0000 7f4e6ec89740 1 -- start start 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f33db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f342f0 0x55e255f3e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 0x55e255f40fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e255e9a090 con 0x55e255f342f0 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e255e41a70 con 0x55e255f339d0 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e255e96050 con 0x55e255f3ebb0 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e577fe640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4e500a2c10 0x7f4e500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f342f0 0x55e255f3e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f342f0 0x55e255f3e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58958/0 (socket says 172.21.15.2:58958) 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 -- 172.21.15.2:0/2316857599 learned_addr learned my addr 172.21.15.2:0/2316857599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 0x55e255f40fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e66d9d640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4e500a2c10 0x7f4e500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f33db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e577fe640 1 -- 172.21.15.2:0/858508138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f4e600ce700 con 0x7f4e68106f10 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 -- 172.21.15.2:0/2316857599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 msgr2=0x55e255f40fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 0x55e255f40fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 -- 172.21.15.2:0/2316857599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 msgr2=0x55e255f33db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f33db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 -- 172.21.15.2:0/2316857599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e255e4e130 con 0x55e255f342f0 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e6659c640 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f342f0 0x55e255f3e670 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009900 tx=0x7f4e58031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d87db704e90c26f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e66d9d640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4e500a2c10 0x7f4e500a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4e6009ac80 tx=0x7f4e6006c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.880+0000 7f4e54ff9640 1 -- 172.21.15.2:0/2316857599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58040070 con 0x55e255f342f0 2024-09-12T00:52:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e54ff9640 1 -- 172.21.15.2:0/2316857599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e58005020 con 0x55e255f342f0 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e54ff9640 1 -- 172.21.15.2:0/2316857599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58035040 con 0x55e255f342f0 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 -- 172.21.15.2:0/2316857599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f342f0 msgr2=0x55e255f3e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f342f0 0x55e255f3e670 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009900 tx=0x7f4e58031630 comp rx=0 tx=0).stop 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 -- 172.21.15.2:0/2316857599 shutdown_connections 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 0x55e255f40fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f342f0 0x55e255f3e670 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/2316857599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f33db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 -- 172.21.15.2:0/2316857599 >> 172.21.15.2:0/2316857599 conn(0x55e255f2ff60 msgr2=0x55e255f30340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 -- 172.21.15.2:0/2316857599 shutdown_connections 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.881+0000 7f4e6ec89740 1 -- 172.21.15.2:0/2316857599 wait complete. 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 1 -- start start 2024-09-12T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 1 Processor -- start 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f3e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f3b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e255f41780 con 0x55e255f3ebb0 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e255e54f20 con 0x55e255f339d0 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e255f41900 con 0x55e255f342f0 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6ec89740 10 client.0 _ll_register_callbacks cb 0x55e255e1e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e65d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e65d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58966/0 (socket says 172.21.15.2:58966) 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e65d9b640 1 -- 172.21.15.2:0/925752025 learned_addr learned my addr 172.21.15.2:0/925752025 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f3e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.882+0000 7f4e6659c640 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f3b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e65d9b640 1 -- 172.21.15.2:0/925752025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 msgr2=0x55e255f3b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f3b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e65d9b640 1 -- 172.21.15.2:0/925752025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 msgr2=0x55e255f3e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f3e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e65d9b640 1 -- 172.21.15.2:0/925752025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e255c0b2b0 con 0x55e255f3ebb0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c013bf0 tx=0x7f4e5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc98fdc40e2d20a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e4dffb640 1 -- 172.21.15.2:0/925752025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c011d30 con 0x55e255f3ebb0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e6ec89740 1 -- 172.21.15.2:0/925752025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e58005020 con 0x55e255f3ebb0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e4dffb640 1 -- 172.21.15.2:0/925752025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f4e5c013030 con 0x55e255f3ebb0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e4dffb640 1 -- 172.21.15.2:0/925752025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e5c013230 con 0x55e255f3ebb0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e6ec89740 10 client.14994 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e6ec89740 1 -- 172.21.15.2:0/925752025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e255f4d0e0 con 0x55e255f3ebb0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.883+0000 7f4e4dffb640 1 -- 172.21.15.2:0/925752025 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e58005020 con 0x55e255f3ebb0 2024-09-12T00:52:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e4dffb640 1 -- 172.21.15.2:0/925752025 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4e5c02a080 con 0x55e255f3ebb0 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e6ec89740 10 client.14994 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e6ec89740 10 client.14994 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e6ec89740 20 client.14994 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e255f4f640 0x55e255f50ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e6ec89740 4 client.14994 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e6ec89740 1 -- 172.21.15.2:0/925752025 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e255ea7600 con 0x55e255f4f640 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e6659c640 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e255f4f640 0x55e255f50ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e6659c640 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e255f4f640 0x55e255f50ab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c39f51d312eff93 server_cookie=5d104ea1bef506e3 in_seq=0 out_seq=0 2024-09-12T00:52:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.884+0000 7f4e4dffb640 10 client.14994 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:52:27.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e4dffb640 1 -- 172.21.15.2:0/925752025 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e255ea7600 con 0x55e255f4f640 2024-09-12T00:52:27.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e4dffb640 10 client.14994 handle_command_reply: tid=0 2024-09-12T00:52:27.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 client.14994 shutdown 2024-09-12T00:52:27.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 -- 172.21.15.2:0/925752025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 msgr2=0x55e255f3bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c013bf0 tx=0x7f4e5c0046c0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 -- 172.21.15.2:0/925752025 shutdown_connections 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e255f4f640 0x55e255f50ab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f3b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/925752025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f3e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e4dffb640 0 client.14994 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.885+0000 7f4e6ec89740 1 -- 172.21.15.2:0/925752025 >> 172.21.15.2:0/925752025 conn(0x55e255f2ff60 msgr2=0x55e255f35c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.886+0000 7f4e6ec89740 1 -- 172.21.15.2:0/925752025 shutdown_connections 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.886+0000 7f4e6ec89740 1 -- 172.21.15.2:0/925752025 wait complete. 2024-09-12T00:52:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.886+0000 7f4e6ec89740 20 client.14994 trim_cache size 0 max 16384 2024-09-12T00:52:27.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6ec89740 1 Processor -- start 2024-09-12T00:52:27.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6ec89740 1 -- start start 2024-09-12T00:52:27.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f339d0 0x55e255f4f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f342f0 0x55e255f3b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e255f4edf0 con 0x55e255f339d0 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e255f4f4c0 con 0x55e255f342f0 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e255f4fb90 con 0x55e255f3ebb0 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e65d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f339d0 0x55e255f4f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e65d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f339d0 0x55e255f4f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58982/0 (socket says 172.21.15.2:58982) 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e65d9b640 1 -- 172.21.15.2:0/1313441396 learned_addr learned my addr 172.21.15.2:0/1313441396 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e65d9b640 1 -- 172.21.15.2:0/1313441396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 msgr2=0x55e255f3bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/1313441396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e6659c640 1 --2- 172.21.15.2:0/1313441396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f342f0 0x55e255f3b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e65d9b640 1 -- 172.21.15.2:0/1313441396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f342f0 msgr2=0x55e255f3b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:27.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/1313441396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f342f0 0x55e255f3b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.905+0000 7f4e65d9b640 1 -- 172.21.15.2:0/1313441396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e255f3e750 con 0x55e255f339d0 2024-09-12T00:52:27.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/1313441396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f339d0 0x55e255f4f640 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c013950 tx=0x7f4e5c003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bbfc0c2651b7d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:27.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e4ffff640 1 -- 172.21.15.2:0/1313441396 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c005850 con 0x55e255f339d0 2024-09-12T00:52:27.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e4ffff640 1 -- 172.21.15.2:0/1313441396 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e5c00b390 con 0x55e255f339d0 2024-09-12T00:52:27.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e4ffff640 1 -- 172.21.15.2:0/1313441396 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0041a0 con 0x55e255f339d0 2024-09-12T00:52:27.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1313441396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f339d0 msgr2=0x55e255f4f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1313441396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f339d0 0x55e255f4f640 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c013950 tx=0x7f4e5c003bd0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1313441396 shutdown_connections 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1313441396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f3ebb0 0x55e255f3bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1313441396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f342f0 0x55e255f3b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1313441396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f339d0 0x55e255f4f640 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.906+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1313441396 >> 172.21.15.2:0/1313441396 conn(0x55e255f2ff60 msgr2=0x55e255f3ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1313441396 shutdown_connections 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1313441396 wait complete. 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 -- start start 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 Processor -- start 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f51d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f52260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e255f50930 con 0x55e255f3ebb0 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e255f50260 con 0x55e255f339d0 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e255f51000 con 0x55e255f342f0 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6ec89740 10 client.0 _ll_register_callbacks cb 0x7f4e5c00be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e65d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e65d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58998/0 (socket says 172.21.15.2:58998) 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e6659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f52260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e65d9b640 1 -- 172.21.15.2:0/1498221136 learned_addr learned my addr 172.21.15.2:0/1498221136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.907+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f51d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6659c640 1 -- 172.21.15.2:0/1498221136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 msgr2=0x55e255f51d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:27.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6659c640 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f51d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6659c640 1 -- 172.21.15.2:0/1498221136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 msgr2=0x55e255f527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6659c640 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6659c640 1 -- 172.21.15.2:0/1498221136 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e255fb7ef0 con 0x55e255f342f0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6659c640 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f52260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000c00 tx=0x7f4e580314c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e360f340d6840d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e4dffb640 1 -- 172.21.15.2:0/1498221136 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58040040 con 0x55e255f342f0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1498221136 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e5c00b390 con 0x55e255f342f0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e4dffb640 1 -- 172.21.15.2:0/1498221136 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f4e58005450 con 0x55e255f342f0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e4dffb640 1 -- 172.21.15.2:0/1498221136 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e58035040 con 0x55e255f342f0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6ec89740 10 client.24730 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.908+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1498221136 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e255fb91b0 con 0x55e255f342f0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e4dffb640 1 -- 172.21.15.2:0/1498221136 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e5c00b390 con 0x55e255f342f0 2024-09-12T00:52:27.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e4dffb640 1 -- 172.21.15.2:0/1498221136 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4e5804d070 con 0x55e255f342f0 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e6ec89740 10 client.24730 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e6ec89740 10 client.24730 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e6ec89740 20 client.24730 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e255fbd7f0 0x55e255fbc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e6ec89740 4 client.24730 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1498221136 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "status"}) -- 0x55e255ea1b10 con 0x55e255fbd7f0 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.909+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e255fbd7f0 0x55e255fbc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e65d9b640 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e255fbd7f0 0x55e255fbc500 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e920699279683d1d server_cookie=55369ef91524bcfb in_seq=0 out_seq=0 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e4dffb640 10 client.24730 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e4dffb640 1 -- 172.21.15.2:0/1498221136 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e255ea1b10 con 0x55e255fbd7f0 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e4dffb640 10 client.24730 handle_command_reply: tid=0 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 client.24730 shutdown 2024-09-12T00:52:27.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1498221136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 msgr2=0x55e255f52260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f52260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000c00 tx=0x7f4e580314c0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1498221136 shutdown_connections 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e255fbd7f0 0x55e255fbc500 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e255f3ebb0 0x55e255f527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e255f342f0 0x55e255f52260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e4dffb640 0 client.24730 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 --2- 172.21.15.2:0/1498221136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e255f339d0 0x55e255f51d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1498221136 >> 172.21.15.2:0/1498221136 conn(0x55e255f2ff60 msgr2=0x55e255f3b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1498221136 shutdown_connections 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 1 -- 172.21.15.2:0/1498221136 wait complete. 2024-09-12T00:52:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.910+0000 7f4e6ec89740 20 client.24730 trim_cache size 0 max 16384 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24494, 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 75.885920511999998, 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 24, 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 83, 2024-09-12T00:52:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T00:52:27.917 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 86.793909471999996 2024-09-12T00:52:27.917 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:52:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4e500a2c10 msgr2=0x7f4e500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4e500a2c10 0x7f4e500a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4e6009ac80 tx=0x7f4e6006c040 comp rx=0 tx=0).stop 2024-09-12T00:52:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68106f10 msgr2=0x7f4e6819f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68106f10 0x7f4e6819f020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000b970 tx=0x7f4e6000be30 comp rx=0 tx=0).stop 2024-09-12T00:52:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/858508138 shutdown_connections 2024-09-12T00:52:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4e500a2c10 0x7f4e500a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68106f10 0x7f4e6819f020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e68102790 0x7f4e6819ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 --2- 172.21.15.2:0/858508138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e68101de0 0x7f4e6819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/858508138 >> 172.21.15.2:0/858508138 conn(0x7f4e680fd8c0 msgr2=0x7f4e680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/858508138 shutdown_connections 2024-09-12T00:52:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:27.911+0000 7f4e6c8b0640 1 -- 172.21.15.2:0/858508138 wait complete. 2024-09-12T00:52:28.583 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T00:52:28.583 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T00:52:28.593 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T00:52:28.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T00:52:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:28.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:28 smithi071 ceph-mon[35276]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:28.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:28 smithi002 ceph-mon[31210]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:29.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:28 smithi167 ceph-mon[35234]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 -- 172.21.15.2:0/1097957194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc1037c0 msgr2=0x7fbecc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 --2- 172.21.15.2:0/1097957194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc1037c0 0x7fbecc10a050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009ca0 tx=0x7fbec402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 -- 172.21.15.2:0/1097957194 shutdown_connections 2024-09-12T00:52:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 --2- 172.21.15.2:0/1097957194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc1037c0 0x7fbecc10a050 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 --2- 172.21.15.2:0/1097957194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc102e00 0x7fbecc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 --2- 172.21.15.2:0/1097957194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbecc101c00 0x7fbecc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 -- 172.21.15.2:0/1097957194 >> 172.21.15.2:0/1097957194 conn(0x7fbecc0fd390 msgr2=0x7fbecc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 -- 172.21.15.2:0/1097957194 shutdown_connections 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.274+0000 7fbed3701640 1 -- 172.21.15.2:0/1097957194 wait complete. 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed3701640 1 Processor -- start 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed3701640 1 -- start start 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed3701640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc101c00 0x7fbecc197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed3701640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc102e00 0x7fbecc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed3701640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbecc1037c0 0x7fbecc19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed3701640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc10d860 con 0x7fbecc102e00 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed3701640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc10d6e0 con 0x7fbecc1037c0 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed3701640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc10d9e0 con 0x7fbecc101c00 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.275+0000 7fbed0c9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc102e00 0x7fbecc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed0c9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc102e00 0x7fbecc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59012/0 (socket says 172.21.15.2:59012) 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed0c9c640 1 -- 172.21.15.2:0/3281949232 learned_addr learned my addr 172.21.15.2:0/3281949232 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed149d640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc101c00 0x7fbecc197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed1c9e640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbecc1037c0 0x7fbecc19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed0c9c640 1 -- 172.21.15.2:0/3281949232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc101c00 msgr2=0x7fbecc197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed0c9c640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc101c00 0x7fbecc197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed0c9c640 1 -- 172.21.15.2:0/3281949232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbecc1037c0 msgr2=0x7fbecc19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed0c9c640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbecc1037c0 0x7fbecc19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed0c9c640 1 -- 172.21.15.2:0/3281949232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc19fab0 con 0x7fbecc102e00 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed149d640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc101c00 0x7fbecc197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed1c9e640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbecc1037c0 0x7fbecc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed0c9c640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc102e00 0x7fbecc1983c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbec800d950 tx=0x7fbec800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbebe7fc640 1 -- 172.21.15.2:0/3281949232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8017070 con 0x7fbecc102e00 2024-09-12T00:52:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbebe7fc640 1 -- 172.21.15.2:0/3281949232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbec8009c30 con 0x7fbecc102e00 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbecc19fda0 con 0x7fbecc102e00 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbebe7fc640 1 -- 172.21.15.2:0/3281949232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec800f6b0 con 0x7fbecc102e00 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.276+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbecc1a0250 con 0x7fbecc102e00 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.277+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbecc109000 con 0x7fbecc102e00 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.279+0000 7fbebe7fc640 1 -- 172.21.15.2:0/3281949232 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fbec80109d0 con 0x7fbecc102e00 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.279+0000 7fbebe7fc640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbeb80a2c40 0x7fbeb80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.279+0000 7fbed149d640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbeb80a2c40 0x7fbeb80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.279+0000 7fbebe7fc640 1 -- 172.21.15.2:0/3281949232 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fbec80ceea0 con 0x7fbecc102e00 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.280+0000 7fbed149d640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbeb80a2c40 0x7fbeb80a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbec00058c0 tx=0x7fbec0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.283+0000 7fbebe7fc640 1 -- 172.21.15.2:0/3281949232 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbec8009de0 con 0x7fbecc102e00 2024-09-12T00:52:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.475+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fbecc062630 con 0x7fbeb80a2c40 2024-09-12T00:52:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.476+0000 7fbebe7fc640 1 -- 172.21.15.2:0/3281949232 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fbecc062630 con 0x7fbeb80a2c40 2024-09-12T00:52:29.475 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-09-12T00:52:29.475 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-09-12T00:52:29.475 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-09-12T00:52:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbeb80a2c40 msgr2=0x7fbeb80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbeb80a2c40 0x7fbeb80a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbec00058c0 tx=0x7fbec0005850 comp rx=0 tx=0).stop 2024-09-12T00:52:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc102e00 msgr2=0x7fbecc1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc102e00 0x7fbecc1983c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbec800d950 tx=0x7fbec800de10 comp rx=0 tx=0).stop 2024-09-12T00:52:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 shutdown_connections 2024-09-12T00:52:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fbeb80a2c40 0x7fbeb80a5100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbecc1037c0 0x7fbecc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc102e00 0x7fbecc1983c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 --2- 172.21.15.2:0/3281949232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc101c00 0x7fbecc197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 >> 172.21.15.2:0/3281949232 conn(0x7fbecc0fd390 msgr2=0x7fbecc1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 shutdown_connections 2024-09-12T00:52:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:29.478+0000 7fbed3701640 1 -- 172.21.15.2:0/3281949232 wait complete. 2024-09-12T00:52:30.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T00:52:30.303 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:30.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:30 smithi002 ceph-mon[31210]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T00:52:30.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:30 smithi002 ceph-mon[31210]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.782+0000 7f678ffbb640 1 -- 172.21.15.2:0/1218616153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 msgr2=0x7f678810a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 --2- 172.21.15.2:0/1218616153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 0x7f678810a200 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6780009cd0 tx=0x7f678002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 -- 172.21.15.2:0/1218616153 shutdown_connections 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 --2- 172.21.15.2:0/1218616153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 0x7f678810a200 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 --2- 172.21.15.2:0/1218616153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6788102fb0 0x7f6788103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 --2- 172.21.15.2:0/1218616153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67880fff30 0x7f6788100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 -- 172.21.15.2:0/1218616153 >> 172.21.15.2:0/1218616153 conn(0x7f67880fba80 msgr2=0x7f67880fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 -- 172.21.15.2:0/1218616153 shutdown_connections 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 -- 172.21.15.2:0/1218616153 wait complete. 2024-09-12T00:52:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.783+0000 7f678ffbb640 1 Processor -- start 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678ffbb640 1 -- start start 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678ffbb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67880fff30 0x7f6788197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678ffbb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6788102fb0 0x7f6788198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678ffbb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 0x7f678819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678ffbb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f678810d870 con 0x7f6788103970 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678ffbb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f678810d6f0 con 0x7f67880fff30 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678ffbb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f678810d9f0 con 0x7f6788102fb0 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678e558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 0x7f678819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678e558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 0x7f678819f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59028/0 (socket says 172.21.15.2:59028) 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678e558640 1 -- 172.21.15.2:0/2403440093 learned_addr learned my addr 172.21.15.2:0/2403440093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678d556640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6788102fb0 0x7f6788198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678dd57640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67880fff30 0x7f6788197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678e558640 1 -- 172.21.15.2:0/2403440093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6788102fb0 msgr2=0x7f6788198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678e558640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6788102fb0 0x7f6788198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678e558640 1 -- 172.21.15.2:0/2403440093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67880fff30 msgr2=0x7f6788197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678e558640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67880fff30 0x7f6788197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.784+0000 7f678e558640 1 -- 172.21.15.2:0/2403440093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678819faf0 con 0x7f6788103970 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.785+0000 7f678e558640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 0x7f678819f480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f67800317f0 tx=0x7f6780003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.785+0000 7f677effd640 1 -- 172.21.15.2:0/2403440093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780004240 con 0x7f6788103970 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.785+0000 7f677effd640 1 -- 172.21.15.2:0/2403440093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67800305a0 con 0x7f6788103970 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.785+0000 7f677effd640 1 -- 172.21.15.2:0/2403440093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678003a660 con 0x7f6788103970 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.785+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678819fd80 con 0x7f6788103970 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.785+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67881a0260 con 0x7f6788103970 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.786+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67881092a0 con 0x7f6788103970 2024-09-12T00:52:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.787+0000 7f677effd640 1 -- 172.21.15.2:0/2403440093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6780030750 con 0x7f6788103970 2024-09-12T00:52:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.788+0000 7f677effd640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f67740a2c40 0x7f67740a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.788+0000 7f677effd640 1 -- 172.21.15.2:0/2403440093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f678002e030 con 0x7f6788103970 2024-09-12T00:52:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.788+0000 7f678dd57640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f67740a2c40 0x7f67740a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.788+0000 7f678dd57640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f67740a2c40 0x7f67740a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6784005fd0 tx=0x7f678400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.792+0000 7f677effd640 1 -- 172.21.15.2:0/2403440093 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67800bd540 con 0x7f6788103970 2024-09-12T00:52:30.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:30 smithi071 ceph-mon[35276]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T00:52:30.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:30 smithi071 ceph-mon[35276]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:30.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:30.991+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6788062630 con 0x7f67740a2c40 2024-09-12T00:52:31.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.003+0000 7f677effd640 1 -- 172.21.15.2:0/2403440093 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f6788062630 con 0x7f67740a2c40 2024-09-12T00:52:31.002 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T00:52:31.002 INFO:teuthology.orchestra.run.smithi002.stdout:mds.a smithi002 running (92s) 17s ago 92s 15.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 3d080893d4d3 2024-09-12T00:52:31.002 INFO:teuthology.orchestra.run.smithi002.stdout:mds.b smithi071 running (90s) 23s ago 89s 26.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 d739c7e0398b 2024-09-12T00:52:31.002 INFO:teuthology.orchestra.run.smithi002.stdout:mds.c smithi167 running (103s) 23s ago 103s 17.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 88ed62cf89f6 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.d smithi002 running (111s) 17s ago 110s 13.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 12770a24cac8 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.e smithi071 running (108s) 23s ago 108s 16.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 cebaae803131 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.f smithi167 running (106s) 23s ago 105s 19.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 375bd601d563 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.g smithi002 running (96s) 17s ago 95s 14.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 391f4f72709e 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.h smithi071 running (101s) 23s ago 100s 19.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 e482ee7a27a0 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.i smithi167 running (98s) 23s ago 98s 17.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 25c0a1a4d5ac 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.j smithi002 running (114s) 17s ago 114s 15.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 565e23792ddf 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.k smithi071 running (117s) 23s ago 117s 15.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 e1228544ad81 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mds.l smithi167 running (2m) 23s ago 119s 16.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 c48b16179465 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.x smithi002 *:9283,8765 running (8m) 17s ago 8m 510M - 19.1.1-298-gb53b6d3e 54467abc55f8 ef1c39039cff 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.y smithi071 *:8443,8765 running (7m) 23s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 eb9232484a38 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.z smithi167 *:8443,8765 running (7m) 23s ago 7m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 925b74cc6ea2 2024-09-12T00:52:31.003 INFO:teuthology.orchestra.run.smithi002.stdout:mon.a smithi002 running (8m) 17s ago 8m 51.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d0b1da0b7a44 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:mon.b smithi071 running (7m) 23s ago 7m 46.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 0c4c712afd07 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:mon.c smithi167 running (7m) 23s ago 7m 43.3M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 bf55787134d2 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 17s ago 6m 48.3M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 40c2ad13e743 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi071 running (6m) 23s ago 6m 56.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 fe36d1f1a681 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi167 running (6m) 23s ago 6m 49.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 60c3cffe6e65 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi002 running (5m) 17s ago 5m 47.4M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 019e6b0b8051 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi071 running (5m) 23s ago 5m 55.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 2898adedd646 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi167 running (4m) 23s ago 4m 52.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7f86e501eb7a 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 smithi002 running (4m) 17s ago 4m 54.8M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 7053addc2554 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 smithi071 running (3m) 23s ago 3m 49.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 e2e6f7d8dc02 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 smithi167 running (3m) 23s ago 3m 46.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 8533729c1a90 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 smithi002 running (3m) 17s ago 3m 51.4M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 bbca6256c34d 2024-09-12T00:52:31.004 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 smithi071 running (2m) 23s ago 2m 46.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 68f9f4bf5c7f 2024-09-12T00:52:31.005 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 smithi167 running (2m) 23s ago 2m 43.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 299f55e74f9b 2024-09-12T00:52:31.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.005+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f67740a2c40 msgr2=0x7f67740a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:31.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.005+0000 7f678ffbb640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f67740a2c40 0x7f67740a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6784005fd0 tx=0x7f678400b390 comp rx=0 tx=0).stop 2024-09-12T00:52:31.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.005+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 msgr2=0x7f678819f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.005+0000 7f678ffbb640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 0x7f678819f480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f67800317f0 tx=0x7f6780003ba0 comp rx=0 tx=0).stop 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.006+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 shutdown_connections 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.006+0000 7f678ffbb640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f67740a2c40 0x7f67740a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.006+0000 7f678ffbb640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6788103970 0x7f678819f480 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.006+0000 7f678ffbb640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6788102fb0 0x7f6788198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.006+0000 7f678ffbb640 1 --2- 172.21.15.2:0/2403440093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67880fff30 0x7f6788197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.006+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 >> 172.21.15.2:0/2403440093 conn(0x7f67880fba80 msgr2=0x7f6788106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.006+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 shutdown_connections 2024-09-12T00:52:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:31.006+0000 7f678ffbb640 1 -- 172.21.15.2:0/2403440093 wait complete. 2024-09-12T00:52:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:30 smithi167 ceph-mon[35234]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T00:52:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:30 smithi167 ceph-mon[35234]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:31.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T00:52:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 -- 172.21.15.2:0/3684197731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1004d0 msgr2=0x7f81ec1008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 --2- 172.21.15.2:0/3684197731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1004d0 0x7f81ec1008d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009900 tx=0x7f81dc02a410 comp rx=0 tx=0).stop 2024-09-12T00:52:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 -- 172.21.15.2:0/3684197731 shutdown_connections 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 --2- 172.21.15.2:0/3684197731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ec1017b0 0x7f81ec101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 --2- 172.21.15.2:0/3684197731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ec100e10 0x7f81ec101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 --2- 172.21.15.2:0/3684197731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1004d0 0x7f81ec1008d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 -- 172.21.15.2:0/3684197731 >> 172.21.15.2:0/3684197731 conn(0x7f81ec0fc280 msgr2=0x7f81ec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 -- 172.21.15.2:0/3684197731 shutdown_connections 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.390+0000 7f81f0874640 1 -- 172.21.15.2:0/3684197731 wait complete. 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81f0874640 1 Processor -- start 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81f0874640 1 -- start start 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81f0874640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ec1004d0 0x7f81ec19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81f0874640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ec100e10 0x7f81ec19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81f0874640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1017b0 0x7f81ec1a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81f0874640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec10fa20 con 0x7f81ec1017b0 2024-09-12T00:52:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81f0874640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec10f8a0 con 0x7f81ec1004d0 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81f0874640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec10fba0 con 0x7f81ec100e10 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1017b0 0x7f81ec1a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1017b0 0x7f81ec1a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59048/0 (socket says 172.21.15.2:59048) 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ead9d640 1 -- 172.21.15.2:0/2930483131 learned_addr learned my addr 172.21.15.2:0/2930483131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ea59c640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ec1004d0 0x7f81ec19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81e9d9b640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ec100e10 0x7f81ec19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ead9d640 1 -- 172.21.15.2:0/2930483131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ec100e10 msgr2=0x7f81ec19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ead9d640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ec100e10 0x7f81ec19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ead9d640 1 -- 172.21.15.2:0/2930483131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ec1004d0 msgr2=0x7f81ec19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ead9d640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ec1004d0 0x7f81ec19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81ead9d640 1 -- 172.21.15.2:0/2930483131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec1a1da0 con 0x7f81ec1017b0 2024-09-12T00:52:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.391+0000 7f81e9d9b640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ec100e10 0x7f81ec19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.392+0000 7f81ead9d640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1017b0 0x7f81ec1a1730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009fd0 tx=0x7f81e400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.392+0000 7f81db7fe640 1 -- 172.21.15.2:0/2930483131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4017070 con 0x7f81ec1017b0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.392+0000 7f81db7fe640 1 -- 172.21.15.2:0/2930483131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e4003e50 con 0x7f81ec1017b0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.392+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec1a2090 con 0x7f81ec1017b0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.392+0000 7f81db7fe640 1 -- 172.21.15.2:0/2930483131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40106c0 con 0x7f81ec1017b0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.392+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec1a25d0 con 0x7f81ec1017b0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.393+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ec10b220 con 0x7f81ec1017b0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.394+0000 7f81db7fe640 1 -- 172.21.15.2:0/2930483131 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f81e4003970 con 0x7f81ec1017b0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.395+0000 7f81db7fe640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81d40a2cc0 0x7f81d40a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.395+0000 7f81ea59c640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81d40a2cc0 0x7f81d40a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.395+0000 7f81db7fe640 1 -- 172.21.15.2:0/2930483131 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f81e40ceef0 con 0x7f81ec1017b0 2024-09-12T00:52:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.395+0000 7f81ea59c640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81d40a2cc0 0x7f81d40a5180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0314e0 tx=0x7f81dc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:32.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.399+0000 7f81db7fe640 1 -- 172.21.15.2:0/2930483131 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81e409bcb0 con 0x7f81ec1017b0 2024-09-12T00:52:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.584+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f81ec062630 con 0x7f81d40a2cc0 2024-09-12T00:52:32.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.590+0000 7f81db7fe640 1 -- 172.21.15.2:0/2930483131 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f81ec062630 con 0x7f81d40a2cc0 2024-09-12T00:52:32.589 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T00:52:32.589 INFO:teuthology.orchestra.run.smithi002.stdout:mds.all 12/12 25s ago 2m smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-09-12T00:52:32.589 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 3/3 25s ago 7m smithi002=x;smithi071=y;smithi167=z;count:3 2024-09-12T00:52:32.589 INFO:teuthology.orchestra.run.smithi002.stdout:mon 3/3 25s ago 7m smithi002:172.21.15.2=a;smithi071:172.21.15.71=b;smithi167:172.21.15.167=c;count:3 2024-09-12T00:52:32.590 INFO:teuthology.orchestra.run.smithi002.stdout:osd 12 25s ago - 2024-09-12T00:52:32.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81d40a2cc0 msgr2=0x7f81d40a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:32.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81d40a2cc0 0x7f81d40a5180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0314e0 tx=0x7f81dc000bc0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1017b0 msgr2=0x7f81ec1a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:32.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1017b0 0x7f81ec1a1730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009fd0 tx=0x7f81e400b260 comp rx=0 tx=0).stop 2024-09-12T00:52:32.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 shutdown_connections 2024-09-12T00:52:32.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f81d40a2cc0 0x7f81d40a5180 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ec1017b0 0x7f81ec1a1730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ec100e10 0x7f81ec19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 --2- 172.21.15.2:0/2930483131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ec1004d0 0x7f81ec19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:32.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 >> 172.21.15.2:0/2930483131 conn(0x7f81ec0fc280 msgr2=0x7f81ec0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:32.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 shutdown_connections 2024-09-12T00:52:32.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:32.592+0000 7f81f0874640 1 -- 172.21.15.2:0/2930483131 wait complete. 2024-09-12T00:52:32.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:32 smithi002 ceph-mon[31210]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-12T00:52:32.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:32 smithi002 ceph-mon[31210]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:32.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:32 smithi071 ceph-mon[35276]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-12T00:52:32.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:32 smithi071 ceph-mon[35276]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:32 smithi167 ceph-mon[35234]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-12T00:52:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:32 smithi167 ceph-mon[35234]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:33.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T00:52:33.462 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:33.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:33 smithi002 ceph-mon[31210]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:33.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:33 smithi071 ceph-mon[35276]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:33.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.939+0000 7f8d84291640 1 -- 172.21.15.2:0/413738580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c102690 msgr2=0x7f8d7c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:33.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.939+0000 7f8d84291640 1 --2- 172.21.15.2:0/413738580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c102690 0x7f8d7c108f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009900 tx=0x7f8d7402a410 comp rx=0 tx=0).stop 2024-09-12T00:52:33.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 -- 172.21.15.2:0/413738580 shutdown_connections 2024-09-12T00:52:33.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 --2- 172.21.15.2:0/413738580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c102690 0x7f8d7c108f20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:33.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 --2- 172.21.15.2:0/413738580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c101cd0 0x7f8d7c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:33.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 --2- 172.21.15.2:0/413738580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d7c100ad0 0x7f8d7c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 -- 172.21.15.2:0/413738580 >> 172.21.15.2:0/413738580 conn(0x7f8d7c0fc280 msgr2=0x7f8d7c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 -- 172.21.15.2:0/413738580 shutdown_connections 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 -- 172.21.15.2:0/413738580 wait complete. 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 Processor -- start 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.940+0000 7f8d84291640 1 -- start start 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d84291640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c100ad0 0x7f8d7c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d84291640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c101cd0 0x7f8d7c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d84291640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d7c102690 0x7f8d7c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d84291640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c10d8c0 con 0x7f8d7c100ad0 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d84291640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c10d740 con 0x7f8d7c102690 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d84291640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c10da40 con 0x7f8d7c101cd0 2024-09-12T00:52:33.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c100ad0 0x7f8d7c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c100ad0 0x7f8d7c197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59064/0 (socket says 172.21.15.2:59064) 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 -- 172.21.15.2:0/526063991 learned_addr learned my addr 172.21.15.2:0/526063991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8282e640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d7c102690 0x7f8d7c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8182c640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c101cd0 0x7f8d7c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 -- 172.21.15.2:0/526063991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c101cd0 msgr2=0x7f8d7c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c101cd0 0x7f8d7c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 -- 172.21.15.2:0/526063991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d7c102690 msgr2=0x7f8d7c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d7c102690 0x7f8d7c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:33.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 -- 172.21.15.2:0/526063991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c19fb40 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8282e640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d7c102690 0x7f8d7c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8182c640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c101cd0 0x7f8d7c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d8202d640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c100ad0 0x7f8d7c197f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800ebc0 tx=0x7f8d7800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d737fe640 1 -- 172.21.15.2:0/526063991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78003b70 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d737fe640 1 -- 172.21.15.2:0/526063991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d78003d10 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d737fe640 1 -- 172.21.15.2:0/526063991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78019980 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c19fe30 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.941+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c1a0360 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.942+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c107ef0 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.944+0000 7f8d737fe640 1 -- 172.21.15.2:0/526063991 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8d78019b20 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.944+0000 7f8d737fe640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d680a2cc0 0x7f8d680a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.944+0000 7f8d737fe640 1 -- 172.21.15.2:0/526063991 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f8d780cfb40 con 0x7f8d7c100ad0 2024-09-12T00:52:33.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.944+0000 7f8d8182c640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d680a2cc0 0x7f8d680a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:33.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.945+0000 7f8d8182c640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d680a2cc0 0x7f8d680a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c006fd0 tx=0x7f8d6c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:33.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:33.947+0000 7f8d737fe640 1 -- 172.21.15.2:0/526063991 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d7809c990 con 0x7f8d7c100ad0 2024-09-12T00:52:34.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:33 smithi167 ceph-mon[35234]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:34.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.128+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8d7c062630 con 0x7f8d680a2cc0 2024-09-12T00:52:34.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.129+0000 7f8d737fe640 1 -- 172.21.15.2:0/526063991 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f8d7c062630 con 0x7f8d680a2cc0 2024-09-12T00:52:34.128 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-09-12T00:52:34.128 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-09-12T00:52:34.128 INFO:teuthology.orchestra.run.smithi002.stdout:smithi071 172.21.15.71 2024-09-12T00:52:34.128 INFO:teuthology.orchestra.run.smithi002.stdout:smithi167 172.21.15.167 2024-09-12T00:52:34.128 INFO:teuthology.orchestra.run.smithi002.stdout:3 hosts in cluster 2024-09-12T00:52:34.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.131+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d680a2cc0 msgr2=0x7f8d680a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:34.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.131+0000 7f8d84291640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d680a2cc0 0x7f8d680a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c006fd0 tx=0x7f8d6c008040 comp rx=0 tx=0).stop 2024-09-12T00:52:34.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.131+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c100ad0 msgr2=0x7f8d7c197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:34.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.131+0000 7f8d84291640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c100ad0 0x7f8d7c197f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800ebc0 tx=0x7f8d7800c6a0 comp rx=0 tx=0).stop 2024-09-12T00:52:34.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.132+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 shutdown_connections 2024-09-12T00:52:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.132+0000 7f8d84291640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f8d680a2cc0 0x7f8d680a5180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.132+0000 7f8d84291640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d7c102690 0x7f8d7c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.132+0000 7f8d84291640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c101cd0 0x7f8d7c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.132+0000 7f8d84291640 1 --2- 172.21.15.2:0/526063991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7c100ad0 0x7f8d7c197f10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.132+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 >> 172.21.15.2:0/526063991 conn(0x7f8d7c0fc280 msgr2=0x7f8d7c1050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.132+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 shutdown_connections 2024-09-12T00:52:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:34.132+0000 7f8d84291640 1 -- 172.21.15.2:0/526063991 wait complete. 2024-09-12T00:52:34.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T00:52:34.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:34 smithi071 ceph-mon[35276]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T00:52:34.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:34 smithi002 ceph-mon[31210]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T00:52:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:34 smithi167 ceph-mon[35234]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T00:52:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 -- 172.21.15.2:0/174222607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 msgr2=0x7f4b54104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 --2- 172.21.15.2:0/174222607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 0x7f4b54104a90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009900 tx=0x7f4b4402a410 comp rx=0 tx=0).stop 2024-09-12T00:52:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 -- 172.21.15.2:0/174222607 shutdown_connections 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 --2- 172.21.15.2:0/174222607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b54107900 0x7f4b54109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 --2- 172.21.15.2:0/174222607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b54104fd0 0x7f4b541073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 --2- 172.21.15.2:0/174222607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 0x7f4b54104a90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 -- 172.21.15.2:0/174222607 >> 172.21.15.2:0/174222607 conn(0x7f4b540fc2a0 msgr2=0x7f4b540fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 -- 172.21.15.2:0/174222607 shutdown_connections 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 -- 172.21.15.2:0/174222607 wait complete. 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.487+0000 7f4b5905e640 1 Processor -- start 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5905e640 1 -- start start 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5905e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 0x7f4b54197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5905e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b54104fd0 0x7f4b54198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5905e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b54107900 0x7f4b5419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5905e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5410d8d0 con 0x7f4b541026a0 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5905e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5410d750 con 0x7f4b54104fd0 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5905e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5410da50 con 0x7f4b54107900 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 0x7f4b54197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 0x7f4b54197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59084/0 (socket says 172.21.15.2:59084) 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 -- 172.21.15.2:0/2733799230 learned_addr learned my addr 172.21.15.2:0/2733799230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5259c640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b54104fd0 0x7f4b54198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 -- 172.21.15.2:0/2733799230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b54107900 msgr2=0x7f4b5419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5359e640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b54107900 0x7f4b5419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b54107900 0x7f4b5419f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 -- 172.21.15.2:0/2733799230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b54104fd0 msgr2=0x7f4b54198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b54104fd0 0x7f4b54198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 -- 172.21.15.2:0/2733799230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5419fb60 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b5259c640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b54104fd0 0x7f4b54198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b52d9d640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 0x7f4b54197f30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009230 tx=0x7f4b44004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.488+0000 7f4b3bfff640 1 -- 172.21.15.2:0/2733799230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4403f030 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.489+0000 7f4b3bfff640 1 -- 172.21.15.2:0/2733799230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b44003ce0 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.489+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5419fdf0 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.489+0000 7f4b3bfff640 1 -- 172.21.15.2:0/2733799230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b44035070 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.489+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b541a0210 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.490+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b540fdd90 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.491+0000 7f4b3bfff640 1 -- 172.21.15.2:0/2733799230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4b44042030 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.491+0000 7f4b3bfff640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4b3c0a2c40 0x7f4b3c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.491+0000 7f4b5259c640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4b3c0a2c40 0x7f4b3c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.491+0000 7f4b3bfff640 1 -- 172.21.15.2:0/2733799230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f4b440ef8d0 con 0x7f4b541026a0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.492+0000 7f4b5259c640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4b3c0a2c40 0x7f4b3c0a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b48005d00 tx=0x7f4b48005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.495+0000 7f4b3bfff640 1 -- 172.21.15.2:0/2733799230 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b440bc690 con 0x7f4b541026a0 2024-09-12T00:52:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.679+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 --> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4b54062630 con 0x7f4b3c0a2c40 2024-09-12T00:52:35.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:35 smithi002 ceph-mon[31210]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:35.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.681+0000 7f4b3bfff640 1 -- 172.21.15.2:0/2733799230 <== mgr.14150 v2:172.21.15.2:6800/288268916 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f4b54062630 con 0x7f4b3c0a2c40 2024-09-12T00:52:35.680 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T00:52:35.680 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-12T00:52:35.680 INFO:teuthology.orchestra.run.smithi002.stdout:smithi071 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040172400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T00:52:35.680 INFO:teuthology.orchestra.run.smithi002.stdout:smithi167 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330080400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T00:52:35.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.683+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4b3c0a2c40 msgr2=0x7f4b3c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:35.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.683+0000 7f4b5905e640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4b3c0a2c40 0x7f4b3c0a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b48005d00 tx=0x7f4b48005ed0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.683+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 msgr2=0x7f4b54197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.683+0000 7f4b5905e640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 0x7f4b54197f30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009230 tx=0x7f4b44004360 comp rx=0 tx=0).stop 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.684+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 shutdown_connections 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.684+0000 7f4b5905e640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f4b3c0a2c40 0x7f4b3c0a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.684+0000 7f4b5905e640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b54107900 0x7f4b5419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.684+0000 7f4b5905e640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b54104fd0 0x7f4b54198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.684+0000 7f4b5905e640 1 --2- 172.21.15.2:0/2733799230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b541026a0 0x7f4b54197f30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.684+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 >> 172.21.15.2:0/2733799230 conn(0x7f4b540fc2a0 msgr2=0x7f4b54103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.684+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 shutdown_connections 2024-09-12T00:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:35.684+0000 7f4b5905e640 1 -- 172.21.15.2:0/2733799230 wait complete. 2024-09-12T00:52:35.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:35 smithi071 ceph-mon[35276]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:36.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:35 smithi167 ceph-mon[35234]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:36.313 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T00:52:36.322 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T00:52:36.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T00:52:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:36.919 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:36 smithi002 ceph-mon[31210]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:36.919 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:36 smithi002 ceph-mon[31210]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:36.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:36 smithi071 ceph-mon[35276]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:36.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:36 smithi071 ceph-mon[35276]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:37.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 -- 172.21.15.2:0/3106200486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 msgr2=0x7fe320105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 --2- 172.21.15.2:0/3106200486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 0x7fe320105400 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe308009900 tx=0x7fe30802a410 comp rx=0 tx=0).stop 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 -- 172.21.15.2:0/3106200486 shutdown_connections 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 --2- 172.21.15.2:0/3106200486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe320105940 0x7fe32010c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 --2- 172.21.15.2:0/3106200486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 0x7fe320105400 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 --2- 172.21.15.2:0/3106200486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe320103e20 0x7fe320104220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 -- 172.21.15.2:0/3106200486 >> 172.21.15.2:0/3106200486 conn(0x7fe3200ff5b0 msgr2=0x7fe3201019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 -- 172.21.15.2:0/3106200486 shutdown_connections 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.003+0000 7fe3268c0640 1 -- 172.21.15.2:0/3106200486 wait complete. 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe3268c0640 1 Processor -- start 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe3268c0640 1 -- start start 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe3268c0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe320103e20 0x7fe32019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe3268c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 0x7fe32019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe3268c0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe320105940 0x7fe3201a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe3268c0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe32010fb80 con 0x7fe320104f80 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe3268c0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe32010fa00 con 0x7fe320105940 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe3268c0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe32010fd00 con 0x7fe320103e20 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe317fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 0x7fe32019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe317fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 0x7fe32019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38788/0 (socket says 172.21.15.2:38788) 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe317fff640 1 -- 172.21.15.2:0/1534893016 learned_addr learned my addr 172.21.15.2:0/1534893016 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe324e5d640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe320105940 0x7fe3201a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.004+0000 7fe31ffff640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe320103e20 0x7fe32019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe317fff640 1 -- 172.21.15.2:0/1534893016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe320103e20 msgr2=0x7fe32019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe317fff640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe320103e20 0x7fe32019a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe317fff640 1 -- 172.21.15.2:0/1534893016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe320105940 msgr2=0x7fe3201a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe317fff640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe320105940 0x7fe3201a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe317fff640 1 -- 172.21.15.2:0/1534893016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3201a1de0 con 0x7fe320104f80 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe317fff640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 0x7fe32019a6f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe30802aa00 tx=0x7fe308032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe31dffb640 1 -- 172.21.15.2:0/1534893016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30803f030 con 0x7fe320104f80 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe31dffb640 1 -- 172.21.15.2:0/1534893016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe308003ce0 con 0x7fe320104f80 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3201a2070 con 0x7fe320104f80 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe31dffb640 1 -- 172.21.15.2:0/1534893016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308035070 con 0x7fe320104f80 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.005+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3201a2620 con 0x7fe320104f80 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.006+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32010b210 con 0x7fe320104f80 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.008+0000 7fe31dffb640 1 -- 172.21.15.2:0/1534893016 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe308042030 con 0x7fe320104f80 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.009+0000 7fe31dffb640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe30c0a2cc0 0x7fe30c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.009+0000 7fe31ffff640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe30c0a2cc0 0x7fe30c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:37.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.009+0000 7fe31dffb640 1 -- 172.21.15.2:0/1534893016 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fe3080efc40 con 0x7fe320104f80 2024-09-12T00:52:37.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.009+0000 7fe31ffff640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe30c0a2cc0 0x7fe30c0a5180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe310009990 tx=0x7fe310009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:37.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.012+0000 7fe31dffb640 1 -- 172.21.15.2:0/1534893016 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3080bc9a0 con 0x7fe320104f80 2024-09-12T00:52:37.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:36 smithi167 ceph-mon[35234]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:36 smithi167 ceph-mon[35234]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:37.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.223+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe32002d7c0 con 0x7fe320104f80 2024-09-12T00:52:37.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.223+0000 7fe31dffb640 1 -- 172.21.15.2:0/1534893016 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3078 (secure 0 0 0) 0x7fe3080bc2a0 con 0x7fe320104f80 2024-09-12T00:52:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:e24 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-12T00:51:23:057392+0000 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 24 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-12T00:51:11.599964+0000 2024-09-12T00:52:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-12T00:51:22.721078+0000 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 300 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-12T00:52:37.224 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 3 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1,2 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24494,1=24487,2=24470} 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-09-12T00:52:37.225 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24494 members: 24470,24487,24494 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b{0:24494} state up:active seq 4 addr [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c{0:24466} state up:standby-replay seq 1 addr [v2:172.21.15.167:6836/2094252120,v1:172.21.15.167:6837/2094252120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.i{1:24487} state up:active seq 8 addr [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.f{1:24460} state up:standby-replay seq 1 addr [v2:172.21.15.167:6834/3315294973,v1:172.21.15.167:6835/3315294973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.h{2:24470} state up:active seq 9 addr [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.e{2:24449} state up:standby-replay seq 1 addr [v2:172.21.15.71:6834/659790149,v1:172.21.15.71:6835/659790149] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.j{-1:14532} state up:standby seq 1 addr [v2:172.21.15.2:6834/3365784178,v1:172.21.15.2:6835/3365784178] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d{-1:14544} state up:standby seq 1 addr [v2:172.21.15.2:6836/2798785367,v1:172.21.15.2:6837/2798785367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.g{-1:14592} state up:standby seq 1 addr [v2:172.21.15.2:6838/2069649482,v1:172.21.15.2:6839/2069649482] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.226 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a{-1:14604} state up:standby seq 1 addr [v2:172.21.15.2:6840/3604590372,v1:172.21.15.2:6841/3604590372] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.227 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.k{-1:24428} state up:standby seq 1 addr [v2:172.21.15.71:6832/3994124611,v1:172.21.15.71:6833/3994124611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.227 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.l{-1:24430} state up:standby seq 1 addr [v2:172.21.15.167:6832/1821901024,v1:172.21.15.167:6833/1821901024] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T00:52:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe30c0a2cc0 msgr2=0x7fe30c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe30c0a2cc0 0x7fe30c0a5180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe310009990 tx=0x7fe310009110 comp rx=0 tx=0).stop 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 msgr2=0x7fe32019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 0x7fe32019a6f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe30802aa00 tx=0x7fe308032da0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 shutdown_connections 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fe30c0a2cc0 0x7fe30c0a5180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe320105940 0x7fe3201a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe320104f80 0x7fe32019a6f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 --2- 172.21.15.2:0/1534893016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe320103e20 0x7fe32019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 >> 172.21.15.2:0/1534893016 conn(0x7fe3200ff5b0 msgr2=0x7fe3201083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 shutdown_connections 2024-09-12T00:52:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:37.226+0000 7fe3268c0640 1 -- 172.21.15.2:0/1534893016 wait complete. 2024-09-12T00:52:37.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:37 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1534893016' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T00:52:37.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T00:52:37.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:37 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1534893016' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T00:52:38.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:37 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1534893016' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T00:52:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.535+0000 7fc5628a1640 1 -- 172.21.15.2:0/597458287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 msgr2=0x7fc55c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.535+0000 7fc5628a1640 1 --2- 172.21.15.2:0/597458287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 0x7fc55c108f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc554009ca0 tx=0x7fc55402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 -- 172.21.15.2:0/597458287 shutdown_connections 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 --2- 172.21.15.2:0/597458287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 0x7fc55c108f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 --2- 172.21.15.2:0/597458287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc55c101cd0 0x7fc55c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 --2- 172.21.15.2:0/597458287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc55c100ad0 0x7fc55c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 -- 172.21.15.2:0/597458287 >> 172.21.15.2:0/597458287 conn(0x7fc55c0fc280 msgr2=0x7fc55c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 -- 172.21.15.2:0/597458287 shutdown_connections 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 -- 172.21.15.2:0/597458287 wait complete. 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 Processor -- start 2024-09-12T00:52:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 -- start start 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.536+0000 7fc5628a1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc55c100ad0 0x7fc55c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5628a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc55c101cd0 0x7fc55c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5628a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 0x7fc55c19f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5628a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c10c730 con 0x7fc55c102690 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5628a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c10c5b0 con 0x7fc55c101cd0 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5628a1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c10c8b0 con 0x7fc55c100ad0 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 0x7fc55c19f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 0x7fc55c19f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38798/0 (socket says 172.21.15.2:38798) 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 -- 172.21.15.2:0/1960858087 learned_addr learned my addr 172.21.15.2:0/1960858087 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc55bfff640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc55c100ad0 0x7fc55c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc55b7fe640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc55c101cd0 0x7fc55c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 -- 172.21.15.2:0/1960858087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc55c100ad0 msgr2=0x7fc55c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc55c100ad0 0x7fc55c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 -- 172.21.15.2:0/1960858087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc55c101cd0 msgr2=0x7fc55c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc55c101cd0 0x7fc55c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 -- 172.21.15.2:0/1960858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c19fb10 con 0x7fc55c102690 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc560e3e640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 0x7fc55c19f200 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc554005e30 tx=0x7fc554031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5597fa640 1 -- 172.21.15.2:0/1960858087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554003c30 con 0x7fc55c102690 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c19fd40 con 0x7fc55c102690 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5597fa640 1 -- 172.21.15.2:0/1960858087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc554003dd0 con 0x7fc55c102690 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.537+0000 7fc5597fa640 1 -- 172.21.15.2:0/1960858087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55402fde0 con 0x7fc55c102690 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.538+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c1a0280 con 0x7fc55c102690 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.538+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55c107ef0 con 0x7fc55c102690 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.540+0000 7fc5597fa640 1 -- 172.21.15.2:0/1960858087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc554004050 con 0x7fc55c102690 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.540+0000 7fc5597fa640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5440a2c10 0x7fc5440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.540+0000 7fc5597fa640 1 -- 172.21.15.2:0/1960858087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fc5540f0600 con 0x7fc55c102690 2024-09-12T00:52:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.540+0000 7fc55bfff640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5440a2c10 0x7fc5440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.541+0000 7fc55bfff640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5440a2c10 0x7fc5440a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc55c101b30 tx=0x7fc54c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.544+0000 7fc5597fa640 1 -- 172.21.15.2:0/1960858087 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5540bd4d0 con 0x7fc55c102690 2024-09-12T00:52:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.723+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fc55c02d9c0 con 0x7fc55c102690 2024-09-12T00:52:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.724+0000 7fc5597fa640 1 -- 172.21.15.2:0/1960858087 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5315 (secure 0 0 0) 0x7fc5540bcdd0 con 0x7fc55c102690 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 83 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:fsid c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-12T00:43:32.673347+0000 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-12T00:52:22.585218+0000 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 26 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-09-12T00:52:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client luminous 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 12 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6802/791585591,v1:172.21.15.2:6803/791585591] [v2:172.21.15.2:6804/791585591,v1:172.21.15.2:6805/791585591] exists,up f0b4432c-3283-4d50-9efe-ebf233a7f1aa 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/683459479,v1:172.21.15.71:6801/683459479] [v2:172.21.15.71:6802/683459479,v1:172.21.15.71:6803/683459479] exists,up e439cd3f-487d-4354-ab99-7d3cada1e585 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 18 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6800/1652392713,v1:172.21.15.167:6801/1652392713] [v2:172.21.15.167:6802/1652392713,v1:172.21.15.167:6803/1652392713] exists,up fa192766-bc23-47c9-b1ff-343437163ca5 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 24 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6810/1194146354,v1:172.21.15.2:6811/1194146354] [v2:172.21.15.2:6812/1194146354,v1:172.21.15.2:6813/1194146354] exists,up a26f41bb-17a5-4199-8781-40a93619bb05 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 up in weight 1 up_from 31 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6808/3103093163,v1:172.21.15.71:6809/3103093163] [v2:172.21.15.71:6810/3103093163,v1:172.21.15.71:6811/3103093163] exists,up 47671b0e-1a96-4bdb-b0f6-78d139586f29 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 up in weight 1 up_from 36 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6808/2028440485,v1:172.21.15.167:6809/2028440485] [v2:172.21.15.167:6810/2028440485,v1:172.21.15.167:6811/2028440485] exists,up 4d03cf8b-e439-469f-96d6-35be185b6a19 2024-09-12T00:52:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 up in weight 1 up_from 43 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6818/2590876261,v1:172.21.15.2:6819/2590876261] [v2:172.21.15.2:6820/2590876261,v1:172.21.15.2:6821/2590876261] exists,up 3fa40635-b89d-46f4-95a2-19db122e4d3c 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 up in weight 1 up_from 48 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6816/1535182996,v1:172.21.15.71:6817/1535182996] [v2:172.21.15.71:6818/1535182996,v1:172.21.15.71:6819/1535182996] exists,up 756dd9c7-23d4-49e5-bf61-aa62aa16dccf 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 up in weight 1 up_from 55 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6816/4071602175,v1:172.21.15.167:6817/4071602175] [v2:172.21.15.167:6818/4071602175,v1:172.21.15.167:6819/4071602175] exists,up 1b6ae68b-311e-4fb8-a90b-8d392b44de12 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 up in weight 1 up_from 62 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6826/1523652680,v1:172.21.15.2:6827/1523652680] [v2:172.21.15.2:6828/1523652680,v1:172.21.15.2:6829/1523652680] exists,up 12040e9d-e418-4d1a-a924-f4ef7d87ab15 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 up in weight 1 up_from 66 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/2261598225,v1:172.21.15.71:6825/2261598225] [v2:172.21.15.71:6826/2261598225,v1:172.21.15.71:6827/2261598225] exists,up d33cc429-55b5-465a-b98d-d205e51e2b89 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 up in weight 1 up_from 73 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6824/792671265,v1:172.21.15.167:6825/792671265] [v2:172.21.15.167:6826/792671265,v1:172.21.15.167:6827/792671265] exists,up 2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.2 [7,11] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.b [8,11] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.c [2,4] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.10 [2,4] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1a [8,1] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.0 [4,7] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.c [3,9] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.1b [4,8] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.1d [5,9] 2024-09-12T00:52:38.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.31 [4,6] 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.33 [5,9] 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/975752128 expires 2024-09-13T00:44:20.763419+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/975752128 expires 2024-09-13T00:44:20.763419+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/657242146 expires 2024-09-13T00:44:20.763419+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2832737308 expires 2024-09-13T00:44:20.763419+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3975664816 expires 2024-09-13T00:44:20.763419+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/1101153984 expires 2024-09-13T00:43:55.741313+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/1101153984 expires 2024-09-13T00:43:55.741313+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2546110907 expires 2024-09-13T00:43:55.741313+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2592542324 expires 2024-09-13T00:43:55.741313+0000 2024-09-12T00:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/629527126 expires 2024-09-13T00:43:55.741313+0000 2024-09-12T00:52:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5440a2c10 msgr2=0x7fc5440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5440a2c10 0x7fc5440a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc55c101b30 tx=0x7fc54c00b390 comp rx=0 tx=0).stop 2024-09-12T00:52:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 msgr2=0x7fc55c19f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 0x7fc55c19f200 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc554005e30 tx=0x7fc554031ee0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 shutdown_connections 2024-09-12T00:52:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fc5440a2c10 0x7fc5440a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c102690 0x7fc55c19f200 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc55c101cd0 0x7fc55c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 --2- 172.21.15.2:0/1960858087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc55c100ad0 0x7fc55c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 >> 172.21.15.2:0/1960858087 conn(0x7fc55c0fc280 msgr2=0x7fc55c1050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 shutdown_connections 2024-09-12T00:52:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:38.726+0000 7fc5628a1640 1 -- 172.21.15.2:0/1960858087 wait complete. 2024-09-12T00:52:38.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:38 smithi071 ceph-mon[35276]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:38.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:38 smithi002 ceph-mon[31210]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:39.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:38 smithi167 ceph-mon[35234]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:39.383 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T00:52:39.422 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:52:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:39.907 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:39 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1960858087' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T00:52:39.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:39 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1960858087' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T00:52:40.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:39 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1960858087' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T00:52:40.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 -- 172.21.15.2:0/2261573770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940101de0 msgr2=0x7f09401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:40.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 --2- 172.21.15.2:0/2261573770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940101de0 0x7f09401021c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0930009900 tx=0x7f093002a410 comp rx=0 tx=0).stop 2024-09-12T00:52:40.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 -- 172.21.15.2:0/2261573770 shutdown_connections 2024-09-12T00:52:40.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 --2- 172.21.15.2:0/2261573770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0940106f10 0x7f094010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 --2- 172.21.15.2:0/2261573770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940102790 0x7f09401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 --2- 172.21.15.2:0/2261573770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940101de0 0x7f09401021c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 -- 172.21.15.2:0/2261573770 >> 172.21.15.2:0/2261573770 conn(0x7f09400fd8c0 msgr2=0x7f09400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 -- 172.21.15.2:0/2261573770 shutdown_connections 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.109+0000 7f0945f84640 1 -- 172.21.15.2:0/2261573770 wait complete. 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f0945f84640 1 Processor -- start 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f0945f84640 1 -- start start 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f0945f84640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0940101de0 0x7f0940198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f0945f84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940102790 0x7f0940198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f0945f84640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940106f10 0x7f094019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f0945f84640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0940111f70 con 0x7f0940102790 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f0945f84640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0940111df0 con 0x7f0940101de0 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f0945f84640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f09401120f0 con 0x7f0940106f10 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940102790 0x7f0940198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940102790 0x7f0940198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38820/0 (socket says 172.21.15.2:38820) 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093effd640 1 -- 172.21.15.2:0/1272669139 learned_addr learned my addr 172.21.15.2:0/1272669139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093ffff640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940106f10 0x7f094019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093f7fe640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0940101de0 0x7f0940198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093effd640 1 -- 172.21.15.2:0/1272669139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940106f10 msgr2=0x7f094019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093effd640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940106f10 0x7f094019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093effd640 1 -- 172.21.15.2:0/1272669139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0940101de0 msgr2=0x7f0940198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093effd640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0940101de0 0x7f0940198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093effd640 1 -- 172.21.15.2:0/1272669139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094019d3e0 con 0x7f0940102790 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.110+0000 7f093ffff640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940106f10 0x7f094019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.111+0000 7f093effd640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940102790 0x7f0940198970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f093400d770 tx=0x7f093400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.111+0000 7f093cff9640 1 -- 172.21.15.2:0/1272669139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934017070 con 0x7f0940102790 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.111+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094019d6d0 con 0x7f0940102790 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.111+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09401a4fb0 con 0x7f0940102790 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.111+0000 7f093cff9640 1 -- 172.21.15.2:0/1272669139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0934005500 con 0x7f0940102790 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.111+0000 7f093cff9640 1 -- 172.21.15.2:0/1272669139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934020060 con 0x7f0940102790 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.112+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09401021c0 con 0x7f0940102790 2024-09-12T00:52:40.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.113+0000 7f093cff9640 1 -- 172.21.15.2:0/1272669139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0934009cc0 con 0x7f0940102790 2024-09-12T00:52:40.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.114+0000 7f093cff9640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f09280a2c10 0x7f09280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:40.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.114+0000 7f093f7fe640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f09280a2c10 0x7f09280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:40.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.114+0000 7f093cff9640 1 -- 172.21.15.2:0/1272669139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f09340ceda0 con 0x7f0940102790 2024-09-12T00:52:40.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.114+0000 7f093f7fe640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f09280a2c10 0x7f09280a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0930005ab0 tx=0x7f0930005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:40.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.118+0000 7f093cff9640 1 -- 172.21.15.2:0/1272669139 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f093409bb60 con 0x7f0940102790 2024-09-12T00:52:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.329+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0940199790 con 0x7f0940102790 2024-09-12T00:52:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.329+0000 7f093cff9640 1 -- 172.21.15.2:0/1272669139 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f093409b460 con 0x7f0940102790 2024-09-12T00:52:40.328 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"btime":"2024-09-12T00:51:23:057392+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:51:22.721078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:52:40.329 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-12T00:52:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f09280a2c10 msgr2=0x7f09280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f09280a2c10 0x7f09280a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0930005ab0 tx=0x7f0930005a20 comp rx=0 tx=0).stop 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940102790 msgr2=0x7f0940198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940102790 0x7f0940198970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f093400d770 tx=0x7f093400dc30 comp rx=0 tx=0).stop 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 shutdown_connections 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f09280a2c10 0x7f09280a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940106f10 0x7f094019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0940102790 0x7f0940198970 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 --2- 172.21.15.2:0/1272669139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0940101de0 0x7f0940198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 >> 172.21.15.2:0/1272669139 conn(0x7f09400fd8c0 msgr2=0x7f09400fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 shutdown_connections 2024-09-12T00:52:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:40.332+0000 7f0945f84640 1 -- 172.21.15.2:0/1272669139 wait complete. 2024-09-12T00:52:40.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:40 smithi071 ceph-mon[35276]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:40.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:40 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1272669139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:40.946 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:40 smithi002 ceph-mon[31210]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:40.946 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:40 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1272669139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:40.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:52:41.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:40 smithi167 ceph-mon[35234]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:41.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:40 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1272669139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:41.233 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.692+0000 7f70e7950640 1 -- 172.21.15.2:0/3027596797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 msgr2=0x7f70e0100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.692+0000 7f70e7950640 1 --2- 172.21.15.2:0/3027596797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 0x7f70e0100cb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009900 tx=0x7f70dc02a410 comp rx=0 tx=0).stop 2024-09-12T00:52:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.692+0000 7f70e7950640 1 -- 172.21.15.2:0/3027596797 shutdown_connections 2024-09-12T00:52:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.692+0000 7f70e7950640 1 --2- 172.21.15.2:0/3027596797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e010e480 0x7f70e0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.692+0000 7f70e7950640 1 --2- 172.21.15.2:0/3027596797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0101280 0x7f70e010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.692+0000 7f70e7950640 1 --2- 172.21.15.2:0/3027596797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 0x7f70e0100cb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.692+0000 7f70e7950640 1 -- 172.21.15.2:0/3027596797 >> 172.21.15.2:0/3027596797 conn(0x7f70e00fc7a0 msgr2=0x7f70e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.693+0000 7f70e7950640 1 -- 172.21.15.2:0/3027596797 shutdown_connections 2024-09-12T00:52:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.693+0000 7f70e7950640 1 -- 172.21.15.2:0/3027596797 wait complete. 2024-09-12T00:52:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.693+0000 7f70e7950640 1 Processor -- start 2024-09-12T00:52:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.693+0000 7f70e7950640 1 -- start start 2024-09-12T00:52:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e7950640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 0x7f70e019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e7950640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0101280 0x7f70e019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e7950640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e010e480 0x7f70e019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e7950640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70e01141b0 con 0x7f70e01008d0 2024-09-12T00:52:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e7950640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0114030 con 0x7f70e010e480 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e7950640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0114330 con 0x7f70e0101280 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 0x7f70e019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 0x7f70e019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38824/0 (socket says 172.21.15.2:38824) 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 -- 172.21.15.2:0/1493276599 learned_addr learned my addr 172.21.15.2:0/1493276599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e5eed640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e010e480 0x7f70e019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e4eeb640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0101280 0x7f70e019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 -- 172.21.15.2:0/1493276599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0101280 msgr2=0x7f70e019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0101280 0x7f70e019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 -- 172.21.15.2:0/1493276599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e010e480 msgr2=0x7f70e019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e010e480 0x7f70e019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 -- 172.21.15.2:0/1493276599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e019f640 con 0x7f70e01008d0 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70e56ec640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 0x7f70e019a690 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f70dc006010 tx=0x7f70dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.694+0000 7f70d67fc640 1 -- 172.21.15.2:0/1493276599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc03f030 con 0x7f70e01008d0 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.695+0000 7f70d67fc640 1 -- 172.21.15.2:0/1493276599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70dc003ce0 con 0x7f70e01008d0 2024-09-12T00:52:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.695+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e019f8d0 con 0x7f70e01008d0 2024-09-12T00:52:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.695+0000 7f70d67fc640 1 -- 172.21.15.2:0/1493276599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc035070 con 0x7f70e01008d0 2024-09-12T00:52:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.695+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e01a7210 con 0x7f70e01008d0 2024-09-12T00:52:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.696+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e0100cb0 con 0x7f70e01008d0 2024-09-12T00:52:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.697+0000 7f70d67fc640 1 -- 172.21.15.2:0/1493276599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f70dc042030 con 0x7f70e01008d0 2024-09-12T00:52:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.697+0000 7f70d67fc640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f70cc0a2c90 0x7f70cc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.698+0000 7f70e4eeb640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f70cc0a2c90 0x7f70cc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.698+0000 7f70d67fc640 1 -- 172.21.15.2:0/1493276599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f70dc0ef300 con 0x7f70e01008d0 2024-09-12T00:52:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.698+0000 7f70e4eeb640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f70cc0a2c90 0x7f70cc0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f70e010ed80 tx=0x7f70d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.702+0000 7f70d67fc640 1 -- 172.21.15.2:0/1493276599 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70dc0bba70 con 0x7f70e01008d0 2024-09-12T00:52:41.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.916+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70e0109610 con 0x7f70e01008d0 2024-09-12T00:52:41.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.916+0000 7f70d67fc640 1 -- 172.21.15.2:0/1493276599 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f70dc0bfd70 con 0x7f70e01008d0 2024-09-12T00:52:41.915 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"btime":"2024-09-12T00:51:23:057392+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:51:22.721078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:52:41.916 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-12T00:52:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f70cc0a2c90 msgr2=0x7f70cc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f70cc0a2c90 0x7f70cc0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f70e010ed80 tx=0x7f70d000b390 comp rx=0 tx=0).stop 2024-09-12T00:52:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 msgr2=0x7f70e019a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 0x7f70e019a690 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f70dc006010 tx=0x7f70dc0042f0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 shutdown_connections 2024-09-12T00:52:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f70cc0a2c90 0x7f70cc0a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e010e480 0x7f70e019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0101280 0x7f70e019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 --2- 172.21.15.2:0/1493276599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e01008d0 0x7f70e019a690 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 >> 172.21.15.2:0/1493276599 conn(0x7f70e00fc7a0 msgr2=0x7f70e00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.919+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 shutdown_connections 2024-09-12T00:52:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:41.920+0000 7f70e7950640 1 -- 172.21.15.2:0/1493276599 wait complete. 2024-09-12T00:52:42.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:52:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:42.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:42 smithi071 ceph-mon[35276]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:42.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:42 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1493276599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:42.962 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:42 smithi002 ceph-mon[31210]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:42.962 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:42 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1493276599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:43.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:42 smithi167 ceph-mon[35234]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T00:52:43.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:42 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1493276599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 -- 172.21.15.2:0/3904232460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4101420 msgr2=0x7f7ab410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 --2- 172.21.15.2:0/3904232460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4101420 0x7f7ab410d950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009cd0 tx=0x7f7aac02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 -- 172.21.15.2:0/3904232460 shutdown_connections 2024-09-12T00:52:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 --2- 172.21.15.2:0/3904232460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4101420 0x7f7ab410d950 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 --2- 172.21.15.2:0/3904232460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab4100a80 0x7f7ab4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 --2- 172.21.15.2:0/3904232460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab4106a80 0x7f7ab4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 -- 172.21.15.2:0/3904232460 >> 172.21.15.2:0/3904232460 conn(0x7f7ab40fc7a0 msgr2=0x7f7ab40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 -- 172.21.15.2:0/3904232460 shutdown_connections 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.280+0000 7f7aba394640 1 -- 172.21.15.2:0/3904232460 wait complete. 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aba394640 1 Processor -- start 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aba394640 1 -- start start 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aba394640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4100a80 0x7f7ab410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aba394640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab4101420 0x7f7ab410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aba394640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab4106a80 0x7f7ab410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aba394640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab4112020 con 0x7f7ab4100a80 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aba394640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab4111ea0 con 0x7f7ab4101420 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aba394640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab41121a0 con 0x7f7ab4106a80 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4100a80 0x7f7ab410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4100a80 0x7f7ab410e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38836/0 (socket says 172.21.15.2:38836) 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7ab3fff640 1 -- 172.21.15.2:0/3426935531 learned_addr learned my addr 172.21.15.2:0/3426935531 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.281+0000 7f7aabfff640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab4101420 0x7f7ab410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab3fff640 1 -- 172.21.15.2:0/3426935531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab4106a80 msgr2=0x7f7ab410ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab3fff640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab4106a80 0x7f7ab410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab3fff640 1 -- 172.21.15.2:0/3426935531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab4101420 msgr2=0x7f7ab410e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab3fff640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab4101420 0x7f7ab410e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab3fff640 1 -- 172.21.15.2:0/3426935531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab41a6a60 con 0x7f7ab4100a80 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab3fff640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4100a80 0x7f7ab410e3e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400b4a0 tx=0x7f7aa400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab1ffb640 1 -- 172.21.15.2:0/3426935531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4015020 con 0x7f7ab4100a80 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab1ffb640 1 -- 172.21.15.2:0/3426935531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7aa4011d10 con 0x7f7ab4100a80 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab41a6d50 con 0x7f7ab4100a80 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7ab1ffb640 1 -- 172.21.15.2:0/3426935531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400f2e0 con 0x7f7ab4100a80 2024-09-12T00:52:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.282+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab41a7250 con 0x7f7ab4100a80 2024-09-12T00:52:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.283+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab4100f60 con 0x7f7ab4100a80 2024-09-12T00:52:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.284+0000 7f7ab1ffb640 1 -- 172.21.15.2:0/3426935531 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7aa4018020 con 0x7f7ab4100a80 2024-09-12T00:52:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.285+0000 7f7ab1ffb640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7aa00a2c90 0x7f7aa00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:43.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.285+0000 7f7aabfff640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7aa00a2c90 0x7f7aa00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:43.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.285+0000 7f7ab1ffb640 1 -- 172.21.15.2:0/3426935531 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f7aa40ce750 con 0x7f7ab4100a80 2024-09-12T00:52:43.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.286+0000 7f7aabfff640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7aa00a2c90 0x7f7aa00a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ab410fe70 tx=0x7f7a9c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.289+0000 7f7ab1ffb640 1 -- 172.21.15.2:0/3426935531 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7aa401f030 con 0x7f7ab4100a80 2024-09-12T00:52:43.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.466+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ab4108a80 con 0x7f7ab4100a80 2024-09-12T00:52:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.467+0000 7f7ab1ffb640 1 -- 172.21.15.2:0/3426935531 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22755 (secure 0 0 0) 0x7f7aa409b620 con 0x7f7ab4100a80 2024-09-12T00:52:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":83,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:52:22.585218+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:52:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7aa00a2c90 msgr2=0x7f7aa00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7aa00a2c90 0x7f7aa00a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ab410fe70 tx=0x7f7a9c009110 comp rx=0 tx=0).stop 2024-09-12T00:52:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4100a80 msgr2=0x7f7ab410e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4100a80 0x7f7ab410e3e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400b4a0 tx=0x7f7aa400b8a0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 shutdown_connections 2024-09-12T00:52:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f7aa00a2c90 0x7f7aa00a5150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab4106a80 0x7f7ab410ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab4101420 0x7f7ab410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 --2- 172.21.15.2:0/3426935531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ab4100a80 0x7f7ab410e3e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 >> 172.21.15.2:0/3426935531 conn(0x7f7ab40fc7a0 msgr2=0x7f7ab40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 shutdown_connections 2024-09-12T00:52:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:43.470+0000 7f7aba394640 1 -- 172.21.15.2:0/3426935531 wait complete. 2024-09-12T00:52:43.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:43 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3426935531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:43.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:43 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3426935531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:44.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:43 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3426935531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:44.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T00:51:11.599964+0000', 'modified': '2024-09-12T00:51:22.721078+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24494, 'mds_1': 24487, 'mds_2': 24470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/659790149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 659790149}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 659790149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/3315294973', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 3315294973}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 3315294973}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6837/2094252120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 2094252120}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2094252120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.71:6837/2619227560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 2619227560}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 2619227560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.167:6839/3375026686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 3375026686}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 3375026686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.71:6839/3061730891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3061730891}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3061730891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24494, 'qdb_cluster': [24470, 24487, 24494]} 2024-09-12T00:52:44.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T00:52:44.075 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T00:52:44.334 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:44.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:44 smithi002 ceph-mon[31210]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 -- 172.21.15.2:0/1574192678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc100e20 msgr2=0x7f71bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 --2- 172.21.15.2:0/1574192678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc100e20 0x7f71bc101200 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009900 tx=0x7f71b402a480 comp rx=0 tx=0).stop 2024-09-12T00:52:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 -- 172.21.15.2:0/1574192678 shutdown_connections 2024-09-12T00:52:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 --2- 172.21.15.2:0/1574192678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc102ef0 0x7f71bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 --2- 172.21.15.2:0/1574192678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71bc102570 0x7f71bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 --2- 172.21.15.2:0/1574192678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc100e20 0x7f71bc101200 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 -- 172.21.15.2:0/1574192678 >> 172.21.15.2:0/1574192678 conn(0x7f71bc0fc7d0 msgr2=0x7f71bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 -- 172.21.15.2:0/1574192678 shutdown_connections 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 -- 172.21.15.2:0/1574192678 wait complete. 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 Processor -- start 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.783+0000 7f71c3a69640 1 -- start start 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c3a69640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc100e20 0x7f71bc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c3a69640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71bc102570 0x7f71bc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c3a69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc102ef0 0x7f71bc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c3a69640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc110f50 con 0x7f71bc102ef0 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c3a69640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc110dd0 con 0x7f71bc100e20 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c3a69640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1110d0 con 0x7f71bc102570 2024-09-12T00:52:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc102ef0 0x7f71bc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc102ef0 0x7f71bc19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38852/0 (socket says 172.21.15.2:38852) 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 -- 172.21.15.2:0/838455417 learned_addr learned my addr 172.21.15.2:0/838455417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c1805640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc100e20 0x7f71bc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c1004640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71bc102570 0x7f71bc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 -- 172.21.15.2:0/838455417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71bc102570 msgr2=0x7f71bc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71bc102570 0x7f71bc198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 -- 172.21.15.2:0/838455417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc100e20 msgr2=0x7f71bc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc100e20 0x7f71bc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 -- 172.21.15.2:0/838455417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc19d3d0 con 0x7f71bc102ef0 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71c2006640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc102ef0 0x7f71bc19ccf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00cad0 tx=0x7f71ac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71baffd640 1 -- 172.21.15.2:0/838455417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00ae20 con 0x7f71bc102ef0 2024-09-12T00:52:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.784+0000 7f71baffd640 1 -- 172.21.15.2:0/838455417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ac005020 con 0x7f71bc102ef0 2024-09-12T00:52:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.785+0000 7f71c3a69640 1 -- 172.21.15.2:0/838455417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc19d6c0 con 0x7f71bc102ef0 2024-09-12T00:52:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.785+0000 7f71baffd640 1 -- 172.21.15.2:0/838455417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00f6f0 con 0x7f71bc102ef0 2024-09-12T00:52:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.785+0000 7f71c3a69640 1 -- 172.21.15.2:0/838455417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc1a4fa0 con 0x7f71bc102ef0 2024-09-12T00:52:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.787+0000 7f71c5e42740 1 Processor -- start 2024-09-12T00:52:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.787+0000 7f71baffd640 1 -- 172.21.15.2:0/838455417 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f71ac0051d0 con 0x7f71bc102ef0 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c5e42740 1 -- start start 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0ef9d0 0x562c9c0efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0f02f0 0x562c9c0fa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0fcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c5e42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562c9c056090 con 0x562c9c0ef9d0 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c5e42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562c9bffda70 con 0x562c9c0f02f0 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c5e42740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562c9c052050 con 0x562c9c0fabb0 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c1004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0ef9d0 0x562c9c0efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c1004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0ef9d0 0x562c9c0efdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38854/0 (socket says 172.21.15.2:38854) 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c1004640 1 -- 172.21.15.2:0/1794333779 learned_addr learned my addr 172.21.15.2:0/1794333779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c1805640 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0f02f0 0x562c9c0fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.788+0000 7f71c1004640 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0fcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71baffd640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71a40a2c10 0x7f71a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71c1004640 1 -- 172.21.15.2:0/1794333779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 msgr2=0x562c9c0fcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71c1004640 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0fcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71c1004640 1 -- 172.21.15.2:0/1794333779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0f02f0 msgr2=0x562c9c0fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71c1004640 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0f02f0 0x562c9c0fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71c1004640 1 -- 172.21.15.2:0/1794333779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9c00a130 con 0x562c9c0ef9d0 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71c1805640 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0f02f0 0x562c9c0fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71c2006640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71a40a2c10 0x7f71a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71c1004640 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0ef9d0 0x562c9c0efdb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f71b000cf70 tx=0x7f71b000c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562251fbf5e105cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71baffd640 1 -- 172.21.15.2:0/838455417 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f71ac0cf2d0 con 0x7f71bc102ef0 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71a3fff640 1 -- 172.21.15.2:0/1794333779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0018030 con 0x562c9c0ef9d0 2024-09-12T00:52:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71a3fff640 1 -- 172.21.15.2:0/1794333779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b0005500 con 0x562c9c0ef9d0 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.789+0000 7f71a3fff640 1 -- 172.21.15.2:0/1794333779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b00108d0 con 0x562c9c0ef9d0 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 -- 172.21.15.2:0/1794333779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0ef9d0 msgr2=0x562c9c0efdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c2006640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71a40a2c10 0x7f71a40a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f71ac09b920 tx=0x7f71ac005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0ef9d0 0x562c9c0efdb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f71b000cf70 tx=0x7f71b000c620 comp rx=0 tx=0).stop 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 -- 172.21.15.2:0/1794333779 shutdown_connections 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0fcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0f02f0 0x562c9c0fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1794333779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0ef9d0 0x562c9c0efdb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 -- 172.21.15.2:0/1794333779 >> 172.21.15.2:0/1794333779 conn(0x562c9c0ebf60 msgr2=0x562c9c0ec340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 -- 172.21.15.2:0/1794333779 shutdown_connections 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 -- 172.21.15.2:0/1794333779 wait complete. 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 -- start start 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.790+0000 7f71c5e42740 1 Processor -- start 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c0fa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c0f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c5e42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562c9c0fd780 con 0x562c9c0f02f0 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c5e42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562c9c010f20 con 0x562c9c0ef9d0 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c5e42740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562c9c0fd900 con 0x562c9c0fabb0 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c5e42740 10 client.0 _ll_register_callbacks cb 0x562c9bfda030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1805640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c0f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1805640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c0f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38868/0 (socket says 172.21.15.2:38868) 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1805640 1 -- 172.21.15.2:0/1445459687 learned_addr learned my addr 172.21.15.2:0/1445459687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1004640 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1004640 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c0fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1805640 1 -- 172.21.15.2:0/1445459687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 msgr2=0x562c9c0f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1805640 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1805640 1 -- 172.21.15.2:0/1445459687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 msgr2=0x562c9c0fa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1805640 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c0fa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1805640 1 -- 172.21.15.2:0/1445459687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9bdc72b0 con 0x562c9c0f02f0 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.791+0000 7f71c1004640 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c1805640 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c0f77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009900 tx=0x7f71b4004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341ce71ada9e578f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71a17fa640 1 -- 172.21.15.2:0/1445459687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4035070 con 0x562c9c0f02f0 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71a17fa640 1 -- 172.21.15.2:0/1445459687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f71b4003bc0 con 0x562c9c0f02f0 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 1 -- 172.21.15.2:0/1445459687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b0005500 con 0x562c9c0f02f0 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71a17fa640 1 -- 172.21.15.2:0/1445459687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f71b4003dc0 con 0x562c9c0f02f0 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 10 client.15072 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 1 -- 172.21.15.2:0/1445459687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562c9c1090a0 con 0x562c9c0f02f0 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71a17fa640 1 -- 172.21.15.2:0/1445459687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b0005500 con 0x562c9c0f02f0 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71a17fa640 1 -- 172.21.15.2:0/1445459687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f71b403b700 con 0x562c9c0f02f0 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 10 client.15072 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 10 client.15072 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 20 client.15072 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x562c9c10b740 0x562c9c10cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 4 client.15072 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.792+0000 7f71c5e42740 1 -- 172.21.15.2:0/1445459687 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c9c063600 con 0x562c9c10b740 2024-09-12T00:52:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.793+0000 7f71c1004640 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x562c9c10b740 0x562c9c10cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.793+0000 7f71c1004640 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x562c9c10b740 0x562c9c10cbb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6fd57f2b13cb7e63 server_cookie=1da9ba626d70a80d in_seq=0 out_seq=0 2024-09-12T00:52:44.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.793+0000 7f71a17fa640 10 client.15072 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71a17fa640 1 -- 172.21.15.2:0/1445459687 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c9c063600 con 0x562c9c10b740 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71a17fa640 10 client.15072 handle_command_reply: tid=0 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 client.15072 shutdown 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 -- 172.21.15.2:0/1445459687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 msgr2=0x562c9c0f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c0f77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009900 tx=0x7f71b4004550 comp rx=0 tx=0).stop 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 -- 172.21.15.2:0/1445459687 shutdown_connections 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x562c9c10b740 0x562c9c10cbb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c0f77a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 --2- 172.21.15.2:0/1445459687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c0fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71a17fa640 0 client.15072 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:52:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 -- 172.21.15.2:0/1445459687 >> 172.21.15.2:0/1445459687 conn(0x562c9c0ebf60 msgr2=0x562c9c0f1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.794+0000 7f71c5e42740 1 -- 172.21.15.2:0/1445459687 shutdown_connections 2024-09-12T00:52:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.795+0000 7f71c5e42740 1 -- 172.21.15.2:0/1445459687 wait complete. 2024-09-12T00:52:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.795+0000 7f71c5e42740 20 client.15072 trim_cache size 0 max 16384 2024-09-12T00:52:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.812+0000 7f71c5e42740 1 Processor -- start 2024-09-12T00:52:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.812+0000 7f71c5e42740 1 -- start start 2024-09-12T00:52:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c0f9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0f02f0 0x562c9c115250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0fabb0 0x562c9c115790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c5e42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562c9c10aef0 con 0x562c9c0fabb0 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c5e42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562c9c10b5c0 con 0x562c9c0ef9d0 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c5e42740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562c9c10bc90 con 0x562c9c0f02f0 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0fabb0 0x562c9c115790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0fabb0 0x562c9c115790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38876/0 (socket says 172.21.15.2:38876) 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 -- 172.21.15.2:0/2012390545 learned_addr learned my addr 172.21.15.2:0/2012390545 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c0f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1805640 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0f02f0 0x562c9c115250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 -- 172.21.15.2:0/2012390545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0f02f0 msgr2=0x562c9c115250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0f02f0 0x562c9c115250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 -- 172.21.15.2:0/2012390545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 msgr2=0x562c9c0f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c0f9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 -- 172.21.15.2:0/2012390545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9c0fd890 con 0x562c9c0fabb0 2024-09-12T00:52:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71c1004640 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0fabb0 0x562c9c115790 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f71b0004f60 tx=0x7f71b0004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa5cb82cb12a2eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71a37fe640 1 -- 172.21.15.2:0/2012390545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0028040 con 0x562c9c0fabb0 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.813+0000 7f71a37fe640 1 -- 172.21.15.2:0/2012390545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b0019040 con 0x562c9c0fabb0 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71a37fe640 1 -- 172.21.15.2:0/2012390545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0018040 con 0x562c9c0fabb0 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 -- 172.21.15.2:0/2012390545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0fabb0 msgr2=0x562c9c115790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0fabb0 0x562c9c115790 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f71b0004f60 tx=0x7f71b0004e50 comp rx=0 tx=0).stop 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 -- 172.21.15.2:0/2012390545 shutdown_connections 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0fabb0 0x562c9c115790 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0f02f0 0x562c9c115250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 --2- 172.21.15.2:0/2012390545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c0f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 -- 172.21.15.2:0/2012390545 >> 172.21.15.2:0/2012390545 conn(0x562c9c0ebf60 msgr2=0x562c9c0f8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 -- 172.21.15.2:0/2012390545 shutdown_connections 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 -- 172.21.15.2:0/2012390545 wait complete. 2024-09-12T00:52:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.814+0000 7f71c5e42740 1 -- start start 2024-09-12T00:52:44.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c5e42740 1 Processor -- start 2024-09-12T00:52:44.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c1721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c172700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c5e42740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c5e42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562c9c10ca30 con 0x562c9c0f02f0 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c5e42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562c9c10c360 con 0x562c9c0ef9d0 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c5e42740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562c9c10d100 con 0x562c9c0fabb0 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c5e42740 10 client.0 _ll_register_callbacks cb 0x7f71b4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1805640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c172700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1805640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c172700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38892/0 (socket says 172.21.15.2:38892) 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1805640 1 -- 172.21.15.2:0/4016111276 learned_addr learned my addr 172.21.15.2:0/4016111276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1004640 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1004640 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c1721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1805640 1 -- 172.21.15.2:0/4016111276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 msgr2=0x562c9c0f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1805640 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1805640 1 -- 172.21.15.2:0/4016111276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 msgr2=0x562c9c1721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1805640 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c1721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1805640 1 -- 172.21.15.2:0/4016111276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9c0f4a10 con 0x562c9c0f02f0 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.815+0000 7f71c1004640 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c1805640 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c172700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f71b4006010 tx=0x7f71b4003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97382d4f75a401c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71a17fa640 1 -- 172.21.15.2:0/4016111276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4035040 con 0x562c9c0f02f0 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71a17fa640 1 -- 172.21.15.2:0/4016111276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f71b403b840 con 0x562c9c0f02f0 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 1 -- 172.21.15.2:0/4016111276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b0019040 con 0x562c9c0f02f0 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71a17fa640 1 -- 172.21.15.2:0/4016111276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f71b40040d0 con 0x562c9c0f02f0 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 10 client.15078 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 1 -- 172.21.15.2:0/4016111276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562c9c179a20 con 0x562c9c0f02f0 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71a17fa640 1 -- 172.21.15.2:0/4016111276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b0019040 con 0x562c9c0f02f0 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71a17fa640 1 -- 172.21.15.2:0/4016111276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f71b4004b10 con 0x562c9c0f02f0 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 10 client.15078 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 10 client.15078 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 20 client.15078 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x562c9c17e640 0x562c9c17d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 4 client.15078 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.816+0000 7f71c5e42740 1 -- 172.21.15.2:0/4016111276 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "status"}) -- 0x562c9c05db10 con 0x562c9c17e640 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.817+0000 7f71c1004640 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x562c9c17e640 0x562c9c17d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.817+0000 7f71c1004640 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x562c9c17e640 0x562c9c17d350 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44620d73713b4aa1 server_cookie=a1485e67273cb166 in_seq=0 out_seq=0 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.817+0000 7f71a17fa640 10 client.15078 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.817+0000 7f71a17fa640 1 -- 172.21.15.2:0/4016111276 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562c9c05db10 con 0x562c9c17e640 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.817+0000 7f71a17fa640 10 client.15078 handle_command_reply: tid=0 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.817+0000 7f71c5e42740 1 client.15078 shutdown 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 -- 172.21.15.2:0/4016111276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 msgr2=0x562c9c172700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c172700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f71b4006010 tx=0x7f71b4003bf0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 -- 172.21.15.2:0/4016111276 shutdown_connections 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x562c9c17e640 0x562c9c17d350 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c9c0fabb0 0x562c9c0f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c9c0f02f0 0x562c9c172700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71a17fa640 0 client.15078 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 --2- 172.21.15.2:0/4016111276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562c9c0ef9d0 0x562c9c1721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 -- 172.21.15.2:0/4016111276 >> 172.21.15.2:0/4016111276 conn(0x562c9c0ebf60 msgr2=0x562c9c0f6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 -- 172.21.15.2:0/4016111276 shutdown_connections 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 1 -- 172.21.15.2:0/4016111276 wait complete. 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c5e42740 20 client.15078 trim_cache size 0 max 16384 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24470, 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 84.770984953999999, 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 24, 2024-09-12T00:52:44.824 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 83, 2024-09-12T00:52:44.824 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T00:52:44.824 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 114.613679754 2024-09-12T00:52:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:52:44.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c3a69640 1 -- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71a40a2c10 msgr2=0x7f71a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c3a69640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71a40a2c10 0x7f71a40a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f71ac09b920 tx=0x7f71ac005960 comp rx=0 tx=0).stop 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c3a69640 1 -- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc102ef0 msgr2=0x7f71bc19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c3a69640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc102ef0 0x7f71bc19ccf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00cad0 tx=0x7f71ac00cf90 comp rx=0 tx=0).stop 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c3a69640 1 -- 172.21.15.2:0/838455417 shutdown_connections 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c3a69640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f71a40a2c10 0x7f71a40a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c3a69640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71bc102ef0 0x7f71bc19ccf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.818+0000 7f71c3a69640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71bc102570 0x7f71bc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.819+0000 7f71c3a69640 1 --2- 172.21.15.2:0/838455417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc100e20 0x7f71bc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.819+0000 7f71c3a69640 1 -- 172.21.15.2:0/838455417 >> 172.21.15.2:0/838455417 conn(0x7f71bc0fc7d0 msgr2=0x7f71bc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.819+0000 7f71c3a69640 1 -- 172.21.15.2:0/838455417 shutdown_connections 2024-09-12T00:52:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:44.819+0000 7f71c3a69640 1 -- 172.21.15.2:0/838455417 wait complete. 2024-09-12T00:52:44.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:44 smithi071 ceph-mon[35276]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:45.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:44 smithi167 ceph-mon[35234]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:52:45.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T00:52:45.814 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 -- 172.21.15.2:0/2235593547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 msgr2=0x7febac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2235593547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 0x7febac1029b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feba0009900 tx=0x7feba002a480 comp rx=0 tx=0).stop 2024-09-12T00:52:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 -- 172.21.15.2:0/2235593547 shutdown_connections 2024-09-12T00:52:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2235593547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac102ef0 0x7febac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2235593547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 0x7febac1029b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2235593547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febac100e20 0x7febac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 -- 172.21.15.2:0/2235593547 >> 172.21.15.2:0/2235593547 conn(0x7febac0fc7d0 msgr2=0x7febac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 -- 172.21.15.2:0/2235593547 shutdown_connections 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.252+0000 7febb0bb4640 1 -- 172.21.15.2:0/2235593547 wait complete. 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febb0bb4640 1 Processor -- start 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febb0bb4640 1 -- start start 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febb0bb4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac100e20 0x7febac0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febb0bb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 0x7febac0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febb0bb4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febac102ef0 0x7febac0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febb0bb4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febac110fc0 con 0x7febac102570 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febb0bb4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7febac110e40 con 0x7febac102ef0 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febb0bb4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7febac111140 con 0x7febac100e20 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 0x7febac0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 0x7febac0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53546/0 (socket says 172.21.15.2:53546) 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 -- 172.21.15.2:0/2338255154 learned_addr learned my addr 172.21.15.2:0/2338255154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febaa59c640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac100e20 0x7febac0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febaad9d640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febac102ef0 0x7febac0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 -- 172.21.15.2:0/2338255154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac100e20 msgr2=0x7febac0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac100e20 0x7febac0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 -- 172.21.15.2:0/2338255154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febac102ef0 msgr2=0x7febac0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febac102ef0 0x7febac0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 -- 172.21.15.2:0/2338255154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac1a6a40 con 0x7febac102570 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7febaa59c640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac100e20 0x7febac0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.253+0000 7feba9d9b640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 0x7febac0fd1c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feba0006010 tx=0x7feba0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.254+0000 7feb9b7fe640 1 -- 172.21.15.2:0/2338255154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba003f070 con 0x7febac102570 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.254+0000 7febb0bb4640 1 -- 172.21.15.2:0/2338255154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febac1a6cd0 con 0x7febac102570 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.254+0000 7feb9b7fe640 1 -- 172.21.15.2:0/2338255154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feba0031c30 con 0x7febac102570 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.254+0000 7feb9b7fe640 1 -- 172.21.15.2:0/2338255154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0035030 con 0x7febac102570 2024-09-12T00:52:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.254+0000 7febb0bb4640 1 -- 172.21.15.2:0/2338255154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febac1a71b0 con 0x7febac102570 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.256+0000 7feb9b7fe640 1 -- 172.21.15.2:0/2338255154 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7feba0042070 con 0x7febac102570 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.256+0000 7febb2f8d740 1 Processor -- start 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febb2f8d740 1 -- start start 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa18db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa23670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa25fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febb2f8d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56364f97f090 con 0x56364fa192f0 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febb2f8d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56364f926a70 con 0x56364fa189d0 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febb2f8d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56364f97b050 con 0x56364fa23bb0 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7feb9b7fe640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7feb940a2c10 0x7feb940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa23670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53556/0 (socket says 172.21.15.2:53556) 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaa59c640 1 -- 172.21.15.2:0/246284286 learned_addr learned my addr 172.21.15.2:0/246284286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaad9d640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7feb940a2c10 0x7feb940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaad9d640 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa18db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7feba9d9b640 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa25fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7feb9b7fe640 1 -- 172.21.15.2:0/2338255154 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7feba00ef830 con 0x7febac102570 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaa59c640 1 -- 172.21.15.2:0/246284286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 msgr2=0x56364fa25fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaa59c640 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa25fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaa59c640 1 -- 172.21.15.2:0/246284286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 msgr2=0x56364fa18db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaa59c640 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa18db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7febaa59c640 1 -- 172.21.15.2:0/246284286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56364f933130 con 0x56364fa192f0 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.257+0000 7feba9d9b640 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa25fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febaa59c640 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa23670 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feb9c007850 tx=0x7feb9c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d81eae3c2ded1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febaad9d640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7feb940a2c10 0x7feb940a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feba4005fd0 tx=0x7feba40094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7feb98ff9640 1 -- 172.21.15.2:0/246284286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00d950 con 0x56364fa192f0 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7feb98ff9640 1 -- 172.21.15.2:0/246284286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb9c018070 con 0x56364fa192f0 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7feb98ff9640 1 -- 172.21.15.2:0/246284286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0123e0 con 0x56364fa192f0 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febb2f8d740 1 -- 172.21.15.2:0/246284286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 msgr2=0x56364fa23670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febb2f8d740 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa23670 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feb9c007850 tx=0x7feb9c007d10 comp rx=0 tx=0).stop 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febb2f8d740 1 -- 172.21.15.2:0/246284286 shutdown_connections 2024-09-12T00:52:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febb2f8d740 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa25fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febb2f8d740 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa23670 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febb2f8d740 1 --2- 172.21.15.2:0/246284286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa18db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.258+0000 7febb2f8d740 1 -- 172.21.15.2:0/246284286 >> 172.21.15.2:0/246284286 conn(0x56364fa14f60 msgr2=0x56364fa15340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 -- 172.21.15.2:0/246284286 shutdown_connections 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 -- 172.21.15.2:0/246284286 wait complete. 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 -- start start 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 Processor -- start 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa189d0 0x56364fa23380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa23bb0 0x56364fa20c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56364fa26780 con 0x56364fa189d0 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56364f939f20 con 0x56364fa23bb0 2024-09-12T00:52:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56364fa26900 con 0x56364fa192f0 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febb2f8d740 10 client.0 _ll_register_callbacks cb 0x56364f903030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa189d0 0x56364fa23380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa189d0 0x56364fa23380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53564/0 (socket says 172.21.15.2:53564) 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febaa59c640 1 -- 172.21.15.2:0/1017145245 learned_addr learned my addr 172.21.15.2:0/1017145245 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.259+0000 7febaad9d640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa23bb0 0x56364fa20c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7feba9d9b640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febaa59c640 1 -- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 msgr2=0x56364fa206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febaa59c640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febaa59c640 1 -- 172.21.15.2:0/1017145245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa23bb0 msgr2=0x56364fa20c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febaa59c640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa23bb0 0x56364fa20c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febaa59c640 1 -- 172.21.15.2:0/1017145245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56364f6f02b0 con 0x56364fa189d0 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7feba9d9b640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febaad9d640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa23bb0 0x56364fa20c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febaa59c640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa189d0 0x56364fa23380 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb9c000c00 tx=0x7feb9c013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d33533df46f8bff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7feb91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7feb91ffb640 1 -- 172.21.15.2:0/1017145245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00dd60 con 0x56364fa189d0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7feb91ffb640 1 -- 172.21.15.2:0/1017145245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7feb9c01c3f0 con 0x56364fa189d0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febb2f8d740 1 -- 172.21.15.2:0/1017145245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb9c018070 con 0x56364fa189d0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7feb91ffb640 1 -- 172.21.15.2:0/1017145245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feb9c01c5f0 con 0x56364fa189d0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febb2f8d740 10 client.15090 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7febb2f8d740 1 -- 172.21.15.2:0/1017145245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56364fa32010 con 0x56364fa189d0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.260+0000 7feb91ffb640 1 -- 172.21.15.2:0/1017145245 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb9c018070 con 0x56364fa189d0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.261+0000 7feb91ffb640 1 -- 172.21.15.2:0/1017145245 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7feb9c02e900 con 0x56364fa189d0 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.261+0000 7febb2f8d740 10 client.15090 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.261+0000 7febb2f8d740 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T00:52:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.261+0000 7febb2f8d740 20 client.15090 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.261+0000 7febb2f8d740 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56364fa342c0 0x56364fa35730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.261+0000 7febb2f8d740 4 client.15090 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.261+0000 7febb2f8d740 1 -- 172.21.15.2:0/1017145245 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56364f98c600 con 0x56364fa342c0 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.261+0000 7feba9d9b640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56364fa342c0 0x56364fa35730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7feb91ffb640 10 client.15090 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7feba9d9b640 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56364fa342c0 0x56364fa35730 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab7730088e0af907 server_cookie=398236a8c19d0624 in_seq=0 out_seq=0 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7feb91ffb640 1 -- 172.21.15.2:0/1017145245 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56364f98c600 con 0x56364fa342c0 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7feb91ffb640 10 client.15090 handle_command_reply: tid=0 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 client.15090 shutdown 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 -- 172.21.15.2:0/1017145245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa189d0 msgr2=0x56364fa23380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa189d0 0x56364fa23380 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb9c000c00 tx=0x7feb9c013730 comp rx=0 tx=0).stop 2024-09-12T00:52:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 -- 172.21.15.2:0/1017145245 shutdown_connections 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56364fa342c0 0x56364fa35730 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa23bb0 0x56364fa20c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 --2- 172.21.15.2:0/1017145245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa189d0 0x56364fa23380 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7feb91ffb640 0 client.15090 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.262+0000 7febb2f8d740 1 -- 172.21.15.2:0/1017145245 >> 172.21.15.2:0/1017145245 conn(0x56364fa14f60 msgr2=0x56364fa1ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.263+0000 7febb2f8d740 1 -- 172.21.15.2:0/1017145245 shutdown_connections 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.263+0000 7febb2f8d740 1 -- 172.21.15.2:0/1017145245 wait complete. 2024-09-12T00:52:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.263+0000 7febb2f8d740 20 client.15090 trim_cache size 0 max 16384 2024-09-12T00:52:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.280+0000 7febb2f8d740 1 Processor -- start 2024-09-12T00:52:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febb2f8d740 1 -- start start 2024-09-12T00:52:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa35730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa20c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa23bb0 0x56364fa33420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febb2f8d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56364fa33a70 con 0x56364fa23bb0 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febb2f8d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56364fa34140 con 0x56364fa189d0 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febb2f8d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56364fa34810 con 0x56364fa192f0 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa23bb0 0x56364fa33420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa23bb0 0x56364fa33420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53568/0 (socket says 172.21.15.2:53568) 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 -- 172.21.15.2:0/2171788414 learned_addr learned my addr 172.21.15.2:0/2171788414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7feba9d9b640 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa20c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaa59c640 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa35730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 -- 172.21.15.2:0/2171788414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 msgr2=0x56364fa20c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:46.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa20c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 -- 172.21.15.2:0/2171788414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 msgr2=0x56364fa35730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa35730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 -- 172.21.15.2:0/2171788414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56364fa14d90 con 0x56364fa23bb0 2024-09-12T00:52:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.281+0000 7febaad9d640 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa23bb0 0x56364fa33420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feba40120f0 tx=0x7feba4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbc6807b5b4aa1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7feb93fff640 1 -- 172.21.15.2:0/2171788414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4004b20 con 0x56364fa23bb0 2024-09-12T00:52:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7feb93fff640 1 -- 172.21.15.2:0/2171788414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feba4004cc0 con 0x56364fa23bb0 2024-09-12T00:52:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7feb93fff640 1 -- 172.21.15.2:0/2171788414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba402a6e0 con 0x56364fa23bb0 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 -- 172.21.15.2:0/2171788414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa23bb0 msgr2=0x56364fa33420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa23bb0 0x56364fa33420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feba40120f0 tx=0x7feba4005bd0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 -- 172.21.15.2:0/2171788414 shutdown_connections 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa23bb0 0x56364fa33420 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa192f0 0x56364fa20c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2171788414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa35730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 -- 172.21.15.2:0/2171788414 >> 172.21.15.2:0/2171788414 conn(0x56364fa14f60 msgr2=0x56364fa15340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 -- 172.21.15.2:0/2171788414 shutdown_connections 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.282+0000 7febb2f8d740 1 -- 172.21.15.2:0/2171788414 wait complete. 2024-09-12T00:52:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 1 -- start start 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 1 Processor -- start 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa3db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa3e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa1d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56364fa355b0 con 0x56364fa192f0 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56364fa34ee0 con 0x56364fa189d0 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56364fa35c80 con 0x56364fa23bb0 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febb2f8d740 10 client.0 _ll_register_callbacks cb 0x7feba4009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7feba9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa3e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7feba9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa3e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53572/0 (socket says 172.21.15.2:53572) 2024-09-12T00:52:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7feba9d9b640 1 -- 172.21.15.2:0/2218553010 learned_addr learned my addr 172.21.15.2:0/2218553010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febaad9d640 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa1d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.283+0000 7febaa59c640 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa3db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feba9d9b640 1 -- 172.21.15.2:0/2218553010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 msgr2=0x56364fa1d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feba9d9b640 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa1d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feba9d9b640 1 -- 172.21.15.2:0/2218553010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 msgr2=0x56364fa3db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feba9d9b640 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa3db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feba9d9b640 1 -- 172.21.15.2:0/2218553010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56364fa1da40 con 0x56364fa192f0 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feba9d9b640 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa3e0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feba00b8860 tx=0x7feba0049770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa0d8b00164239f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feb91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feb91ffb640 1 -- 172.21.15.2:0/2218553010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0049040 con 0x56364fa192f0 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feb91ffb640 1 -- 172.21.15.2:0/2218553010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7feba00b8500 con 0x56364fa192f0 2024-09-12T00:52:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7febb2f8d740 1 -- 172.21.15.2:0/2218553010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba4004cc0 con 0x56364fa192f0 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feb91ffb640 1 -- 172.21.15.2:0/2218553010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feba0031de0 con 0x56364fa192f0 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7febb2f8d740 10 client.15096 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7febb2f8d740 1 -- 172.21.15.2:0/2218553010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56364fa3b720 con 0x56364fa192f0 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feb91ffb640 1 -- 172.21.15.2:0/2218553010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feba4004cc0 con 0x56364fa192f0 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7feb91ffb640 1 -- 172.21.15.2:0/2218553010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7feba00bc0f0 con 0x56364fa192f0 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.284+0000 7febb2f8d740 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febb2f8d740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febb2f8d740 20 client.15096 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56364faa3160 0x56364faa1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febb2f8d740 4 client.15096 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febb2f8d740 1 -- 172.21.15.2:0/2218553010 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "status"}) -- 0x56364f986b10 con 0x56364faa3160 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febaa59c640 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56364faa3160 0x56364faa1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febaa59c640 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56364faa3160 0x56364faa1e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6cb734d92d02097c server_cookie=4660cba7e032e3b4 in_seq=0 out_seq=0 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7feb91ffb640 10 client.15096 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7feb91ffb640 1 -- 172.21.15.2:0/2218553010 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56364f986b10 con 0x56364faa3160 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7feb91ffb640 10 client.15096 handle_command_reply: tid=0 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febb2f8d740 1 client.15096 shutdown 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.285+0000 7febb2f8d740 1 -- 172.21.15.2:0/2218553010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 msgr2=0x56364fa3e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa3e0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feba00b8860 tx=0x7feba0049770 comp rx=0 tx=0).stop 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 -- 172.21.15.2:0/2218553010 shutdown_connections 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56364faa3160 0x56364faa1e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56364fa23bb0 0x56364fa1d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7feb91ffb640 0 client.15096 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:52:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56364fa192f0 0x56364fa3e0d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 --2- 172.21.15.2:0/2218553010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56364fa189d0 0x56364fa3db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 -- 172.21.15.2:0/2218553010 >> 172.21.15.2:0/2218553010 conn(0x56364fa14f60 msgr2=0x56364fa1bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 -- 172.21.15.2:0/2218553010 shutdown_connections 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 1 -- 172.21.15.2:0/2218553010 wait complete. 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb2f8d740 20 client.15096 trim_cache size 0 max 16384 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24487, 2024-09-12T00:52:46.292 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:52:46.293 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:52:46.293 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:52:46.293 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 87.241725477000003, 2024-09-12T00:52:46.293 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 24, 2024-09-12T00:52:46.293 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 83, 2024-09-12T00:52:46.293 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T00:52:46.293 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 113.506053052 2024-09-12T00:52:46.293 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 -- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7feb940a2c10 msgr2=0x7feb940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7feb940a2c10 0x7feb940a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feba4005fd0 tx=0x7feba40094f0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 -- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 msgr2=0x7febac0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 0x7febac0fd1c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feba0006010 tx=0x7feba0003c10 comp rx=0 tx=0).stop 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 -- 172.21.15.2:0/2338255154 shutdown_connections 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7feb940a2c10 0x7feb940a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febac102ef0 0x7febac0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac102570 0x7febac0fd1c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 --2- 172.21.15.2:0/2338255154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac100e20 0x7febac0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 -- 172.21.15.2:0/2338255154 >> 172.21.15.2:0/2338255154 conn(0x7febac0fc7d0 msgr2=0x7febac06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 -- 172.21.15.2:0/2338255154 shutdown_connections 2024-09-12T00:52:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:46.286+0000 7febb0bb4640 1 -- 172.21.15.2:0/2338255154 wait complete. 2024-09-12T00:52:46.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:46 smithi071 ceph-mon[35276]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:46.959 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:46 smithi002 ceph-mon[31210]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:46.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T00:52:47.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:46 smithi167 ceph-mon[35234]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:52:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:47.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 -- 172.21.15.2:0/130984238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c102790 msgr2=0x7fd92c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 --2- 172.21.15.2:0/130984238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c102790 0x7fd92c1067e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009900 tx=0x7fd91c02a410 comp rx=0 tx=0).stop 2024-09-12T00:52:47.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 -- 172.21.15.2:0/130984238 shutdown_connections 2024-09-12T00:52:47.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 --2- 172.21.15.2:0/130984238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c106f10 0x7fd92c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 --2- 172.21.15.2:0/130984238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c102790 0x7fd92c1067e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 --2- 172.21.15.2:0/130984238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c101de0 0x7fd92c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 -- 172.21.15.2:0/130984238 >> 172.21.15.2:0/130984238 conn(0x7fd92c0fd8c0 msgr2=0x7fd92c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:47.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 -- 172.21.15.2:0/130984238 shutdown_connections 2024-09-12T00:52:47.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.673+0000 7fd934389640 1 -- 172.21.15.2:0/130984238 wait complete. 2024-09-12T00:52:47.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd934389640 1 Processor -- start 2024-09-12T00:52:47.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd934389640 1 -- start start 2024-09-12T00:52:47.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd934389640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c101de0 0x7fd92c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd934389640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c102790 0x7fd92c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd934389640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c106f10 0x7fd92c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd934389640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c111f90 con 0x7fd92c106f10 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd934389640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c111e10 con 0x7fd92c101de0 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd934389640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c112110 con 0x7fd92c102790 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932926640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c106f10 0x7fd92c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932926640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c106f10 0x7fd92c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53588/0 (socket says 172.21.15.2:53588) 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932926640 1 -- 172.21.15.2:0/3437811221 learned_addr learned my addr 172.21.15.2:0/3437811221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932125640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c101de0 0x7fd92c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd931924640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c102790 0x7fd92c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932926640 1 -- 172.21.15.2:0/3437811221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c102790 msgr2=0x7fd92c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932926640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c102790 0x7fd92c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932926640 1 -- 172.21.15.2:0/3437811221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c101de0 msgr2=0x7fd92c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932926640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c101de0 0x7fd92c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.674+0000 7fd932926640 1 -- 172.21.15.2:0/3437811221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c19d440 con 0x7fd92c106f10 2024-09-12T00:52:47.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.675+0000 7fd932926640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c106f10 0x7fd92c19cd60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd92400b970 tx=0x7fd92400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:47.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.675+0000 7fd9237fe640 1 -- 172.21.15.2:0/3437811221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924019070 con 0x7fd92c106f10 2024-09-12T00:52:47.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.675+0000 7fd9237fe640 1 -- 172.21.15.2:0/3437811221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd92400cb40 con 0x7fd92c106f10 2024-09-12T00:52:47.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.675+0000 7fd934389640 1 -- 172.21.15.2:0/3437811221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c19d730 con 0x7fd92c106f10 2024-09-12T00:52:47.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.675+0000 7fd9237fe640 1 -- 172.21.15.2:0/3437811221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924007650 con 0x7fd92c106f10 2024-09-12T00:52:47.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.675+0000 7fd934389640 1 -- 172.21.15.2:0/3437811221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c1a5010 con 0x7fd92c106f10 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.677+0000 7fd9237fe640 1 -- 172.21.15.2:0/3437811221 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd92401c070 con 0x7fd92c106f10 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.677+0000 7fd936762740 1 Processor -- start 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd936762740 1 -- start start 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd936762740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388dda5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd936762740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda61b0 0x56388ddb4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd936762740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388ddb4fc0 0x56388ddb73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd936762740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56388dd0c090 con 0x56388ddb4fc0 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd936762740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56388dcb3a70 con 0x56388dda5890 2024-09-12T00:52:47.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd936762740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56388dd08050 con 0x56388dda61b0 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd931924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388ddb4fc0 0x56388ddb73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd931924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388ddb4fc0 0x56388ddb73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53594/0 (socket says 172.21.15.2:53594) 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd931924640 1 -- 172.21.15.2:0/2532302891 learned_addr learned my addr 172.21.15.2:0/2532302891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd932125640 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda61b0 0x56388ddb4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd931924640 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388dda5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd9237fe640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd9180a2c10 0x7fd9180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.678+0000 7fd932926640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd9180a2c10 0x7fd9180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd932125640 1 -- 172.21.15.2:0/2532302891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 msgr2=0x56388dda5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd932125640 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388dda5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd932125640 1 -- 172.21.15.2:0/2532302891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388ddb4fc0 msgr2=0x56388ddb73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd932125640 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388ddb4fc0 0x56388ddb73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd932125640 1 -- 172.21.15.2:0/2532302891 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388dcc0130 con 0x56388dda61b0 2024-09-12T00:52:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd9237fe640 1 -- 172.21.15.2:0/3437811221 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fd9240ce750 con 0x7fd92c106f10 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd932125640 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda61b0 0x56388ddb4a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd92800bbf0 tx=0x7fd9280107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d8415d51f81eac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd932926640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd9180a2c10 0x7fd9180a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd92400b940 tx=0x7fd92406cf80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd920dea640 1 -- 172.21.15.2:0/2532302891 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928004030 con 0x56388dda61b0 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd920dea640 1 -- 172.21.15.2:0/2532302891 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9280041d0 con 0x56388dda61b0 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.679+0000 7fd920dea640 1 -- 172.21.15.2:0/2532302891 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928011640 con 0x56388dda61b0 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 -- 172.21.15.2:0/2532302891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda61b0 msgr2=0x56388ddb4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda61b0 0x56388ddb4a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd92800bbf0 tx=0x7fd9280107a0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 -- 172.21.15.2:0/2532302891 shutdown_connections 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388ddb4fc0 0x56388ddb73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda61b0 0x56388ddb4a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 --2- 172.21.15.2:0/2532302891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388dda5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 -- 172.21.15.2:0/2532302891 >> 172.21.15.2:0/2532302891 conn(0x56388dda1f60 msgr2=0x56388dda2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:47.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 -- 172.21.15.2:0/2532302891 shutdown_connections 2024-09-12T00:52:47.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 -- 172.21.15.2:0/2532302891 wait complete. 2024-09-12T00:52:47.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.680+0000 7fd936762740 1 -- start start 2024-09-12T00:52:47.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd936762740 1 Processor -- start 2024-09-12T00:52:47.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd936762740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda5890 0x56388ddb4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd936762740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda61b0 0x56388ddb1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd936762740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 0x56388ddb2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd936762740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56388ddb7b90 con 0x56388dda5890 2024-09-12T00:52:47.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd936762740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56388dcc6f20 con 0x56388dda61b0 2024-09-12T00:52:47.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd936762740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56388ddb7d10 con 0x56388ddb4fc0 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd936762740 10 client.0 _ll_register_callbacks cb 0x56388dc90030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda5890 0x56388ddb4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda5890 0x56388ddb4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53604/0 (socket says 172.21.15.2:53604) 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 -- 172.21.15.2:0/581956473 learned_addr learned my addr 172.21.15.2:0/581956473 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 0x56388ddb2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd932125640 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda61b0 0x56388ddb1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 -- 172.21.15.2:0/581956473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 msgr2=0x56388ddb2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 0x56388ddb2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 -- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda61b0 msgr2=0x56388ddb1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda61b0 0x56388ddb1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 -- 172.21.15.2:0/581956473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388da7d2b0 con 0x56388dda5890 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd932125640 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda61b0 0x56388ddb1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd931924640 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda5890 0x56388ddb4880 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd91c000c00 tx=0x7fd91c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a64e55ac2883a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.681+0000 7fd915ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd915ffb640 1 -- 172.21.15.2:0/581956473 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c035040 con 0x56388dda5890 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd915ffb640 1 -- 172.21.15.2:0/581956473 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fd91c004310 con 0x56388dda5890 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 1 -- 172.21.15.2:0/581956473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9280041d0 con 0x56388dda5890 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd915ffb640 1 -- 172.21.15.2:0/581956473 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd91c052050 con 0x56388dda5890 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 10 client.15108 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 1 -- 172.21.15.2:0/581956473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56388ddc3550 con 0x56388dda5890 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd915ffb640 1 -- 172.21.15.2:0/581956473 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9280041d0 con 0x56388dda5890 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd915ffb640 1 -- 172.21.15.2:0/581956473 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd91c03a040 con 0x56388dda5890 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 10 client.15108 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 10 client.15108 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 20 client.15108 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56388ddc5ba0 0x56388ddc7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 4 client.15108 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.682+0000 7fd936762740 1 -- 172.21.15.2:0/581956473 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56388dd19600 con 0x56388ddc5ba0 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.683+0000 7fd932125640 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56388ddc5ba0 0x56388ddc7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.683+0000 7fd915ffb640 10 client.15108 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.683+0000 7fd932125640 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56388ddc5ba0 0x56388ddc7010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76c7105e32ecd8e6 server_cookie=732ea0732796f8a2 in_seq=0 out_seq=0 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd915ffb640 1 -- 172.21.15.2:0/581956473 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56388dd19600 con 0x56388ddc5ba0 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd915ffb640 10 client.15108 handle_command_reply: tid=0 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 client.15108 shutdown 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 -- 172.21.15.2:0/581956473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda5890 msgr2=0x56388ddb4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda5890 0x56388ddb4880 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd91c000c00 tx=0x7fd91c005d50 comp rx=0 tx=0).stop 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 -- 172.21.15.2:0/581956473 shutdown_connections 2024-09-12T00:52:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56388ddc5ba0 0x56388ddc7010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 0x56388ddb2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda61b0 0x56388ddb1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 --2- 172.21.15.2:0/581956473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda5890 0x56388ddb4880 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 -- 172.21.15.2:0/581956473 >> 172.21.15.2:0/581956473 conn(0x56388dda1f60 msgr2=0x56388dda7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd915ffb640 0 client.15108 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:52:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 -- 172.21.15.2:0/581956473 shutdown_connections 2024-09-12T00:52:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 1 -- 172.21.15.2:0/581956473 wait complete. 2024-09-12T00:52:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.684+0000 7fd936762740 20 client.15108 trim_cache size 0 max 16384 2024-09-12T00:52:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd936762740 1 Processor -- start 2024-09-12T00:52:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd936762740 1 -- start start 2024-09-12T00:52:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd936762740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388ddc6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd936762740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddb1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd936762740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 0x56388ddb2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd936762740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56388ddc5350 con 0x56388dda61b0 2024-09-12T00:52:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd936762740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56388ddc5a20 con 0x56388dda5890 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd936762740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56388ddc60f0 con 0x56388ddb4fc0 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.702+0000 7fd932125640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddb1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd932125640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddb1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53608/0 (socket says 172.21.15.2:53608) 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd932125640 1 -- 172.21.15.2:0/1330225482 learned_addr learned my addr 172.21.15.2:0/1330225482 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd931924640 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388ddc6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd931924640 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 0x56388ddb2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd932125640 1 -- 172.21.15.2:0/1330225482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 msgr2=0x56388ddb2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd932125640 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 0x56388ddb2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd932125640 1 -- 172.21.15.2:0/1330225482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 msgr2=0x56388ddc6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd932125640 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388ddc6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd932125640 1 -- 172.21.15.2:0/1330225482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388dda6e60 con 0x56388dda61b0 2024-09-12T00:52:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd931924640 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388ddc6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd932125640 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddb1be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd92800bbc0 tx=0x7fd928003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267cf1a78fc73bb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd917fff640 1 -- 172.21.15.2:0/1330225482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928005040 con 0x56388dda61b0 2024-09-12T00:52:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd917fff640 1 -- 172.21.15.2:0/1330225482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9280035f0 con 0x56388dda61b0 2024-09-12T00:52:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.703+0000 7fd917fff640 1 -- 172.21.15.2:0/1330225482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928027660 con 0x56388dda61b0 2024-09-12T00:52:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 -- 172.21.15.2:0/1330225482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 msgr2=0x56388ddb1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddb1be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd92800bbc0 tx=0x7fd928003e40 comp rx=0 tx=0).stop 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 -- 172.21.15.2:0/1330225482 shutdown_connections 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388ddb4fc0 0x56388ddb2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddb1be0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 --2- 172.21.15.2:0/1330225482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388dda5890 0x56388ddc6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 -- 172.21.15.2:0/1330225482 >> 172.21.15.2:0/1330225482 conn(0x56388dda1f60 msgr2=0x56388dd9cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 -- 172.21.15.2:0/1330225482 shutdown_connections 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 -- 172.21.15.2:0/1330225482 wait complete. 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 -- start start 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 Processor -- start 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.704+0000 7fd936762740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda5890 0x56388ddcf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd936762740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddcd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd936762740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388ddb4fc0 0x56388ddcda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd936762740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56388ddc6e90 con 0x56388dda61b0 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd936762740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56388ddc67c0 con 0x56388ddb4fc0 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd936762740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56388ddc7560 con 0x56388dda5890 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd936762740 10 client.0 _ll_register_callbacks cb 0x7fd91c031710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda5890 0x56388ddcf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda5890 0x56388ddcf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:39376/0 (socket says 172.21.15.2:39376) 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 -- 172.21.15.2:0/2497626684 learned_addr learned my addr 172.21.15.2:0/2497626684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388ddb4fc0 0x56388ddcda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 -- 172.21.15.2:0/2497626684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388ddb4fc0 msgr2=0x56388ddcda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388ddb4fc0 0x56388ddcda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 -- 172.21.15.2:0/2497626684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 msgr2=0x56388ddcd520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:52:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd932125640 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddcd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddcd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 -- 172.21.15.2:0/2497626684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388ddce260 con 0x56388dda5890 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd932125640 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddcd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd931924640 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda5890 0x56388ddcf930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd91c031820 tx=0x7fd91c009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5792caecee474fef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.705+0000 7fd915ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd915ffb640 1 -- 172.21.15.2:0/2497626684 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c035070 con 0x56388dda5890 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 1 -- 172.21.15.2:0/2497626684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9280035f0 con 0x56388dda5890 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd915ffb640 1 -- 172.21.15.2:0/2497626684 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fd91c032e00 con 0x56388dda5890 2024-09-12T00:52:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd915ffb640 1 -- 172.21.15.2:0/2497626684 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd91c004310 con 0x56388dda5890 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 10 client.24814 fetch_fsmap learned FSMap version 24 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 1 -- 172.21.15.2:0/2497626684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56388de2f1f0 con 0x56388dda5890 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd915ffb640 1 -- 172.21.15.2:0/2497626684 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9280035f0 con 0x56388dda5890 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd915ffb640 1 -- 172.21.15.2:0/2497626684 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd91c061400 con 0x56388dda5890 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 10 client.24814 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 10 client.24814 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 20 client.24814 populate_metadata read hostname 'smithi002' 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56388de33d50 0x56388de32a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 4 client.24814 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.706+0000 7fd936762740 1 -- 172.21.15.2:0/2497626684 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "status"}) -- 0x56388dd13b10 con 0x56388de33d50 2024-09-12T00:52:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.707+0000 7fd932125640 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56388de33d50 0x56388de32a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.707+0000 7fd932125640 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56388de33d50 0x56388de32a60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ece7da892003c4b server_cookie=115bb624f2b7e927 in_seq=0 out_seq=0 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.707+0000 7fd915ffb640 10 client.24814 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.707+0000 7fd915ffb640 1 -- 172.21.15.2:0/2497626684 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56388dd13b10 con 0x56388de33d50 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.707+0000 7fd915ffb640 10 client.24814 handle_command_reply: tid=0 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.707+0000 7fd936762740 1 client.24814 shutdown 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.707+0000 7fd936762740 1 -- 172.21.15.2:0/2497626684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda5890 msgr2=0x56388ddcf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.707+0000 7fd936762740 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda5890 0x56388ddcf930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd91c031820 tx=0x7fd91c009580 comp rx=0 tx=0).stop 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 1 -- 172.21.15.2:0/2497626684 shutdown_connections 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56388de33d50 0x56388de32a60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56388ddb4fc0 0x56388ddcda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56388dda61b0 0x56388ddcd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd915ffb640 0 client.24814 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 1 --2- 172.21.15.2:0/2497626684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56388dda5890 0x56388ddcf930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 1 -- 172.21.15.2:0/2497626684 >> 172.21.15.2:0/2497626684 conn(0x56388dda1f60 msgr2=0x56388ddb1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 1 -- 172.21.15.2:0/2497626684 shutdown_connections 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 1 -- 172.21.15.2:0/2497626684 wait complete. 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd936762740 20 client.24814 trim_cache size 0 max 16384 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-12T00:52:47.714 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24494, 2024-09-12T00:52:47.715 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:52:47.715 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:52:47.715 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:52:47.715 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 95.682350139999997, 2024-09-12T00:52:47.715 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 24, 2024-09-12T00:52:47.715 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 83, 2024-09-12T00:52:47.716 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T00:52:47.716 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 106.590338925 2024-09-12T00:52:47.716 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 -- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd9180a2c10 msgr2=0x7fd9180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd9180a2c10 0x7fd9180a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd92400b940 tx=0x7fd92406cf80 comp rx=0 tx=0).stop 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 -- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c106f10 msgr2=0x7fd92c19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c106f10 0x7fd92c19cd60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd92400b970 tx=0x7fd92400be30 comp rx=0 tx=0).stop 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 -- 172.21.15.2:0/3437811221 shutdown_connections 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7fd9180a2c10 0x7fd9180a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c106f10 0x7fd92c19cd60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c102790 0x7fd92c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 --2- 172.21.15.2:0/3437811221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c101de0 0x7fd92c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 -- 172.21.15.2:0/3437811221 >> 172.21.15.2:0/3437811221 conn(0x7fd92c0fd8c0 msgr2=0x7fd92c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 -- 172.21.15.2:0/3437811221 shutdown_connections 2024-09-12T00:52:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:47.708+0000 7fd934389640 1 -- 172.21.15.2:0/3437811221 wait complete. 2024-09-12T00:52:48.637 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T00:52:48.647 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T00:52:48.647 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T00:52:48.647 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T00:52:48.647 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-12T00:52:48.648 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T00:52:48.648 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T00:52:48.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-12T00:52:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 -- 172.21.15.2:0/1639423841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 msgr2=0x7f95d4109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 --2- 172.21.15.2:0/1639423841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 0x7f95d4109fa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009ca0 tx=0x7f95cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:52:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 -- 172.21.15.2:0/1639423841 shutdown_connections 2024-09-12T00:52:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 --2- 172.21.15.2:0/1639423841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 0x7f95d4109fa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 --2- 172.21.15.2:0/1639423841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4102d50 0x7f95d41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 --2- 172.21.15.2:0/1639423841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4101b60 0x7f95d4101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 -- 172.21.15.2:0/1639423841 >> 172.21.15.2:0/1639423841 conn(0x7f95d40fd2e0 msgr2=0x7f95d40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 -- 172.21.15.2:0/1639423841 shutdown_connections 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.762+0000 7f95d9b78640 1 -- 172.21.15.2:0/1639423841 wait complete. 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d9b78640 1 Processor -- start 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d9b78640 1 -- start start 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d9b78640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4101b60 0x7f95d4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d9b78640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4102d50 0x7f95d41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d9b78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 0x7f95d419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d9b78640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95d410d7e0 con 0x7f95d4103710 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d9b78640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95d410d660 con 0x7f95d4101b60 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d9b78640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95d410d960 con 0x7f95d4102d50 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 0x7f95d419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 0x7f95d419f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53626/0 (socket says 172.21.15.2:53626) 2024-09-12T00:52:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d3fff640 1 -- 172.21.15.2:0/179124643 learned_addr learned my addr 172.21.15.2:0/179124643 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d37fe640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4101b60 0x7f95d4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95caffd640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4102d50 0x7f95d41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d3fff640 1 -- 172.21.15.2:0/179124643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4102d50 msgr2=0x7f95d41983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d3fff640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4102d50 0x7f95d41983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d3fff640 1 -- 172.21.15.2:0/179124643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4101b60 msgr2=0x7f95d4197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.763+0000 7f95d3fff640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4101b60 0x7f95d4197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.764+0000 7f95d3fff640 1 -- 172.21.15.2:0/179124643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d419fa80 con 0x7f95d4103710 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.764+0000 7f95d3fff640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 0x7f95d419f410 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f95cc031ae0 tx=0x7f95cc031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.764+0000 7f95d17fa640 1 -- 172.21.15.2:0/179124643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc003c30 con 0x7f95d4103710 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.764+0000 7f95d17fa640 1 -- 172.21.15.2:0/179124643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95cc003dd0 con 0x7f95d4103710 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.764+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d419fd10 con 0x7f95d4103710 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.764+0000 7f95d17fa640 1 -- 172.21.15.2:0/179124643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc02fcb0 con 0x7f95d4103710 2024-09-12T00:52:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.764+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d41a0200 con 0x7f95d4103710 2024-09-12T00:52:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.765+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d4108f00 con 0x7f95d4103710 2024-09-12T00:52:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.766+0000 7f95d17fa640 1 -- 172.21.15.2:0/179124643 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f95cc004050 con 0x7f95d4103710 2024-09-12T00:52:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.767+0000 7f95d17fa640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f95c00a2c10 0x7f95c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.767+0000 7f95d37fe640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f95c00a2c10 0x7f95c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.767+0000 7f95d17fa640 1 -- 172.21.15.2:0/179124643 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f95cc0f0630 con 0x7f95d4103710 2024-09-12T00:52:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.768+0000 7f95d37fe640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f95c00a2c10 0x7f95c00a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005fd0 tx=0x7f95c400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.770+0000 7f95d17fa640 1 -- 172.21.15.2:0/179124643 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95cc0bd530 con 0x7f95d4103710 2024-09-12T00:52:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:48 smithi071 ceph-mon[35276]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-12T00:52:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:48.994+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f95d4062e90 con 0x7f95d4103710 2024-09-12T00:52:48.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:48 smithi002 ceph-mon[31210]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-12T00:52:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:48 smithi167 ceph-mon[35234]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-12T00:52:49.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.656+0000 7f95d17fa640 1 -- 172.21.15.2:0/179124643 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f95cc0bce30 con 0x7f95d4103710 2024-09-12T00:52:49.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.659+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f95c00a2c10 msgr2=0x7f95c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:49.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.659+0000 7f95d9b78640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f95c00a2c10 0x7f95c00a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005fd0 tx=0x7f95c400b410 comp rx=0 tx=0).stop 2024-09-12T00:52:49.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.659+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 msgr2=0x7f95d419f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:49.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.659+0000 7f95d9b78640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 0x7f95d419f410 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f95cc031ae0 tx=0x7f95cc031ee0 comp rx=0 tx=0).stop 2024-09-12T00:52:49.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.660+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 shutdown_connections 2024-09-12T00:52:49.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.660+0000 7f95d9b78640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f95c00a2c10 0x7f95c00a50d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:49.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.660+0000 7f95d9b78640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d4103710 0x7f95d419f410 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:49.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.660+0000 7f95d9b78640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4102d50 0x7f95d41983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:49.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.660+0000 7f95d9b78640 1 --2- 172.21.15.2:0/179124643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4101b60 0x7f95d4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:49.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.660+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 >> 172.21.15.2:0/179124643 conn(0x7f95d40fd2e0 msgr2=0x7f95d41060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:49.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.660+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 shutdown_connections 2024-09-12T00:52:49.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:49.660+0000 7f95d9b78640 1 -- 172.21.15.2:0/179124643 wait complete. 2024-09-12T00:52:49.676 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T00:52:49.704 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T00:52:49.704 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T00:52:49.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:49.705 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-12T00:52:49.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:49.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-12T00:52:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-12T00:52:49.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:52:49.795 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-12T00:52:49.795 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T00:52:49.795 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:49.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T00:52:49.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:49 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/179124643' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T00:52:49.942 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:49 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: ignoring --setuser ceph since I am not root 2024-09-12T00:52:49.942 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:49 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: ignoring --setgroup ceph since I am not root 2024-09-12T00:52:49.942 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:49 smithi071 ceph-mgr[36644]: -- 172.21.15.71:0/4107497573 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ce82db0e0 con 0x563ce82b8800 2024-09-12T00:52:49.942 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:49 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:49.803+0000 7fd37b505040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T00:52:49.942 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:49 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:49.859+0000 7fd37b505040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T00:52:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:49 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/179124643' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T00:52:49.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:49 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ignoring --setuser ceph since I am not root 2024-09-12T00:52:49.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:49 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ignoring --setgroup ceph since I am not root 2024-09-12T00:52:49.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:49 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:49.819+0000 7f0f339ce040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T00:52:49.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:49 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:49.880+0000 7f0f339ce040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T00:52:50.015 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:49 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/179124643' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T00:52:50.015 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: ignoring --setuser ceph since I am not root 2024-09-12T00:52:50.015 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: ignoring --setgroup ceph since I am not root 2024-09-12T00:52:50.016 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:49 smithi167 ceph-mgr[37030]: -- 172.21.15.167:0/786551545 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a3715b30e0 con 0x55a371590800 2024-09-12T00:52:50.016 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:49.811+0000 7f015ab77040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T00:52:50.016 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:49.868+0000 7f015ab77040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T00:52:50.016 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:50.016+0000 7f015ab77040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T00:52:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:50.287 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:50.084+0000 7f015ab77040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T00:52:50.287 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:50.232+0000 7f015ab77040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:52:50.354 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:50.004+0000 7fd37b505040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T00:52:50.354 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:50.070+0000 7fd37b505040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T00:52:50.354 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:50.216+0000 7fd37b505040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:52:50.354 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:50.354+0000 7fd37b505040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T00:52:50.399 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:50.039+0000 7f0f339ce040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T00:52:50.399 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:50.126+0000 7f0f339ce040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T00:52:50.399 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:50.281+0000 7f0f339ce040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:52:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.625+0000 7f54d85b7640 1 -- 172.21.15.2:0/2095219619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d0102d90 msgr2=0x7f54d0103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.625+0000 7f54d85b7640 1 --2- 172.21.15.2:0/2095219619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d0102d90 0x7f54d0103170 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009cd0 tx=0x7f54cc02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.625+0000 7f54d85b7640 1 -- 172.21.15.2:0/2095219619 shutdown_connections 2024-09-12T00:52:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.625+0000 7f54d85b7640 1 --2- 172.21.15.2:0/2095219619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54d0108290 0x7f54d010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.625+0000 7f54d85b7640 1 --2- 172.21.15.2:0/2095219619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0103740 0x7f54d0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.625+0000 7f54d85b7640 1 --2- 172.21.15.2:0/2095219619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d0102d90 0x7f54d0103170 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.625+0000 7f54d85b7640 1 -- 172.21.15.2:0/2095219619 >> 172.21.15.2:0/2095219619 conn(0x7f54d00fc7d0 msgr2=0x7f54d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.626+0000 7f54d85b7640 1 -- 172.21.15.2:0/2095219619 shutdown_connections 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.626+0000 7f54d85b7640 1 -- 172.21.15.2:0/2095219619 wait complete. 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.626+0000 7f54d85b7640 1 Processor -- start 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.626+0000 7f54d85b7640 1 -- start start 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d85b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0102d90 0x7f54d019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d85b7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54d0103740 0x7f54d019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d85b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d0108290 0x7f54d010e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d85b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f54d0112090 con 0x7f54d0108290 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d85b7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54d0111f10 con 0x7f54d0103740 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d85b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54d0112210 con 0x7f54d0102d90 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0102d90 0x7f54d019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0102d90 0x7f54d019f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:39432/0 (socket says 172.21.15.2:39432) 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d5b52640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54d0103740 0x7f54d019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 -- 172.21.15.2:0/4283397756 learned_addr learned my addr 172.21.15.2:0/4283397756 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6b54640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d0108290 0x7f54d010e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 -- 172.21.15.2:0/4283397756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54d0103740 msgr2=0x7f54d019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54d0103740 0x7f54d019f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 -- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d0108290 msgr2=0x7f54d010e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d0108290 0x7f54d010e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 -- 172.21.15.2:0/4283397756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d010e8d0 con 0x7f54d0102d90 2024-09-12T00:52:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54d6353640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0102d90 0x7f54d019f260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54cc02ae00 tx=0x7f54cc031e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.627+0000 7f54c77fe640 1 -- 172.21.15.2:0/4283397756 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc003e00 con 0x7f54d0102d90 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.628+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d010eb60 con 0x7f54d0102d90 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.628+0000 7f54c77fe640 1 -- 172.21.15.2:0/4283397756 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54cc004520 con 0x7f54d0102d90 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.628+0000 7f54c77fe640 1 -- 172.21.15.2:0/4283397756 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc030de0 con 0x7f54d0102d90 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.628+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d019adc0 con 0x7f54d0102d90 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.629+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d006a7f0 con 0x7f54d0102d90 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.630+0000 7f54c77fe640 1 -- 172.21.15.2:0/4283397756 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 137900+0+0 (secure 0 0 0) 0x7f54cc0046d0 con 0x7f54d0102d90 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.631+0000 7f54c77fe640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f54bc0a2c60 0x7f54bc0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.631+0000 7f54d5b52640 1 -- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f54bc0a2c60 msgr2=0x7f54bc0a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/288268916 2024-09-12T00:52:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.631+0000 7f54c77fe640 1 -- 172.21.15.2:0/4283397756 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7f54cc02e030 con 0x7f54d0102d90 2024-09-12T00:52:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.631+0000 7f54d5b52640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f54bc0a2c60 0x7f54bc0a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:52:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.635+0000 7f54c77fe640 1 -- 172.21.15.2:0/4283397756 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54cc04b060 con 0x7f54d0102d90 2024-09-12T00:52:50.656 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:50.373+0000 7f015ab77040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T00:52:50.656 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:50.431+0000 7f0f339ce040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T00:52:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.832+0000 7f54d5b52640 1 -- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f54bc0a2c60 msgr2=0x7f54bc0a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/288268916 2024-09-12T00:52:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.832+0000 7f54d5b52640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f54bc0a2c60 0x7f54bc0a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T00:52:50.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.851+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f54d0197780 con 0x7f54d0102d90 2024-09-12T00:52:50.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.851+0000 7f54c77fe640 1 -- 172.21.15.2:0/4283397756 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f54cc0bd5f0 con 0x7f54d0102d90 2024-09-12T00:52:50.850 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T00:52:50.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f54bc0a2c60 msgr2=0x7f54bc0a5120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T00:52:50.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f54bc0a2c60 0x7f54bc0a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0102d90 msgr2=0x7f54d019f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0102d90 0x7f54d019f260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54cc02ae00 tx=0x7f54cc031e60 comp rx=0 tx=0).stop 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 shutdown_connections 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:6800/288268916,v1:172.21.15.2:6801/288268916] conn(0x7f54bc0a2c60 0x7f54bc0a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d0108290 0x7f54d010e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54d0103740 0x7f54d019f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 --2- 172.21.15.2:0/4283397756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0102d90 0x7f54d019f260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 >> 172.21.15.2:0/4283397756 conn(0x7f54d00fc7d0 msgr2=0x7f54d0100980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 shutdown_connections 2024-09-12T00:52:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:50.853+0000 7f54d85b7640 1 -- 172.21.15.2:0/4283397756 wait complete. 2024-09-12T00:52:50.931 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/179124643' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T00:52:50.932 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-mon[35234]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T00:52:50.932 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:50.688+0000 7f015ab77040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T00:52:50.932 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:50.749+0000 7f015ab77040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T00:52:50.932 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:50.933+0000 7f015ab77040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T00:52:50.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/179124643' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T00:52:50.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-mon[35276]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T00:52:50.942 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:50.665+0000 7fd37b505040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T00:52:50.942 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:50.725+0000 7fd37b505040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T00:52:50.942 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:50 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:50.906+0000 7fd37b505040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T00:52:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:50 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/179124643' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T00:52:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:50 smithi002 ceph-mon[31210]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T00:52:50.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:50.766+0000 7f0f339ce040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T00:52:50.995 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:50.830+0000 7f0f339ce040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T00:52:51.283 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:51.032+0000 7f0f339ce040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T00:52:51.594 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T00:52:51.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:51.595 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-12T00:52:51.612 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T00:52:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T00:52:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-12T00:52:51.613 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T00:52:51.614 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42173sec preferred_lft 42173sec 2024-09-12T00:52:51.614 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-12T00:52:51.614 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-12T00:52:51.614 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T00:52:51.614 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-12T00:52:51.614 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-12T00:52:51.614 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T00:52:51.614 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T00:52:51.614 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-12T00:52:51.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-12T00:52:51.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-12T00:52:51.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-12T00:52:51.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T00:52:51.615 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-12T00:52:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T00:52:51.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:51 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4283397756' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T00:52:51.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:51.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:51.833 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T00:52:51.861 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-12T00:52:51.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:51.863 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-12T00:52:51.941 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-12T00:52:51.941 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T00:52:51.941 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T00:52:51.941 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T00:52:51.941 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T00:52:51.942 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T00:52:51.942 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-12T00:52:51.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T00:52:51.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T00:52:51.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T00:52:51.942 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-12T00:52:51.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:51 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4283397756' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T00:52:51.943 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:51 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:51.776+0000 7fd37b505040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T00:52:51.943 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:51 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:51.842+0000 7fd37b505040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T00:52:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T00:52:52.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:51 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4283397756' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T00:52:52.037 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:51.816+0000 7f015ab77040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T00:52:52.037 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:51.882+0000 7f015ab77040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T00:52:52.077 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:52 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:52.003+0000 7f0f339ce040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T00:52:52.077 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:52 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:52.077+0000 7f0f339ce040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T00:52:52.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:52.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:52.260 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-12T00:52:52.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:52.277 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-12T00:52:52.333 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T00:52:52.333 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-12T00:52:52.333 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T00:52:52.333 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T00:52:52.333 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-12T00:52:52.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T00:52:52.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:52.455 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T00:52:52.456 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T00:52:52.456 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-12T00:52:52.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T00:52:52.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T00:52:52.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T00:52:52.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T00:52:52.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T00:52:52.456 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-12T00:52:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T00:52:52.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:52.591 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T00:52:52.591 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-12T00:52:52.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-12T00:52:52.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T00:52:52.592 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-12T00:52:52.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T00:52:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:52.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T00:52:52.674 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:52.691 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T00:52:52.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T00:52:52.691 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:52.747 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T00:52:52.747 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T00:52:52.747 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/ebe3e7ee-7918-4d89-bd93-a3a036ffddab 2024-09-12T00:52:52.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:52.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/ebe3e7ee-7918-4d89-bd93-a3a036ffddab /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-12T00:52:52.796 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:52 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:52.542+0000 7fd37b505040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T00:52:52.796 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:52 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:52.656+0000 7fd37b505040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T00:52:52.853 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:52.595+0000 7f015ab77040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T00:52:52.853 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:52.711+0000 7f015ab77040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T00:52:52.863 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-12T00:52:52.863 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-12T00:52:53.003 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-12T00:52:53.003 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-12T00:52:53.003 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.71:3300,172.21.15.167:3300" 2024-09-12T00:52:53.003 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@c8315cee-709f-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/ebe3e7ee-7918-4d89-bd93-a3a036ffddab 2024-09-12T00:52:53.003 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.2:3300/172.21.15.71:3300/172.21.15.167:3300" will pass to kernel 2024-09-12T00:52:53.004 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T00:52:53.004 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-09-12T00:52:53.004 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T00:52:53.004 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T00:52:53.004 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T00:52:53.006 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T00:52:53.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:52:53.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:53.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:52 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:52.797+0000 7fd37b505040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:52:53.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:52 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:52.857+0000 7fd37b505040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T00:52:53.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.005+0000 7fd37b505040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T00:52:53.074 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.074+0000 7fd37b505040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T00:52:53.126 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:52 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:52.849+0000 7f0f339ce040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T00:52:53.126 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:52 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:52.973+0000 7f0f339ce040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T00:52:53.136 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:52.854+0000 7f015ab77040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:52:53.136 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:52.916+0000 7f015ab77040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T00:52:53.136 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.069+0000 7f015ab77040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T00:52:53.136 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.137+0000 7f015ab77040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T00:52:53.355 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.134+0000 7fd37b505040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T00:52:53.355 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.290+0000 7fd37b505040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T00:52:53.355 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.356+0000 7fd37b505040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T00:52:53.418 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.126+0000 7f0f339ce040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T00:52:53.418 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.190+0000 7f0f339ce040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T00:52:53.418 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.347+0000 7f0f339ce040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T00:52:53.418 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.418+0000 7f0f339ce040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T00:52:53.419 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.197+0000 7f015ab77040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T00:52:53.420 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.357+0000 7f015ab77040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T00:52:53.420 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.421+0000 7f015ab77040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T00:52:53.618 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.422+0000 7fd37b505040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T00:52:53.618 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.502+0000 7fd37b505040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T00:52:53.618 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.561+0000 7fd37b505040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T00:52:53.618 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:53.618+0000 7fd37b505040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T00:52:53.685 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.487+0000 7f015ab77040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T00:52:53.685 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.568+0000 7f015ab77040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T00:52:53.685 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.628+0000 7f015ab77040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T00:52:53.686 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:53.686+0000 7f015ab77040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T00:52:53.713 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.481+0000 7f0f339ce040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T00:52:53.714 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.646+0000 7f0f339ce040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T00:52:53.714 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.714+0000 7f0f339ce040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T00:52:53.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.783+0000 7f0f339ce040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T00:52:53.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.869+0000 7f0f339ce040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T00:52:53.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.931+0000 7f0f339ce040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T00:52:53.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:53.992+0000 7f0f339ce040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T00:52:54.692 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 00:52:54 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T00:52:54.400+0000 7fd37b505040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T00:52:54.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:54 smithi071 ceph-mon[35276]: Standby manager daemon y restarted 2024-09-12T00:52:54.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:54 smithi071 ceph-mon[35276]: Standby manager daemon y started 2024-09-12T00:52:54.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:54 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T00:52:54.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:54 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:52:54.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:54 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T00:52:54.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:54 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:52:54.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:54 smithi002 ceph-mon[31210]: Standby manager daemon y restarted 2024-09-12T00:52:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:54 smithi002 ceph-mon[31210]: Standby manager daemon y started 2024-09-12T00:52:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:54 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T00:52:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:54 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:52:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:54 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T00:52:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:54 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:52:54.787 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 00:52:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z[37026]: 2024-09-12T00:52:54.486+0000 7f015ab77040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T00:52:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:54 smithi167 ceph-mon[35234]: Standby manager daemon y restarted 2024-09-12T00:52:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:54 smithi167 ceph-mon[35234]: Standby manager daemon y started 2024-09-12T00:52:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:54 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T00:52:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:54 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:52:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:54 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T00:52:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:54 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.71:0/3233957469' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:52:54.852 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T00:52:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T00:52:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:54.926 INFO:teuthology.orchestra.run.smithi002.stdout:client24838 2024-09-12T00:52:54.927 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:52:54.927 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T00:52:54.946 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T00:52:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T00:52:55.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:client24838 2024-09-12T00:52:55.073 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T00:52:55.117 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:54.826+0000 7f0f339ce040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T00:52:55.117 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.116+0000 7f0e9b2e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T00:52:55.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:55.146 INFO:teuthology.orchestra.run.smithi002.stdout:client24838 2024-09-12T00:52:55.146 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c8315cee-709f-11ef-bcea-c7b262605968.client24838/status') 2024-09-12T00:52:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T00:52:55.209 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.24838 (3)172.21.15.2:0/399905516 2024-09-12T00:52:55.209 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2024-09-12T00:52:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2024-09-12T00:52:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2024-09-12T00:52:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:69 bytes copied, 2.588e-05 s, 2.7 MB/s 2024-09-12T00:52:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T00:52:55.217 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T00:52:55.230 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T00:52:55.230 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T00:52:55.230 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 -- 172.21.15.2:0/1707315094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c101c30 msgr2=0x7f501c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 --2- 172.21.15.2:0/1707315094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c101c30 0x7f501c1020b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5004009900 tx=0x7f500402a410 comp rx=0 tx=0).stop 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 -- 172.21.15.2:0/1707315094 shutdown_connections 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 --2- 172.21.15.2:0/1707315094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f501c1025f0 0x7f501c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 --2- 172.21.15.2:0/1707315094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c101c30 0x7f501c1020b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 --2- 172.21.15.2:0/1707315094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501c100a40 0x7f501c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 -- 172.21.15.2:0/1707315094 >> 172.21.15.2:0/1707315094 conn(0x7f501c0fc1c0 msgr2=0x7f501c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 -- 172.21.15.2:0/1707315094 shutdown_connections 2024-09-12T00:52:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.339+0000 7f502130a640 1 -- 172.21.15.2:0/1707315094 wait complete. 2024-09-12T00:52:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f502130a640 1 Processor -- start 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f502130a640 1 -- start start 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f502130a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501c100a40 0x7f501c197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f502130a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f501c101c30 0x7f501c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f502130a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1025f0 0x7f501c19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f502130a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f501c10d810 con 0x7f501c1025f0 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f502130a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f501c10d690 con 0x7f501c101c30 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f502130a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f501c10d990 con 0x7f501c100a40 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f501b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1025f0 0x7f501c19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.340+0000 7f501b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1025f0 0x7f501c19f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53830/0 (socket says 172.21.15.2:53830) 2024-09-12T00:52:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f501b7fe640 1 -- 172.21.15.2:0/240172287 learned_addr learned my addr 172.21.15.2:0/240172287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f501affd640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501c100a40 0x7f501c197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f5013fff640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f501c101c30 0x7f501c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f501b7fe640 1 -- 172.21.15.2:0/240172287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501c100a40 msgr2=0x7f501c197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f501b7fe640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501c100a40 0x7f501c197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f501b7fe640 1 -- 172.21.15.2:0/240172287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f501c101c30 msgr2=0x7f501c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f501b7fe640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f501c101c30 0x7f501c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f501b7fe640 1 -- 172.21.15.2:0/240172287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c19faa0 con 0x7f501c1025f0 2024-09-12T00:52:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f501b7fe640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1025f0 0x7f501c19f430 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f501400eaa0 tx=0x7f501400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f5018ff9640 1 -- 172.21.15.2:0/240172287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501400cdb0 con 0x7f501c1025f0 2024-09-12T00:52:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f5018ff9640 1 -- 172.21.15.2:0/240172287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5014005020 con 0x7f501c1025f0 2024-09-12T00:52:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c19fd90 con 0x7f501c1025f0 2024-09-12T00:52:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f5018ff9640 1 -- 172.21.15.2:0/240172287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50140116b0 con 0x7f501c1025f0 2024-09-12T00:52:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.341+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c1a0200 con 0x7f501c1025f0 2024-09-12T00:52:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.342+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c107e80 con 0x7f501c1025f0 2024-09-12T00:52:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.344+0000 7f5018ff9640 1 -- 172.21.15.2:0/240172287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f5014005560 con 0x7f501c1025f0 2024-09-12T00:52:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.345+0000 7f5018ff9640 1 -- 172.21.15.2:0/240172287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f50140cf130 con 0x7f501c1025f0 2024-09-12T00:52:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.348+0000 7f5018ff9640 1 -- 172.21.15.2:0/240172287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5014016030 con 0x7f501c1025f0 2024-09-12T00:52:55.420 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.116+0000 7f0e9b2e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.420 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.116+0000 7f0e9b2e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.421 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.116+0000 7f0e9b2e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.421 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.116+0000 7f0e9b2e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.421 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.118+0000 7f0e9dae5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.421 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.118+0000 7f0e9dae5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.421 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.118+0000 7f0e9dae5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.421 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.118+0000 7f0e9dae5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.421 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:55.118+0000 7f0e9dae5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:55.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.571+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f501c02d7c0 con 0x7f501c1025f0 2024-09-12T00:52:55.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T00:52:55.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: Standby manager daemon z restarted 2024-09-12T00:52:55.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: Standby manager daemon z started 2024-09-12T00:52:55.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: Active manager daemon x restarted 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: Activating manager daemon x 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: mgrmap e20: x(active, starting, since 0.0129081s), standbys: z, y 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T00:52:55.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T00:52:55.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:52:55.748 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T00:52:55.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T00:52:55.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T00:52:55.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: Manager daemon x is now available 2024-09-12T00:52:55.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:55.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T00:52:55.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:55 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T00:52:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T00:52:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: Standby manager daemon z restarted 2024-09-12T00:52:55.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: Standby manager daemon z started 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: Active manager daemon x restarted 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: Activating manager daemon x 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: mgrmap e20: x(active, starting, since 0.0129081s), standbys: z, y 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:52:55.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T00:52:55.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:52:55.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T00:52:55.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T00:52:55.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T00:52:55.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: Manager daemon x is now available 2024-09-12T00:52:55.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:55.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T00:52:55.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:55 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T00:52:55.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.846+0000 7f5018ff9640 1 -- 172.21.15.2:0/240172287 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f5014097a20 con 0x7f501c1025f0 2024-09-12T00:52:55.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.847+0000 7f5018ff9640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f50080a9aa0 0x7f50080abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:55.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.849+0000 7f501affd640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f50080a9aa0 0x7f50080abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:55.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:55.852+0000 7f501affd640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f50080a9aa0 0x7f50080abe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f501c101a90 tx=0x7f500c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:55.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T00:52:55.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: Standby manager daemon z restarted 2024-09-12T00:52:55.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: Standby manager daemon z started 2024-09-12T00:52:55.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T00:52:55.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.? 172.21.15.167:0/3254125090' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: Active manager daemon x restarted 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: Activating manager daemon x 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: mgrmap e20: x(active, starting, since 0.0129081s), standbys: z, y 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T00:52:55.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:52:55.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:52:55.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:52:55.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T00:52:55.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T00:52:55.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T00:52:55.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T00:52:55.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T00:52:55.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T00:52:55.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: Manager daemon x is now available 2024-09-12T00:52:55.947 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:55.947 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T00:52:55.947 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:55 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T00:52:56.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.470+0000 7f5018ff9640 1 -- 172.21.15.2:0/240172287 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f5014094a60 con 0x7f501c1025f0 2024-09-12T00:52:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f50080a9aa0 msgr2=0x7f50080abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f50080a9aa0 0x7f50080abe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f501c101a90 tx=0x7f500c005f90 comp rx=0 tx=0).stop 2024-09-12T00:52:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1025f0 msgr2=0x7f501c19f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1025f0 0x7f501c19f430 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f501400eaa0 tx=0x7f501400ef60 comp rx=0 tx=0).stop 2024-09-12T00:52:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 shutdown_connections 2024-09-12T00:52:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f50080a9aa0 0x7f50080abe90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1025f0 0x7f501c19f430 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f501c101c30 0x7f501c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 --2- 172.21.15.2:0/240172287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501c100a40 0x7f501c197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 >> 172.21.15.2:0/240172287 conn(0x7f501c0fc1c0 msgr2=0x7f501c105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:56.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.472+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 shutdown_connections 2024-09-12T00:52:56.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.473+0000 7f502130a640 1 -- 172.21.15.2:0/240172287 wait complete. 2024-09-12T00:52:56.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-12T00:52:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 -- 172.21.15.2:0/361601509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204103780 msgr2=0x7fd20410a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 --2- 172.21.15.2:0/361601509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204103780 0x7fd20410a010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009ca0 tx=0x7fd1fc02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 -- 172.21.15.2:0/361601509 shutdown_connections 2024-09-12T00:52:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 --2- 172.21.15.2:0/361601509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204103780 0x7fd20410a010 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 --2- 172.21.15.2:0/361601509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd204102dc0 0x7fd204103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 --2- 172.21.15.2:0/361601509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2040ffdf0 0x7fd2041001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 -- 172.21.15.2:0/361601509 >> 172.21.15.2:0/361601509 conn(0x7fd2040fb930 msgr2=0x7fd2040fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 -- 172.21.15.2:0/361601509 shutdown_connections 2024-09-12T00:52:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.596+0000 7fd20c78d640 1 -- 172.21.15.2:0/361601509 wait complete. 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20c78d640 1 Processor -- start 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20c78d640 1 -- start start 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20c78d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2040ffdf0 0x7fd204197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20c78d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204102dc0 0x7fd204198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20c78d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd204103780 0x7fd20419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20c78d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd20410d7a0 con 0x7fd204102dc0 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20c78d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd20410d620 con 0x7fd204103780 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20c78d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd20410d920 con 0x7fd2040ffdf0 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd209d28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204102dc0 0x7fd204198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20a529640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2040ffdf0 0x7fd204197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20a529640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2040ffdf0 0x7fd204197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52576/0 (socket says 172.21.15.2:52576) 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd209d28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204102dc0 0x7fd204198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45162/0 (socket says 172.21.15.2:45162) 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20ad2a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd204103780 0x7fd20419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.597+0000 7fd20a529640 1 -- 172.21.15.2:0/339521443 learned_addr learned my addr 172.21.15.2:0/339521443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd209d28640 1 -- 172.21.15.2:0/339521443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2040ffdf0 msgr2=0x7fd204197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd209d28640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2040ffdf0 0x7fd204197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd209d28640 1 -- 172.21.15.2:0/339521443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd204103780 msgr2=0x7fd20419f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd209d28640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd204103780 0x7fd20419f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd209d28640 1 -- 172.21.15.2:0/339521443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20419f9d0 con 0x7fd204102dc0 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd20a529640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2040ffdf0 0x7fd204197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd20ad2a640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd204103780 0x7fd20419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd209d28640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204102dc0 0x7fd204198300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400c970 tx=0x7fd1f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd1fb7fe640 1 -- 172.21.15.2:0/339521443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4007bb0 con 0x7fd204102dc0 2024-09-12T00:52:56.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20419fcc0 con 0x7fd204102dc0 2024-09-12T00:52:56.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd1fb7fe640 1 -- 172.21.15.2:0/339521443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f4007d50 con 0x7fd204102dc0 2024-09-12T00:52:56.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd1fb7fe640 1 -- 172.21.15.2:0/339521443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4018820 con 0x7fd204102dc0 2024-09-12T00:52:56.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.598+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2041a01b0 con 0x7fd204102dc0 2024-09-12T00:52:56.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.599+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd204108fc0 con 0x7fd204102dc0 2024-09-12T00:52:56.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.602+0000 7fd1fb7fe640 1 -- 172.21.15.2:0/339521443 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fd1f40189c0 con 0x7fd204102dc0 2024-09-12T00:52:56.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.603+0000 7fd1fb7fe640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd1f00a2970 0x7fd1f00a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:56.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.603+0000 7fd20a529640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd1f00a2970 0x7fd1f00a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:56.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.603+0000 7fd1fb7fe640 1 -- 172.21.15.2:0/339521443 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd1f40cf120 con 0x7fd204102dc0 2024-09-12T00:52:56.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.604+0000 7fd20a529640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd1f00a2970 0x7fd1f00a4e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd204199290 tx=0x7fd200005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:56.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.605+0000 7fd1fb7fe640 1 -- 172.21.15.2:0/339521443 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1f4014030 con 0x7fd204102dc0 2024-09-12T00:52:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/240172287' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T00:52:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-mon[31210]: mgrmap e21: x(active, since 1.01899s), standbys: z, y 2024-09-12T00:52:56.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:56 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/240172287' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T00:52:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:56 smithi167 ceph-mon[35234]: mgrmap e21: x(active, since 1.01899s), standbys: z, y 2024-09-12T00:52:56.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.837+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fd2040626d0 con 0x7fd1f00a2970 2024-09-12T00:52:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.855+0000 7fd1fb7fe640 1 -- 172.21.15.2:0/339521443 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fd2040626d0 con 0x7fd1f00a2970 2024-09-12T00:52:56.855 INFO:teuthology.orchestra.run.smithi002.stdout:{} 2024-09-12T00:52:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd1f00a2970 msgr2=0x7fd1f00a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd1f00a2970 0x7fd1f00a4e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd204199290 tx=0x7fd200005f90 comp rx=0 tx=0).stop 2024-09-12T00:52:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204102dc0 msgr2=0x7fd204198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204102dc0 0x7fd204198300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400c970 tx=0x7fd1f400ce30 comp rx=0 tx=0).stop 2024-09-12T00:52:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 shutdown_connections 2024-09-12T00:52:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd1f00a2970 0x7fd1f00a4e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd204103780 0x7fd20419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd204102dc0 0x7fd204198300 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 --2- 172.21.15.2:0/339521443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2040ffdf0 0x7fd204197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 >> 172.21.15.2:0/339521443 conn(0x7fd2040fb930 msgr2=0x7fd204106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 shutdown_connections 2024-09-12T00:52:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:56.857+0000 7fd20c78d640 1 -- 172.21.15.2:0/339521443 wait complete. 2024-09-12T00:52:56.869 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T00:52:56.905 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T00:52:56.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:52:56.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:56 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/240172287' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T00:52:56.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:56 smithi071 ceph-mon[35276]: mgrmap e21: x(active, since 1.01899s), standbys: z, y 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 -- 172.21.15.2:0/3485571156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66d4104f00 msgr2=0x7f66d41072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 --2- 172.21.15.2:0/3485571156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66d4104f00 0x7f66d41072f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009900 tx=0x7f66c802a410 comp rx=0 tx=0).stop 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 -- 172.21.15.2:0/3485571156 shutdown_connections 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 --2- 172.21.15.2:0/3485571156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66d4107830 0x7f66d4109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 --2- 172.21.15.2:0/3485571156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66d4104f00 0x7f66d41072f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 --2- 172.21.15.2:0/3485571156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d41025d0 0x7f66d41049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 -- 172.21.15.2:0/3485571156 >> 172.21.15.2:0/3485571156 conn(0x7f66d40fc1f0 msgr2=0x7f66d40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 -- 172.21.15.2:0/3485571156 shutdown_connections 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.045+0000 7f66da445640 1 -- 172.21.15.2:0/3485571156 wait complete. 2024-09-12T00:52:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66da445640 1 Processor -- start 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66da445640 1 -- start start 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66da445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66d41025d0 0x7f66d4197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66da445640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66d4104f00 0x7f66d4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66da445640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4107830 0x7f66d419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66da445640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410d850 con 0x7f66d41025d0 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66da445640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410d6d0 con 0x7f66d4104f00 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66da445640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410d9d0 con 0x7f66d4107830 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66d41025d0 0x7f66d4197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66d41025d0 0x7f66d4197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45222/0 (socket says 172.21.15.2:45222) 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66d3fff640 1 -- 172.21.15.2:0/2257941358 learned_addr learned my addr 172.21.15.2:0/2257941358 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66d37fe640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66d4104f00 0x7f66d4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.046+0000 7f66d89e2640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4107830 0x7f66d419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d3fff640 1 -- 172.21.15.2:0/2257941358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4107830 msgr2=0x7f66d419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d3fff640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4107830 0x7f66d419f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d3fff640 1 -- 172.21.15.2:0/2257941358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66d4104f00 msgr2=0x7f66d4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d3fff640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66d4104f00 0x7f66d4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d3fff640 1 -- 172.21.15.2:0/2257941358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d419fb20 con 0x7f66d41025d0 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d3fff640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66d41025d0 0x7f66d4197f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66c400e9f0 tx=0x7f66c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d17fa640 1 -- 172.21.15.2:0/2257941358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c400ccc0 con 0x7f66d41025d0 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d17fa640 1 -- 172.21.15.2:0/2257941358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66c400ce60 con 0x7f66d41025d0 2024-09-12T00:52:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d419fe10 con 0x7f66d41025d0 2024-09-12T00:52:57.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66d17fa640 1 -- 172.21.15.2:0/2257941358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4010690 con 0x7f66d41025d0 2024-09-12T00:52:57.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.047+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d41a0210 con 0x7f66d41025d0 2024-09-12T00:52:57.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.048+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d40fdce0 con 0x7f66d41025d0 2024-09-12T00:52:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.050+0000 7f66d17fa640 1 -- 172.21.15.2:0/2257941358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f66c40046c0 con 0x7f66d41025d0 2024-09-12T00:52:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.050+0000 7f66d17fa640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f66bc0a2990 0x7f66bc0a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.051+0000 7f66d17fa640 1 -- 172.21.15.2:0/2257941358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f66c40cf310 con 0x7f66d41025d0 2024-09-12T00:52:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.051+0000 7f66d37fe640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f66bc0a2990 0x7f66bc0a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.051+0000 7f66d37fe640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f66bc0a2990 0x7f66bc0a4e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66c802aa00 tx=0x7f66c80315b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.054+0000 7f66d17fa640 1 -- 172.21.15.2:0/2257941358 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66c40541b0 con 0x7f66d41025d0 2024-09-12T00:52:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.233+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66d4062e90 con 0x7f66d41025d0 2024-09-12T00:52:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.235+0000 7f66d17fa640 1 -- 172.21.15.2:0/2257941358 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+23181 (secure 0 0 0) 0x7f66c409c3b0 con 0x7f66d41025d0 2024-09-12T00:52:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:57.235 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":84,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:52:54.829249+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/761407779":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3529963366":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/838113285":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/17217547":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6800/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/780422410":"2024-09-13T00:52:54.829221+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f66bc0a2990 msgr2=0x7f66bc0a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f66bc0a2990 0x7f66bc0a4e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66c802aa00 tx=0x7f66c80315b0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66d41025d0 msgr2=0x7f66d4197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66d41025d0 0x7f66d4197f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66c400e9f0 tx=0x7f66c400edf0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 shutdown_connections 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f66bc0a2990 0x7f66bc0a4e50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4107830 0x7f66d419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66d4104f00 0x7f66d4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 --2- 172.21.15.2:0/2257941358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66d41025d0 0x7f66d4197f00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 >> 172.21.15.2:0/2257941358 conn(0x7f66d40fc1f0 msgr2=0x7f66d4102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 shutdown_connections 2024-09-12T00:52:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.237+0000 7f66da445640 1 -- 172.21.15.2:0/2257941358 wait complete. 2024-09-12T00:52:57.245 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:56.810+0000 7f0e87239640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:00:52:56] ENGINE Error in HTTPServer.serve 2024-09-12T00:52:57.245 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: Traceback (most recent call last): 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._connections.run(self.expiration_interval) 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._run(expiration_interval) 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: s = self.context.wrap_socket( 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: return self.sslsocket_class._create( 2024-09-12T00:52:57.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self.do_handshake() 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: self._sslobj.do_handshake() 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:56.842+0000 7f0e982da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:56.842+0000 7f0e982da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:56.842+0000 7f0e982da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:56.842+0000 7f0e982da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:57.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:52:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:52:56.842+0000 7f0e982da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:52:57.248 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T00:46:35.272846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T00:51:07.745388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T00:51:09.978808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T00:52:57.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T00:52:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 -- 172.21.15.2:0/3931667252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 msgr2=0x7f71e01049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 --2- 172.21.15.2:0/3931667252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 0x7f71e01049c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009900 tx=0x7f71d002a410 comp rx=0 tx=0).stop 2024-09-12T00:52:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 -- 172.21.15.2:0/3931667252 shutdown_connections 2024-09-12T00:52:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 --2- 172.21.15.2:0/3931667252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e0107830 0x7f71e0109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 --2- 172.21.15.2:0/3931667252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71e0104f00 0x7f71e01072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 --2- 172.21.15.2:0/3931667252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 0x7f71e01049c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 -- 172.21.15.2:0/3931667252 >> 172.21.15.2:0/3931667252 conn(0x7f71e00fc190 msgr2=0x7f71e00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 -- 172.21.15.2:0/3931667252 shutdown_connections 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.361+0000 7f71e658d640 1 -- 172.21.15.2:0/3931667252 wait complete. 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71e658d640 1 Processor -- start 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71e658d640 1 -- start start 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71e658d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 0x7f71e0101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71e658d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71e0104f00 0x7f71e0100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71e658d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e0107830 0x7f71e0100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71e658d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f71e010d830 con 0x7f71e01025d0 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71e658d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71e010d6b0 con 0x7f71e0107830 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71e658d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71e010d9b0 con 0x7f71e0104f00 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 0x7f71e0101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 0x7f71e0101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45232/0 (socket says 172.21.15.2:45232) 2024-09-12T00:52:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.362+0000 7f71dffff640 1 -- 172.21.15.2:0/1334523094 learned_addr learned my addr 172.21.15.2:0/1334523094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71df7fe640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71e0104f00 0x7f71e0100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71e4b2a640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e0107830 0x7f71e0100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dffff640 1 -- 172.21.15.2:0/1334523094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71e0104f00 msgr2=0x7f71e0100580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dffff640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71e0104f00 0x7f71e0100580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dffff640 1 -- 172.21.15.2:0/1334523094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e0107830 msgr2=0x7f71e0100ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dffff640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e0107830 0x7f71e0100ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dffff640 1 -- 172.21.15.2:0/1334523094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e0101350 con 0x7f71e01025d0 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dffff640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 0x7f71e0101f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71d0005940 tx=0x7f71d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dd7fa640 1 -- 172.21.15.2:0/1334523094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d003f030 con 0x7f71e01025d0 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dd7fa640 1 -- 172.21.15.2:0/1334523094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71d0003ce0 con 0x7f71e01025d0 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e01a2040 con 0x7f71e01025d0 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71dd7fa640 1 -- 172.21.15.2:0/1334523094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0035070 con 0x7f71e01025d0 2024-09-12T00:52:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.363+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e01a2560 con 0x7f71e01025d0 2024-09-12T00:52:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.364+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e00fdc80 con 0x7f71e01025d0 2024-09-12T00:52:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.366+0000 7f71dd7fa640 1 -- 172.21.15.2:0/1334523094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f71d0042030 con 0x7f71e01025d0 2024-09-12T00:52:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.367+0000 7f71dd7fa640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f71c80a2990 0x7f71c80a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.367+0000 7f71df7fe640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f71c80a2990 0x7f71c80a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.367+0000 7f71dd7fa640 1 -- 172.21.15.2:0/1334523094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f71d00ef0e0 con 0x7f71e01025d0 2024-09-12T00:52:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.367+0000 7f71df7fe640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f71c80a2990 0x7f71c80a4e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71e0101cb0 tx=0x7f71d4005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.371+0000 7f71dd7fa640 1 -- 172.21.15.2:0/1334523094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71d00bbc40 con 0x7f71e01025d0 2024-09-12T00:52:57.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.488+0000 7f71dd7fa640 1 -- 172.21.15.2:0/1334523094 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 22) ==== 137952+0+0 (secure 0 0 0) 0x7f71d0003800 con 0x7f71e01025d0 2024-09-12T00:52:57.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.577+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f71e0062df0 con 0x7f71e01025d0 2024-09-12T00:52:57.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.578+0000 7f71dd7fa640 1 -- 172.21.15.2:0/1334523094 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f71d0072010 con 0x7f71e01025d0 2024-09-12T00:52:57.578 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-12T00:52:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f71c80a2990 msgr2=0x7f71c80a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f71c80a2990 0x7f71c80a4e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71e0101cb0 tx=0x7f71d4005f90 comp rx=0 tx=0).stop 2024-09-12T00:52:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 msgr2=0x7f71e0101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 0x7f71e0101f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71d0005940 tx=0x7f71d00042f0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 shutdown_connections 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f71c80a2990 0x7f71c80a4e50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e0107830 0x7f71e0100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71e0104f00 0x7f71e0100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 --2- 172.21.15.2:0/1334523094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e01025d0 0x7f71e0101f40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 >> 172.21.15.2:0/1334523094 conn(0x7f71e00fc190 msgr2=0x7f71e0102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 shutdown_connections 2024-09-12T00:52:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.580+0000 7f71e658d640 1 -- 172.21.15.2:0/1334523094 wait complete. 2024-09-12T00:52:57.590 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/240172287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: [12/Sep/2024:00:52:56] ENGINE Bus STARTING 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.591 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:57 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2257941358' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:57.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T00:52:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 -- 172.21.15.2:0/1522018817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c102d50 msgr2=0x7f2c7c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 --2- 172.21.15.2:0/1522018817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c102d50 0x7f2c7c1031d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009900 tx=0x7f2c6c02a410 comp rx=0 tx=0).stop 2024-09-12T00:52:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 -- 172.21.15.2:0/1522018817 shutdown_connections 2024-09-12T00:52:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 --2- 172.21.15.2:0/1522018817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7c103710 0x7f2c7c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 --2- 172.21.15.2:0/1522018817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c102d50 0x7f2c7c1031d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 --2- 172.21.15.2:0/1522018817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c7c101b60 0x7f2c7c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 -- 172.21.15.2:0/1522018817 >> 172.21.15.2:0/1522018817 conn(0x7f2c7c0fd2e0 msgr2=0x7f2c7c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 -- 172.21.15.2:0/1522018817 shutdown_connections 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.701+0000 7f2c83aba640 1 -- 172.21.15.2:0/1522018817 wait complete. 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c83aba640 1 Processor -- start 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c83aba640 1 -- start start 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c83aba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c101b60 0x7f2c7c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c83aba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7c102d50 0x7f2c7c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c83aba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c7c103710 0x7f2c7c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c83aba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c10d7c0 con 0x7f2c7c101b60 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c83aba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c10d640 con 0x7f2c7c102d50 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c83aba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c10d940 con 0x7f2c7c103710 2024-09-12T00:52:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c81856640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c101b60 0x7f2c7c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c81856640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c101b60 0x7f2c7c075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45258/0 (socket says 172.21.15.2:45258) 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.702+0000 7f2c81856640 1 -- 172.21.15.2:0/155813650 learned_addr learned my addr 172.21.15.2:0/155813650 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c81055640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7c102d50 0x7f2c7c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c82057640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c7c103710 0x7f2c7c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c81856640 1 -- 172.21.15.2:0/155813650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c7c103710 msgr2=0x7f2c7c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c81856640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c7c103710 0x7f2c7c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c81856640 1 -- 172.21.15.2:0/155813650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7c102d50 msgr2=0x7f2c7c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c81856640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7c102d50 0x7f2c7c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c81856640 1 -- 172.21.15.2:0/155813650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7c0753b0 con 0x7f2c7c101b60 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c82057640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c7c103710 0x7f2c7c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:52:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c81856640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c101b60 0x7f2c7c075fa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800d770 tx=0x7f2c7800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c72ffd640 1 -- 172.21.15.2:0/155813650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78017070 con 0x7f2c7c101b60 2024-09-12T00:52:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c72ffd640 1 -- 172.21.15.2:0/155813650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c78009c30 con 0x7f2c7c101b60 2024-09-12T00:52:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7c1a1f90 con 0x7f2c7c101b60 2024-09-12T00:52:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c72ffd640 1 -- 172.21.15.2:0/155813650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78003dd0 con 0x7f2c7c101b60 2024-09-12T00:52:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.703+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c7c1a2390 con 0x7f2c7c101b60 2024-09-12T00:52:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.704+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c7c108ff0 con 0x7f2c7c101b60 2024-09-12T00:52:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.706+0000 7f2c72ffd640 1 -- 172.21.15.2:0/155813650 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 137952+0+0 (secure 0 0 0) 0x7f2c78003f90 con 0x7f2c7c101b60 2024-09-12T00:52:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.706+0000 7f2c72ffd640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2c680a2d00 0x7f2c680a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.707+0000 7f2c81055640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2c680a2d00 0x7f2c680a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.707+0000 7f2c72ffd640 1 -- 172.21.15.2:0/155813650 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2c780cf1d0 con 0x7f2c7c101b60 2024-09-12T00:52:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.707+0000 7f2c81055640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2c680a2d00 0x7f2c680a51c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0314e0 tx=0x7f2c6c000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:57.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.710+0000 7f2c72ffd640 1 -- 172.21.15.2:0/155813650 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c78009de0 con 0x7f2c7c101b60 2024-09-12T00:52:57.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/240172287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T00:52:57.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:52:57.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: [12/Sep/2024:00:52:56] ENGINE Bus STARTING 2024-09-12T00:52:57.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:57 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2257941358' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.889+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2c7c02da70 con 0x7f2c7c101b60 2024-09-12T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.890+0000 7f2c72ffd640 1 -- 172.21.15.2:0/155813650 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f2c7809bd80 con 0x7f2c7c101b60 2024-09-12T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-12T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2c680a2d00 msgr2=0x7f2c680a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2c680a2d00 0x7f2c680a51c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0314e0 tx=0x7f2c6c000bc0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c101b60 msgr2=0x7f2c7c075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c101b60 0x7f2c7c075fa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800d770 tx=0x7f2c7800dc30 comp rx=0 tx=0).stop 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 shutdown_connections 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2c680a2d00 0x7f2c680a51c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c7c103710 0x7f2c7c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c7c102d50 0x7f2c7c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 --2- 172.21.15.2:0/155813650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c7c101b60 0x7f2c7c075fa0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 >> 172.21.15.2:0/155813650 conn(0x7f2c7c0fd2e0 msgr2=0x7f2c7c1061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 shutdown_connections 2024-09-12T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:57.892+0000 7f2c83aba640 1 -- 172.21.15.2:0/155813650 wait complete. 2024-09-12T00:52:57.903 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T00:52:57.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/240172287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T00:52:57.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:52:57.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: [12/Sep/2024:00:52:56] ENGINE Bus STARTING 2024-09-12T00:52:57.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:57.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:57 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2257941358' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.013+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/2864515451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4100a30 msgr2=0x7f3dc4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.013+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/2864515451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4100a30 0x7f3dc4100e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc002a410 comp rx=0 tx=0).stop 2024-09-12T00:52:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.014+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/2864515451 shutdown_connections 2024-09-12T00:52:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.014+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/2864515451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dc41025e0 0x7f3dc4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.014+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/2864515451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc4101c20 0x7f3dc41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.014+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/2864515451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4100a30 0x7f3dc4100e30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.014+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/2864515451 >> 172.21.15.2:0/2864515451 conn(0x7f3dc40fc1b0 msgr2=0x7f3dc40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.014+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/2864515451 shutdown_connections 2024-09-12T00:52:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.014+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/2864515451 wait complete. 2024-09-12T00:52:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.014+0000 7f3dcc1c4640 1 Processor -- start 2024-09-12T00:52:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dcc1c4640 1 -- start start 2024-09-12T00:52:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dcc1c4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc4100a30 0x7f3dc406aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dcc1c4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4101c20 0x7f3dc419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dcc1c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dc41025e0 0x7f3dc419f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dcc1c4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc410c6b0 con 0x7f3dc4101c20 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dcc1c4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc410c530 con 0x7f3dc4100a30 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dcc1c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc410c830 con 0x7f3dc41025e0 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4101c20 0x7f3dc419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4101c20 0x7f3dc419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45274/0 (socket says 172.21.15.2:45274) 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 -- 172.21.15.2:0/3665822027 learned_addr learned my addr 172.21.15.2:0/3665822027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc9f60640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc4100a30 0x7f3dc406aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dca761640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dc41025e0 0x7f3dc419f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 -- 172.21.15.2:0/3665822027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dc41025e0 msgr2=0x7f3dc419f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dc41025e0 0x7f3dc419f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 -- 172.21.15.2:0/3665822027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc4100a30 msgr2=0x7f3dc406aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc4100a30 0x7f3dc406aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 -- 172.21.15.2:0/3665822027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc419fb40 con 0x7f3dc4101c20 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc9f60640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc4100a30 0x7f3dc406aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.015+0000 7f3dc975f640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4101c20 0x7f3dc419cc10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3db400e9f0 tx=0x7f3db400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.016+0000 7f3dbaffd640 1 -- 172.21.15.2:0/3665822027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db400cd80 con 0x7f3dc4101c20 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.016+0000 7f3dbaffd640 1 -- 172.21.15.2:0/3665822027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db4010910 con 0x7f3dc4101c20 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.016+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc419fdd0 con 0x7f3dc4101c20 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.016+0000 7f3dbaffd640 1 -- 172.21.15.2:0/3665822027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4018990 con 0x7f3dc4101c20 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.016+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc41a0290 con 0x7f3dc4101c20 2024-09-12T00:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.017+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc4107ec0 con 0x7f3dc4101c20 2024-09-12T00:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.019+0000 7f3dbaffd640 1 -- 172.21.15.2:0/3665822027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 137952+0+0 (secure 0 0 0) 0x7f3db4010ac0 con 0x7f3dc4101c20 2024-09-12T00:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.019+0000 7f3dbaffd640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3db00a2d00 0x7f3db00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.019+0000 7f3dbaffd640 1 -- 172.21.15.2:0/3665822027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f3db40cfb70 con 0x7f3dc4101c20 2024-09-12T00:52:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.019+0000 7f3dc9f60640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3db00a2d00 0x7f3db00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.020+0000 7f3dc9f60640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3db00a2d00 0x7f3db00a51c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0005ab0 tx=0x7f3dc0000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.024+0000 7f3dbaffd640 1 -- 172.21.15.2:0/3665822027 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3db409c0f0 con 0x7f3dc4101c20 2024-09-12T00:52:58.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.204+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3dc402da10 con 0x7f3dc4101c20 2024-09-12T00:52:58.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.205+0000 7f3dbaffd640 1 -- 172.21.15.2:0/3665822027 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f3db40a03f0 con 0x7f3dc4101c20 2024-09-12T00:52:58.205 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-12T00:52:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3db00a2d00 msgr2=0x7f3db00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3db00a2d00 0x7f3db00a51c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0005ab0 tx=0x7f3dc0000bc0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4101c20 msgr2=0x7f3dc419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4101c20 0x7f3dc419cc10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3db400e9f0 tx=0x7f3db400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 shutdown_connections 2024-09-12T00:52:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3db00a2d00 0x7f3db00a51c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dc41025e0 0x7f3dc419f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dc4101c20 0x7f3dc419cc10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 --2- 172.21.15.2:0/3665822027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc4100a30 0x7f3dc406aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 >> 172.21.15.2:0/3665822027 conn(0x7f3dc40fc1b0 msgr2=0x7f3dc4105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 shutdown_connections 2024-09-12T00:52:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:58.207+0000 7f3dcc1c4640 1 -- 172.21.15.2:0/3665822027 wait complete. 2024-09-12T00:52:58.218 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T00:52:58.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:52:58.506 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:52:58.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: [12/Sep/2024:00:52:56] ENGINE Serving on https://172.21.15.2:7150 2024-09-12T00:52:58.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: [12/Sep/2024:00:52:56] ENGINE Error in HTTPServer.serve 2024-09-12T00:52:58.734 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-12T00:52:58.734 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T00:52:58.734 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-12T00:52:58.734 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T00:52:58.734 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-12T00:52:58.734 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T00:52:58.735 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: [12/Sep/2024:00:52:56] ENGINE Serving on http://172.21.15.2:8765 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: [12/Sep/2024:00:52:56] ENGINE Bus STARTED 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: Unable to set osd_memory_target on smithi167 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1334523094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:58.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:58.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/155813650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:52:58.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:58 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3665822027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:52:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: [12/Sep/2024:00:52:56] ENGINE Serving on https://172.21.15.2:7150 2024-09-12T00:52:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: [12/Sep/2024:00:52:56] ENGINE Error in HTTPServer.serve 2024-09-12T00:52:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout: Traceback (most recent call last): 2024-09-12T00:52:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T00:52:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout: self._connections.run(self.expiration_interval) 2024-09-12T00:52:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T00:52:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout: self._run(expiration_interval) 2024-09-12T00:52:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: s = self.context.wrap_socket( 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: return self.sslsocket_class._create( 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: self.do_handshake() 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: self._sslobj.do_handshake() 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T00:52:58.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: [12/Sep/2024:00:52:56] ENGINE Serving on http://172.21.15.2:8765 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: [12/Sep/2024:00:52:56] ENGINE Bus STARTED 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-12T00:52:58.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: Unable to set osd_memory_target on smithi167 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1334523094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.790 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:58.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:58.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/155813650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:52:58.791 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:58 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3665822027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: [12/Sep/2024:00:52:56] ENGINE Serving on https://172.21.15.2:7150 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: [12/Sep/2024:00:52:56] ENGINE Error in HTTPServer.serve 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: Traceback (most recent call last): 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: self._run(expiration_interval) 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T00:52:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout: s = self.context.wrap_socket( 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout: return self.sslsocket_class._create( 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout: self.do_handshake() 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout: self._sslobj.do_handshake() 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: [12/Sep/2024:00:52:56] ENGINE Serving on http://172.21.15.2:8765 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: [12/Sep/2024:00:52:56] ENGINE Bus STARTED 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-12T00:52:58.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: Unable to set osd_memory_target on smithi167 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1334523094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:52:58.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:58.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:58.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/155813650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:52:58.946 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:58 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3665822027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:52:59.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 -- 172.21.15.2:0/2224530734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050100a80 msgr2=0x7f2050100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 --2- 172.21.15.2:0/2224530734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050100a80 0x7f2050100ee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2040009930 tx=0x7f204002a420 comp rx=0 tx=0).stop 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 -- 172.21.15.2:0/2224530734 shutdown_connections 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 --2- 172.21.15.2:0/2224530734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2050101420 0x7f205010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 --2- 172.21.15.2:0/2224530734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050100a80 0x7f2050100ee0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 --2- 172.21.15.2:0/2224530734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2050106a80 0x7f2050106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 -- 172.21.15.2:0/2224530734 >> 172.21.15.2:0/2224530734 conn(0x7f20500fc7a0 msgr2=0x7f20500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 -- 172.21.15.2:0/2224530734 shutdown_connections 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.061+0000 7f2058782640 1 -- 172.21.15.2:0/2224530734 wait complete. 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2058782640 1 Processor -- start 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2058782640 1 -- start start 2024-09-12T00:52:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2058782640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2050100a80 0x7f2050198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2058782640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2050101420 0x7f2050198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2058782640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050106a80 0x7f205019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2058782640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2050110e90 con 0x7f2050106a80 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2058782640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2050110d10 con 0x7f2050100a80 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2058782640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2050111010 con 0x7f2050101420 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2056d1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050106a80 0x7f205019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f205651e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2050100a80 0x7f2050198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2056d1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050106a80 0x7f205019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45280/0 (socket says 172.21.15.2:45280) 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.062+0000 7f2056d1f640 1 -- 172.21.15.2:0/3618864747 learned_addr learned my addr 172.21.15.2:0/3618864747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2055d1d640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2050101420 0x7f2050198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2056d1f640 1 -- 172.21.15.2:0/3618864747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2050101420 msgr2=0x7f2050198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2056d1f640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2050101420 0x7f2050198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2056d1f640 1 -- 172.21.15.2:0/3618864747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2050100a80 msgr2=0x7f2050198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2056d1f640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2050100a80 0x7f2050198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2056d1f640 1 -- 172.21.15.2:0/3618864747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205019d3f0 con 0x7f2050106a80 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f205651e640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2050100a80 0x7f2050198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2056d1f640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050106a80 0x7f205019cd10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f204800eb10 tx=0x7f204800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f20477fe640 1 -- 172.21.15.2:0/3618864747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048004b20 con 0x7f2050106a80 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f20477fe640 1 -- 172.21.15.2:0/3618864747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2048004cc0 con 0x7f2050106a80 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205019d6e0 con 0x7f2050106a80 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f20477fe640 1 -- 172.21.15.2:0/3618864747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048010760 con 0x7f2050106a80 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.063+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20501a4fc0 con 0x7f2050106a80 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.064+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2050100ee0 con 0x7f2050106a80 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.065+0000 7f20477fe640 1 -- 172.21.15.2:0/3618864747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 137952+0+0 (secure 0 0 0) 0x7f2048005020 con 0x7f2050106a80 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.066+0000 7f20477fe640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f203c0a2cf0 0x7f203c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.066+0000 7f205651e640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f203c0a2cf0 0x7f203c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:52:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.066+0000 7f20477fe640 1 -- 172.21.15.2:0/3618864747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f20480cfa20 con 0x7f2050106a80 2024-09-12T00:52:59.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.067+0000 7f205651e640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f203c0a2cf0 0x7f203c0a51b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f204c0058c0 tx=0x7f204c00a2d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:52:59.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.070+0000 7f20477fe640 1 -- 172.21.15.2:0/3618864747 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f204809c5f0 con 0x7f2050106a80 2024-09-12T00:52:59.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.280+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2050109a90 con 0x7f2050106a80 2024-09-12T00:52:59.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.281+0000 7f20477fe640 1 -- 172.21.15.2:0/3618864747 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f204809bef0 con 0x7f2050106a80 2024-09-12T00:52:59.281 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:52:59.281 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:52:59.282 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:52:59.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f203c0a2cf0 msgr2=0x7f203c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:59.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f203c0a2cf0 0x7f203c0a51b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f204c0058c0 tx=0x7f204c00a2d0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050106a80 msgr2=0x7f205019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:52:59.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050106a80 0x7f205019cd10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f204800eb10 tx=0x7f204800c2d0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 shutdown_connections 2024-09-12T00:52:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f203c0a2cf0 0x7f203c0a51b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2050106a80 0x7f205019cd10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2050101420 0x7f2050198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 --2- 172.21.15.2:0/3618864747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2050100a80 0x7f2050198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:52:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 >> 172.21.15.2:0/3618864747 conn(0x7f20500fc7a0 msgr2=0x7f205006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:52:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.283+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 shutdown_connections 2024-09-12T00:52:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:52:59.284+0000 7f2058782640 1 -- 172.21.15.2:0/3618864747 wait complete. 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:59.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:52:59 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3618864747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:59.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-12T00:52:59.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-12T00:52:59.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:52:59 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3618864747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: Updating smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:52:59.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:52:59 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3618864747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:52:59.986 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T00:52:59.987 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T00:52:59.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:53:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 -- 172.21.15.2:0/86742811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d4102ca0 msgr2=0x7f83d4103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 --2- 172.21.15.2:0/86742811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d4102ca0 0x7f83d4103080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009900 tx=0x7f83d002a480 comp rx=0 tx=0).stop 2024-09-12T00:53:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 -- 172.21.15.2:0/86742811 shutdown_connections 2024-09-12T00:53:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 --2- 172.21.15.2:0/86742811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83d410c0f0 0x7f83d410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 --2- 172.21.15.2:0/86742811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d41035c0 0x7f83d410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 --2- 172.21.15.2:0/86742811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d4102ca0 0x7f83d4103080 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 -- 172.21.15.2:0/86742811 >> 172.21.15.2:0/86742811 conn(0x7f83d40fc6b0 msgr2=0x7f83d40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 -- 172.21.15.2:0/86742811 shutdown_connections 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.093+0000 7f83db27b640 1 -- 172.21.15.2:0/86742811 wait complete. 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83db27b640 1 Processor -- start 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83db27b640 1 -- start start 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83db27b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4102ca0 0x7f83d41008f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83db27b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d41035c0 0x7f83d4100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83db27b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83d410c0f0 0x7f83d4101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83db27b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83d4111ed0 con 0x7f83d41035c0 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83db27b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83d4111d50 con 0x7f83d410c0f0 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83db27b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83d4112050 con 0x7f83d4102ca0 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83d8816640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d41035c0 0x7f83d4100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83d8816640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d41035c0 0x7f83d4100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45306/0 (socket says 172.21.15.2:45306) 2024-09-12T00:53:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83d8816640 1 -- 172.21.15.2:0/209819140 learned_addr learned my addr 172.21.15.2:0/209819140 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.094+0000 7f83d9017640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4102ca0 0x7f83d41008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83d9818640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83d410c0f0 0x7f83d4101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83d8816640 1 -- 172.21.15.2:0/209819140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4102ca0 msgr2=0x7f83d41008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83d8816640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4102ca0 0x7f83d41008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83d8816640 1 -- 172.21.15.2:0/209819140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83d410c0f0 msgr2=0x7f83d4101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83d8816640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83d410c0f0 0x7f83d4101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83d8816640 1 -- 172.21.15.2:0/209819140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d41a69a0 con 0x7f83d41035c0 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83d9017640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4102ca0 0x7f83d41008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83d8816640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d41035c0 0x7f83d4100e30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f83c800e9f0 tx=0x7f83c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83c67fc640 1 -- 172.21.15.2:0/209819140 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c800ccc0 con 0x7f83d41035c0 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83c67fc640 1 -- 172.21.15.2:0/209819140 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83c800ce60 con 0x7f83d41035c0 2024-09-12T00:53:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d41a6c90 con 0x7f83d41035c0 2024-09-12T00:53:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83c67fc640 1 -- 172.21.15.2:0/209819140 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8010690 con 0x7f83d41035c0 2024-09-12T00:53:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.095+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d41a7190 con 0x7f83d41035c0 2024-09-12T00:53:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.096+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d4103080 con 0x7f83d41035c0 2024-09-12T00:53:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.097+0000 7f83c67fc640 1 -- 172.21.15.2:0/209819140 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f83c80046c0 con 0x7f83d41035c0 2024-09-12T00:53:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.098+0000 7f83c67fc640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83c00a2ea0 0x7f83c00a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.098+0000 7f83c67fc640 1 -- 172.21.15.2:0/209819140 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f83c80cfb80 con 0x7f83d41035c0 2024-09-12T00:53:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.098+0000 7f83d9017640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83c00a2ea0 0x7f83c00a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.098+0000 7f83d9017640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83c00a2ea0 0x7f83c00a5360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f83d0005ab0 tx=0x7f83d0005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:00.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.102+0000 7f83c67fc640 1 -- 172.21.15.2:0/209819140 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83c809c500 con 0x7f83d41035c0 2024-09-12T00:53:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.277+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83d41071d0 con 0x7f83c00a2ea0 2024-09-12T00:53:00.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.284+0000 7f83c67fc640 1 -- 172.21.15.2:0/209819140 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257882 (secure 0 0 0) 0x7f83d00315b0 con 0x7f83c00a2ea0 2024-09-12T00:53:00.286 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:53:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83c00a2ea0 msgr2=0x7f83c00a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83c00a2ea0 0x7f83c00a5360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f83d0005ab0 tx=0x7f83d0005a20 comp rx=0 tx=0).stop 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d41035c0 msgr2=0x7f83d4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d41035c0 0x7f83d4100e30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f83c800e9f0 tx=0x7f83c800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 shutdown_connections 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83c00a2ea0 0x7f83c00a5360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83d410c0f0 0x7f83d4101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d41035c0 0x7f83d4100e30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 --2- 172.21.15.2:0/209819140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4102ca0 0x7f83d41008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 >> 172.21.15.2:0/209819140 conn(0x7f83d40fc6b0 msgr2=0x7f83d40fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 shutdown_connections 2024-09-12T00:53:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.287+0000 7f83db27b640 1 -- 172.21.15.2:0/209819140 wait complete. 2024-09-12T00:53:00.298 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-12T00:52:58.873796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187362,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":827,"num_read_kb":573,"num_write":468,"num_write_kb":4374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376336,"kb_used_data":14508,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565488,"statfs":{"total":1151940427776,"available":1151555059712,"internally_reserved":0,"allocated":14856192,"data_stored":8871916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.015197"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884145+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:52:54.884145+0000","last_peered":"2024-09-12T00:52:54.884145+0000","last_clean":"2024-09-12T00:52:54.884145+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:52:54.884145+0000","last_undegraded":"2024-09-12T00:52:54.884145+0000","last_fullsized":"2024-09-12T00:52:54.884145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880965+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:52:54.880965+0000","last_peered":"2024-09-12T00:52:54.880965+0000","last_clean":"2024-09-12T00:52:54.880965+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:52:54.880965+0000","last_undegraded":"2024-09-12T00:52:54.880965+0000","last_fullsized":"2024-09-12T00:52:54.880965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888565+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:52:54.888565+0000","last_peered":"2024-09-12T00:52:54.888565+0000","last_clean":"2024-09-12T00:52:54.888565+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:52:54.888565+0000","last_undegraded":"2024-09-12T00:52:54.888565+0000","last_fullsized":"2024-09-12T00:52:54.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871452+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:52:54.871452+0000","last_peered":"2024-09-12T00:52:54.871452+0000","last_clean":"2024-09-12T00:52:54.871452+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:52:54.871452+0000","last_undegraded":"2024-09-12T00:52:54.871452+0000","last_fullsized":"2024-09-12T00:52:54.871452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871301+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:52:54.871301+0000","last_peered":"2024-09-12T00:52:54.871301+0000","last_clean":"2024-09-12T00:52:54.871301+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:52:54.871301+0000","last_undegraded":"2024-09-12T00:52:54.871301+0000","last_fullsized":"2024-09-12T00:52:54.871301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890111+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:52:54.890111+0000","last_peered":"2024-09-12T00:52:54.890111+0000","last_clean":"2024-09-12T00:52:54.890111+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:52:54.890111+0000","last_undegraded":"2024-09-12T00:52:54.890111+0000","last_fullsized":"2024-09-12T00:52:54.890111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879651+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:52:54.879651+0000","last_peered":"2024-09-12T00:52:54.879651+0000","last_clean":"2024-09-12T00:52:54.879651+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:52:54.879651+0000","last_undegraded":"2024-09-12T00:52:54.879651+0000","last_fullsized":"2024-09-12T00:52:54.879651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880503+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:52:54.880503+0000","last_peered":"2024-09-12T00:52:54.880503+0000","last_clean":"2024-09-12T00:52:54.880503+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:52:54.880503+0000","last_undegraded":"2024-09-12T00:52:54.880503+0000","last_fullsized":"2024-09-12T00:52:54.880503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880321+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:52:54.880321+0000","last_peered":"2024-09-12T00:52:54.880321+0000","last_clean":"2024-09-12T00:52:54.880321+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:52:54.880321+0000","last_undegraded":"2024-09-12T00:52:54.880321+0000","last_fullsized":"2024-09-12T00:52:54.880321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878237+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:52:54.878237+0000","last_peered":"2024-09-12T00:52:54.878237+0000","last_clean":"2024-09-12T00:52:54.878237+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:52:54.878237+0000","last_undegraded":"2024-09-12T00:52:54.878237+0000","last_fullsized":"2024-09-12T00:52:54.878237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.881472+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:52:54.881472+0000","last_peered":"2024-09-12T00:52:54.881472+0000","last_clean":"2024-09-12T00:52:54.881472+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:52:54.881472+0000","last_undegraded":"2024-09-12T00:52:54.881472+0000","last_fullsized":"2024-09-12T00:52:54.881472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868621+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:52:54.868621+0000","last_peered":"2024-09-12T00:52:54.868621+0000","last_clean":"2024-09-12T00:52:54.868621+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:52:54.868621+0000","last_undegraded":"2024-09-12T00:52:54.868621+0000","last_fullsized":"2024-09-12T00:52:54.868621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884657+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:52:54.884657+0000","last_peered":"2024-09-12T00:52:54.884657+0000","last_clean":"2024-09-12T00:52:54.884657+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:52:54.884657+0000","last_undegraded":"2024-09-12T00:52:54.884657+0000","last_fullsized":"2024-09-12T00:52:54.884657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.886083+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:52:54.886083+0000","last_peered":"2024-09-12T00:52:54.886083+0000","last_clean":"2024-09-12T00:52:54.886083+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:52:54.886083+0000","last_undegraded":"2024-09-12T00:52:54.886083+0000","last_fullsized":"2024-09-12T00:52:54.886083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889586+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:52:54.889586+0000","last_peered":"2024-09-12T00:52:54.889586+0000","last_clean":"2024-09-12T00:52:54.889586+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:52:54.889586+0000","last_undegraded":"2024-09-12T00:52:54.889586+0000","last_fullsized":"2024-09-12T00:52:54.889586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887265+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:52:54.887265+0000","last_peered":"2024-09-12T00:52:54.887265+0000","last_clean":"2024-09-12T00:52:54.887265+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:52:54.887265+0000","last_undegraded":"2024-09-12T00:52:54.887265+0000","last_fullsized":"2024-09-12T00:52:54.887265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884255+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:52:54.884255+0000","last_peered":"2024-09-12T00:52:54.884255+0000","last_clean":"2024-09-12T00:52:54.884255+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:52:54.884255+0000","last_undegraded":"2024-09-12T00:52:54.884255+0000","last_fullsized":"2024-09-12T00:52:54.884255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889401+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:52:54.889401+0000","last_peered":"2024-09-12T00:52:54.889401+0000","last_clean":"2024-09-12T00:52:54.889401+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:52:54.889401+0000","last_undegraded":"2024-09-12T00:52:54.889401+0000","last_fullsized":"2024-09-12T00:52:54.889401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874518+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:52:54.874518+0000","last_peered":"2024-09-12T00:52:54.874518+0000","last_clean":"2024-09-12T00:52:54.874518+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:52:54.874518+0000","last_undegraded":"2024-09-12T00:52:54.874518+0000","last_fullsized":"2024-09-12T00:52:54.874518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871178+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:52:54.871178+0000","last_peered":"2024-09-12T00:52:54.871178+0000","last_clean":"2024-09-12T00:52:54.871178+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:52:54.871178+0000","last_undegraded":"2024-09-12T00:52:54.871178+0000","last_fullsized":"2024-09-12T00:52:54.871178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883483+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:52:54.883483+0000","last_peered":"2024-09-12T00:52:54.883483+0000","last_clean":"2024-09-12T00:52:54.883483+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:52:54.883483+0000","last_undegraded":"2024-09-12T00:52:54.883483+0000","last_fullsized":"2024-09-12T00:52:54.883483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.885630+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:52:54.885630+0000","last_peered":"2024-09-12T00:52:54.885630+0000","last_clean":"2024-09-12T00:52:54.885630+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:52:54.885630+0000","last_undegraded":"2024-09-12T00:52:54.885630+0000","last_fullsized":"2024-09-12T00:52:54.885630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876750+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:52:54.876750+0000","last_peered":"2024-09-12T00:52:54.876750+0000","last_clean":"2024-09-12T00:52:54.876750+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:52:54.876750+0000","last_undegraded":"2024-09-12T00:52:54.876750+0000","last_fullsized":"2024-09-12T00:52:54.876750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875520+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:52:54.875520+0000","last_peered":"2024-09-12T00:52:54.875520+0000","last_clean":"2024-09-12T00:52:54.875520+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:52:54.875520+0000","last_undegraded":"2024-09-12T00:52:54.875520+0000","last_fullsized":"2024-09-12T00:52:54.875520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874846+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:52:54.874846+0000","last_peered":"2024-09-12T00:52:54.874846+0000","last_clean":"2024-09-12T00:52:54.874846+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:52:54.874846+0000","last_undegraded":"2024-09-12T00:52:54.874846+0000","last_fullsized":"2024-09-12T00:52:54.874846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882315+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:52:54.882315+0000","last_peered":"2024-09-12T00:52:54.882315+0000","last_clean":"2024-09-12T00:52:54.882315+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:52:54.882315+0000","last_undegraded":"2024-09-12T00:52:54.882315+0000","last_fullsized":"2024-09-12T00:52:54.882315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876433+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:52:54.876433+0000","last_peered":"2024-09-12T00:52:54.876433+0000","last_clean":"2024-09-12T00:52:54.876433+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:52:54.876433+0000","last_undegraded":"2024-09-12T00:52:54.876433+0000","last_fullsized":"2024-09-12T00:52:54.876433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883390+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:52:54.883390+0000","last_peered":"2024-09-12T00:52:54.883390+0000","last_clean":"2024-09-12T00:52:54.883390+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:52:54.883390+0000","last_undegraded":"2024-09-12T00:52:54.883390+0000","last_fullsized":"2024-09-12T00:52:54.883390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889494+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:52:54.889494+0000","last_peered":"2024-09-12T00:52:54.889494+0000","last_clean":"2024-09-12T00:52:54.889494+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:52:54.889494+0000","last_undegraded":"2024-09-12T00:52:54.889494+0000","last_fullsized":"2024-09-12T00:52:54.889494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882408+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:52:54.882408+0000","last_peered":"2024-09-12T00:52:54.882408+0000","last_clean":"2024-09-12T00:52:54.882408+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:52:54.882408+0000","last_undegraded":"2024-09-12T00:52:54.882408+0000","last_fullsized":"2024-09-12T00:52:54.882408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871902+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:52:54.871902+0000","last_peered":"2024-09-12T00:52:54.871902+0000","last_clean":"2024-09-12T00:52:54.871902+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:52:54.871902+0000","last_undegraded":"2024-09-12T00:52:54.871902+0000","last_fullsized":"2024-09-12T00:52:54.871902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876051+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:52:54.876051+0000","last_peered":"2024-09-12T00:52:54.876051+0000","last_clean":"2024-09-12T00:52:54.876051+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:52:54.876051+0000","last_undegraded":"2024-09-12T00:52:54.876051+0000","last_fullsized":"2024-09-12T00:52:54.876051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868139+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:52:54.868139+0000","last_peered":"2024-09-12T00:52:54.868139+0000","last_clean":"2024-09-12T00:52:54.868139+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:52:54.868139+0000","last_undegraded":"2024-09-12T00:52:54.868139+0000","last_fullsized":"2024-09-12T00:52:54.868139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'9","reported_seq":136,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.210017+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:52:55.210017+0000","last_peered":"2024-09-12T00:52:55.210017+0000","last_clean":"2024-09-12T00:52:55.210017+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:52:55.210017+0000","last_undegraded":"2024-09-12T00:52:55.210017+0000","last_fullsized":"2024-09-12T00:52:55.210017+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875141+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:52:54.875141+0000","last_peered":"2024-09-12T00:52:54.875141+0000","last_clean":"2024-09-12T00:52:54.875141+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:52:54.875141+0000","last_undegraded":"2024-09-12T00:52:54.875141+0000","last_fullsized":"2024-09-12T00:52:54.875141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.836360+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:52:54.836360+0000","last_peered":"2024-09-12T00:52:54.836360+0000","last_clean":"2024-09-12T00:52:54.836360+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:52:54.836360+0000","last_undegraded":"2024-09-12T00:52:54.836360+0000","last_fullsized":"2024-09-12T00:52:54.836360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.833879+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:52:54.833879+0000","last_peered":"2024-09-12T00:52:54.833879+0000","last_clean":"2024-09-12T00:52:54.833879+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:52:54.833879+0000","last_undegraded":"2024-09-12T00:52:54.833879+0000","last_fullsized":"2024-09-12T00:52:54.833879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888219+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:52:54.888219+0000","last_peered":"2024-09-12T00:52:54.888219+0000","last_clean":"2024-09-12T00:52:54.888219+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.888219+0000","last_undegraded":"2024-09-12T00:52:54.888219+0000","last_fullsized":"2024-09-12T00:52:54.888219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839021+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:52:54.839021+0000","last_peered":"2024-09-12T00:52:54.839021+0000","last_clean":"2024-09-12T00:52:54.839021+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:52:54.839021+0000","last_undegraded":"2024-09-12T00:52:54.839021+0000","last_fullsized":"2024-09-12T00:52:54.839021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887645+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:52:54.887645+0000","last_peered":"2024-09-12T00:52:54.887645+0000","last_clean":"2024-09-12T00:52:54.887645+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:52:54.887645+0000","last_undegraded":"2024-09-12T00:52:54.887645+0000","last_fullsized":"2024-09-12T00:52:54.887645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":127,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.845103+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:52:54.845103+0000","last_peered":"2024-09-12T00:52:54.845103+0000","last_clean":"2024-09-12T00:52:54.845103+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:52:54.845103+0000","last_undegraded":"2024-09-12T00:52:54.845103+0000","last_fullsized":"2024-09-12T00:52:54.845103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.891678+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:52:54.891678+0000","last_peered":"2024-09-12T00:52:54.891678+0000","last_clean":"2024-09-12T00:52:54.891678+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:52:54.891678+0000","last_undegraded":"2024-09-12T00:52:54.891678+0000","last_fullsized":"2024-09-12T00:52:54.891678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.843451+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:52:54.843451+0000","last_peered":"2024-09-12T00:52:54.843451+0000","last_clean":"2024-09-12T00:52:54.843451+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:52:54.843451+0000","last_undegraded":"2024-09-12T00:52:54.843451+0000","last_fullsized":"2024-09-12T00:52:54.843451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887219+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:52:54.887219+0000","last_peered":"2024-09-12T00:52:54.887219+0000","last_clean":"2024-09-12T00:52:54.887219+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:52:54.887219+0000","last_undegraded":"2024-09-12T00:52:54.887219+0000","last_fullsized":"2024-09-12T00:52:54.887219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839370+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:52:54.839370+0000","last_peered":"2024-09-12T00:52:54.839370+0000","last_clean":"2024-09-12T00:52:54.839370+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:52:54.839370+0000","last_undegraded":"2024-09-12T00:52:54.839370+0000","last_fullsized":"2024-09-12T00:52:54.839370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884249+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:52:54.884249+0000","last_peered":"2024-09-12T00:52:54.884249+0000","last_clean":"2024-09-12T00:52:54.884249+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:52:54.884249+0000","last_undegraded":"2024-09-12T00:52:54.884249+0000","last_fullsized":"2024-09-12T00:52:54.884249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'34","reported_seq":261,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.209954+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:52:55.209954+0000","last_peered":"2024-09-12T00:52:55.209954+0000","last_clean":"2024-09-12T00:52:55.209954+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:52:55.209954+0000","last_undegraded":"2024-09-12T00:52:55.209954+0000","last_fullsized":"2024-09-12T00:52:55.209954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":164,"num_write":35,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.866993+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:52:54.866993+0000","last_peered":"2024-09-12T00:52:54.866993+0000","last_clean":"2024-09-12T00:52:54.866993+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:52:54.866993+0000","last_undegraded":"2024-09-12T00:52:54.866993+0000","last_fullsized":"2024-09-12T00:52:54.866993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838847+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:52:54.838847+0000","last_peered":"2024-09-12T00:52:54.838847+0000","last_clean":"2024-09-12T00:52:54.838847+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:52:54.838847+0000","last_undegraded":"2024-09-12T00:52:54.838847+0000","last_fullsized":"2024-09-12T00:52:54.838847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884700+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:52:54.884700+0000","last_peered":"2024-09-12T00:52:54.884700+0000","last_clean":"2024-09-12T00:52:54.884700+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:52:54.884700+0000","last_undegraded":"2024-09-12T00:52:54.884700+0000","last_fullsized":"2024-09-12T00:52:54.884700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839358+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:52:54.839358+0000","last_peered":"2024-09-12T00:52:54.839358+0000","last_clean":"2024-09-12T00:52:54.839358+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:52:54.839358+0000","last_undegraded":"2024-09-12T00:52:54.839358+0000","last_fullsized":"2024-09-12T00:52:54.839358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883708+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:52:54.883708+0000","last_peered":"2024-09-12T00:52:54.883708+0000","last_clean":"2024-09-12T00:52:54.883708+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:52:54.883708+0000","last_undegraded":"2024-09-12T00:52:54.883708+0000","last_fullsized":"2024-09-12T00:52:54.883708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'5","reported_seq":131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.207136+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:52:55.207136+0000","last_peered":"2024-09-12T00:52:55.207136+0000","last_clean":"2024-09-12T00:52:55.207136+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:52:55.207136+0000","last_undegraded":"2024-09-12T00:52:55.207136+0000","last_fullsized":"2024-09-12T00:52:55.207136+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873525+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:52:54.873525+0000","last_peered":"2024-09-12T00:52:54.873525+0000","last_clean":"2024-09-12T00:52:54.873525+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:52:54.873525+0000","last_undegraded":"2024-09-12T00:52:54.873525+0000","last_fullsized":"2024-09-12T00:52:54.873525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.846569+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:52:54.846569+0000","last_peered":"2024-09-12T00:52:54.846569+0000","last_clean":"2024-09-12T00:52:54.846569+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:52:54.846569+0000","last_undegraded":"2024-09-12T00:52:54.846569+0000","last_fullsized":"2024-09-12T00:52:54.846569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.859661+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:52:54.859661+0000","last_peered":"2024-09-12T00:52:54.859661+0000","last_clean":"2024-09-12T00:52:54.859661+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:52:54.859661+0000","last_undegraded":"2024-09-12T00:52:54.859661+0000","last_fullsized":"2024-09-12T00:52:54.859661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848120+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:52:54.848120+0000","last_peered":"2024-09-12T00:52:54.848120+0000","last_clean":"2024-09-12T00:52:54.848120+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:52:54.848120+0000","last_undegraded":"2024-09-12T00:52:54.848120+0000","last_fullsized":"2024-09-12T00:52:54.848120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876330+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:52:54.876330+0000","last_peered":"2024-09-12T00:52:54.876330+0000","last_clean":"2024-09-12T00:52:54.876330+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:52:54.876330+0000","last_undegraded":"2024-09-12T00:52:54.876330+0000","last_fullsized":"2024-09-12T00:52:54.876330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.834098+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:52:54.834098+0000","last_peered":"2024-09-12T00:52:54.834098+0000","last_clean":"2024-09-12T00:52:54.834098+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:52:54.834098+0000","last_undegraded":"2024-09-12T00:52:54.834098+0000","last_fullsized":"2024-09-12T00:52:54.834098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873806+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:52:54.873806+0000","last_peered":"2024-09-12T00:52:54.873806+0000","last_clean":"2024-09-12T00:52:54.873806+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:52:54.873806+0000","last_undegraded":"2024-09-12T00:52:54.873806+0000","last_fullsized":"2024-09-12T00:52:54.873806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":75,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.079853+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:52:55.079853+0000","last_peered":"2024-09-12T00:52:55.079853+0000","last_clean":"2024-09-12T00:52:55.079853+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:52:55.079853+0000","last_undegraded":"2024-09-12T00:52:55.079853+0000","last_fullsized":"2024-09-12T00:52:55.079853+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878977+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:52:54.878977+0000","last_peered":"2024-09-12T00:52:54.878977+0000","last_clean":"2024-09-12T00:52:54.878977+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:52:54.878977+0000","last_undegraded":"2024-09-12T00:52:54.878977+0000","last_fullsized":"2024-09-12T00:52:54.878977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.845024+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:52:54.845024+0000","last_peered":"2024-09-12T00:52:54.845024+0000","last_clean":"2024-09-12T00:52:54.845024+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:52:54.845024+0000","last_undegraded":"2024-09-12T00:52:54.845024+0000","last_fullsized":"2024-09-12T00:52:54.845024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883108+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:52:54.883108+0000","last_peered":"2024-09-12T00:52:54.883108+0000","last_clean":"2024-09-12T00:52:54.883108+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:52:54.883108+0000","last_undegraded":"2024-09-12T00:52:54.883108+0000","last_fullsized":"2024-09-12T00:52:54.883108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841831+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:52:54.841831+0000","last_peered":"2024-09-12T00:52:54.841831+0000","last_clean":"2024-09-12T00:52:54.841831+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:52:54.841831+0000","last_undegraded":"2024-09-12T00:52:54.841831+0000","last_fullsized":"2024-09-12T00:52:54.841831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.844886+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:52:54.844886+0000","last_peered":"2024-09-12T00:52:54.844886+0000","last_clean":"2024-09-12T00:52:54.844886+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:52:54.844886+0000","last_undegraded":"2024-09-12T00:52:54.844886+0000","last_fullsized":"2024-09-12T00:52:54.844886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883842+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:52:54.883842+0000","last_peered":"2024-09-12T00:52:54.883842+0000","last_clean":"2024-09-12T00:52:54.883842+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:52:54.883842+0000","last_undegraded":"2024-09-12T00:52:54.883842+0000","last_fullsized":"2024-09-12T00:52:54.883842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841723+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:52:54.841723+0000","last_peered":"2024-09-12T00:52:54.841723+0000","last_clean":"2024-09-12T00:52:54.841723+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:52:54.841723+0000","last_undegraded":"2024-09-12T00:52:54.841723+0000","last_fullsized":"2024-09-12T00:52:54.841723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874307+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:52:54.874307+0000","last_peered":"2024-09-12T00:52:54.874307+0000","last_clean":"2024-09-12T00:52:54.874307+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.874307+0000","last_undegraded":"2024-09-12T00:52:54.874307+0000","last_fullsized":"2024-09-12T00:52:54.874307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":127,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.840548+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:52:54.840548+0000","last_peered":"2024-09-12T00:52:54.840548+0000","last_clean":"2024-09-12T00:52:54.840548+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:52:54.840548+0000","last_undegraded":"2024-09-12T00:52:54.840548+0000","last_fullsized":"2024-09-12T00:52:54.840548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871701+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:52:54.871701+0000","last_peered":"2024-09-12T00:52:54.871701+0000","last_clean":"2024-09-12T00:52:54.871701+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:52:54.871701+0000","last_undegraded":"2024-09-12T00:52:54.871701+0000","last_fullsized":"2024-09-12T00:52:54.871701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850494+0000","last_change":"2024-09-12T00:52:22.594327+0000","last_active":"2024-09-12T00:52:54.850494+0000","last_peered":"2024-09-12T00:52:54.850494+0000","last_clean":"2024-09-12T00:52:54.850494+0000","last_became_active":"2024-09-12T00:52:22.593876+0000","last_became_peered":"2024-09-12T00:52:22.593876+0000","last_unstale":"2024-09-12T00:52:54.850494+0000","last_undegraded":"2024-09-12T00:52:54.850494+0000","last_fullsized":"2024-09-12T00:52:54.850494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:17.961428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876981+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:52:54.876981+0000","last_peered":"2024-09-12T00:52:54.876981+0000","last_clean":"2024-09-12T00:52:54.876981+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:52:54.876981+0000","last_undegraded":"2024-09-12T00:52:54.876981+0000","last_fullsized":"2024-09-12T00:52:54.876981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841926+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:52:54.841926+0000","last_peered":"2024-09-12T00:52:54.841926+0000","last_clean":"2024-09-12T00:52:54.841926+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:52:54.841926+0000","last_undegraded":"2024-09-12T00:52:54.841926+0000","last_fullsized":"2024-09-12T00:52:54.841926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875489+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:52:54.875489+0000","last_peered":"2024-09-12T00:52:54.875489+0000","last_clean":"2024-09-12T00:52:54.875489+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:52:54.875489+0000","last_undegraded":"2024-09-12T00:52:54.875489+0000","last_fullsized":"2024-09-12T00:52:54.875489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848626+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:52:54.848626+0000","last_peered":"2024-09-12T00:52:54.848626+0000","last_clean":"2024-09-12T00:52:54.848626+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:52:54.848626+0000","last_undegraded":"2024-09-12T00:52:54.848626+0000","last_fullsized":"2024-09-12T00:52:54.848626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884371+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:52:54.884371+0000","last_peered":"2024-09-12T00:52:54.884371+0000","last_clean":"2024-09-12T00:52:54.884371+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:52:54.884371+0000","last_undegraded":"2024-09-12T00:52:54.884371+0000","last_fullsized":"2024-09-12T00:52:54.884371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'45","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.083016+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:52:55.083016+0000","last_peered":"2024-09-12T00:52:55.083016+0000","last_clean":"2024-09-12T00:52:55.083016+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:52:55.083016+0000","last_undegraded":"2024-09-12T00:52:55.083016+0000","last_fullsized":"2024-09-12T00:52:55.083016+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873351+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:52:54.873351+0000","last_peered":"2024-09-12T00:52:54.873351+0000","last_clean":"2024-09-12T00:52:54.873351+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:52:54.873351+0000","last_undegraded":"2024-09-12T00:52:54.873351+0000","last_fullsized":"2024-09-12T00:52:54.873351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848558+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:52:54.848558+0000","last_peered":"2024-09-12T00:52:54.848558+0000","last_clean":"2024-09-12T00:52:54.848558+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:52:54.848558+0000","last_undegraded":"2024-09-12T00:52:54.848558+0000","last_fullsized":"2024-09-12T00:52:54.848558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890212+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:52:54.890212+0000","last_peered":"2024-09-12T00:52:54.890212+0000","last_clean":"2024-09-12T00:52:54.890212+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:52:54.890212+0000","last_undegraded":"2024-09-12T00:52:54.890212+0000","last_fullsized":"2024-09-12T00:52:54.890212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838291+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:52:54.838291+0000","last_peered":"2024-09-12T00:52:54.838291+0000","last_clean":"2024-09-12T00:52:54.838291+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:52:54.838291+0000","last_undegraded":"2024-09-12T00:52:54.838291+0000","last_fullsized":"2024-09-12T00:52:54.838291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875091+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:52:54.875091+0000","last_peered":"2024-09-12T00:52:54.875091+0000","last_clean":"2024-09-12T00:52:54.875091+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:52:54.875091+0000","last_undegraded":"2024-09-12T00:52:54.875091+0000","last_fullsized":"2024-09-12T00:52:54.875091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839819+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:52:54.839819+0000","last_peered":"2024-09-12T00:52:54.839819+0000","last_clean":"2024-09-12T00:52:54.839819+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:52:54.839819+0000","last_undegraded":"2024-09-12T00:52:54.839819+0000","last_fullsized":"2024-09-12T00:52:54.839819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878537+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:52:54.878537+0000","last_peered":"2024-09-12T00:52:54.878537+0000","last_clean":"2024-09-12T00:52:54.878537+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:52:54.878537+0000","last_undegraded":"2024-09-12T00:52:54.878537+0000","last_fullsized":"2024-09-12T00:52:54.878537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838894+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:52:54.838894+0000","last_peered":"2024-09-12T00:52:54.838894+0000","last_clean":"2024-09-12T00:52:54.838894+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:52:54.838894+0000","last_undegraded":"2024-09-12T00:52:54.838894+0000","last_fullsized":"2024-09-12T00:52:54.838894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884443+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:52:54.884443+0000","last_peered":"2024-09-12T00:52:54.884443+0000","last_clean":"2024-09-12T00:52:54.884443+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:52:54.884443+0000","last_undegraded":"2024-09-12T00:52:54.884443+0000","last_fullsized":"2024-09-12T00:52:54.884443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850626+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:52:54.850626+0000","last_peered":"2024-09-12T00:52:54.850626+0000","last_clean":"2024-09-12T00:52:54.850626+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:52:54.850626+0000","last_undegraded":"2024-09-12T00:52:54.850626+0000","last_fullsized":"2024-09-12T00:52:54.850626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880746+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:52:54.880746+0000","last_peered":"2024-09-12T00:52:54.880746+0000","last_clean":"2024-09-12T00:52:54.880746+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:52:54.880746+0000","last_undegraded":"2024-09-12T00:52:54.880746+0000","last_fullsized":"2024-09-12T00:52:54.880746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889345+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:52:54.889345+0000","last_peered":"2024-09-12T00:52:54.889345+0000","last_clean":"2024-09-12T00:52:54.889345+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:52:54.889345+0000","last_undegraded":"2024-09-12T00:52:54.889345+0000","last_fullsized":"2024-09-12T00:52:54.889345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.847896+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:52:54.847896+0000","last_peered":"2024-09-12T00:52:54.847896+0000","last_clean":"2024-09-12T00:52:54.847896+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:52:54.847896+0000","last_undegraded":"2024-09-12T00:52:54.847896+0000","last_fullsized":"2024-09-12T00:52:54.847896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888948+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:52:54.888948+0000","last_peered":"2024-09-12T00:52:54.888948+0000","last_clean":"2024-09-12T00:52:54.888948+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:52:54.888948+0000","last_undegraded":"2024-09-12T00:52:54.888948+0000","last_fullsized":"2024-09-12T00:52:54.888948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848504+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:52:54.848504+0000","last_peered":"2024-09-12T00:52:54.848504+0000","last_clean":"2024-09-12T00:52:54.848504+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:52:54.848504+0000","last_undegraded":"2024-09-12T00:52:54.848504+0000","last_fullsized":"2024-09-12T00:52:54.848504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888796+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:52:54.888796+0000","last_peered":"2024-09-12T00:52:54.888796+0000","last_clean":"2024-09-12T00:52:54.888796+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:52:54.888796+0000","last_undegraded":"2024-09-12T00:52:54.888796+0000","last_fullsized":"2024-09-12T00:52:54.888796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839897+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:52:54.839897+0000","last_peered":"2024-09-12T00:52:54.839897+0000","last_clean":"2024-09-12T00:52:54.839897+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:52:54.839897+0000","last_undegraded":"2024-09-12T00:52:54.839897+0000","last_fullsized":"2024-09-12T00:52:54.839897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879161+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:52:54.879161+0000","last_peered":"2024-09-12T00:52:54.879161+0000","last_clean":"2024-09-12T00:52:54.879161+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:52:54.879161+0000","last_undegraded":"2024-09-12T00:52:54.879161+0000","last_fullsized":"2024-09-12T00:52:54.879161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.842302+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:52:54.842302+0000","last_peered":"2024-09-12T00:52:54.842302+0000","last_clean":"2024-09-12T00:52:54.842302+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:52:54.842302+0000","last_undegraded":"2024-09-12T00:52:54.842302+0000","last_fullsized":"2024-09-12T00:52:54.842302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596760,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":691,"num_read_kb":454,"num_write":285,"num_write_kb":1434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1790280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":454100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28816,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716336,"statfs":{"total":95995035648,"available":95965528064,"internally_reserved":0,"allocated":1773568,"data_stored":1244195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40824,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704328,"statfs":{"total":95995035648,"available":95953231872,"internally_reserved":0,"allocated":1347584,"data_stored":847669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201328,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28340,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716812,"statfs":{"total":95995035648,"available":95966015488,"internally_reserved":0,"allocated":1343488,"data_stored":847472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1544192,"data_stored":1047649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":937984,"data_stored":453725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1556480,"data_stored":1046013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":455390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1478656,"data_stored":978735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":521974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1007616,"data_stored":519998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":454996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:53:00.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:53:00.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 -- 172.21.15.2:0/1954232022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c101990 msgr2=0x7faf9c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 --2- 172.21.15.2:0/1954232022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c101990 0x7faf9c101d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009900 tx=0x7faf8c02a410 comp rx=0 tx=0).stop 2024-09-12T00:53:00.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 -- 172.21.15.2:0/1954232022 shutdown_connections 2024-09-12T00:53:00.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 --2- 172.21.15.2:0/1954232022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf9c106f40 0x7faf9c10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 --2- 172.21.15.2:0/1954232022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf9c102340 0x7faf9c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 --2- 172.21.15.2:0/1954232022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c101990 0x7faf9c101d70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 -- 172.21.15.2:0/1954232022 >> 172.21.15.2:0/1954232022 conn(0x7faf9c075ec0 msgr2=0x7faf9c0762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 -- 172.21.15.2:0/1954232022 shutdown_connections 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.443+0000 7fafa23bd640 1 -- 172.21.15.2:0/1954232022 wait complete. 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa23bd640 1 Processor -- start 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa23bd640 1 -- start start 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa23bd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf9c101990 0x7faf9c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa23bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf9c106f40 0x7faf9c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa23bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c19bc10 0x7faf9c19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa23bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c110e00 con 0x7faf9c19bc10 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa23bd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c110c80 con 0x7faf9c101990 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa23bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c110f80 con 0x7faf9c106f40 2024-09-12T00:53:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa095a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c19bc10 0x7faf9c19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa095a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c19bc10 0x7faf9c19c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45330/0 (socket says 172.21.15.2:45330) 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7fafa095a640 1 -- 172.21.15.2:0/2348336361 learned_addr learned my addr 172.21.15.2:0/2348336361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.444+0000 7faf9bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf9c101990 0x7faf9c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7fafa095a640 1 -- 172.21.15.2:0/2348336361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf9c106f40 msgr2=0x7faf9c197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7faf9b7fe640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf9c106f40 0x7faf9c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7fafa095a640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf9c106f40 0x7faf9c197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7fafa095a640 1 -- 172.21.15.2:0/2348336361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf9c101990 msgr2=0x7faf9c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7fafa095a640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf9c101990 0x7faf9c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7fafa095a640 1 -- 172.21.15.2:0/2348336361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c19c700 con 0x7faf9c19bc10 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7faf9b7fe640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf9c106f40 0x7faf9c197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7faf9bfff640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf9c101990 0x7faf9c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7fafa095a640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c19bc10 0x7faf9c19c0c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf9400eb10 tx=0x7faf9400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:00.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7faf997fa640 1 -- 172.21.15.2:0/2348336361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94004b20 con 0x7faf9c19bc10 2024-09-12T00:53:00.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c19c9f0 con 0x7faf9c19bc10 2024-09-12T00:53:00.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7faf997fa640 1 -- 172.21.15.2:0/2348336361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf94004cc0 con 0x7faf9c19bc10 2024-09-12T00:53:00.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7faf997fa640 1 -- 172.21.15.2:0/2348336361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94010760 con 0x7faf9c19bc10 2024-09-12T00:53:00.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.445+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c1008e0 con 0x7faf9c19bc10 2024-09-12T00:53:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.446+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9c101d70 con 0x7faf9c19bc10 2024-09-12T00:53:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.447+0000 7faf997fa640 1 -- 172.21.15.2:0/2348336361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7faf94005020 con 0x7faf9c19bc10 2024-09-12T00:53:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.448+0000 7faf997fa640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf840a2e20 0x7faf840a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.448+0000 7faf9bfff640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf840a2e20 0x7faf840a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.448+0000 7faf997fa640 1 -- 172.21.15.2:0/2348336361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7faf940cfd50 con 0x7faf9c19bc10 2024-09-12T00:53:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.449+0000 7faf9bfff640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf840a2e20 0x7faf840a52e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009230 tx=0x7faf8c0058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:00.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.452+0000 7faf997fa640 1 -- 172.21.15.2:0/2348336361 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf9409c670 con 0x7faf9c19bc10 2024-09-12T00:53:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.626+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf9c1014e0 con 0x7faf840a2e20 2024-09-12T00:53:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.633+0000 7faf997fa640 1 -- 172.21.15.2:0/2348336361 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257882 (secure 0 0 0) 0x7faf9c1014e0 con 0x7faf840a2e20 2024-09-12T00:53:00.635 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:00.636 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:53:00.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf840a2e20 msgr2=0x7faf840a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf840a2e20 0x7faf840a52e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009230 tx=0x7faf8c0058d0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c19bc10 msgr2=0x7faf9c19c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c19bc10 0x7faf9c19c0c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf9400eb10 tx=0x7faf9400c2d0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 shutdown_connections 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf840a2e20 0x7faf840a52e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c19bc10 0x7faf9c19c0c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf9c106f40 0x7faf9c197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 --2- 172.21.15.2:0/2348336361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf9c101990 0x7faf9c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 >> 172.21.15.2:0/2348336361 conn(0x7faf9c075ec0 msgr2=0x7faf9c104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 shutdown_connections 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.636+0000 7fafa23bd640 1 -- 172.21.15.2:0/2348336361 wait complete. 2024-09-12T00:53:00.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:00 smithi002 ceph-mon[31210]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:53:00.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:00 smithi002 ceph-mon[31210]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-12T00:53:00.647 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-12T00:52:58.873796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187362,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":827,"num_read_kb":573,"num_write":468,"num_write_kb":4374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376336,"kb_used_data":14508,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565488,"statfs":{"total":1151940427776,"available":1151555059712,"internally_reserved":0,"allocated":14856192,"data_stored":8871916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.015197"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884145+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:52:54.884145+0000","last_peered":"2024-09-12T00:52:54.884145+0000","last_clean":"2024-09-12T00:52:54.884145+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:52:54.884145+0000","last_undegraded":"2024-09-12T00:52:54.884145+0000","last_fullsized":"2024-09-12T00:52:54.884145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880965+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:52:54.880965+0000","last_peered":"2024-09-12T00:52:54.880965+0000","last_clean":"2024-09-12T00:52:54.880965+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:52:54.880965+0000","last_undegraded":"2024-09-12T00:52:54.880965+0000","last_fullsized":"2024-09-12T00:52:54.880965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888565+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:52:54.888565+0000","last_peered":"2024-09-12T00:52:54.888565+0000","last_clean":"2024-09-12T00:52:54.888565+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:52:54.888565+0000","last_undegraded":"2024-09-12T00:52:54.888565+0000","last_fullsized":"2024-09-12T00:52:54.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871452+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:52:54.871452+0000","last_peered":"2024-09-12T00:52:54.871452+0000","last_clean":"2024-09-12T00:52:54.871452+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:52:54.871452+0000","last_undegraded":"2024-09-12T00:52:54.871452+0000","last_fullsized":"2024-09-12T00:52:54.871452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871301+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:52:54.871301+0000","last_peered":"2024-09-12T00:52:54.871301+0000","last_clean":"2024-09-12T00:52:54.871301+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:52:54.871301+0000","last_undegraded":"2024-09-12T00:52:54.871301+0000","last_fullsized":"2024-09-12T00:52:54.871301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890111+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:52:54.890111+0000","last_peered":"2024-09-12T00:52:54.890111+0000","last_clean":"2024-09-12T00:52:54.890111+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:52:54.890111+0000","last_undegraded":"2024-09-12T00:52:54.890111+0000","last_fullsized":"2024-09-12T00:52:54.890111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879651+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:52:54.879651+0000","last_peered":"2024-09-12T00:52:54.879651+0000","last_clean":"2024-09-12T00:52:54.879651+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:52:54.879651+0000","last_undegraded":"2024-09-12T00:52:54.879651+0000","last_fullsized":"2024-09-12T00:52:54.879651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880503+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:52:54.880503+0000","last_peered":"2024-09-12T00:52:54.880503+0000","last_clean":"2024-09-12T00:52:54.880503+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:52:54.880503+0000","last_undegraded":"2024-09-12T00:52:54.880503+0000","last_fullsized":"2024-09-12T00:52:54.880503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880321+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:52:54.880321+0000","last_peered":"2024-09-12T00:52:54.880321+0000","last_clean":"2024-09-12T00:52:54.880321+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:52:54.880321+0000","last_undegraded":"2024-09-12T00:52:54.880321+0000","last_fullsized":"2024-09-12T00:52:54.880321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878237+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:52:54.878237+0000","last_peered":"2024-09-12T00:52:54.878237+0000","last_clean":"2024-09-12T00:52:54.878237+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:52:54.878237+0000","last_undegraded":"2024-09-12T00:52:54.878237+0000","last_fullsized":"2024-09-12T00:52:54.878237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.881472+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:52:54.881472+0000","last_peered":"2024-09-12T00:52:54.881472+0000","last_clean":"2024-09-12T00:52:54.881472+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:52:54.881472+0000","last_undegraded":"2024-09-12T00:52:54.881472+0000","last_fullsized":"2024-09-12T00:52:54.881472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868621+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:52:54.868621+0000","last_peered":"2024-09-12T00:52:54.868621+0000","last_clean":"2024-09-12T00:52:54.868621+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:52:54.868621+0000","last_undegraded":"2024-09-12T00:52:54.868621+0000","last_fullsized":"2024-09-12T00:52:54.868621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884657+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:52:54.884657+0000","last_peered":"2024-09-12T00:52:54.884657+0000","last_clean":"2024-09-12T00:52:54.884657+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:52:54.884657+0000","last_undegraded":"2024-09-12T00:52:54.884657+0000","last_fullsized":"2024-09-12T00:52:54.884657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.886083+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:52:54.886083+0000","last_peered":"2024-09-12T00:52:54.886083+0000","last_clean":"2024-09-12T00:52:54.886083+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:52:54.886083+0000","last_undegraded":"2024-09-12T00:52:54.886083+0000","last_fullsized":"2024-09-12T00:52:54.886083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889586+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:52:54.889586+0000","last_peered":"2024-09-12T00:52:54.889586+0000","last_clean":"2024-09-12T00:52:54.889586+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:52:54.889586+0000","last_undegraded":"2024-09-12T00:52:54.889586+0000","last_fullsized":"2024-09-12T00:52:54.889586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887265+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:52:54.887265+0000","last_peered":"2024-09-12T00:52:54.887265+0000","last_clean":"2024-09-12T00:52:54.887265+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:52:54.887265+0000","last_undegraded":"2024-09-12T00:52:54.887265+0000","last_fullsized":"2024-09-12T00:52:54.887265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884255+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:52:54.884255+0000","last_peered":"2024-09-12T00:52:54.884255+0000","last_clean":"2024-09-12T00:52:54.884255+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:52:54.884255+0000","last_undegraded":"2024-09-12T00:52:54.884255+0000","last_fullsized":"2024-09-12T00:52:54.884255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889401+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:52:54.889401+0000","last_peered":"2024-09-12T00:52:54.889401+0000","last_clean":"2024-09-12T00:52:54.889401+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:52:54.889401+0000","last_undegraded":"2024-09-12T00:52:54.889401+0000","last_fullsized":"2024-09-12T00:52:54.889401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874518+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:52:54.874518+0000","last_peered":"2024-09-12T00:52:54.874518+0000","last_clean":"2024-09-12T00:52:54.874518+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:52:54.874518+0000","last_undegraded":"2024-09-12T00:52:54.874518+0000","last_fullsized":"2024-09-12T00:52:54.874518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871178+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:52:54.871178+0000","last_peered":"2024-09-12T00:52:54.871178+0000","last_clean":"2024-09-12T00:52:54.871178+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:52:54.871178+0000","last_undegraded":"2024-09-12T00:52:54.871178+0000","last_fullsized":"2024-09-12T00:52:54.871178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883483+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:52:54.883483+0000","last_peered":"2024-09-12T00:52:54.883483+0000","last_clean":"2024-09-12T00:52:54.883483+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:52:54.883483+0000","last_undegraded":"2024-09-12T00:52:54.883483+0000","last_fullsized":"2024-09-12T00:52:54.883483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.885630+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:52:54.885630+0000","last_peered":"2024-09-12T00:52:54.885630+0000","last_clean":"2024-09-12T00:52:54.885630+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:52:54.885630+0000","last_undegraded":"2024-09-12T00:52:54.885630+0000","last_fullsized":"2024-09-12T00:52:54.885630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876750+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:52:54.876750+0000","last_peered":"2024-09-12T00:52:54.876750+0000","last_clean":"2024-09-12T00:52:54.876750+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:52:54.876750+0000","last_undegraded":"2024-09-12T00:52:54.876750+0000","last_fullsized":"2024-09-12T00:52:54.876750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875520+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:52:54.875520+0000","last_peered":"2024-09-12T00:52:54.875520+0000","last_clean":"2024-09-12T00:52:54.875520+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:52:54.875520+0000","last_undegraded":"2024-09-12T00:52:54.875520+0000","last_fullsized":"2024-09-12T00:52:54.875520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874846+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:52:54.874846+0000","last_peered":"2024-09-12T00:52:54.874846+0000","last_clean":"2024-09-12T00:52:54.874846+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:52:54.874846+0000","last_undegraded":"2024-09-12T00:52:54.874846+0000","last_fullsized":"2024-09-12T00:52:54.874846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882315+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:52:54.882315+0000","last_peered":"2024-09-12T00:52:54.882315+0000","last_clean":"2024-09-12T00:52:54.882315+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:52:54.882315+0000","last_undegraded":"2024-09-12T00:52:54.882315+0000","last_fullsized":"2024-09-12T00:52:54.882315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876433+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:52:54.876433+0000","last_peered":"2024-09-12T00:52:54.876433+0000","last_clean":"2024-09-12T00:52:54.876433+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:52:54.876433+0000","last_undegraded":"2024-09-12T00:52:54.876433+0000","last_fullsized":"2024-09-12T00:52:54.876433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883390+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:52:54.883390+0000","last_peered":"2024-09-12T00:52:54.883390+0000","last_clean":"2024-09-12T00:52:54.883390+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:52:54.883390+0000","last_undegraded":"2024-09-12T00:52:54.883390+0000","last_fullsized":"2024-09-12T00:52:54.883390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889494+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:52:54.889494+0000","last_peered":"2024-09-12T00:52:54.889494+0000","last_clean":"2024-09-12T00:52:54.889494+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:52:54.889494+0000","last_undegraded":"2024-09-12T00:52:54.889494+0000","last_fullsized":"2024-09-12T00:52:54.889494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882408+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:52:54.882408+0000","last_peered":"2024-09-12T00:52:54.882408+0000","last_clean":"2024-09-12T00:52:54.882408+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:52:54.882408+0000","last_undegraded":"2024-09-12T00:52:54.882408+0000","last_fullsized":"2024-09-12T00:52:54.882408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871902+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:52:54.871902+0000","last_peered":"2024-09-12T00:52:54.871902+0000","last_clean":"2024-09-12T00:52:54.871902+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:52:54.871902+0000","last_undegraded":"2024-09-12T00:52:54.871902+0000","last_fullsized":"2024-09-12T00:52:54.871902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876051+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:52:54.876051+0000","last_peered":"2024-09-12T00:52:54.876051+0000","last_clean":"2024-09-12T00:52:54.876051+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:52:54.876051+0000","last_undegraded":"2024-09-12T00:52:54.876051+0000","last_fullsized":"2024-09-12T00:52:54.876051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868139+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:52:54.868139+0000","last_peered":"2024-09-12T00:52:54.868139+0000","last_clean":"2024-09-12T00:52:54.868139+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:52:54.868139+0000","last_undegraded":"2024-09-12T00:52:54.868139+0000","last_fullsized":"2024-09-12T00:52:54.868139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'9","reported_seq":136,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.210017+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:52:55.210017+0000","last_peered":"2024-09-12T00:52:55.210017+0000","last_clean":"2024-09-12T00:52:55.210017+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:52:55.210017+0000","last_undegraded":"2024-09-12T00:52:55.210017+0000","last_fullsized":"2024-09-12T00:52:55.210017+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875141+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:52:54.875141+0000","last_peered":"2024-09-12T00:52:54.875141+0000","last_clean":"2024-09-12T00:52:54.875141+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:52:54.875141+0000","last_undegraded":"2024-09-12T00:52:54.875141+0000","last_fullsized":"2024-09-12T00:52:54.875141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.836360+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:52:54.836360+0000","last_peered":"2024-09-12T00:52:54.836360+0000","last_clean":"2024-09-12T00:52:54.836360+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:52:54.836360+0000","last_undegraded":"2024-09-12T00:52:54.836360+0000","last_fullsized":"2024-09-12T00:52:54.836360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.833879+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:52:54.833879+0000","last_peered":"2024-09-12T00:52:54.833879+0000","last_clean":"2024-09-12T00:52:54.833879+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:52:54.833879+0000","last_undegraded":"2024-09-12T00:52:54.833879+0000","last_fullsized":"2024-09-12T00:52:54.833879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888219+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:52:54.888219+0000","last_peered":"2024-09-12T00:52:54.888219+0000","last_clean":"2024-09-12T00:52:54.888219+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.888219+0000","last_undegraded":"2024-09-12T00:52:54.888219+0000","last_fullsized":"2024-09-12T00:52:54.888219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839021+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:52:54.839021+0000","last_peered":"2024-09-12T00:52:54.839021+0000","last_clean":"2024-09-12T00:52:54.839021+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:52:54.839021+0000","last_undegraded":"2024-09-12T00:52:54.839021+0000","last_fullsized":"2024-09-12T00:52:54.839021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887645+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:52:54.887645+0000","last_peered":"2024-09-12T00:52:54.887645+0000","last_clean":"2024-09-12T00:52:54.887645+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:52:54.887645+0000","last_undegraded":"2024-09-12T00:52:54.887645+0000","last_fullsized":"2024-09-12T00:52:54.887645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":127,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.845103+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:52:54.845103+0000","last_peered":"2024-09-12T00:52:54.845103+0000","last_clean":"2024-09-12T00:52:54.845103+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:52:54.845103+0000","last_undegraded":"2024-09-12T00:52:54.845103+0000","last_fullsized":"2024-09-12T00:52:54.845103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.891678+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:52:54.891678+0000","last_peered":"2024-09-12T00:52:54.891678+0000","last_clean":"2024-09-12T00:52:54.891678+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:52:54.891678+0000","last_undegraded":"2024-09-12T00:52:54.891678+0000","last_fullsized":"2024-09-12T00:52:54.891678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.843451+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:52:54.843451+0000","last_peered":"2024-09-12T00:52:54.843451+0000","last_clean":"2024-09-12T00:52:54.843451+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:52:54.843451+0000","last_undegraded":"2024-09-12T00:52:54.843451+0000","last_fullsized":"2024-09-12T00:52:54.843451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887219+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:52:54.887219+0000","last_peered":"2024-09-12T00:52:54.887219+0000","last_clean":"2024-09-12T00:52:54.887219+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:52:54.887219+0000","last_undegraded":"2024-09-12T00:52:54.887219+0000","last_fullsized":"2024-09-12T00:52:54.887219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839370+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:52:54.839370+0000","last_peered":"2024-09-12T00:52:54.839370+0000","last_clean":"2024-09-12T00:52:54.839370+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:52:54.839370+0000","last_undegraded":"2024-09-12T00:52:54.839370+0000","last_fullsized":"2024-09-12T00:52:54.839370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884249+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:52:54.884249+0000","last_peered":"2024-09-12T00:52:54.884249+0000","last_clean":"2024-09-12T00:52:54.884249+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:52:54.884249+0000","last_undegraded":"2024-09-12T00:52:54.884249+0000","last_fullsized":"2024-09-12T00:52:54.884249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'34","reported_seq":261,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.209954+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:52:55.209954+0000","last_peered":"2024-09-12T00:52:55.209954+0000","last_clean":"2024-09-12T00:52:55.209954+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:52:55.209954+0000","last_undegraded":"2024-09-12T00:52:55.209954+0000","last_fullsized":"2024-09-12T00:52:55.209954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":164,"num_write":35,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.866993+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:52:54.866993+0000","last_peered":"2024-09-12T00:52:54.866993+0000","last_clean":"2024-09-12T00:52:54.866993+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:52:54.866993+0000","last_undegraded":"2024-09-12T00:52:54.866993+0000","last_fullsized":"2024-09-12T00:52:54.866993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838847+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:52:54.838847+0000","last_peered":"2024-09-12T00:52:54.838847+0000","last_clean":"2024-09-12T00:52:54.838847+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:52:54.838847+0000","last_undegraded":"2024-09-12T00:52:54.838847+0000","last_fullsized":"2024-09-12T00:52:54.838847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884700+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:52:54.884700+0000","last_peered":"2024-09-12T00:52:54.884700+0000","last_clean":"2024-09-12T00:52:54.884700+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:52:54.884700+0000","last_undegraded":"2024-09-12T00:52:54.884700+0000","last_fullsized":"2024-09-12T00:52:54.884700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839358+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:52:54.839358+0000","last_peered":"2024-09-12T00:52:54.839358+0000","last_clean":"2024-09-12T00:52:54.839358+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:52:54.839358+0000","last_undegraded":"2024-09-12T00:52:54.839358+0000","last_fullsized":"2024-09-12T00:52:54.839358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883708+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:52:54.883708+0000","last_peered":"2024-09-12T00:52:54.883708+0000","last_clean":"2024-09-12T00:52:54.883708+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:52:54.883708+0000","last_undegraded":"2024-09-12T00:52:54.883708+0000","last_fullsized":"2024-09-12T00:52:54.883708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'5","reported_seq":131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.207136+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:52:55.207136+0000","last_peered":"2024-09-12T00:52:55.207136+0000","last_clean":"2024-09-12T00:52:55.207136+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:52:55.207136+0000","last_undegraded":"2024-09-12T00:52:55.207136+0000","last_fullsized":"2024-09-12T00:52:55.207136+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873525+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:52:54.873525+0000","last_peered":"2024-09-12T00:52:54.873525+0000","last_clean":"2024-09-12T00:52:54.873525+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:52:54.873525+0000","last_undegraded":"2024-09-12T00:52:54.873525+0000","last_fullsized":"2024-09-12T00:52:54.873525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.846569+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:52:54.846569+0000","last_peered":"2024-09-12T00:52:54.846569+0000","last_clean":"2024-09-12T00:52:54.846569+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:52:54.846569+0000","last_undegraded":"2024-09-12T00:52:54.846569+0000","last_fullsized":"2024-09-12T00:52:54.846569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.859661+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:52:54.859661+0000","last_peered":"2024-09-12T00:52:54.859661+0000","last_clean":"2024-09-12T00:52:54.859661+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:52:54.859661+0000","last_undegraded":"2024-09-12T00:52:54.859661+0000","last_fullsized":"2024-09-12T00:52:54.859661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848120+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:52:54.848120+0000","last_peered":"2024-09-12T00:52:54.848120+0000","last_clean":"2024-09-12T00:52:54.848120+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:52:54.848120+0000","last_undegraded":"2024-09-12T00:52:54.848120+0000","last_fullsized":"2024-09-12T00:52:54.848120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876330+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:52:54.876330+0000","last_peered":"2024-09-12T00:52:54.876330+0000","last_clean":"2024-09-12T00:52:54.876330+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:52:54.876330+0000","last_undegraded":"2024-09-12T00:52:54.876330+0000","last_fullsized":"2024-09-12T00:52:54.876330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.834098+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:52:54.834098+0000","last_peered":"2024-09-12T00:52:54.834098+0000","last_clean":"2024-09-12T00:52:54.834098+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:52:54.834098+0000","last_undegraded":"2024-09-12T00:52:54.834098+0000","last_fullsized":"2024-09-12T00:52:54.834098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873806+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:52:54.873806+0000","last_peered":"2024-09-12T00:52:54.873806+0000","last_clean":"2024-09-12T00:52:54.873806+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:52:54.873806+0000","last_undegraded":"2024-09-12T00:52:54.873806+0000","last_fullsized":"2024-09-12T00:52:54.873806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":75,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.079853+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:52:55.079853+0000","last_peered":"2024-09-12T00:52:55.079853+0000","last_clean":"2024-09-12T00:52:55.079853+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:52:55.079853+0000","last_undegraded":"2024-09-12T00:52:55.079853+0000","last_fullsized":"2024-09-12T00:52:55.079853+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878977+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:52:54.878977+0000","last_peered":"2024-09-12T00:52:54.878977+0000","last_clean":"2024-09-12T00:52:54.878977+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:52:54.878977+0000","last_undegraded":"2024-09-12T00:52:54.878977+0000","last_fullsized":"2024-09-12T00:52:54.878977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.845024+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:52:54.845024+0000","last_peered":"2024-09-12T00:52:54.845024+0000","last_clean":"2024-09-12T00:52:54.845024+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:52:54.845024+0000","last_undegraded":"2024-09-12T00:52:54.845024+0000","last_fullsized":"2024-09-12T00:52:54.845024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883108+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:52:54.883108+0000","last_peered":"2024-09-12T00:52:54.883108+0000","last_clean":"2024-09-12T00:52:54.883108+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:52:54.883108+0000","last_undegraded":"2024-09-12T00:52:54.883108+0000","last_fullsized":"2024-09-12T00:52:54.883108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841831+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:52:54.841831+0000","last_peered":"2024-09-12T00:52:54.841831+0000","last_clean":"2024-09-12T00:52:54.841831+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:52:54.841831+0000","last_undegraded":"2024-09-12T00:52:54.841831+0000","last_fullsized":"2024-09-12T00:52:54.841831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.844886+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:52:54.844886+0000","last_peered":"2024-09-12T00:52:54.844886+0000","last_clean":"2024-09-12T00:52:54.844886+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:52:54.844886+0000","last_undegraded":"2024-09-12T00:52:54.844886+0000","last_fullsized":"2024-09-12T00:52:54.844886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883842+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:52:54.883842+0000","last_peered":"2024-09-12T00:52:54.883842+0000","last_clean":"2024-09-12T00:52:54.883842+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:52:54.883842+0000","last_undegraded":"2024-09-12T00:52:54.883842+0000","last_fullsized":"2024-09-12T00:52:54.883842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841723+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:52:54.841723+0000","last_peered":"2024-09-12T00:52:54.841723+0000","last_clean":"2024-09-12T00:52:54.841723+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:52:54.841723+0000","last_undegraded":"2024-09-12T00:52:54.841723+0000","last_fullsized":"2024-09-12T00:52:54.841723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874307+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:52:54.874307+0000","last_peered":"2024-09-12T00:52:54.874307+0000","last_clean":"2024-09-12T00:52:54.874307+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.874307+0000","last_undegraded":"2024-09-12T00:52:54.874307+0000","last_fullsized":"2024-09-12T00:52:54.874307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":127,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.840548+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:52:54.840548+0000","last_peered":"2024-09-12T00:52:54.840548+0000","last_clean":"2024-09-12T00:52:54.840548+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:52:54.840548+0000","last_undegraded":"2024-09-12T00:52:54.840548+0000","last_fullsized":"2024-09-12T00:52:54.840548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871701+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:52:54.871701+0000","last_peered":"2024-09-12T00:52:54.871701+0000","last_clean":"2024-09-12T00:52:54.871701+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:52:54.871701+0000","last_undegraded":"2024-09-12T00:52:54.871701+0000","last_fullsized":"2024-09-12T00:52:54.871701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850494+0000","last_change":"2024-09-12T00:52:22.594327+0000","last_active":"2024-09-12T00:52:54.850494+0000","last_peered":"2024-09-12T00:52:54.850494+0000","last_clean":"2024-09-12T00:52:54.850494+0000","last_became_active":"2024-09-12T00:52:22.593876+0000","last_became_peered":"2024-09-12T00:52:22.593876+0000","last_unstale":"2024-09-12T00:52:54.850494+0000","last_undegraded":"2024-09-12T00:52:54.850494+0000","last_fullsized":"2024-09-12T00:52:54.850494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:17.961428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876981+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:52:54.876981+0000","last_peered":"2024-09-12T00:52:54.876981+0000","last_clean":"2024-09-12T00:52:54.876981+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:52:54.876981+0000","last_undegraded":"2024-09-12T00:52:54.876981+0000","last_fullsized":"2024-09-12T00:52:54.876981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841926+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:52:54.841926+0000","last_peered":"2024-09-12T00:52:54.841926+0000","last_clean":"2024-09-12T00:52:54.841926+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:52:54.841926+0000","last_undegraded":"2024-09-12T00:52:54.841926+0000","last_fullsized":"2024-09-12T00:52:54.841926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875489+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:52:54.875489+0000","last_peered":"2024-09-12T00:52:54.875489+0000","last_clean":"2024-09-12T00:52:54.875489+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:52:54.875489+0000","last_undegraded":"2024-09-12T00:52:54.875489+0000","last_fullsized":"2024-09-12T00:52:54.875489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848626+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:52:54.848626+0000","last_peered":"2024-09-12T00:52:54.848626+0000","last_clean":"2024-09-12T00:52:54.848626+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:52:54.848626+0000","last_undegraded":"2024-09-12T00:52:54.848626+0000","last_fullsized":"2024-09-12T00:52:54.848626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884371+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:52:54.884371+0000","last_peered":"2024-09-12T00:52:54.884371+0000","last_clean":"2024-09-12T00:52:54.884371+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:52:54.884371+0000","last_undegraded":"2024-09-12T00:52:54.884371+0000","last_fullsized":"2024-09-12T00:52:54.884371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'45","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.083016+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:52:55.083016+0000","last_peered":"2024-09-12T00:52:55.083016+0000","last_clean":"2024-09-12T00:52:55.083016+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:52:55.083016+0000","last_undegraded":"2024-09-12T00:52:55.083016+0000","last_fullsized":"2024-09-12T00:52:55.083016+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873351+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:52:54.873351+0000","last_peered":"2024-09-12T00:52:54.873351+0000","last_clean":"2024-09-12T00:52:54.873351+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:52:54.873351+0000","last_undegraded":"2024-09-12T00:52:54.873351+0000","last_fullsized":"2024-09-12T00:52:54.873351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848558+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:52:54.848558+0000","last_peered":"2024-09-12T00:52:54.848558+0000","last_clean":"2024-09-12T00:52:54.848558+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:52:54.848558+0000","last_undegraded":"2024-09-12T00:52:54.848558+0000","last_fullsized":"2024-09-12T00:52:54.848558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890212+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:52:54.890212+0000","last_peered":"2024-09-12T00:52:54.890212+0000","last_clean":"2024-09-12T00:52:54.890212+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:52:54.890212+0000","last_undegraded":"2024-09-12T00:52:54.890212+0000","last_fullsized":"2024-09-12T00:52:54.890212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838291+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:52:54.838291+0000","last_peered":"2024-09-12T00:52:54.838291+0000","last_clean":"2024-09-12T00:52:54.838291+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:52:54.838291+0000","last_undegraded":"2024-09-12T00:52:54.838291+0000","last_fullsized":"2024-09-12T00:52:54.838291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875091+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:52:54.875091+0000","last_peered":"2024-09-12T00:52:54.875091+0000","last_clean":"2024-09-12T00:52:54.875091+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:52:54.875091+0000","last_undegraded":"2024-09-12T00:52:54.875091+0000","last_fullsized":"2024-09-12T00:52:54.875091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839819+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:52:54.839819+0000","last_peered":"2024-09-12T00:52:54.839819+0000","last_clean":"2024-09-12T00:52:54.839819+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:52:54.839819+0000","last_undegraded":"2024-09-12T00:52:54.839819+0000","last_fullsized":"2024-09-12T00:52:54.839819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878537+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:52:54.878537+0000","last_peered":"2024-09-12T00:52:54.878537+0000","last_clean":"2024-09-12T00:52:54.878537+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:52:54.878537+0000","last_undegraded":"2024-09-12T00:52:54.878537+0000","last_fullsized":"2024-09-12T00:52:54.878537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838894+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:52:54.838894+0000","last_peered":"2024-09-12T00:52:54.838894+0000","last_clean":"2024-09-12T00:52:54.838894+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:52:54.838894+0000","last_undegraded":"2024-09-12T00:52:54.838894+0000","last_fullsized":"2024-09-12T00:52:54.838894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884443+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:52:54.884443+0000","last_peered":"2024-09-12T00:52:54.884443+0000","last_clean":"2024-09-12T00:52:54.884443+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:52:54.884443+0000","last_undegraded":"2024-09-12T00:52:54.884443+0000","last_fullsized":"2024-09-12T00:52:54.884443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850626+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:52:54.850626+0000","last_peered":"2024-09-12T00:52:54.850626+0000","last_clean":"2024-09-12T00:52:54.850626+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:52:54.850626+0000","last_undegraded":"2024-09-12T00:52:54.850626+0000","last_fullsized":"2024-09-12T00:52:54.850626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880746+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:52:54.880746+0000","last_peered":"2024-09-12T00:52:54.880746+0000","last_clean":"2024-09-12T00:52:54.880746+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:52:54.880746+0000","last_undegraded":"2024-09-12T00:52:54.880746+0000","last_fullsized":"2024-09-12T00:52:54.880746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889345+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:52:54.889345+0000","last_peered":"2024-09-12T00:52:54.889345+0000","last_clean":"2024-09-12T00:52:54.889345+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:52:54.889345+0000","last_undegraded":"2024-09-12T00:52:54.889345+0000","last_fullsized":"2024-09-12T00:52:54.889345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.847896+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:52:54.847896+0000","last_peered":"2024-09-12T00:52:54.847896+0000","last_clean":"2024-09-12T00:52:54.847896+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:52:54.847896+0000","last_undegraded":"2024-09-12T00:52:54.847896+0000","last_fullsized":"2024-09-12T00:52:54.847896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888948+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:52:54.888948+0000","last_peered":"2024-09-12T00:52:54.888948+0000","last_clean":"2024-09-12T00:52:54.888948+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:52:54.888948+0000","last_undegraded":"2024-09-12T00:52:54.888948+0000","last_fullsized":"2024-09-12T00:52:54.888948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848504+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:52:54.848504+0000","last_peered":"2024-09-12T00:52:54.848504+0000","last_clean":"2024-09-12T00:52:54.848504+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:52:54.848504+0000","last_undegraded":"2024-09-12T00:52:54.848504+0000","last_fullsized":"2024-09-12T00:52:54.848504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888796+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:52:54.888796+0000","last_peered":"2024-09-12T00:52:54.888796+0000","last_clean":"2024-09-12T00:52:54.888796+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:52:54.888796+0000","last_undegraded":"2024-09-12T00:52:54.888796+0000","last_fullsized":"2024-09-12T00:52:54.888796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839897+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:52:54.839897+0000","last_peered":"2024-09-12T00:52:54.839897+0000","last_clean":"2024-09-12T00:52:54.839897+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:52:54.839897+0000","last_undegraded":"2024-09-12T00:52:54.839897+0000","last_fullsized":"2024-09-12T00:52:54.839897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879161+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:52:54.879161+0000","last_peered":"2024-09-12T00:52:54.879161+0000","last_clean":"2024-09-12T00:52:54.879161+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:52:54.879161+0000","last_undegraded":"2024-09-12T00:52:54.879161+0000","last_fullsized":"2024-09-12T00:52:54.879161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.842302+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:52:54.842302+0000","last_peered":"2024-09-12T00:52:54.842302+0000","last_clean":"2024-09-12T00:52:54.842302+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:52:54.842302+0000","last_undegraded":"2024-09-12T00:52:54.842302+0000","last_fullsized":"2024-09-12T00:52:54.842302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596760,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":691,"num_read_kb":454,"num_write":285,"num_write_kb":1434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1790280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":454100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28816,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716336,"statfs":{"total":95995035648,"available":95965528064,"internally_reserved":0,"allocated":1773568,"data_stored":1244195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40824,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704328,"statfs":{"total":95995035648,"available":95953231872,"internally_reserved":0,"allocated":1347584,"data_stored":847669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201328,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28340,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716812,"statfs":{"total":95995035648,"available":95966015488,"internally_reserved":0,"allocated":1343488,"data_stored":847472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1544192,"data_stored":1047649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":937984,"data_stored":453725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1556480,"data_stored":1046013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":455390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1478656,"data_stored":978735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":521974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1007616,"data_stored":519998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":454996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:53:00.651 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T00:53:00.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:53:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:00 smithi167 ceph-mon[35234]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:53:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:00 smithi167 ceph-mon[35234]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-12T00:53:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.791+0000 7fad0a1c6640 1 -- 172.21.15.2:0/1897994385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad041035c0 msgr2=0x7fad0410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.791+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/1897994385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad041035c0 0x7fad0410baa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7facf8009900 tx=0x7facf802a480 comp rx=0 tx=0).stop 2024-09-12T00:53:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.791+0000 7fad0a1c6640 1 -- 172.21.15.2:0/1897994385 shutdown_connections 2024-09-12T00:53:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.791+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/1897994385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad0410c0f0 0x7fad0410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.791+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/1897994385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad041035c0 0x7fad0410baa0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.791+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/1897994385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad04102ca0 0x7fad04103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.791+0000 7fad0a1c6640 1 -- 172.21.15.2:0/1897994385 >> 172.21.15.2:0/1897994385 conn(0x7fad040fc6b0 msgr2=0x7fad040fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.791+0000 7fad0a1c6640 1 -- 172.21.15.2:0/1897994385 shutdown_connections 2024-09-12T00:53:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.792+0000 7fad0a1c6640 1 -- 172.21.15.2:0/1897994385 wait complete. 2024-09-12T00:53:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.792+0000 7fad0a1c6640 1 Processor -- start 2024-09-12T00:53:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.792+0000 7fad0a1c6640 1 -- start start 2024-09-12T00:53:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.792+0000 7fad0a1c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad04102ca0 0x7fad04198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.792+0000 7fad0a1c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad041035c0 0x7fad04198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.792+0000 7fad0a1c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0410c0f0 0x7fad0419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad0a1c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad04111f20 con 0x7fad0410c0f0 2024-09-12T00:53:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad0a1c6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad04111da0 con 0x7fad04102ca0 2024-09-12T00:53:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad0a1c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad041120a0 con 0x7fad041035c0 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0410c0f0 0x7fad0419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0410c0f0 0x7fad0419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45348/0 (socket says 172.21.15.2:45348) 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 -- 172.21.15.2:0/528787189 learned_addr learned my addr 172.21.15.2:0/528787189 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad02ffd640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad041035c0 0x7fad04198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad037fe640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad04102ca0 0x7fad04198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 -- 172.21.15.2:0/528787189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad041035c0 msgr2=0x7fad04198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad041035c0 0x7fad04198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 -- 172.21.15.2:0/528787189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad04102ca0 msgr2=0x7fad04198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad04102ca0 0x7fad04198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 -- 172.21.15.2:0/528787189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0419d420 con 0x7fad0410c0f0 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad037fe640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad04102ca0 0x7fad04198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad03fff640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0410c0f0 0x7fad0419ccf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7facfc00eaa0 tx=0x7facfc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad00ff9640 1 -- 172.21.15.2:0/528787189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc00cdb0 con 0x7fad0410c0f0 2024-09-12T00:53:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0419d710 con 0x7fad0410c0f0 2024-09-12T00:53:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad00ff9640 1 -- 172.21.15.2:0/528787189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc005020 con 0x7fad0410c0f0 2024-09-12T00:53:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad00ff9640 1 -- 172.21.15.2:0/528787189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0116b0 con 0x7fad0410c0f0 2024-09-12T00:53:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.793+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad041a4fa0 con 0x7fad0410c0f0 2024-09-12T00:53:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.794+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad04103080 con 0x7fad0410c0f0 2024-09-12T00:53:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.795+0000 7fad00ff9640 1 -- 172.21.15.2:0/528787189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7facfc005560 con 0x7fad0410c0f0 2024-09-12T00:53:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.796+0000 7fad00ff9640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7facec0a2e20 0x7facec0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.796+0000 7fad037fe640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7facec0a2e20 0x7facec0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.796+0000 7fad00ff9640 1 -- 172.21.15.2:0/528787189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7facfc0cf990 con 0x7fad0410c0f0 2024-09-12T00:53:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.797+0000 7fad037fe640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7facec0a2e20 0x7facec0a52e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7facf4005d00 tx=0x7facf4009550 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:00.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.800+0000 7fad00ff9640 1 -- 172.21.15.2:0/528787189 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facfc016030 con 0x7fad0410c0f0 2024-09-12T00:53:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:00 smithi071 ceph-mon[35276]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:53:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:00 smithi071 ceph-mon[35276]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-12T00:53:00.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.976+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad04062630 con 0x7facec0a2e20 2024-09-12T00:53:00.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.982+0000 7fad00ff9640 1 -- 172.21.15.2:0/528787189 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257749 (secure 0 0 0) 0x7fad04062630 con 0x7facec0a2e20 2024-09-12T00:53:00.986 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:00.987 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:53:00.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7facec0a2e20 msgr2=0x7facec0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7facec0a2e20 0x7facec0a52e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7facf4005d00 tx=0x7facf4009550 comp rx=0 tx=0).stop 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0410c0f0 msgr2=0x7fad0419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0410c0f0 0x7fad0419ccf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7facfc00eaa0 tx=0x7facfc00ef60 comp rx=0 tx=0).stop 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 shutdown_connections 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7facec0a2e20 0x7facec0a52e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad0410c0f0 0x7fad0419ccf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad041035c0 0x7fad04198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 --2- 172.21.15.2:0/528787189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad04102ca0 0x7fad04198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.985+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 >> 172.21.15.2:0/528787189 conn(0x7fad040fc6b0 msgr2=0x7fad040fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.986+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 shutdown_connections 2024-09-12T00:53:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:00.986+0000 7fad0a1c6640 1 -- 172.21.15.2:0/528787189 wait complete. 2024-09-12T00:53:00.996 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-09-12T00:53:00.874131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188541,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":961,"num_read_kb":802,"num_write":499,"num_write_kb":4381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":880,"ondisk_log_size":880,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376512,"kb_used_data":14640,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565312,"statfs":{"total":1151940427776,"available":1151554879488,"internally_reserved":0,"allocated":14991360,"data_stored":9007839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1179,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":229,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.015532"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884145+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:52:54.884145+0000","last_peered":"2024-09-12T00:52:54.884145+0000","last_clean":"2024-09-12T00:52:54.884145+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:52:54.884145+0000","last_undegraded":"2024-09-12T00:52:54.884145+0000","last_fullsized":"2024-09-12T00:52:54.884145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880965+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:52:54.880965+0000","last_peered":"2024-09-12T00:52:54.880965+0000","last_clean":"2024-09-12T00:52:54.880965+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:52:54.880965+0000","last_undegraded":"2024-09-12T00:52:54.880965+0000","last_fullsized":"2024-09-12T00:52:54.880965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888565+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:52:54.888565+0000","last_peered":"2024-09-12T00:52:54.888565+0000","last_clean":"2024-09-12T00:52:54.888565+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:52:54.888565+0000","last_undegraded":"2024-09-12T00:52:54.888565+0000","last_fullsized":"2024-09-12T00:52:54.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871452+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:52:54.871452+0000","last_peered":"2024-09-12T00:52:54.871452+0000","last_clean":"2024-09-12T00:52:54.871452+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:52:54.871452+0000","last_undegraded":"2024-09-12T00:52:54.871452+0000","last_fullsized":"2024-09-12T00:52:54.871452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871301+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:52:54.871301+0000","last_peered":"2024-09-12T00:52:54.871301+0000","last_clean":"2024-09-12T00:52:54.871301+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:52:54.871301+0000","last_undegraded":"2024-09-12T00:52:54.871301+0000","last_fullsized":"2024-09-12T00:52:54.871301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890111+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:52:54.890111+0000","last_peered":"2024-09-12T00:52:54.890111+0000","last_clean":"2024-09-12T00:52:54.890111+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:52:54.890111+0000","last_undegraded":"2024-09-12T00:52:54.890111+0000","last_fullsized":"2024-09-12T00:52:54.890111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879651+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:52:54.879651+0000","last_peered":"2024-09-12T00:52:54.879651+0000","last_clean":"2024-09-12T00:52:54.879651+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:52:54.879651+0000","last_undegraded":"2024-09-12T00:52:54.879651+0000","last_fullsized":"2024-09-12T00:52:54.879651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880503+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:52:54.880503+0000","last_peered":"2024-09-12T00:52:54.880503+0000","last_clean":"2024-09-12T00:52:54.880503+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:52:54.880503+0000","last_undegraded":"2024-09-12T00:52:54.880503+0000","last_fullsized":"2024-09-12T00:52:54.880503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880321+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:52:54.880321+0000","last_peered":"2024-09-12T00:52:54.880321+0000","last_clean":"2024-09-12T00:52:54.880321+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:52:54.880321+0000","last_undegraded":"2024-09-12T00:52:54.880321+0000","last_fullsized":"2024-09-12T00:52:54.880321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878237+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:52:54.878237+0000","last_peered":"2024-09-12T00:52:54.878237+0000","last_clean":"2024-09-12T00:52:54.878237+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:52:54.878237+0000","last_undegraded":"2024-09-12T00:52:54.878237+0000","last_fullsized":"2024-09-12T00:52:54.878237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.881472+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:52:54.881472+0000","last_peered":"2024-09-12T00:52:54.881472+0000","last_clean":"2024-09-12T00:52:54.881472+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:52:54.881472+0000","last_undegraded":"2024-09-12T00:52:54.881472+0000","last_fullsized":"2024-09-12T00:52:54.881472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868621+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:52:54.868621+0000","last_peered":"2024-09-12T00:52:54.868621+0000","last_clean":"2024-09-12T00:52:54.868621+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:52:54.868621+0000","last_undegraded":"2024-09-12T00:52:54.868621+0000","last_fullsized":"2024-09-12T00:52:54.868621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884657+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:52:54.884657+0000","last_peered":"2024-09-12T00:52:54.884657+0000","last_clean":"2024-09-12T00:52:54.884657+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:52:54.884657+0000","last_undegraded":"2024-09-12T00:52:54.884657+0000","last_fullsized":"2024-09-12T00:52:54.884657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.886083+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:52:54.886083+0000","last_peered":"2024-09-12T00:52:54.886083+0000","last_clean":"2024-09-12T00:52:54.886083+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:52:54.886083+0000","last_undegraded":"2024-09-12T00:52:54.886083+0000","last_fullsized":"2024-09-12T00:52:54.886083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889586+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:52:54.889586+0000","last_peered":"2024-09-12T00:52:54.889586+0000","last_clean":"2024-09-12T00:52:54.889586+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:52:54.889586+0000","last_undegraded":"2024-09-12T00:52:54.889586+0000","last_fullsized":"2024-09-12T00:52:54.889586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887265+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:52:54.887265+0000","last_peered":"2024-09-12T00:52:54.887265+0000","last_clean":"2024-09-12T00:52:54.887265+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:52:54.887265+0000","last_undegraded":"2024-09-12T00:52:54.887265+0000","last_fullsized":"2024-09-12T00:52:54.887265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884255+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:52:54.884255+0000","last_peered":"2024-09-12T00:52:54.884255+0000","last_clean":"2024-09-12T00:52:54.884255+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:52:54.884255+0000","last_undegraded":"2024-09-12T00:52:54.884255+0000","last_fullsized":"2024-09-12T00:52:54.884255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889401+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:52:54.889401+0000","last_peered":"2024-09-12T00:52:54.889401+0000","last_clean":"2024-09-12T00:52:54.889401+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:52:54.889401+0000","last_undegraded":"2024-09-12T00:52:54.889401+0000","last_fullsized":"2024-09-12T00:52:54.889401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874518+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:52:54.874518+0000","last_peered":"2024-09-12T00:52:54.874518+0000","last_clean":"2024-09-12T00:52:54.874518+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:52:54.874518+0000","last_undegraded":"2024-09-12T00:52:54.874518+0000","last_fullsized":"2024-09-12T00:52:54.874518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871178+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:52:54.871178+0000","last_peered":"2024-09-12T00:52:54.871178+0000","last_clean":"2024-09-12T00:52:54.871178+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:52:54.871178+0000","last_undegraded":"2024-09-12T00:52:54.871178+0000","last_fullsized":"2024-09-12T00:52:54.871178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883483+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:52:54.883483+0000","last_peered":"2024-09-12T00:52:54.883483+0000","last_clean":"2024-09-12T00:52:54.883483+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:52:54.883483+0000","last_undegraded":"2024-09-12T00:52:54.883483+0000","last_fullsized":"2024-09-12T00:52:54.883483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.885630+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:52:54.885630+0000","last_peered":"2024-09-12T00:52:54.885630+0000","last_clean":"2024-09-12T00:52:54.885630+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:52:54.885630+0000","last_undegraded":"2024-09-12T00:52:54.885630+0000","last_fullsized":"2024-09-12T00:52:54.885630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876750+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:52:54.876750+0000","last_peered":"2024-09-12T00:52:54.876750+0000","last_clean":"2024-09-12T00:52:54.876750+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:52:54.876750+0000","last_undegraded":"2024-09-12T00:52:54.876750+0000","last_fullsized":"2024-09-12T00:52:54.876750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875520+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:52:54.875520+0000","last_peered":"2024-09-12T00:52:54.875520+0000","last_clean":"2024-09-12T00:52:54.875520+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:52:54.875520+0000","last_undegraded":"2024-09-12T00:52:54.875520+0000","last_fullsized":"2024-09-12T00:52:54.875520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874846+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:52:54.874846+0000","last_peered":"2024-09-12T00:52:54.874846+0000","last_clean":"2024-09-12T00:52:54.874846+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:52:54.874846+0000","last_undegraded":"2024-09-12T00:52:54.874846+0000","last_fullsized":"2024-09-12T00:52:54.874846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882315+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:52:54.882315+0000","last_peered":"2024-09-12T00:52:54.882315+0000","last_clean":"2024-09-12T00:52:54.882315+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:52:54.882315+0000","last_undegraded":"2024-09-12T00:52:54.882315+0000","last_fullsized":"2024-09-12T00:52:54.882315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876433+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:52:54.876433+0000","last_peered":"2024-09-12T00:52:54.876433+0000","last_clean":"2024-09-12T00:52:54.876433+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:52:54.876433+0000","last_undegraded":"2024-09-12T00:52:54.876433+0000","last_fullsized":"2024-09-12T00:52:54.876433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883390+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:52:54.883390+0000","last_peered":"2024-09-12T00:52:54.883390+0000","last_clean":"2024-09-12T00:52:54.883390+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:52:54.883390+0000","last_undegraded":"2024-09-12T00:52:54.883390+0000","last_fullsized":"2024-09-12T00:52:54.883390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889494+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:52:54.889494+0000","last_peered":"2024-09-12T00:52:54.889494+0000","last_clean":"2024-09-12T00:52:54.889494+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:52:54.889494+0000","last_undegraded":"2024-09-12T00:52:54.889494+0000","last_fullsized":"2024-09-12T00:52:54.889494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882408+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:52:54.882408+0000","last_peered":"2024-09-12T00:52:54.882408+0000","last_clean":"2024-09-12T00:52:54.882408+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:52:54.882408+0000","last_undegraded":"2024-09-12T00:52:54.882408+0000","last_fullsized":"2024-09-12T00:52:54.882408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871902+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:52:54.871902+0000","last_peered":"2024-09-12T00:52:54.871902+0000","last_clean":"2024-09-12T00:52:54.871902+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:52:54.871902+0000","last_undegraded":"2024-09-12T00:52:54.871902+0000","last_fullsized":"2024-09-12T00:52:54.871902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876051+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:52:54.876051+0000","last_peered":"2024-09-12T00:52:54.876051+0000","last_clean":"2024-09-12T00:52:54.876051+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:52:54.876051+0000","last_undegraded":"2024-09-12T00:52:54.876051+0000","last_fullsized":"2024-09-12T00:52:54.876051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868139+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:52:54.868139+0000","last_peered":"2024-09-12T00:52:54.868139+0000","last_clean":"2024-09-12T00:52:54.868139+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:52:54.868139+0000","last_undegraded":"2024-09-12T00:52:54.868139+0000","last_fullsized":"2024-09-12T00:52:54.868139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'10","reported_seq":143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.215816+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:52:59.215816+0000","last_peered":"2024-09-12T00:52:59.215816+0000","last_clean":"2024-09-12T00:52:59.215816+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:52:59.215816+0000","last_undegraded":"2024-09-12T00:52:59.215816+0000","last_fullsized":"2024-09-12T00:52:59.215816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2335,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875141+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:52:54.875141+0000","last_peered":"2024-09-12T00:52:54.875141+0000","last_clean":"2024-09-12T00:52:54.875141+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:52:54.875141+0000","last_undegraded":"2024-09-12T00:52:54.875141+0000","last_fullsized":"2024-09-12T00:52:54.875141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.836360+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:52:54.836360+0000","last_peered":"2024-09-12T00:52:54.836360+0000","last_clean":"2024-09-12T00:52:54.836360+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:52:54.836360+0000","last_undegraded":"2024-09-12T00:52:54.836360+0000","last_fullsized":"2024-09-12T00:52:54.836360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.833879+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:52:54.833879+0000","last_peered":"2024-09-12T00:52:54.833879+0000","last_clean":"2024-09-12T00:52:54.833879+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:52:54.833879+0000","last_undegraded":"2024-09-12T00:52:54.833879+0000","last_fullsized":"2024-09-12T00:52:54.833879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888219+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:52:54.888219+0000","last_peered":"2024-09-12T00:52:54.888219+0000","last_clean":"2024-09-12T00:52:54.888219+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.888219+0000","last_undegraded":"2024-09-12T00:52:54.888219+0000","last_fullsized":"2024-09-12T00:52:54.888219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839021+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:52:54.839021+0000","last_peered":"2024-09-12T00:52:54.839021+0000","last_clean":"2024-09-12T00:52:54.839021+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:52:54.839021+0000","last_undegraded":"2024-09-12T00:52:54.839021+0000","last_fullsized":"2024-09-12T00:52:54.839021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887645+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:52:54.887645+0000","last_peered":"2024-09-12T00:52:54.887645+0000","last_clean":"2024-09-12T00:52:54.887645+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:52:54.887645+0000","last_undegraded":"2024-09-12T00:52:54.887645+0000","last_fullsized":"2024-09-12T00:52:54.887645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.215284+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:52:59.215284+0000","last_peered":"2024-09-12T00:52:59.215284+0000","last_clean":"2024-09-12T00:52:59.215284+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:52:59.215284+0000","last_undegraded":"2024-09-12T00:52:59.215284+0000","last_fullsized":"2024-09-12T00:52:59.215284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.891678+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:52:54.891678+0000","last_peered":"2024-09-12T00:52:54.891678+0000","last_clean":"2024-09-12T00:52:54.891678+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:52:54.891678+0000","last_undegraded":"2024-09-12T00:52:54.891678+0000","last_fullsized":"2024-09-12T00:52:54.891678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.843451+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:52:54.843451+0000","last_peered":"2024-09-12T00:52:54.843451+0000","last_clean":"2024-09-12T00:52:54.843451+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:52:54.843451+0000","last_undegraded":"2024-09-12T00:52:54.843451+0000","last_fullsized":"2024-09-12T00:52:54.843451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887219+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:52:54.887219+0000","last_peered":"2024-09-12T00:52:54.887219+0000","last_clean":"2024-09-12T00:52:54.887219+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:52:54.887219+0000","last_undegraded":"2024-09-12T00:52:54.887219+0000","last_fullsized":"2024-09-12T00:52:54.887219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839370+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:52:54.839370+0000","last_peered":"2024-09-12T00:52:54.839370+0000","last_clean":"2024-09-12T00:52:54.839370+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:52:54.839370+0000","last_undegraded":"2024-09-12T00:52:54.839370+0000","last_fullsized":"2024-09-12T00:52:54.839370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884249+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:52:54.884249+0000","last_peered":"2024-09-12T00:52:54.884249+0000","last_clean":"2024-09-12T00:52:54.884249+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:52:54.884249+0000","last_undegraded":"2024-09-12T00:52:54.884249+0000","last_fullsized":"2024-09-12T00:52:54.884249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'35","reported_seq":273,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.216728+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:53:00.216728+0000","last_peered":"2024-09-12T00:53:00.216728+0000","last_clean":"2024-09-12T00:53:00.216728+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:53:00.216728+0000","last_undegraded":"2024-09-12T00:53:00.216728+0000","last_fullsized":"2024-09-12T00:53:00.216728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66873,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":170,"num_write":36,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.866993+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:52:54.866993+0000","last_peered":"2024-09-12T00:52:54.866993+0000","last_clean":"2024-09-12T00:52:54.866993+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:52:54.866993+0000","last_undegraded":"2024-09-12T00:52:54.866993+0000","last_fullsized":"2024-09-12T00:52:54.866993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838847+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:52:54.838847+0000","last_peered":"2024-09-12T00:52:54.838847+0000","last_clean":"2024-09-12T00:52:54.838847+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:52:54.838847+0000","last_undegraded":"2024-09-12T00:52:54.838847+0000","last_fullsized":"2024-09-12T00:52:54.838847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884700+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:52:54.884700+0000","last_peered":"2024-09-12T00:52:54.884700+0000","last_clean":"2024-09-12T00:52:54.884700+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:52:54.884700+0000","last_undegraded":"2024-09-12T00:52:54.884700+0000","last_fullsized":"2024-09-12T00:52:54.884700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839358+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:52:54.839358+0000","last_peered":"2024-09-12T00:52:54.839358+0000","last_clean":"2024-09-12T00:52:54.839358+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:52:54.839358+0000","last_undegraded":"2024-09-12T00:52:54.839358+0000","last_fullsized":"2024-09-12T00:52:54.839358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883708+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:52:54.883708+0000","last_peered":"2024-09-12T00:52:54.883708+0000","last_clean":"2024-09-12T00:52:54.883708+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:52:54.883708+0000","last_undegraded":"2024-09-12T00:52:54.883708+0000","last_fullsized":"2024-09-12T00:52:54.883708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.213129+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:52:59.213129+0000","last_peered":"2024-09-12T00:52:59.213129+0000","last_clean":"2024-09-12T00:52:59.213129+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:52:59.213129+0000","last_undegraded":"2024-09-12T00:52:59.213129+0000","last_fullsized":"2024-09-12T00:52:59.213129+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873525+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:52:54.873525+0000","last_peered":"2024-09-12T00:52:54.873525+0000","last_clean":"2024-09-12T00:52:54.873525+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:52:54.873525+0000","last_undegraded":"2024-09-12T00:52:54.873525+0000","last_fullsized":"2024-09-12T00:52:54.873525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.846569+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:52:54.846569+0000","last_peered":"2024-09-12T00:52:54.846569+0000","last_clean":"2024-09-12T00:52:54.846569+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:52:54.846569+0000","last_undegraded":"2024-09-12T00:52:54.846569+0000","last_fullsized":"2024-09-12T00:52:54.846569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.859661+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:52:54.859661+0000","last_peered":"2024-09-12T00:52:54.859661+0000","last_clean":"2024-09-12T00:52:54.859661+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:52:54.859661+0000","last_undegraded":"2024-09-12T00:52:54.859661+0000","last_fullsized":"2024-09-12T00:52:54.859661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848120+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:52:54.848120+0000","last_peered":"2024-09-12T00:52:54.848120+0000","last_clean":"2024-09-12T00:52:54.848120+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:52:54.848120+0000","last_undegraded":"2024-09-12T00:52:54.848120+0000","last_fullsized":"2024-09-12T00:52:54.848120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876330+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:52:54.876330+0000","last_peered":"2024-09-12T00:52:54.876330+0000","last_clean":"2024-09-12T00:52:54.876330+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:52:54.876330+0000","last_undegraded":"2024-09-12T00:52:54.876330+0000","last_fullsized":"2024-09-12T00:52:54.876330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.834098+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:52:54.834098+0000","last_peered":"2024-09-12T00:52:54.834098+0000","last_clean":"2024-09-12T00:52:54.834098+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:52:54.834098+0000","last_undegraded":"2024-09-12T00:52:54.834098+0000","last_fullsized":"2024-09-12T00:52:54.834098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873806+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:52:54.873806+0000","last_peered":"2024-09-12T00:52:54.873806+0000","last_clean":"2024-09-12T00:52:54.873806+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:52:54.873806+0000","last_undegraded":"2024-09-12T00:52:54.873806+0000","last_fullsized":"2024-09-12T00:52:54.873806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":75,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.079853+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:52:55.079853+0000","last_peered":"2024-09-12T00:52:55.079853+0000","last_clean":"2024-09-12T00:52:55.079853+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:52:55.079853+0000","last_undegraded":"2024-09-12T00:52:55.079853+0000","last_fullsized":"2024-09-12T00:52:55.079853+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878977+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:52:54.878977+0000","last_peered":"2024-09-12T00:52:54.878977+0000","last_clean":"2024-09-12T00:52:54.878977+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:52:54.878977+0000","last_undegraded":"2024-09-12T00:52:54.878977+0000","last_fullsized":"2024-09-12T00:52:54.878977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.845024+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:52:54.845024+0000","last_peered":"2024-09-12T00:52:54.845024+0000","last_clean":"2024-09-12T00:52:54.845024+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:52:54.845024+0000","last_undegraded":"2024-09-12T00:52:54.845024+0000","last_fullsized":"2024-09-12T00:52:54.845024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883108+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:52:54.883108+0000","last_peered":"2024-09-12T00:52:54.883108+0000","last_clean":"2024-09-12T00:52:54.883108+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:52:54.883108+0000","last_undegraded":"2024-09-12T00:52:54.883108+0000","last_fullsized":"2024-09-12T00:52:54.883108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"84'148","reported_seq":393,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.974099+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:52:56.974099+0000","last_peered":"2024-09-12T00:52:56.974099+0000","last_clean":"2024-09-12T00:52:56.974099+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:52:56.974099+0000","last_undegraded":"2024-09-12T00:52:56.974099+0000","last_fullsized":"2024-09-12T00:52:56.974099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.844886+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:52:54.844886+0000","last_peered":"2024-09-12T00:52:54.844886+0000","last_clean":"2024-09-12T00:52:54.844886+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:52:54.844886+0000","last_undegraded":"2024-09-12T00:52:54.844886+0000","last_fullsized":"2024-09-12T00:52:54.844886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883842+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:52:54.883842+0000","last_peered":"2024-09-12T00:52:54.883842+0000","last_clean":"2024-09-12T00:52:54.883842+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:52:54.883842+0000","last_undegraded":"2024-09-12T00:52:54.883842+0000","last_fullsized":"2024-09-12T00:52:54.883842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841723+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:52:54.841723+0000","last_peered":"2024-09-12T00:52:54.841723+0000","last_clean":"2024-09-12T00:52:54.841723+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:52:54.841723+0000","last_undegraded":"2024-09-12T00:52:54.841723+0000","last_fullsized":"2024-09-12T00:52:54.841723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874307+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:52:54.874307+0000","last_peered":"2024-09-12T00:52:54.874307+0000","last_clean":"2024-09-12T00:52:54.874307+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.874307+0000","last_undegraded":"2024-09-12T00:52:54.874307+0000","last_fullsized":"2024-09-12T00:52:54.874307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.212388+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:52:59.212388+0000","last_peered":"2024-09-12T00:52:59.212388+0000","last_clean":"2024-09-12T00:52:59.212388+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:52:59.212388+0000","last_undegraded":"2024-09-12T00:52:59.212388+0000","last_fullsized":"2024-09-12T00:52:59.212388+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871701+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:52:54.871701+0000","last_peered":"2024-09-12T00:52:54.871701+0000","last_clean":"2024-09-12T00:52:54.871701+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:52:54.871701+0000","last_undegraded":"2024-09-12T00:52:54.871701+0000","last_fullsized":"2024-09-12T00:52:54.871701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850494+0000","last_change":"2024-09-12T00:52:22.594327+0000","last_active":"2024-09-12T00:52:54.850494+0000","last_peered":"2024-09-12T00:52:54.850494+0000","last_clean":"2024-09-12T00:52:54.850494+0000","last_became_active":"2024-09-12T00:52:22.593876+0000","last_became_peered":"2024-09-12T00:52:22.593876+0000","last_unstale":"2024-09-12T00:52:54.850494+0000","last_undegraded":"2024-09-12T00:52:54.850494+0000","last_fullsized":"2024-09-12T00:52:54.850494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:17.961428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876981+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:52:54.876981+0000","last_peered":"2024-09-12T00:52:54.876981+0000","last_clean":"2024-09-12T00:52:54.876981+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:52:54.876981+0000","last_undegraded":"2024-09-12T00:52:54.876981+0000","last_fullsized":"2024-09-12T00:52:54.876981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841926+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:52:54.841926+0000","last_peered":"2024-09-12T00:52:54.841926+0000","last_clean":"2024-09-12T00:52:54.841926+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:52:54.841926+0000","last_undegraded":"2024-09-12T00:52:54.841926+0000","last_fullsized":"2024-09-12T00:52:54.841926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875489+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:52:54.875489+0000","last_peered":"2024-09-12T00:52:54.875489+0000","last_clean":"2024-09-12T00:52:54.875489+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:52:54.875489+0000","last_undegraded":"2024-09-12T00:52:54.875489+0000","last_fullsized":"2024-09-12T00:52:54.875489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848626+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:52:54.848626+0000","last_peered":"2024-09-12T00:52:54.848626+0000","last_clean":"2024-09-12T00:52:54.848626+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:52:54.848626+0000","last_undegraded":"2024-09-12T00:52:54.848626+0000","last_fullsized":"2024-09-12T00:52:54.848626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884371+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:52:54.884371+0000","last_peered":"2024-09-12T00:52:54.884371+0000","last_clean":"2024-09-12T00:52:54.884371+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:52:54.884371+0000","last_undegraded":"2024-09-12T00:52:54.884371+0000","last_fullsized":"2024-09-12T00:52:54.884371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'47","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.044576+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:52:56.044576+0000","last_peered":"2024-09-12T00:52:56.044576+0000","last_clean":"2024-09-12T00:52:56.044576+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:52:56.044576+0000","last_undegraded":"2024-09-12T00:52:56.044576+0000","last_fullsized":"2024-09-12T00:52:56.044576+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873351+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:52:54.873351+0000","last_peered":"2024-09-12T00:52:54.873351+0000","last_clean":"2024-09-12T00:52:54.873351+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:52:54.873351+0000","last_undegraded":"2024-09-12T00:52:54.873351+0000","last_fullsized":"2024-09-12T00:52:54.873351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848558+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:52:54.848558+0000","last_peered":"2024-09-12T00:52:54.848558+0000","last_clean":"2024-09-12T00:52:54.848558+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:52:54.848558+0000","last_undegraded":"2024-09-12T00:52:54.848558+0000","last_fullsized":"2024-09-12T00:52:54.848558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890212+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:52:54.890212+0000","last_peered":"2024-09-12T00:52:54.890212+0000","last_clean":"2024-09-12T00:52:54.890212+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:52:54.890212+0000","last_undegraded":"2024-09-12T00:52:54.890212+0000","last_fullsized":"2024-09-12T00:52:54.890212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838291+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:52:54.838291+0000","last_peered":"2024-09-12T00:52:54.838291+0000","last_clean":"2024-09-12T00:52:54.838291+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:52:54.838291+0000","last_undegraded":"2024-09-12T00:52:54.838291+0000","last_fullsized":"2024-09-12T00:52:54.838291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875091+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:52:54.875091+0000","last_peered":"2024-09-12T00:52:54.875091+0000","last_clean":"2024-09-12T00:52:54.875091+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:52:54.875091+0000","last_undegraded":"2024-09-12T00:52:54.875091+0000","last_fullsized":"2024-09-12T00:52:54.875091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839819+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:52:54.839819+0000","last_peered":"2024-09-12T00:52:54.839819+0000","last_clean":"2024-09-12T00:52:54.839819+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:52:54.839819+0000","last_undegraded":"2024-09-12T00:52:54.839819+0000","last_fullsized":"2024-09-12T00:52:54.839819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878537+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:52:54.878537+0000","last_peered":"2024-09-12T00:52:54.878537+0000","last_clean":"2024-09-12T00:52:54.878537+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:52:54.878537+0000","last_undegraded":"2024-09-12T00:52:54.878537+0000","last_fullsized":"2024-09-12T00:52:54.878537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.061886+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:52:56.061886+0000","last_peered":"2024-09-12T00:52:56.061886+0000","last_clean":"2024-09-12T00:52:56.061886+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:52:56.061886+0000","last_undegraded":"2024-09-12T00:52:56.061886+0000","last_fullsized":"2024-09-12T00:52:56.061886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884443+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:52:54.884443+0000","last_peered":"2024-09-12T00:52:54.884443+0000","last_clean":"2024-09-12T00:52:54.884443+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:52:54.884443+0000","last_undegraded":"2024-09-12T00:52:54.884443+0000","last_fullsized":"2024-09-12T00:52:54.884443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850626+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:52:54.850626+0000","last_peered":"2024-09-12T00:52:54.850626+0000","last_clean":"2024-09-12T00:52:54.850626+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:52:54.850626+0000","last_undegraded":"2024-09-12T00:52:54.850626+0000","last_fullsized":"2024-09-12T00:52:54.850626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880746+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:52:54.880746+0000","last_peered":"2024-09-12T00:52:54.880746+0000","last_clean":"2024-09-12T00:52:54.880746+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:52:54.880746+0000","last_undegraded":"2024-09-12T00:52:54.880746+0000","last_fullsized":"2024-09-12T00:52:54.880746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889345+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:52:54.889345+0000","last_peered":"2024-09-12T00:52:54.889345+0000","last_clean":"2024-09-12T00:52:54.889345+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:52:54.889345+0000","last_undegraded":"2024-09-12T00:52:54.889345+0000","last_fullsized":"2024-09-12T00:52:54.889345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.847896+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:52:54.847896+0000","last_peered":"2024-09-12T00:52:54.847896+0000","last_clean":"2024-09-12T00:52:54.847896+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:52:54.847896+0000","last_undegraded":"2024-09-12T00:52:54.847896+0000","last_fullsized":"2024-09-12T00:52:54.847896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888948+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:52:54.888948+0000","last_peered":"2024-09-12T00:52:54.888948+0000","last_clean":"2024-09-12T00:52:54.888948+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:52:54.888948+0000","last_undegraded":"2024-09-12T00:52:54.888948+0000","last_fullsized":"2024-09-12T00:52:54.888948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848504+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:52:54.848504+0000","last_peered":"2024-09-12T00:52:54.848504+0000","last_clean":"2024-09-12T00:52:54.848504+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:52:54.848504+0000","last_undegraded":"2024-09-12T00:52:54.848504+0000","last_fullsized":"2024-09-12T00:52:54.848504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888796+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:52:54.888796+0000","last_peered":"2024-09-12T00:52:54.888796+0000","last_clean":"2024-09-12T00:52:54.888796+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:52:54.888796+0000","last_undegraded":"2024-09-12T00:52:54.888796+0000","last_fullsized":"2024-09-12T00:52:54.888796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839897+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:52:54.839897+0000","last_peered":"2024-09-12T00:52:54.839897+0000","last_clean":"2024-09-12T00:52:54.839897+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:52:54.839897+0000","last_undegraded":"2024-09-12T00:52:54.839897+0000","last_fullsized":"2024-09-12T00:52:54.839897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879161+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:52:54.879161+0000","last_peered":"2024-09-12T00:52:54.879161+0000","last_clean":"2024-09-12T00:52:54.879161+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:52:54.879161+0000","last_undegraded":"2024-09-12T00:52:54.879161+0000","last_fullsized":"2024-09-12T00:52:54.879161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.842302+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:52:54.842302+0000","last_peered":"2024-09-12T00:52:54.842302+0000","last_clean":"2024-09-12T00:52:54.842302+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:52:54.842302+0000","last_undegraded":"2024-09-12T00:52:54.842302+0000","last_fullsized":"2024-09-12T00:52:54.842302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597939,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":724,"num_read_kb":472,"num_write":296,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1793817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":454100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28816,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716336,"statfs":{"total":95995035648,"available":95965528064,"internally_reserved":0,"allocated":1773568,"data_stored":1244981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972396,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40820,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704332,"statfs":{"total":95995035648,"available":95953235968,"internally_reserved":0,"allocated":1347584,"data_stored":847669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201329,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716816,"statfs":{"total":95995035648,"available":95966019584,"internally_reserved":0,"allocated":1343488,"data_stored":847472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1048435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593788,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":937984,"data_stored":453725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32896,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712256,"statfs":{"total":95995035648,"available":95961350144,"internally_reserved":0,"allocated":1691648,"data_stored":1178792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":455783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1478656,"data_stored":978735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":522760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1007616,"data_stored":520391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":454996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:53:01.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:53:01.293 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:01.678 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:01 smithi002 ceph-mon[31210]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:01.678 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:01 smithi002 ceph-mon[31210]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 -- 172.21.15.2:0/129464600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c102d40 msgr2=0x7f5f7c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 --2- 172.21.15.2:0/129464600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c102d40 0x7f5f7c103120 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009900 tx=0x7f5f6c02a480 comp rx=0 tx=0).stop 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 -- 172.21.15.2:0/129464600 shutdown_connections 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 --2- 172.21.15.2:0/129464600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f7c10c170 0x7f5f7c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 --2- 172.21.15.2:0/129464600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f7c103660 0x7f5f7c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 --2- 172.21.15.2:0/129464600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c102d40 0x7f5f7c103120 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 -- 172.21.15.2:0/129464600 >> 172.21.15.2:0/129464600 conn(0x7f5f7c0fc7a0 msgr2=0x7f5f7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 -- 172.21.15.2:0/129464600 shutdown_connections 2024-09-12T00:53:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.761+0000 7f5f8322d640 1 -- 172.21.15.2:0/129464600 wait complete. 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f8322d640 1 Processor -- start 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f8322d640 1 -- start start 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f8322d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f7c102d40 0x7f5f7c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f8322d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f7c103660 0x7f5f7c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f8322d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c10c170 0x7f5f7c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f8322d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c111f70 con 0x7f5f7c10c170 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f8322d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c111df0 con 0x7f5f7c102d40 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f8322d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c1120f0 con 0x7f5f7c103660 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f817ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c10c170 0x7f5f7c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f817ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c10c170 0x7f5f7c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45374/0 (socket says 172.21.15.2:45374) 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f817ca640 1 -- 172.21.15.2:0/611260735 learned_addr learned my addr 172.21.15.2:0/611260735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f80fc9640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f7c102d40 0x7f5f7c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f7bfff640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f7c103660 0x7f5f7c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f817ca640 1 -- 172.21.15.2:0/611260735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f7c103660 msgr2=0x7f5f7c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f817ca640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f7c103660 0x7f5f7c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f817ca640 1 -- 172.21.15.2:0/611260735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f7c102d40 msgr2=0x7f5f7c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f817ca640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f7c102d40 0x7f5f7c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.762+0000 7f5f817ca640 1 -- 172.21.15.2:0/611260735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c19d380 con 0x7f5f7c10c170 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.763+0000 7f5f817ca640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c10c170 0x7f5f7c19cca0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400cce0 tx=0x7f5f7400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.763+0000 7f5f79ffb640 1 -- 172.21.15.2:0/611260735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7400f450 con 0x7f5f7c10c170 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.763+0000 7f5f79ffb640 1 -- 172.21.15.2:0/611260735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f7400fad0 con 0x7f5f7c10c170 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.763+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c19d670 con 0x7f5f7c10c170 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.763+0000 7f5f79ffb640 1 -- 172.21.15.2:0/611260735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74018c10 con 0x7f5f7c10c170 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.763+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7c1a4f50 con 0x7f5f7c10c170 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.764+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7c103120 con 0x7f5f7c10c170 2024-09-12T00:53:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.765+0000 7f5f79ffb640 1 -- 172.21.15.2:0/611260735 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f5f7400f5f0 con 0x7f5f7c10c170 2024-09-12T00:53:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.766+0000 7f5f79ffb640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f640a2e10 0x7f5f640a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.766+0000 7f5f80fc9640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f640a2e10 0x7f5f640a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.766+0000 7f5f79ffb640 1 -- 172.21.15.2:0/611260735 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5f740cfe30 con 0x7f5f7c10c170 2024-09-12T00:53:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.766+0000 7f5f80fc9640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f640a2e10 0x7f5f640a52d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000c00 tx=0x7f5f6c0058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.770+0000 7f5f79ffb640 1 -- 172.21.15.2:0/611260735 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f74014030 con 0x7f5f7c10c170 2024-09-12T00:53:01.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:01 smithi167 ceph-mon[35234]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:01.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:01 smithi167 ceph-mon[35234]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:01.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:01 smithi071 ceph-mon[35276]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:01 smithi071 ceph-mon[35276]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:01.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.981+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f7c1a5180 con 0x7f5f7c10c170 2024-09-12T00:53:01.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.982+0000 7f5f79ffb640 1 -- 172.21.15.2:0/611260735 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f5f7409c750 con 0x7f5f7c10c170 2024-09-12T00:53:01.982 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:01.982 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:53:01.982 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f640a2e10 msgr2=0x7f5f640a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f640a2e10 0x7f5f640a52d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000c00 tx=0x7f5f6c0058d0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c10c170 msgr2=0x7f5f7c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c10c170 0x7f5f7c19cca0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400cce0 tx=0x7f5f7400a620 comp rx=0 tx=0).stop 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 shutdown_connections 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f640a2e10 0x7f5f640a52d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c10c170 0x7f5f7c19cca0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f7c103660 0x7f5f7c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 --2- 172.21.15.2:0/611260735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f7c102d40 0x7f5f7c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 >> 172.21.15.2:0/611260735 conn(0x7f5f7c0fc7a0 msgr2=0x7f5f7c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:01.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 shutdown_connections 2024-09-12T00:53:01.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:01.984+0000 7f5f8322d640 1 -- 172.21.15.2:0/611260735 wait complete. 2024-09-12T00:53:02.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:02 smithi002 ceph-mon[31210]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.4 KiB/s wr, 32 op/s 2024-09-12T00:53:02.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:02 smithi002 ceph-mon[31210]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:02.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:02 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/611260735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:02.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:53:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:02 smithi167 ceph-mon[35234]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.4 KiB/s wr, 32 op/s 2024-09-12T00:53:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:02 smithi167 ceph-mon[35234]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:02 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/611260735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:02.843 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:02 smithi071 ceph-mon[35276]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.4 KiB/s wr, 32 op/s 2024-09-12T00:53:02.843 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:02 smithi071 ceph-mon[35276]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:02.843 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:02 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/611260735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:02.990 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 -- 172.21.15.2:0/1175851020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381082a0 msgr2=0x7faf3810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 --2- 172.21.15.2:0/1175851020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381082a0 0x7faf3810ec40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faf30009cd0 tx=0x7faf3002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 -- 172.21.15.2:0/1175851020 shutdown_connections 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 --2- 172.21.15.2:0/1175851020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381082a0 0x7faf3810ec40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 --2- 172.21.15.2:0/1175851020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf381036e0 0x7faf38107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 --2- 172.21.15.2:0/1175851020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf38102d30 0x7faf38103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 -- 172.21.15.2:0/1175851020 >> 172.21.15.2:0/1175851020 conn(0x7faf380fc7d0 msgr2=0x7faf380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 -- 172.21.15.2:0/1175851020 shutdown_connections 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.409+0000 7faf3e68c640 1 -- 172.21.15.2:0/1175851020 wait complete. 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3e68c640 1 Processor -- start 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3e68c640 1 -- start start 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3e68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf38102d30 0x7faf38100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3e68c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf381036e0 0x7faf38100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3e68c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf381082a0 0x7faf38101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3e68c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf381120a0 con 0x7faf38102d30 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3e68c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf38111f20 con 0x7faf381082a0 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3e68c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faf38112220 con 0x7faf381036e0 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf38102d30 0x7faf38100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf38102d30 0x7faf38100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45394/0 (socket says 172.21.15.2:45394) 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf37fff640 1 -- 172.21.15.2:0/3311790831 learned_addr learned my addr 172.21.15.2:0/3311790831 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf3cc29640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf381082a0 0x7faf38101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf2ffff640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf381036e0 0x7faf38100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf37fff640 1 -- 172.21.15.2:0/3311790831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf381036e0 msgr2=0x7faf38100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf37fff640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf381036e0 0x7faf38100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf37fff640 1 -- 172.21.15.2:0/3311790831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf381082a0 msgr2=0x7faf38101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf37fff640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf381082a0 0x7faf38101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf37fff640 1 -- 172.21.15.2:0/3311790831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf381a69f0 con 0x7faf38102d30 2024-09-12T00:53:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.410+0000 7faf2ffff640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf381036e0 0x7faf38100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.411+0000 7faf37fff640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf38102d30 0x7faf38100990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf2800c970 tx=0x7faf2800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.411+0000 7faf35ffb640 1 -- 172.21.15.2:0/3311790831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28007bb0 con 0x7faf38102d30 2024-09-12T00:53:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.411+0000 7faf35ffb640 1 -- 172.21.15.2:0/3311790831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf28007d50 con 0x7faf38102d30 2024-09-12T00:53:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.411+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf381a6ce0 con 0x7faf38102d30 2024-09-12T00:53:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.411+0000 7faf35ffb640 1 -- 172.21.15.2:0/3311790831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2800f450 con 0x7faf38102d30 2024-09-12T00:53:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.411+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf381a7170 con 0x7faf38102d30 2024-09-12T00:53:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.412+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf38103110 con 0x7faf38102d30 2024-09-12T00:53:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.413+0000 7faf35ffb640 1 -- 172.21.15.2:0/3311790831 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7faf28004fe0 con 0x7faf38102d30 2024-09-12T00:53:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.414+0000 7faf35ffb640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf240a2e10 0x7faf240a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.414+0000 7faf2ffff640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf240a2e10 0x7faf240a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.414+0000 7faf35ffb640 1 -- 172.21.15.2:0/3311790831 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7faf280cf8d0 con 0x7faf38102d30 2024-09-12T00:53:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.414+0000 7faf2ffff640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf240a2e10 0x7faf240a52d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf38102420 tx=0x7faf20005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.417+0000 7faf35ffb640 1 -- 172.21.15.2:0/3311790831 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf28014030 con 0x7faf38102d30 2024-09-12T00:53:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.596+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf3810a2e0 con 0x7faf38102d30 2024-09-12T00:53:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.598+0000 7faf35ffb640 1 -- 172.21.15.2:0/3311790831 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+23181 (secure 0 0 0) 0x7faf2809c250 con 0x7faf38102d30 2024-09-12T00:53:03.598 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:03.598 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":84,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:52:54.829249+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/761407779":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3529963366":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/838113285":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/17217547":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6800/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/780422410":"2024-09-13T00:52:54.829221+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:53:03.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf240a2e10 msgr2=0x7faf240a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:03.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf240a2e10 0x7faf240a52d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf38102420 tx=0x7faf20005f90 comp rx=0 tx=0).stop 2024-09-12T00:53:03.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf38102d30 msgr2=0x7faf38100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:03.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf38102d30 0x7faf38100990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf2800c970 tx=0x7faf2800ce30 comp rx=0 tx=0).stop 2024-09-12T00:53:03.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 shutdown_connections 2024-09-12T00:53:03.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faf240a2e10 0x7faf240a52d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf381082a0 0x7faf38101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf381036e0 0x7faf38100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 --2- 172.21.15.2:0/3311790831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf38102d30 0x7faf38100990 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:03.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 >> 172.21.15.2:0/3311790831 conn(0x7faf380fc7d0 msgr2=0x7faf38105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:03.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 shutdown_connections 2024-09-12T00:53:03.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:03.600+0000 7faf3e68c640 1 -- 172.21.15.2:0/3311790831 wait complete. 2024-09-12T00:53:04.305 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T00:53:04.305 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T00:53:04.314 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T00:53:04.314 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T00:53:04.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-12T00:53:04.315 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T00:53:04.315 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:53:04.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:53:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.426+0000 7f3feba53640 1 -- 172.21.15.2:0/541959089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe4102d20 msgr2=0x7f3fe4103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.426+0000 7f3feba53640 1 --2- 172.21.15.2:0/541959089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe4102d20 0x7f3fe4103100 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009900 tx=0x7f3fe002a480 comp rx=0 tx=0).stop 2024-09-12T00:53:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 -- 172.21.15.2:0/541959089 shutdown_connections 2024-09-12T00:53:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 --2- 172.21.15.2:0/541959089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe410c0f0 0x7f3fe410e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 --2- 172.21.15.2:0/541959089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe4103640 0x7f3fe410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 --2- 172.21.15.2:0/541959089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe4102d20 0x7f3fe4103100 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 -- 172.21.15.2:0/541959089 >> 172.21.15.2:0/541959089 conn(0x7f3fe40779a0 msgr2=0x7f3fe40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 -- 172.21.15.2:0/541959089 shutdown_connections 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 -- 172.21.15.2:0/541959089 wait complete. 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 Processor -- start 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 -- start start 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe4102d20 0x7f3fe4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.427+0000 7f3feba53640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe4103640 0x7f3fe4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3feba53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe410c0f0 0x7f3fe419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3feba53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe4111ea0 con 0x7f3fe410c0f0 2024-09-12T00:53:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3feba53640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe4111d20 con 0x7f3fe4103640 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3feba53640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe4112020 con 0x7f3fe4102d20 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe410c0f0 0x7f3fe419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe410c0f0 0x7f3fe419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45408/0 (socket says 172.21.15.2:45408) 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 -- 172.21.15.2:0/2371205728 learned_addr learned my addr 172.21.15.2:0/2371205728 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe97ef640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe4102d20 0x7f3fe4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe8fee640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe4103640 0x7f3fe4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 -- 172.21.15.2:0/2371205728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe4102d20 msgr2=0x7f3fe4198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe4102d20 0x7f3fe4198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 -- 172.21.15.2:0/2371205728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe4103640 msgr2=0x7f3fe4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe4103640 0x7f3fe4198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 -- 172.21.15.2:0/2371205728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe419d320 con 0x7f3fe410c0f0 2024-09-12T00:53:04.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fe9ff0640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe410c0f0 0x7f3fe419cbf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00cce0 tx=0x7f3fdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:04.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fda7fc640 1 -- 172.21.15.2:0/2371205728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00f450 con 0x7f3fe410c0f0 2024-09-12T00:53:04.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe419d610 con 0x7f3fe410c0f0 2024-09-12T00:53:04.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fda7fc640 1 -- 172.21.15.2:0/2371205728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fdc00fad0 con 0x7f3fe410c0f0 2024-09-12T00:53:04.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.428+0000 7f3fda7fc640 1 -- 172.21.15.2:0/2371205728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc018c10 con 0x7f3fe410c0f0 2024-09-12T00:53:04.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.429+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe41a4ea0 con 0x7f3fe410c0f0 2024-09-12T00:53:04.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.429+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe406a240 con 0x7f3fe410c0f0 2024-09-12T00:53:04.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.431+0000 7f3fda7fc640 1 -- 172.21.15.2:0/2371205728 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f3fdc00f5f0 con 0x7f3fe410c0f0 2024-09-12T00:53:04.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.431+0000 7f3fda7fc640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3fd00a2e10 0x7f3fd00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:04.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.432+0000 7f3fe97ef640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3fd00a2e10 0x7f3fd00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:04.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.432+0000 7f3fda7fc640 1 -- 172.21.15.2:0/2371205728 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f3fdc0cfd20 con 0x7f3fe410c0f0 2024-09-12T00:53:04.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.432+0000 7f3fe97ef640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3fd00a2e10 0x7f3fd00a52d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009230 tx=0x7f3fe00058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:04.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.436+0000 7f3fda7fc640 1 -- 172.21.15.2:0/2371205728 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fdc014030 con 0x7f3fe410c0f0 2024-09-12T00:53:04.588 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:04.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.630+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f3fe4103100 con 0x7f3fe410c0f0 2024-09-12T00:53:04.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.634+0000 7f3fda7fc640 1 -- 172.21.15.2:0/2371205728 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7f3fe4103100 con 0x7f3fe410c0f0 2024-09-12T00:53:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3fd00a2e10 msgr2=0x7f3fd00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3fd00a2e10 0x7f3fd00a52d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009230 tx=0x7f3fe00058d0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe410c0f0 msgr2=0x7f3fe419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe410c0f0 0x7f3fe419cbf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00cce0 tx=0x7f3fdc00a620 comp rx=0 tx=0).stop 2024-09-12T00:53:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 shutdown_connections 2024-09-12T00:53:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f3fd00a2e10 0x7f3fd00a52d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe410c0f0 0x7f3fe419cbf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe4103640 0x7f3fe4198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 --2- 172.21.15.2:0/2371205728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe4102d20 0x7f3fe4198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 >> 172.21.15.2:0/2371205728 conn(0x7f3fe40779a0 msgr2=0x7f3fe40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 shutdown_connections 2024-09-12T00:53:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.636+0000 7f3feba53640 1 -- 172.21.15.2:0/2371205728 wait complete. 2024-09-12T00:53:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:04 smithi002 ceph-mon[31210]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1021 B/s wr, 23 op/s 2024-09-12T00:53:04.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:04 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3311790831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:53:04.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 -- 172.21.15.2:0/1169743908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb8102ca0 msgr2=0x7f9bb8103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/1169743908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb8102ca0 0x7f9bb8103080 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009900 tx=0x7f9bb402a480 comp rx=0 tx=0).stop 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 -- 172.21.15.2:0/1169743908 shutdown_connections 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/1169743908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb810c0f0 0x7f9bb810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/1169743908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb81035c0 0x7f9bb810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/1169743908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb8102ca0 0x7f9bb8103080 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 -- 172.21.15.2:0/1169743908 >> 172.21.15.2:0/1169743908 conn(0x7f9bb80fc6b0 msgr2=0x7f9bb80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 -- 172.21.15.2:0/1169743908 shutdown_connections 2024-09-12T00:53:04.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.756+0000 7f9bbfae6640 1 -- 172.21.15.2:0/1169743908 wait complete. 2024-09-12T00:53:04.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbfae6640 1 Processor -- start 2024-09-12T00:53:04.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbfae6640 1 -- start start 2024-09-12T00:53:04.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbfae6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb8102ca0 0x7f9bb8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:04.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbfae6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb81035c0 0x7f9bb8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:04.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbfae6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb810c0f0 0x7f9bb819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:04.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbfae6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8111f10 con 0x7f9bb810c0f0 2024-09-12T00:53:04.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbfae6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8111d90 con 0x7f9bb8102ca0 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbfae6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8112090 con 0x7f9bb81035c0 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbe083640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb810c0f0 0x7f9bb819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbe083640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb810c0f0 0x7f9bb819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45424/0 (socket says 172.21.15.2:45424) 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbd882640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb8102ca0 0x7f9bb8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbe083640 1 -- 172.21.15.2:0/4105006899 learned_addr learned my addr 172.21.15.2:0/4105006899 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbd081640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb81035c0 0x7f9bb8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.757+0000 7f9bbe083640 1 -- 172.21.15.2:0/4105006899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb81035c0 msgr2=0x7f9bb8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9bbe083640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb81035c0 0x7f9bb8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9bbe083640 1 -- 172.21.15.2:0/4105006899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb8102ca0 msgr2=0x7f9bb8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9bbe083640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb8102ca0 0x7f9bb8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9bbe083640 1 -- 172.21.15.2:0/4105006899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb819d440 con 0x7f9bb810c0f0 2024-09-12T00:53:04.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9bbd882640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb8102ca0 0x7f9bb8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9bbe083640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb810c0f0 0x7f9bb819cd10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009fd0 tx=0x7f9bb000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9baeffd640 1 -- 172.21.15.2:0/4105006899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0017070 con 0x7f9bb810c0f0 2024-09-12T00:53:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9baeffd640 1 -- 172.21.15.2:0/4105006899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb0003e50 con 0x7f9bb810c0f0 2024-09-12T00:53:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb819d730 con 0x7f9bb810c0f0 2024-09-12T00:53:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9baeffd640 1 -- 172.21.15.2:0/4105006899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00106c0 con 0x7f9bb810c0f0 2024-09-12T00:53:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.758+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb81a4fc0 con 0x7f9bb810c0f0 2024-09-12T00:53:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.759+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb8103080 con 0x7f9bb810c0f0 2024-09-12T00:53:04.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.760+0000 7f9baeffd640 1 -- 172.21.15.2:0/4105006899 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f9bb0003970 con 0x7f9bb810c0f0 2024-09-12T00:53:04.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.761+0000 7f9baeffd640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ba40a2e10 0x7f9ba40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:04.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.761+0000 7f9bbd882640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ba40a2e10 0x7f9ba40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:04.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.761+0000 7f9baeffd640 1 -- 172.21.15.2:0/4105006899 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9bb00cf440 con 0x7f9bb810c0f0 2024-09-12T00:53:04.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.762+0000 7f9bbd882640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ba40a2e10 0x7f9ba40a52d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009230 tx=0x7f9bb40058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:04.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.764+0000 7f9baeffd640 1 -- 172.21.15.2:0/4105006899 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9bb009b770 con 0x7f9bb810c0f0 2024-09-12T00:53:04.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:04 smithi167 ceph-mon[35234]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1021 B/s wr, 23 op/s 2024-09-12T00:53:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:04 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3311790831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:53:04.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:04 smithi071 ceph-mon[35276]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1021 B/s wr, 23 op/s 2024-09-12T00:53:04.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:04 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3311790831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:53:04.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.954+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f9bb81997a0 con 0x7f9bb810c0f0 2024-09-12T00:53:04.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.958+0000 7f9baeffd640 1 -- 172.21.15.2:0/4105006899 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f9bb81997a0 con 0x7f9bb810c0f0 2024-09-12T00:53:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ba40a2e10 msgr2=0x7f9ba40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ba40a2e10 0x7f9ba40a52d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009230 tx=0x7f9bb40058d0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb810c0f0 msgr2=0x7f9bb819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb810c0f0 0x7f9bb819cd10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009fd0 tx=0x7f9bb000b260 comp rx=0 tx=0).stop 2024-09-12T00:53:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 shutdown_connections 2024-09-12T00:53:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ba40a2e10 0x7f9ba40a52d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb810c0f0 0x7f9bb819cd10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb81035c0 0x7f9bb8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 --2- 172.21.15.2:0/4105006899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb8102ca0 0x7f9bb8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:04.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 >> 172.21.15.2:0/4105006899 conn(0x7f9bb80fc6b0 msgr2=0x7f9bb80fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:04.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 shutdown_connections 2024-09-12T00:53:04.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:04.961+0000 7f9bbfae6640 1 -- 172.21.15.2:0/4105006899 wait complete. 2024-09-12T00:53:04.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-12T00:53:05.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 -- 172.21.15.2:0/2886110897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0058103670 msgr2=0x7f005810bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 --2- 172.21.15.2:0/2886110897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0058103670 0x7f005810bb60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c02a480 comp rx=0 tx=0).stop 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 -- 172.21.15.2:0/2886110897 shutdown_connections 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 --2- 172.21.15.2:0/2886110897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005810c180 0x7f005810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 --2- 172.21.15.2:0/2886110897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0058103670 0x7f005810bb60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 --2- 172.21.15.2:0/2886110897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0058102d50 0x7f0058103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 -- 172.21.15.2:0/2886110897 >> 172.21.15.2:0/2886110897 conn(0x7f00580fc7d0 msgr2=0x7f00580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 -- 172.21.15.2:0/2886110897 shutdown_connections 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.048+0000 7f005cd87640 1 -- 172.21.15.2:0/2886110897 wait complete. 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.049+0000 7f005cd87640 1 Processor -- start 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.049+0000 7f005cd87640 1 -- start start 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.049+0000 7f005cd87640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0058102d50 0x7f00581009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.049+0000 7f005cd87640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0058103670 0x7f0058100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.049+0000 7f005cd87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005810c180 0x7f0058101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.049+0000 7f005cd87640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0058111fc0 con 0x7f0058103670 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.049+0000 7f005cd87640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0058111e40 con 0x7f0058102d50 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.049+0000 7f005cd87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0058112140 con 0x7f005810c180 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0058102d50 0x7f00581009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0058102d50 0x7f00581009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:54532/0 (socket says 172.21.15.2:54532) 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 -- 172.21.15.2:0/1422124092 learned_addr learned my addr 172.21.15.2:0/1422124092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f0055d9b640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0058103670 0x7f0058100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f0056d9d640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005810c180 0x7f0058101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 -- 172.21.15.2:0/1422124092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005810c180 msgr2=0x7f0058101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005810c180 0x7f0058101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 -- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0058103670 msgr2=0x7f0058100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0058103670 0x7f0058100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 -- 172.21.15.2:0/1422124092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00581a6960 con 0x7f0058102d50 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005659c640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0058102d50 0x7f00581009b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f004800ebc0 tx=0x7f004800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f00477fe640 1 -- 172.21.15.2:0/1422124092 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048010630 con 0x7f0058102d50 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f00477fe640 1 -- 172.21.15.2:0/1422124092 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0048010cb0 con 0x7f0058102d50 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f005cd87640 1 -- 172.21.15.2:0/1422124092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00581a6c50 con 0x7f0058102d50 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.050+0000 7f00477fe640 1 -- 172.21.15.2:0/1422124092 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048018bd0 con 0x7f0058102d50 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.051+0000 7f005cd87640 1 -- 172.21.15.2:0/1422124092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00581a71b0 con 0x7f0058102d50 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.054+0000 7f00477fe640 1 -- 172.21.15.2:0/1422124092 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f00480107d0 con 0x7f0058102d50 2024-09-12T00:53:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.054+0000 7f005f160740 1 Processor -- start 2024-09-12T00:53:05.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.054+0000 7f005f160740 1 -- start start 2024-09-12T00:53:05.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f005f160740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda1b60 0x56203bda1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f00477fe640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f00400a2e90 0x7f00400a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f005f160740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f005f160740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bdacd40 0x56203bdaf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f005f160740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56203bd07280 con 0x56203bda1b60 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f005f160740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56203bcaeb10 con 0x56203bdacd40 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f005f160740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56203bd03240 con 0x56203bda2480 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f00477fe640 1 -- 172.21.15.2:0/1422124092 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f00480cfda0 con 0x7f0058102d50 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0055d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0055d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52882/0 (socket says 172.21.15.2:52882) 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0055d9b640 1 -- 172.21.15.2:0/2412881356 learned_addr learned my addr 172.21.15.2:0/2412881356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f005659c640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f00400a2e90 0x7f00400a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0056d9d640 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda1b60 0x56203bda1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0055d9b640 1 -- 172.21.15.2:0/2412881356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bdacd40 msgr2=0x56203bdaf130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:53:05.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0055d9b640 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bdacd40 0x56203bdaf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0055d9b640 1 -- 172.21.15.2:0/2412881356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda1b60 msgr2=0x56203bda1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0055d9b640 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda1b60 0x56203bda1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.055+0000 7f0055d9b640 1 -- 172.21.15.2:0/2412881356 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203bcbb1f0 con 0x56203bda2480 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.056+0000 7f0056d9d640 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda1b60 0x56203bda1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.056+0000 7f005659c640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f00400a2e90 0x7f00400a5350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f00480cd380 tx=0x7f0048018670 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.056+0000 7f0055d9b640 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdac800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b150c2ab94f8cb25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.056+0000 7f0044ff9640 1 -- 172.21.15.2:0/2412881356 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c040070 con 0x56203bda2480 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.056+0000 7f0044ff9640 1 -- 172.21.15.2:0/2412881356 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f004c031970 con 0x56203bda2480 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.056+0000 7f0044ff9640 1 -- 172.21.15.2:0/2412881356 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c035040 con 0x56203bda2480 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 -- 172.21.15.2:0/2412881356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 msgr2=0x56203bdac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdac800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c005dd0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 -- 172.21.15.2:0/2412881356 shutdown_connections 2024-09-12T00:53:05.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bdacd40 0x56203bdaf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdac800 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 --2- 172.21.15.2:0/2412881356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda1b60 0x56203bda1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 -- 172.21.15.2:0/2412881356 >> 172.21.15.2:0/2412881356 conn(0x56203bd9e0f0 msgr2=0x56203bd9e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 -- 172.21.15.2:0/2412881356 shutdown_connections 2024-09-12T00:53:05.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 -- 172.21.15.2:0/2412881356 wait complete. 2024-09-12T00:53:05.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.057+0000 7f005f160740 1 -- start start 2024-09-12T00:53:05.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f005f160740 1 Processor -- start 2024-09-12T00:53:05.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f005f160740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bda9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f005f160740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdaa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f005f160740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdaa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f005f160740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56203bdaf910 con 0x56203bdacd40 2024-09-12T00:53:05.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f005f160740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56203bcc1f10 con 0x56203bda1b60 2024-09-12T00:53:05.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f005f160740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56203bdafa90 con 0x56203bda2480 2024-09-12T00:53:05.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f005f160740 10 client.0 _ll_register_callbacks cb 0x56203bc8aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f0055d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdaa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f0055d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdaa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52896/0 (socket says 172.21.15.2:52896) 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f0055d9b640 1 -- 172.21.15.2:0/3952001619 learned_addr learned my addr 172.21.15.2:0/3952001619 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f0056d9d640 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bda9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.058+0000 7f0056d9d640 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdaa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f0055d9b640 1 -- 172.21.15.2:0/3952001619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 msgr2=0x56203bda9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f0055d9b640 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bda9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f0055d9b640 1 -- 172.21.15.2:0/3952001619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 msgr2=0x56203bdaa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f0055d9b640 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdaa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f0055d9b640 1 -- 172.21.15.2:0/3952001619 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56203ba786a0 con 0x56203bda2480 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f0056d9d640 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdaa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f0055d9b640 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdaa120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f004c006010 tx=0x7f004c005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35d1b58cde865c43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f003dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f003dffb640 1 -- 172.21.15.2:0/3952001619 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c04c020 con 0x56203bda2480 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f003dffb640 1 -- 172.21.15.2:0/3952001619 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f004c004260 con 0x56203bda2480 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f005f160740 1 -- 172.21.15.2:0/3952001619 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004c031970 con 0x56203bda2480 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f003dffb640 1 -- 172.21.15.2:0/3952001619 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f004c057050 con 0x56203bda2480 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f005f160740 10 client.24946 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.059+0000 7f005f160740 1 -- 172.21.15.2:0/3952001619 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56203bdaf960 con 0x56203bda2480 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f003dffb640 1 -- 172.21.15.2:0/3952001619 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f004c031970 con 0x56203bda2480 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f003dffb640 1 -- 172.21.15.2:0/3952001619 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f004c003780 con 0x56203bda2480 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f005f160740 10 client.24946 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:05.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f005f160740 10 client.24946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f005f160740 20 client.24946 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f005f160740 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56203bdbc740 0x56203bdbeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f005f160740 4 client.24946 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f005f160740 1 -- 172.21.15.2:0/3952001619 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56203bd147f0 con 0x56203bdbc740 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.060+0000 7f0056d9d640 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56203bdbc740 0x56203bdbeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f003dffb640 10 client.24946 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f0056d9d640 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56203bdbc740 0x56203bdbeb30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faf55a0017fe1934 server_cookie=bcd05d553403df9 in_seq=0 out_seq=0 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f003dffb640 1 -- 172.21.15.2:0/3952001619 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56203bd147f0 con 0x56203bdbc740 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f003dffb640 10 client.24946 handle_command_reply: tid=0 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f005f160740 1 client.24946 shutdown 2024-09-12T00:53:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f005f160740 1 -- 172.21.15.2:0/3952001619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 msgr2=0x56203bdaa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f005f160740 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdaa120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f004c006010 tx=0x7f004c005250 comp rx=0 tx=0).stop 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f005f160740 1 -- 172.21.15.2:0/3952001619 shutdown_connections 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f005f160740 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56203bdbc740 0x56203bdbeb30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f005f160740 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdaa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f005f160740 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda2480 0x56203bdaa120 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f005f160740 1 --2- 172.21.15.2:0/3952001619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bda9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.061+0000 7f003dffb640 0 client.24946 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.062+0000 7f005f160740 1 -- 172.21.15.2:0/3952001619 >> 172.21.15.2:0/3952001619 conn(0x56203bd9e0f0 msgr2=0x56203bda3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.062+0000 7f005f160740 1 -- 172.21.15.2:0/3952001619 shutdown_connections 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.062+0000 7f005f160740 1 -- 172.21.15.2:0/3952001619 wait complete. 2024-09-12T00:53:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.062+0000 7f005f160740 20 client.24946 trim_cache size 0 max 16384 2024-09-12T00:53:05.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.079+0000 7f005f160740 1 Processor -- start 2024-09-12T00:53:05.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.079+0000 7f005f160740 1 -- start start 2024-09-12T00:53:05.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.079+0000 7f005f160740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bdaa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.079+0000 7f005f160740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda2480 0x56203bd9d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.079+0000 7f005f160740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bdacd40 0x56203bdc4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f005f160740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f00581b2420 con 0x56203bda2480 2024-09-12T00:53:05.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f005f160740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00581afcf0 con 0x56203bda1b60 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f005f160740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00581adb40 con 0x56203bdacd40 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda2480 0x56203bd9d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda2480 0x56203bd9d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45476/0 (socket says 172.21.15.2:45476) 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 -- 172.21.15.2:0/752801893 learned_addr learned my addr 172.21.15.2:0/752801893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0056d9d640 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bdaa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0056d9d640 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bdacd40 0x56203bdc4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 -- 172.21.15.2:0/752801893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bdacd40 msgr2=0x56203bdc4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bdacd40 0x56203bdc4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 -- 172.21.15.2:0/752801893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 msgr2=0x56203bdaa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bdaa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 -- 172.21.15.2:0/752801893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203bd9df20 con 0x56203bda2480 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0056d9d640 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bdaa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:05.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f0055d9b640 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda2480 0x56203bd9d160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f004c003bd0 tx=0x7f004c003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758d847565b22b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.080+0000 7f003ffff640 1 -- 172.21.15.2:0/752801893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c04c040 con 0x56203bda2480 2024-09-12T00:53:05.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f003ffff640 1 -- 172.21.15.2:0/752801893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f004c004260 con 0x56203bda2480 2024-09-12T00:53:05.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f003ffff640 1 -- 172.21.15.2:0/752801893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c040070 con 0x56203bda2480 2024-09-12T00:53:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 -- 172.21.15.2:0/752801893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda2480 msgr2=0x56203bd9d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda2480 0x56203bd9d160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f004c003bd0 tx=0x7f004c003ec0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 -- 172.21.15.2:0/752801893 shutdown_connections 2024-09-12T00:53:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bdacd40 0x56203bdc4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bda2480 0x56203bd9d160 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 --2- 172.21.15.2:0/752801893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda1b60 0x56203bdaa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 -- 172.21.15.2:0/752801893 >> 172.21.15.2:0/752801893 conn(0x56203bd9e0f0 msgr2=0x56203bd9ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 -- 172.21.15.2:0/752801893 shutdown_connections 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.081+0000 7f005f160740 1 -- 172.21.15.2:0/752801893 wait complete. 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 1 -- start start 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 1 Processor -- start 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda1b60 0x56203bdb52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda2480 0x56203bdb05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdb0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f00581ae1b0 con 0x56203bdacd40 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00581af620 con 0x56203bda2480 2024-09-12T00:53:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00581ae880 con 0x56203bda1b60 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f005f160740 10 client.0 _ll_register_callbacks cb 0x7f004c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f0056d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdb0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f0055d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda2480 0x56203bdb05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f0055d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda2480 0x56203bdb05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:54570/0 (socket says 172.21.15.2:54570) 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f0055d9b640 1 -- 172.21.15.2:0/845077965 learned_addr learned my addr 172.21.15.2:0/845077965 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f0056d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdb0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45492/0 (socket says 172.21.15.2:45492) 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.082+0000 7f0056d9d640 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda1b60 0x56203bdb52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f0055d9b640 1 -- 172.21.15.2:0/845077965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda1b60 msgr2=0x56203bdb52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f0055d9b640 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda1b60 0x56203bdb52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f0055d9b640 1 -- 172.21.15.2:0/845077965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 msgr2=0x56203bdb0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f0055d9b640 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdb0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f0055d9b640 1 -- 172.21.15.2:0/845077965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56203bda49d0 con 0x56203bda2480 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f0056d9d640 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdb0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f0055d9b640 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda2480 0x56203bdb05f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c02a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6deaee45fdd86b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f003dffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f003dffb640 1 -- 172.21.15.2:0/845077965 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c040040 con 0x56203bda2480 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f005f160740 1 -- 172.21.15.2:0/845077965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004c004260 con 0x56203bda2480 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f003dffb640 1 -- 172.21.15.2:0/845077965 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f004c0035f0 con 0x56203bda2480 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f003dffb640 1 -- 172.21.15.2:0/845077965 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f004c04c040 con 0x56203bda2480 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f005f160740 10 client.25007 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.083+0000 7f005f160740 1 -- 172.21.15.2:0/845077965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56203be26fb0 con 0x56203bda2480 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f003dffb640 1 -- 172.21.15.2:0/845077965 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f004c004260 con 0x56203bda2480 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f003dffb640 1 -- 172.21.15.2:0/845077965 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f004c064450 con 0x56203bda2480 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f005f160740 10 client.25007 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f005f160740 10 client.25007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f005f160740 20 client.25007 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f005f160740 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56203be27620 0x56203be29a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f005f160740 4 client.25007 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:53:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f005f160740 1 -- 172.21.15.2:0/845077965 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56203bd0ed00 con 0x56203be27620 2024-09-12T00:53:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f0056d9d640 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56203be27620 0x56203be29a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f003dffb640 10 client.25007 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.084+0000 7f0056d9d640 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56203be27620 0x56203be29a40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=348f938baa01c209 server_cookie=759a6dd104d7724a in_seq=0 out_seq=0 2024-09-12T00:53:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f003dffb640 1 -- 172.21.15.2:0/845077965 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56203bd0ed00 con 0x56203be27620 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f003dffb640 10 client.25007 handle_command_reply: tid=0 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 client.25007 shutdown 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 -- 172.21.15.2:0/845077965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda2480 msgr2=0x56203bdb05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda2480 0x56203bdb05f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c02a480 comp rx=0 tx=0).stop 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 -- 172.21.15.2:0/845077965 shutdown_connections 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56203be27620 0x56203be29a40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56203bdacd40 0x56203bdb0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56203bda2480 0x56203bdb05f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 --2- 172.21.15.2:0/845077965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56203bda1b60 0x56203bdb52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f005f160740 1 -- 172.21.15.2:0/845077965 >> 172.21.15.2:0/845077965 conn(0x56203bd9e0f0 msgr2=0x56203bda3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.085+0000 7f003dffb640 0 client.25007 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.086+0000 7f005f160740 1 -- 172.21.15.2:0/845077965 shutdown_connections 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.086+0000 7f005f160740 1 -- 172.21.15.2:0/845077965 wait complete. 2024-09-12T00:53:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.086+0000 7f005f160740 20 client.25007 trim_cache size 0 max 16384 2024-09-12T00:53:05.090 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:53:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "9f4cc9c1-4ffb-426f-a55f-718fa0024be6", 2024-09-12T00:53:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:53:05.090 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.086+0000 7f005cd87640 1 -- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f00400a2e90 msgr2=0x7f00400a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.086+0000 7f005cd87640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f00400a2e90 0x7f00400a5350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f00480cd380 tx=0x7f0048018670 comp rx=0 tx=0).stop 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.086+0000 7f005cd87640 1 -- 172.21.15.2:0/1422124092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0058102d50 msgr2=0x7f00581009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.086+0000 7f005cd87640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0058102d50 0x7f00581009b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f004800ebc0 tx=0x7f004800c6a0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.087+0000 7f005cd87640 1 -- 172.21.15.2:0/1422124092 shutdown_connections 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.087+0000 7f005cd87640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f00400a2e90 0x7f00400a5350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.087+0000 7f005cd87640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005810c180 0x7f0058101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.087+0000 7f005cd87640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0058103670 0x7f0058100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.087+0000 7f005cd87640 1 --2- 172.21.15.2:0/1422124092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0058102d50 0x7f00581009b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.087+0000 7f005cd87640 1 -- 172.21.15.2:0/1422124092 >> 172.21.15.2:0/1422124092 conn(0x7f00580fc7d0 msgr2=0x7f00580fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.087+0000 7f005cd87640 1 -- 172.21.15.2:0/1422124092 shutdown_connections 2024-09-12T00:53:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.087+0000 7f005cd87640 1 -- 172.21.15.2:0/1422124092 wait complete. 2024-09-12T00:53:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 -- 172.21.15.2:0/4189957920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa81069b0 msgr2=0x7f2fa8106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/4189957920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa81069b0 0x7f2fa8106d90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009930 tx=0x7f2f9802a420 comp rx=0 tx=0).stop 2024-09-12T00:53:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 -- 172.21.15.2:0/4189957920 shutdown_connections 2024-09-12T00:53:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/4189957920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa8101340 0x7f2fa810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/4189957920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fa81009a0 0x7f2fa8100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/4189957920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa81069b0 0x7f2fa8106d90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 -- 172.21.15.2:0/4189957920 >> 172.21.15.2:0/4189957920 conn(0x7f2fa80779a0 msgr2=0x7f2fa80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 -- 172.21.15.2:0/4189957920 shutdown_connections 2024-09-12T00:53:05.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.093+0000 7f2fac8f1640 1 -- 172.21.15.2:0/4189957920 wait complete. 2024-09-12T00:53:05.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.094+0000 7f2fac8f1640 1 Processor -- start 2024-09-12T00:53:05.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.094+0000 7f2fac8f1640 1 -- start start 2024-09-12T00:53:05.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.094+0000 7f2fac8f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa81009a0 0x7f2fa8102570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.094+0000 7f2fac8f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8101340 0x7f2fa8102ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.094+0000 7f2fac8f1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fa81069b0 0x7f2fa8102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.094+0000 7f2fac8f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8110df0 con 0x7f2fa8101340 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.094+0000 7f2fac8f1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8110c70 con 0x7f2fa81069b0 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.094+0000 7f2fac8f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8110f70 con 0x7f2fa81009a0 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8101340 0x7f2fa8102ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa6d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fa81069b0 0x7f2fa8102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8101340 0x7f2fa8102ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45514/0 (socket says 172.21.15.2:45514) 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa5d9b640 1 -- 172.21.15.2:0/2257432923 learned_addr learned my addr 172.21.15.2:0/2257432923 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa659c640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa81009a0 0x7f2fa8102570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa6d9d640 1 -- 172.21.15.2:0/2257432923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa81009a0 msgr2=0x7f2fa8102570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa6d9d640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa81009a0 0x7f2fa8102570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa6d9d640 1 -- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8101340 msgr2=0x7f2fa8102ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa6d9d640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8101340 0x7f2fa8102ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa6d9d640 1 -- 172.21.15.2:0/2257432923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa81a6900 con 0x7f2fa81069b0 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa659c640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa81009a0 0x7f2fa8102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fa6d9d640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fa81069b0 0x7f2fa8102ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000ec50 tx=0x7f2fa000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2f977fe640 1 -- 172.21.15.2:0/2257432923 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0003b70 con 0x7f2fa81069b0 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2f977fe640 1 -- 172.21.15.2:0/2257432923 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fa0003d10 con 0x7f2fa81069b0 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.095+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa81a6bf0 con 0x7f2fa81069b0 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.096+0000 7f2f977fe640 1 -- 172.21.15.2:0/2257432923 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0010890 con 0x7f2fa81069b0 2024-09-12T00:53:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.096+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa81a70f0 con 0x7f2fa81069b0 2024-09-12T00:53:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.097+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa81020e0 con 0x7f2fa81069b0 2024-09-12T00:53:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.098+0000 7f2f977fe640 1 -- 172.21.15.2:0/2257432923 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f2fa0003fc0 con 0x7f2fa81069b0 2024-09-12T00:53:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.099+0000 7f2f977fe640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2f900a2e10 0x7f2f900a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.099+0000 7f2fa659c640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2f900a2e10 0x7f2f900a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.099+0000 7f2f977fe640 1 -- 172.21.15.2:0/2257432923 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2fa00cfd20 con 0x7f2fa81069b0 2024-09-12T00:53:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.099+0000 7f2fa659c640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2f900a2e10 0x7f2f900a52d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f98000c00 tx=0x7f2f98005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.103+0000 7f2f977fe640 1 -- 172.21.15.2:0/2257432923 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2fa009c6a0 con 0x7f2fa81069b0 2024-09-12T00:53:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.282+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f2fa81a7460 con 0x7f2fa81069b0 2024-09-12T00:53:05.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.288+0000 7f2f977fe640 1 -- 172.21.15.2:0/2257432923 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7f2fa009bfa0 con 0x7f2fa81069b0 2024-09-12T00:53:05.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.290+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2f900a2e10 msgr2=0x7f2f900a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.290+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2f900a2e10 0x7f2f900a52d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f98000c00 tx=0x7f2f98005a20 comp rx=0 tx=0).stop 2024-09-12T00:53:05.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.290+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fa81069b0 msgr2=0x7f2fa8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.290+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fa81069b0 0x7f2fa8102ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000ec50 tx=0x7f2fa000c6a0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.291+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 shutdown_connections 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.291+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2f900a2e10 0x7f2f900a52d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.291+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fa81069b0 0x7f2fa8102ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.291+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8101340 0x7f2fa8102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.291+0000 7f2fac8f1640 1 --2- 172.21.15.2:0/2257432923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa81009a0 0x7f2fa8102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.291+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 >> 172.21.15.2:0/2257432923 conn(0x7f2fa80779a0 msgr2=0x7f2fa8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.291+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 shutdown_connections 2024-09-12T00:53:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.291+0000 7f2fac8f1640 1 -- 172.21.15.2:0/2257432923 wait complete. 2024-09-12T00:53:05.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-12T00:53:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3233630001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c102460 msgr2=0x7fbd7c10e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3233630001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c102460 0x7fbd7c10e990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009cd0 tx=0x7fbd7402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3233630001 shutdown_connections 2024-09-12T00:53:05.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3233630001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c102460 0x7fbd7c10e990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3233630001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd7c101ac0 0x7fbd7c101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3233630001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c107ad0 0x7fbd7c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3233630001 >> 172.21.15.2:0/3233630001 conn(0x7fbd7c0fd7a0 msgr2=0x7fbd7c0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3233630001 shutdown_connections 2024-09-12T00:53:05.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.415+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3233630001 wait complete. 2024-09-12T00:53:05.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd83a1e640 1 Processor -- start 2024-09-12T00:53:05.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd83a1e640 1 -- start start 2024-09-12T00:53:05.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd83a1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c101ac0 0x7fbd7c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd83a1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c102460 0x7fbd7c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd83a1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd7c107ad0 0x7fbd7c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd83a1e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c111f10 con 0x7fbd7c101ac0 2024-09-12T00:53:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd83a1e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c111d90 con 0x7fbd7c107ad0 2024-09-12T00:53:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd83a1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c112090 con 0x7fbd7c102460 2024-09-12T00:53:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd817ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c101ac0 0x7fbd7c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd817ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c101ac0 0x7fbd7c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45534/0 (socket says 172.21.15.2:45534) 2024-09-12T00:53:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.416+0000 7fbd817ba640 1 -- 172.21.15.2:0/3073158158 learned_addr learned my addr 172.21.15.2:0/3073158158 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd80fb9640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c102460 0x7fbd7c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd81fbb640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd7c107ad0 0x7fbd7c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd817ba640 1 -- 172.21.15.2:0/3073158158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c102460 msgr2=0x7fbd7c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd817ba640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c102460 0x7fbd7c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd817ba640 1 -- 172.21.15.2:0/3073158158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd7c107ad0 msgr2=0x7fbd7c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd817ba640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd7c107ad0 0x7fbd7c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd817ba640 1 -- 172.21.15.2:0/3073158158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7c19d3f0 con 0x7fbd7c101ac0 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd817ba640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c101ac0 0x7fbd7c198400 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800e9f0 tx=0x7fbd7800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd727fc640 1 -- 172.21.15.2:0/3073158158 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800cd80 con 0x7fbd7c101ac0 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7c19d6e0 con 0x7fbd7c101ac0 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd727fc640 1 -- 172.21.15.2:0/3073158158 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd78005500 con 0x7fbd7c101ac0 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd727fc640 1 -- 172.21.15.2:0/3073158158 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78010690 con 0x7fbd7c101ac0 2024-09-12T00:53:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.417+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd7c1a4f70 con 0x7fbd7c101ac0 2024-09-12T00:53:05.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.418+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd7c101f20 con 0x7fbd7c101ac0 2024-09-12T00:53:05.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.420+0000 7fbd727fc640 1 -- 172.21.15.2:0/3073158158 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fbd780046c0 con 0x7fbd7c101ac0 2024-09-12T00:53:05.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.420+0000 7fbd727fc640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd680a2e10 0x7fbd680a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.420+0000 7fbd80fb9640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd680a2e10 0x7fbd680a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.420+0000 7fbd727fc640 1 -- 172.21.15.2:0/3073158158 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fbd780cfc80 con 0x7fbd7c101ac0 2024-09-12T00:53:05.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.421+0000 7fbd80fb9640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd680a2e10 0x7fbd680a52d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0ffe40 tx=0x7fbd6c00b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.423+0000 7fbd727fc640 1 -- 172.21.15.2:0/3073158158 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd780541b0 con 0x7fbd7c101ac0 2024-09-12T00:53:05.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.621+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fbd7c062630 con 0x7fbd680a2e10 2024-09-12T00:53:05.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.690+0000 7fbd727fc640 1 -- 172.21.15.2:0/3073158158 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbd7c062630 con 0x7fbd680a2e10 2024-09-12T00:53:05.691 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule set for path / 2024-09-12T00:53:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.692+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd680a2e10 msgr2=0x7fbd680a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.692+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd680a2e10 0x7fbd680a52d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0ffe40 tx=0x7fbd6c00b410 comp rx=0 tx=0).stop 2024-09-12T00:53:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.692+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c101ac0 msgr2=0x7fbd7c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.692+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c101ac0 0x7fbd7c198400 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800e9f0 tx=0x7fbd7800edf0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.692+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 shutdown_connections 2024-09-12T00:53:05.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.693+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd680a2e10 0x7fbd680a52d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.693+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd7c107ad0 0x7fbd7c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.693+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c102460 0x7fbd7c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.693+0000 7fbd83a1e640 1 --2- 172.21.15.2:0/3073158158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7c101ac0 0x7fbd7c198400 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.693+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 >> 172.21.15.2:0/3073158158 conn(0x7fbd7c0fd7a0 msgr2=0x7fbd7c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.693+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 shutdown_connections 2024-09-12T00:53:05.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.693+0000 7fbd83a1e640 1 -- 172.21.15.2:0/3073158158 wait complete. 2024-09-12T00:53:05.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-12T00:53:05.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 -- 172.21.15.2:0/561473672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8430100810 msgr2=0x7f8430100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 --2- 172.21.15.2:0/561473672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8430100810 0x7f8430100c70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8420009cd0 tx=0x7f842002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 -- 172.21.15.2:0/561473672 shutdown_connections 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 --2- 172.21.15.2:0/561473672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84301011b0 0x7f843010d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 --2- 172.21.15.2:0/561473672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8430100810 0x7f8430100c70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 --2- 172.21.15.2:0/561473672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8430106820 0x7f8430106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 -- 172.21.15.2:0/561473672 >> 172.21.15.2:0/561473672 conn(0x7f84300777f0 msgr2=0x7f84300feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 -- 172.21.15.2:0/561473672 shutdown_connections 2024-09-12T00:53:05.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.814+0000 7f8435da2640 1 -- 172.21.15.2:0/561473672 wait complete. 2024-09-12T00:53:05.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8435da2640 1 Processor -- start 2024-09-12T00:53:05.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8435da2640 1 -- start start 2024-09-12T00:53:05.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8435da2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8430100810 0x7f84301982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8435da2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84301011b0 0x7f84301987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8435da2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8430106820 0x7f843019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8435da2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8430110c60 con 0x7f84301011b0 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8435da2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8430110ae0 con 0x7f8430100810 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8435da2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8430110de0 con 0x7f8430106820 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84301011b0 0x7f84301987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84301011b0 0x7f84301987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45542/0 (socket says 172.21.15.2:45542) 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 -- 172.21.15.2:0/2699631543 learned_addr learned my addr 172.21.15.2:0/2699631543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f8434da0640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8430100810 0x7f84301982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f84355a1640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8430106820 0x7f843019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 -- 172.21.15.2:0/2699631543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8430106820 msgr2=0x7f843019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8430106820 0x7f843019cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 -- 172.21.15.2:0/2699631543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8430100810 msgr2=0x7f84301982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8430100810 0x7f84301982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:05.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 -- 172.21.15.2:0/2699631543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843019d290 con 0x7f84301011b0 2024-09-12T00:53:05.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.815+0000 7f842ffff640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84301011b0 0x7f84301987e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8420005e30 tx=0x7f8420032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.816+0000 7f842dffb640 1 -- 172.21.15.2:0/2699631543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420004040 con 0x7f84301011b0 2024-09-12T00:53:05.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.816+0000 7f842dffb640 1 -- 172.21.15.2:0/2699631543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84200046c0 con 0x7f84301011b0 2024-09-12T00:53:05.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.816+0000 7f842dffb640 1 -- 172.21.15.2:0/2699631543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420046480 con 0x7f84301011b0 2024-09-12T00:53:05.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.816+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843019d520 con 0x7f84301011b0 2024-09-12T00:53:05.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.816+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84301a4e10 con 0x7f84301011b0 2024-09-12T00:53:05.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.817+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8430100c70 con 0x7f84301011b0 2024-09-12T00:53:05.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.819+0000 7f842dffb640 1 -- 172.21.15.2:0/2699631543 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f84200305a0 con 0x7f84301011b0 2024-09-12T00:53:05.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.820+0000 7f842dffb640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f841c0a2e80 0x7f841c0a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:05.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.820+0000 7f8434da0640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f841c0a2e80 0x7f841c0a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:05.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.820+0000 7f842dffb640 1 -- 172.21.15.2:0/2699631543 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f842002e030 con 0x7f84301011b0 2024-09-12T00:53:05.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.821+0000 7f8434da0640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f841c0a2e80 0x7f841c0a5340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8418009b50 tx=0x7f8418005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:05.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:05.824+0000 7f842dffb640 1 -- 172.21.15.2:0/2699631543 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f842004b060 con 0x7f84301011b0 2024-09-12T00:53:05.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2371205728' entity='client.admin' 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4105006899' entity='client.admin' 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:53:05.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:53:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='client.? ' entity='client.admin' 2024-09-12T00:53:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:05.943 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2371205728' entity='client.admin' 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4105006899' entity='client.admin' 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:05.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:53:05.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:05.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:53:05.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:05.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='client.? ' entity='client.admin' 2024-09-12T00:53:05.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:05.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:05.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:05.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:06.026 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:06.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.030+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f8430062630 con 0x7f841c0a2e80 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2371205728' entity='client.admin' 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4105006899' entity='client.admin' 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='client.? ' entity='client.admin' 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:53:06.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:53:06.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.093+0000 7f842dffb640 1 -- 172.21.15.2:0/2699631543 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f8430062630 con 0x7f841c0a2e80 2024-09-12T00:53:06.092 INFO:teuthology.orchestra.run.smithi002.stdout:Retention added to path / 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f841c0a2e80 msgr2=0x7f841c0a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f841c0a2e80 0x7f841c0a5340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8418009b50 tx=0x7f8418005f90 comp rx=0 tx=0).stop 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84301011b0 msgr2=0x7f84301987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84301011b0 0x7f84301987e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8420005e30 tx=0x7f8420032fb0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 shutdown_connections 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f841c0a2e80 0x7f841c0a5340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8430106820 0x7f843019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84301011b0 0x7f84301987e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 --2- 172.21.15.2:0/2699631543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8430100810 0x7f84301982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 >> 172.21.15.2:0/2699631543 conn(0x7f84300777f0 msgr2=0x7f8430069d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 shutdown_connections 2024-09-12T00:53:06.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.095+0000 7f8435da2640 1 -- 172.21.15.2:0/2699631543 wait complete. 2024-09-12T00:53:06.105 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T00:53:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.211+0000 7f9c2719f640 1 -- 172.21.15.2:0/332003535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 msgr2=0x7f9c20100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.211+0000 7f9c2719f640 1 --2- 172.21.15.2:0/332003535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 0x7f9c20100c70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009930 tx=0x7f9c1002a420 comp rx=0 tx=0).stop 2024-09-12T00:53:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.211+0000 7f9c2719f640 1 -- 172.21.15.2:0/332003535 shutdown_connections 2024-09-12T00:53:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.211+0000 7f9c2719f640 1 --2- 172.21.15.2:0/332003535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c201011b0 0x7f9c2010d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.211+0000 7f9c2719f640 1 --2- 172.21.15.2:0/332003535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 0x7f9c20100c70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.211+0000 7f9c2719f640 1 --2- 172.21.15.2:0/332003535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c20106820 0x7f9c20106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.211+0000 7f9c2719f640 1 -- 172.21.15.2:0/332003535 >> 172.21.15.2:0/332003535 conn(0x7f9c200777f0 msgr2=0x7f9c200feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.211+0000 7f9c2719f640 1 -- 172.21.15.2:0/332003535 shutdown_connections 2024-09-12T00:53:06.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.212+0000 7f9c2719f640 1 -- 172.21.15.2:0/332003535 wait complete. 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.212+0000 7f9c2719f640 1 Processor -- start 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.212+0000 7f9c2719f640 1 -- start start 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.212+0000 7f9c2719f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 0x7f9c20198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.212+0000 7f9c2719f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c201011b0 0x7f9c20198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.212+0000 7f9c2719f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c20106820 0x7f9c2019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2719f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20110c70 con 0x7f9c20100810 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2719f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20110af0 con 0x7f9c20106820 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2719f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20110df0 con 0x7f9c201011b0 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 0x7f9c20198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 0x7f9c20198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50846/0 (socket says 172.21.15.2:50846) 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 -- 172.21.15.2:0/589157213 learned_addr learned my addr 172.21.15.2:0/589157213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2599c640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c201011b0 0x7f9c20198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2699e640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c20106820 0x7f9c2019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 -- 172.21.15.2:0/589157213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c201011b0 msgr2=0x7f9c20198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c201011b0 0x7f9c20198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 -- 172.21.15.2:0/589157213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c20106820 msgr2=0x7f9c2019cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c20106820 0x7f9c2019cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 -- 172.21.15.2:0/589157213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2019d200 con 0x7f9c20100810 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2619d640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 0x7f9c20198210 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00c920 tx=0x7f9c1c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c177fe640 1 -- 172.21.15.2:0/589157213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c007c70 con 0x7f9c20100810 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c177fe640 1 -- 172.21.15.2:0/589157213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c1c007e10 con 0x7f9c20100810 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2019d4f0 con 0x7f9c20100810 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.213+0000 7f9c177fe640 1 -- 172.21.15.2:0/589157213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c018890 con 0x7f9c20100810 2024-09-12T00:53:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.214+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c201a4d80 con 0x7f9c20100810 2024-09-12T00:53:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.215+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c20100c70 con 0x7f9c20100810 2024-09-12T00:53:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.216+0000 7f9c177fe640 1 -- 172.21.15.2:0/589157213 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f9c1c018a70 con 0x7f9c20100810 2024-09-12T00:53:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.217+0000 7f9c177fe640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c0c0a2e00 0x7f9c0c0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.217+0000 7f9c2599c640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c0c0a2e00 0x7f9c0c0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.217+0000 7f9c177fe640 1 -- 172.21.15.2:0/589157213 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9c1c0cf770 con 0x7f9c20100810 2024-09-12T00:53:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.217+0000 7f9c2599c640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c0c0a2e00 0x7f9c0c0a52c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c10006010 tx=0x7f9c10000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.221+0000 7f9c177fe640 1 -- 172.21.15.2:0/589157213 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c1c014030 con 0x7f9c20100810 2024-09-12T00:53:06.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.419+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f9c20062630 con 0x7f9c0c0a2e00 2024-09-12T00:53:06.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.426+0000 7f9c177fe640 1 -- 172.21.15.2:0/589157213 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f9c20062630 con 0x7f9c0c0a2e00 2024-09-12T00:53:06.426 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T00:53:05", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-12T00:53:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c0c0a2e00 msgr2=0x7f9c0c0a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c0c0a2e00 0x7f9c0c0a52c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c10006010 tx=0x7f9c10000bc0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 msgr2=0x7f9c20198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 0x7f9c20198210 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00c920 tx=0x7f9c1c00cde0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 shutdown_connections 2024-09-12T00:53:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c0c0a2e00 0x7f9c0c0a52c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c20106820 0x7f9c2019cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c201011b0 0x7f9c20198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 --2- 172.21.15.2:0/589157213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c20100810 0x7f9c20198210 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 >> 172.21.15.2:0/589157213 conn(0x7f9c200777f0 msgr2=0x7f9c20069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.428+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 shutdown_connections 2024-09-12T00:53:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.429+0000 7f9c2719f640 1 -- 172.21.15.2:0/589157213 wait complete. 2024-09-12T00:53:06.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T00:53:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 -- 172.21.15.2:0/4223022782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102470 msgr2=0x7fa96c10e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 --2- 172.21.15.2:0/4223022782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102470 0x7fa96c10e9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa964009ca0 tx=0x7fa96402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 -- 172.21.15.2:0/4223022782 shutdown_connections 2024-09-12T00:53:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 --2- 172.21.15.2:0/4223022782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102470 0x7fa96c10e9a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 --2- 172.21.15.2:0/4223022782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa96c101ad0 0x7fa96c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 --2- 172.21.15.2:0/4223022782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa96c107b70 0x7fa96c107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 -- 172.21.15.2:0/4223022782 >> 172.21.15.2:0/4223022782 conn(0x7fa96c0fd7d0 msgr2=0x7fa96c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 -- 172.21.15.2:0/4223022782 shutdown_connections 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.549+0000 7fa9717fd640 1 -- 172.21.15.2:0/4223022782 wait complete. 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa9717fd640 1 Processor -- start 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa9717fd640 1 -- start start 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa9717fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c101ad0 0x7fa96c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa9717fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa96c102470 0x7fa96c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa9717fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa96c107b70 0x7fa96c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa9717fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c111f20 con 0x7fa96c107b70 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa9717fd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c111da0 con 0x7fa96c101ad0 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa9717fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1120a0 con 0x7fa96c102470 2024-09-12T00:53:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa96b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa96c107b70 0x7fa96c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa96b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa96c107b70 0x7fa96c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50866/0 (socket says 172.21.15.2:50866) 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.550+0000 7fa96b7fe640 1 -- 172.21.15.2:0/1734424358 learned_addr learned my addr 172.21.15.2:0/1734424358 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa96affd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c101ad0 0x7fa96c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa963fff640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa96c102470 0x7fa96c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa96b7fe640 1 -- 172.21.15.2:0/1734424358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa96c102470 msgr2=0x7fa96c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa96b7fe640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa96c102470 0x7fa96c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa96b7fe640 1 -- 172.21.15.2:0/1734424358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c101ad0 msgr2=0x7fa96c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa96b7fe640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c101ad0 0x7fa96c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa96b7fe640 1 -- 172.21.15.2:0/1734424358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c1a6890 con 0x7fa96c107b70 2024-09-12T00:53:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa96b7fe640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa96c107b70 0x7fa96c074f70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa964006010 tx=0x7fa964003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa968ff9640 1 -- 172.21.15.2:0/1734424358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964031650 con 0x7fa96c107b70 2024-09-12T00:53:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa968ff9640 1 -- 172.21.15.2:0/1734424358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9640317f0 con 0x7fa96c107b70 2024-09-12T00:53:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c1a6b20 con 0x7fa96c107b70 2024-09-12T00:53:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa968ff9640 1 -- 172.21.15.2:0/1734424358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9640309e0 con 0x7fa96c107b70 2024-09-12T00:53:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.551+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c1a70c0 con 0x7fa96c107b70 2024-09-12T00:53:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.552+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96c101f30 con 0x7fa96c107b70 2024-09-12T00:53:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.554+0000 7fa968ff9640 1 -- 172.21.15.2:0/1734424358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fa964030b80 con 0x7fa96c107b70 2024-09-12T00:53:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.554+0000 7fa968ff9640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa9580a2e90 0x7fa9580a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.554+0000 7fa968ff9640 1 -- 172.21.15.2:0/1734424358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fa9640f0a80 con 0x7fa96c107b70 2024-09-12T00:53:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.554+0000 7fa96affd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa9580a2e90 0x7fa9580a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.555+0000 7fa96affd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa9580a2e90 0x7fa9580a5350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009ae0 tx=0x7fa95c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.558+0000 7fa968ff9640 1 -- 172.21.15.2:0/1734424358 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa9640f2e20 con 0x7fa96c107b70 2024-09-12T00:53:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 -- 172.21.15.2:0/2332084619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101df0 msgr2=0x7fed34105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 --2- 172.21.15.2:0/2332084619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101df0 0x7fed34105920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fed24009900 tx=0x7fed2402a410 comp rx=0 tx=0).stop 2024-09-12T00:53:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 -- 172.21.15.2:0/2332084619 shutdown_connections 2024-09-12T00:53:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 --2- 172.21.15.2:0/2332084619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed34106050 0x7fed3410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 --2- 172.21.15.2:0/2332084619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101df0 0x7fed34105920 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 --2- 172.21.15.2:0/2332084619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed34101440 0x7fed34101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 -- 172.21.15.2:0/2332084619 >> 172.21.15.2:0/2332084619 conn(0x7fed34077210 msgr2=0x7fed340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 -- 172.21.15.2:0/2332084619 shutdown_connections 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 -- 172.21.15.2:0/2332084619 wait complete. 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.565+0000 7fed3930e640 1 Processor -- start 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed3930e640 1 -- start start 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed3930e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101440 0x7fed341a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed3930e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed34101df0 0x7fed341a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed3930e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed34106050 0x7fed3419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed3930e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed34111050 con 0x7fed34101440 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed3930e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed34110ed0 con 0x7fed34101df0 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed3930e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed341111d0 con 0x7fed34106050 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101440 0x7fed341a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101440 0x7fed341a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50882/0 (socket says 172.21.15.2:50882) 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed32ffd640 1 -- 172.21.15.2:0/3037327135 learned_addr learned my addr 172.21.15.2:0/3037327135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed337fe640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed34106050 0x7fed3419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed32ffd640 1 -- 172.21.15.2:0/3037327135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed34106050 msgr2=0x7fed3419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed32ffd640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed34106050 0x7fed3419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed32ffd640 1 -- 172.21.15.2:0/3037327135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed34101df0 msgr2=0x7fed341a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed32ffd640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed34101df0 0x7fed341a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.566+0000 7fed32ffd640 1 -- 172.21.15.2:0/3037327135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3419af20 con 0x7fed34101440 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.567+0000 7fed32ffd640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101440 0x7fed341a05e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00d950 tx=0x7fed1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.567+0000 7fed2bfff640 1 -- 172.21.15.2:0/3037327135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c017030 con 0x7fed34101440 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.567+0000 7fed2bfff640 1 -- 172.21.15.2:0/3037327135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed1c004020 con 0x7fed34101440 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.567+0000 7fed3930e640 1 -- 172.21.15.2:0/3037327135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3419b210 con 0x7fed34101440 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.567+0000 7fed2bfff640 1 -- 172.21.15.2:0/3037327135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0047a0 con 0x7fed34101440 2024-09-12T00:53:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.567+0000 7fed3930e640 1 -- 172.21.15.2:0/3037327135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed341a7560 con 0x7fed34101440 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed2bfff640 1 -- 172.21.15.2:0/3037327135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fed1c0041d0 con 0x7fed34101440 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed3b6e7740 1 Processor -- start 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed3b6e7740 1 -- start start 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fd5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fe0680 0x55d9b8fe2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8f3b2e0 con 0x55d9b8fd5dc0 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8ee2ce0 con 0x55d9b8fe0680 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8f372a0 con 0x55d9b8fd54a0 2024-09-12T00:53:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50890/0 (socket says 172.21.15.2:50890) 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.570+0000 7fed32ffd640 1 -- 172.21.15.2:0/1762726239 learned_addr learned my addr 172.21.15.2:0/1762726239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed327fc640 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fe0680 0x55d9b8fe2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed337fe640 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fd5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed32ffd640 1 -- 172.21.15.2:0/1762726239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 msgr2=0x55d9b8fd5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed32ffd640 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fd5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed32ffd640 1 -- 172.21.15.2:0/1762726239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fe0680 msgr2=0x55d9b8fe2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed32ffd640 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fe0680 0x55d9b8fe2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed32ffd640 1 -- 172.21.15.2:0/1762726239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b8ec7440 con 0x55d9b8fd5dc0 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed2bfff640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed200a2e90 0x7fed200a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed337fe640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed200a2e90 0x7fed200a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed32ffd640 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe0140 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0cc770 tx=0x7fed1c097600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3f06a900a3c8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed2bfff640 1 -- 172.21.15.2:0/3037327135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fed1c0cf0e0 con 0x7fed34101440 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed297fa640 1 -- 172.21.15.2:0/1762726239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c09b130 con 0x55d9b8fd5dc0 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed297fa640 1 -- 172.21.15.2:0/1762726239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed1c09ba60 con 0x55d9b8fd5dc0 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.571+0000 7fed297fa640 1 -- 172.21.15.2:0/1762726239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c09acc0 con 0x55d9b8fd5dc0 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1762726239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd5dc0 msgr2=0x55d9b8fe0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed337fe640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed200a2e90 0x7fed200a5350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed2c005fd0 tx=0x7fed2c009500 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe0140 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0cc770 tx=0x7fed1c097600 comp rx=0 tx=0).stop 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1762726239 shutdown_connections 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fe0680 0x55d9b8fe2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe0140 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/1762726239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fd5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1762726239 >> 172.21.15.2:0/1762726239 conn(0x55d9b8fd1a30 msgr2=0x55d9b8fd1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1762726239 shutdown_connections 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.572+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1762726239 wait complete. 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 1 -- start start 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 1 Processor -- start 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fdd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fe0680 0x55d9b8fdd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8fe3250 con 0x55d9b8fe0680 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8ef6050 con 0x55d9b8fd5dc0 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8fe33d0 con 0x55d9b8fd54a0 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed3b6e7740 10 client.0 _ll_register_callbacks cb 0x55d9b8f36160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fe0680 0x55d9b8fdd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fe0680 0x55d9b8fdd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50900/0 (socket says 172.21.15.2:50900) 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed337fe640 1 -- 172.21.15.2:0/965456252 learned_addr learned my addr 172.21.15.2:0/965456252 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed327fc640 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fdd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.573+0000 7fed32ffd640 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed337fe640 1 -- 172.21.15.2:0/965456252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 msgr2=0x55d9b8fdff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed337fe640 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed337fe640 1 -- 172.21.15.2:0/965456252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 msgr2=0x55d9b8fdd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed337fe640 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fdd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed337fe640 1 -- 172.21.15.2:0/965456252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b8cac3c0 con 0x55d9b8fe0680 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed337fe640 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fe0680 0x55d9b8fdd760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0099c0 tx=0x7fed2c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18df874312d4bd88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed1a7fc640 1 -- 172.21.15.2:0/965456252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c004b20 con 0x55d9b8fe0680 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed3b6e7740 1 -- 172.21.15.2:0/965456252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed1c09ba60 con 0x55d9b8fe0680 2024-09-12T00:53:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed1a7fc640 1 -- 172.21.15.2:0/965456252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fed2c004cc0 con 0x55d9b8fe0680 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed1a7fc640 1 -- 172.21.15.2:0/965456252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fed2c00f7d0 con 0x55d9b8fe0680 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed3b6e7740 10 client.15321 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed3b6e7740 1 -- 172.21.15.2:0/965456252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d9b8feec80 con 0x55d9b8fe0680 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.574+0000 7fed1a7fc640 1 -- 172.21.15.2:0/965456252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed1c09ba60 con 0x55d9b8fe0680 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.575+0000 7fed1a7fc640 1 -- 172.21.15.2:0/965456252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fed2c026070 con 0x55d9b8fe0680 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.575+0000 7fed3b6e7740 10 client.15321 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.575+0000 7fed3b6e7740 10 client.15321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.575+0000 7fed3b6e7740 20 client.15321 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.575+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9b8ff0190 0x55d9b8ff25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.575+0000 7fed3b6e7740 4 client.15321 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.575+0000 7fed3b6e7740 1 -- 172.21.15.2:0/965456252 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9b8f48850 con 0x55d9b8ff0190 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.575+0000 7fed32ffd640 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9b8ff0190 0x55d9b8ff25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.576+0000 7fed1a7fc640 10 client.15321 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.576+0000 7fed32ffd640 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9b8ff0190 0x55d9b8ff25e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0de7d0c1a509fcb server_cookie=1cbe463dacf2670f in_seq=0 out_seq=0 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.576+0000 7fed1a7fc640 1 -- 172.21.15.2:0/965456252 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fed1c080e80 con 0x55d9b8ff0190 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.576+0000 7fed1a7fc640 10 client.15321 handle_command_reply: tid=0 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.576+0000 7fed3b6e7740 1 client.15321 shutdown 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.576+0000 7fed3b6e7740 1 -- 172.21.15.2:0/965456252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fe0680 msgr2=0x55d9b8fdd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.576+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fe0680 0x55d9b8fdd760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0099c0 tx=0x7fed2c004ab0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.576+0000 7fed3b6e7740 1 -- 172.21.15.2:0/965456252 shutdown_connections 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9b8ff0190 0x55d9b8ff25e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fe0680 0x55d9b8fdd760 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fdd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed1a7fc640 0 client.15321 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/965456252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed3b6e7740 1 -- 172.21.15.2:0/965456252 >> 172.21.15.2:0/965456252 conn(0x55d9b8fd1a30 msgr2=0x55d9b8fd7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed3b6e7740 1 -- 172.21.15.2:0/965456252 shutdown_connections 2024-09-12T00:53:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed3b6e7740 1 -- 172.21.15.2:0/965456252 wait complete. 2024-09-12T00:53:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.577+0000 7fed3b6e7740 20 client.15321 trim_cache size 0 max 16384 2024-09-12T00:53:06.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.594+0000 7fed3b6e7740 1 Processor -- start 2024-09-12T00:53:06.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.594+0000 7fed3b6e7740 1 -- start start 2024-09-12T00:53:06.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fdd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8ff7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed341b2650 con 0x55d9b8fd1a30 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed341aff20 con 0x55d9b8fd5dc0 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed341add70 con 0x55d9b8fd54a0 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fdd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fdd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50912/0 (socket says 172.21.15.2:50912) 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed32ffd640 1 -- 172.21.15.2:0/1476566471 learned_addr learned my addr 172.21.15.2:0/1476566471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed337fe640 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8ff7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed327fc640 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed32ffd640 1 -- 172.21.15.2:0/1476566471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 msgr2=0x55d9b8fdf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed32ffd640 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed32ffd640 1 -- 172.21.15.2:0/1476566471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 msgr2=0x55d9b8ff7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:06.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed32ffd640 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8ff7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed32ffd640 1 -- 172.21.15.2:0/1476566471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b8fe02e0 con 0x55d9b8fd1a30 2024-09-12T00:53:06.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.595+0000 7fed327fc640 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:06.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.596+0000 7fed32ffd640 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fdd1e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fed1c09b060 tx=0x7fed1c097730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f32eb72734c962 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.596+0000 7fed28ff9640 1 -- 172.21.15.2:0/1476566471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c09aea0 con 0x55d9b8fd1a30 2024-09-12T00:53:06.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.596+0000 7fed28ff9640 1 -- 172.21.15.2:0/1476566471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d9b8f48850 con 0x55d9b8fd1a30 2024-09-12T00:53:06.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.596+0000 7fed28ff9640 1 -- 172.21.15.2:0/1476566471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c09ba60 con 0x55d9b8fd1a30 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1476566471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 msgr2=0x55d9b8fdd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fdd1e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fed1c09b060 tx=0x7fed1c097730 comp rx=0 tx=0).stop 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1476566471 shutdown_connections 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8ff7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fdf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/1476566471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fdd1e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1476566471 >> 172.21.15.2:0/1476566471 conn(0x55d9b8fdd8c0 msgr2=0x55d9b8fdea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1476566471 shutdown_connections 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 -- 172.21.15.2:0/1476566471 wait complete. 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 -- start start 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 Processor -- start 2024-09-12T00:53:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fe8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fe6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.597+0000 7fed3b6e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed341ae3e0 con 0x55d9b8fd1a30 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed341af850 con 0x55d9b8fd5dc0 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed3b6e7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed341aeab0 con 0x55d9b8fd54a0 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed3b6e7740 10 client.0 _ll_register_callbacks cb 0x7fed2c009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fe8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fe8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50928/0 (socket says 172.21.15.2:50928) 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 -- 172.21.15.2:0/3186572988 learned_addr learned my addr 172.21.15.2:0/3186572988 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed327fc640 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fe6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed337fe640 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 -- 172.21.15.2:0/3186572988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 msgr2=0x55d9b8fe6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fe6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 -- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 msgr2=0x55d9b8fe6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 -- 172.21.15.2:0/3186572988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b9059e90 con 0x55d9b8fd1a30 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed337fe640 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed32ffd640 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fe8f20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fed1c097d30 tx=0x7fed1c0cf3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9996d8dc96c72ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed1a7fc640 1 -- 172.21.15.2:0/3186572988 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c09aea0 con 0x55d9b8fd1a30 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed3b6e7740 1 -- 172.21.15.2:0/3186572988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9b8f48850 con 0x55d9b8fd1a30 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.598+0000 7fed1a7fc640 1 -- 172.21.15.2:0/3186572988 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fed1c0b4120 con 0x55d9b8fd1a30 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed1a7fc640 1 -- 172.21.15.2:0/3186572988 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fed1c09ba60 con 0x55d9b8fd1a30 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed3b6e7740 10 client.15327 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed3b6e7740 1 -- 172.21.15.2:0/3186572988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d9b905aff0 con 0x55d9b8fd1a30 2024-09-12T00:53:06.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed1a7fc640 1 -- 172.21.15.2:0/3186572988 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d9b8f48850 con 0x55d9b8fd1a30 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed1a7fc640 1 -- 172.21.15.2:0/3186572988 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fed1c0d2860 con 0x55d9b8fd1a30 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed3b6e7740 10 client.15327 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed3b6e7740 10 client.15327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed3b6e7740 20 client.15327 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9b8fe0680 0x55d9b905d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed3b6e7740 4 client.15327 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed3b6e7740 1 -- 172.21.15.2:0/3186572988 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d9b8f42d60 con 0x55d9b8fe0680 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.599+0000 7fed327fc640 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9b8fe0680 0x55d9b905d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed327fc640 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9b8fe0680 0x55d9b905d1d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d877b167d27d099 server_cookie=70e0fc7ec23fb5be in_seq=0 out_seq=0 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed1a7fc640 10 client.15327 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed1a7fc640 1 -- 172.21.15.2:0/3186572988 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d9b8f42d60 con 0x55d9b8fe0680 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed1a7fc640 10 client.15327 handle_command_reply: tid=0 2024-09-12T00:53:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 client.15327 shutdown 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 -- 172.21.15.2:0/3186572988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 msgr2=0x55d9b8fe8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fe8f20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fed1c097d30 tx=0x7fed1c0cf3e0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 -- 172.21.15.2:0/3186572988 shutdown_connections 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9b8fe0680 0x55d9b905d1d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9b8fd5dc0 0x55d9b8fe6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9b8fd54a0 0x55d9b8fe6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed1a7fc640 0 client.15327 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 --2- 172.21.15.2:0/3186572988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9b8fd1a30 0x55d9b8fe8f20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 -- 172.21.15.2:0/3186572988 >> 172.21.15.2:0/3186572988 conn(0x55d9b8fdd8c0 msgr2=0x55d9b8fdf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 -- 172.21.15.2:0/3186572988 shutdown_connections 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 1 -- 172.21.15.2:0/3186572988 wait complete. 2024-09-12T00:53:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.600+0000 7fed3b6e7740 20 client.15327 trim_cache size 0 max 16384 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout: "9f4cc9c1-4ffb-426f-a55f-718fa0024be6": { 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "9f4cc9c1-4ffb-426f-a55f-718fa0024be6", 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:53:06.606 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:06.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 -- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed200a2e90 msgr2=0x7fed200a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed200a2e90 0x7fed200a5350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed2c005fd0 tx=0x7fed2c009500 comp rx=0 tx=0).stop 2024-09-12T00:53:06.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 -- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101440 msgr2=0x7fed341a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101440 0x7fed341a05e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00d950 tx=0x7fed1c00de10 comp rx=0 tx=0).stop 2024-09-12T00:53:06.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 -- 172.21.15.2:0/3037327135 shutdown_connections 2024-09-12T00:53:06.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed200a2e90 0x7fed200a5350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed34106050 0x7fed3419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed34101df0 0x7fed341a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 --2- 172.21.15.2:0/3037327135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed34101440 0x7fed341a05e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 -- 172.21.15.2:0/3037327135 >> 172.21.15.2:0/3037327135 conn(0x7fed34077210 msgr2=0x7fed34100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 -- 172.21.15.2:0/3037327135 shutdown_connections 2024-09-12T00:53:06.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.601+0000 7fed3930e640 1 -- 172.21.15.2:0/3037327135 wait complete. 2024-09-12T00:53:06.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:06 smithi002 ceph-mon[31210]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 795 B/s wr, 18 op/s 2024-09-12T00:53:06.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:06 smithi002 ceph-mon[31210]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:06.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.771+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fa96c0fe5e0 con 0x7fa9580a2e90 2024-09-12T00:53:06.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.778+0000 7fa968ff9640 1 -- 172.21.15.2:0/1734424358 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fa96c0fe5e0 con 0x7fa9580a2e90 2024-09-12T00:53:06.777 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa9580a2e90 msgr2=0x7fa9580a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa9580a2e90 0x7fa9580a5350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009ae0 tx=0x7fa95c005f90 comp rx=0 tx=0).stop 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa96c107b70 msgr2=0x7fa96c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa96c107b70 0x7fa96c074f70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa964006010 tx=0x7fa964003ce0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 shutdown_connections 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa9580a2e90 0x7fa9580a5350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa96c107b70 0x7fa96c074f70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa96c102470 0x7fa96c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 --2- 172.21.15.2:0/1734424358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c101ad0 0x7fa96c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:06.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 >> 172.21.15.2:0/1734424358 conn(0x7fa96c0fd7d0 msgr2=0x7fa96c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:06.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 shutdown_connections 2024-09-12T00:53:06.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:06.780+0000 7fa9717fd640 1 -- 172.21.15.2:0/1734424358 wait complete. 2024-09-12T00:53:06.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-12T00:53:06.817 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-12T00:53:06.845 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-12T00:53:06.873 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T00:53:06.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T00:53:06.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:06 smithi071 ceph-mon[35276]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 795 B/s wr, 18 op/s 2024-09-12T00:53:06.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:06 smithi071 ceph-mon[35276]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:07.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:06 smithi167 ceph-mon[35234]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 795 B/s wr, 18 op/s 2024-09-12T00:53:07.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:06 smithi167 ceph-mon[35234]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:07.428 INFO:tasks.cephfs.filesystem:scrub status for tag:9f4cc9c1-4ffb-426f-a55f-718fa0024be6 - {'path': '/', 'tag': '9f4cc9c1-4ffb-426f-a55f-718fa0024be6', 'options': 'recursive,force'} 2024-09-12T00:53:07.561 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:07.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:07 smithi071 ceph-mon[35276]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:07.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:07 smithi071 ceph-mon[35276]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:07.963 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:07 smithi002 ceph-mon[31210]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:07.963 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:07 smithi002 ceph-mon[31210]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:07 smithi167 ceph-mon[35234]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:07 smithi167 ceph-mon[35234]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:08.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 -- 172.21.15.2:0/3459866512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 msgr2=0x7f12f81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:08.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 --2- 172.21.15.2:0/3459866512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 0x7f12f81021c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009900 tx=0x7f12e802a410 comp rx=0 tx=0).stop 2024-09-12T00:53:08.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 -- 172.21.15.2:0/3459866512 shutdown_connections 2024-09-12T00:53:08.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 --2- 172.21.15.2:0/3459866512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8106f10 0x7f12f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 --2- 172.21.15.2:0/3459866512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f8102790 0x7f12f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 --2- 172.21.15.2:0/3459866512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 0x7f12f81021c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 -- 172.21.15.2:0/3459866512 >> 172.21.15.2:0/3459866512 conn(0x7f12f80fd8c0 msgr2=0x7f12f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 -- 172.21.15.2:0/3459866512 shutdown_connections 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.044+0000 7f12fcf78640 1 -- 172.21.15.2:0/3459866512 wait complete. 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12fcf78640 1 Processor -- start 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12fcf78640 1 -- start start 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12fcf78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 0x7f12f8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12fcf78640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8102790 0x7f12f81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12fcf78640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f8106f10 0x7f12f819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12fcf78640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8111f70 con 0x7f12f8101de0 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12fcf78640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8111df0 con 0x7f12f8106f10 2024-09-12T00:53:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12fcf78640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81120f0 con 0x7f12f8102790 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12f659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 0x7f12f8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12f659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 0x7f12f8198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50944/0 (socket says 172.21.15.2:50944) 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.045+0000 7f12f659c640 1 -- 172.21.15.2:0/2089697636 learned_addr learned my addr 172.21.15.2:0/2089697636 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12f6d9d640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f8106f10 0x7f12f819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12effff640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8102790 0x7f12f81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12f659c640 1 -- 172.21.15.2:0/2089697636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8102790 msgr2=0x7f12f81988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12f659c640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8102790 0x7f12f81988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12f659c640 1 -- 172.21.15.2:0/2089697636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f8106f10 msgr2=0x7f12f819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12f659c640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f8106f10 0x7f12f819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12f659c640 1 -- 172.21.15.2:0/2089697636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f819d320 con 0x7f12f8101de0 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12effff640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8102790 0x7f12f81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12f659c640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 0x7f12f8198370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f12e8006010 tx=0x7f12e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12ef7fe640 1 -- 172.21.15.2:0/2089697636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e803f030 con 0x7f12f8101de0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12ef7fe640 1 -- 172.21.15.2:0/2089697636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e8003ce0 con 0x7f12f8101de0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f819d5b0 con 0x7f12f8101de0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12ef7fe640 1 -- 172.21.15.2:0/2089697636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8035070 con 0x7f12f8101de0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.046+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f81a4ef0 con 0x7f12f8101de0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.047+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f81032c0 con 0x7f12f8101de0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.048+0000 7f12ef7fe640 1 -- 172.21.15.2:0/2089697636 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f12e8042030 con 0x7f12f8101de0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.049+0000 7f12ef7fe640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f12e40a2e10 0x7f12e40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.049+0000 7f12ef7fe640 1 -- 172.21.15.2:0/2089697636 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f12e80efd40 con 0x7f12f8101de0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.049+0000 7f12effff640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f12e40a2e10 0x7f12e40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.050+0000 7f12effff640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f12e40a2e10 0x7f12e40a52d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12f81088e0 tx=0x7f12e000a5c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:08.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.053+0000 7f12ef7fe640 1 -- 172.21.15.2:0/2089697636 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12e80bc850 con 0x7f12f8101de0 2024-09-12T00:53:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.226+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12f8062630 con 0x7f12e40a2e10 2024-09-12T00:53:08.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.233+0000 7f12ef7fe640 1 -- 172.21.15.2:0/2089697636 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257764 (secure 0 0 0) 0x7f12f8062630 con 0x7f12e40a2e10 2024-09-12T00:53:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:08.236 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:53:08.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f12e40a2e10 msgr2=0x7f12e40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:08.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f12e40a2e10 0x7f12e40a52d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12f81088e0 tx=0x7f12e000a5c0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 msgr2=0x7f12f8198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 0x7f12f8198370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f12e8006010 tx=0x7f12e80042f0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 shutdown_connections 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f12e40a2e10 0x7f12e40a52d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f8106f10 0x7f12f819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8102790 0x7f12f81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 --2- 172.21.15.2:0/2089697636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12f8101de0 0x7f12f8198370 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 >> 172.21.15.2:0/2089697636 conn(0x7f12f80fd8c0 msgr2=0x7f12f80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 shutdown_connections 2024-09-12T00:53:08.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:08.236+0000 7f12fcf78640 1 -- 172.21.15.2:0/2089697636 wait complete. 2024-09-12T00:53:08.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:08 smithi071 ceph-mon[35276]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:08.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:08 smithi071 ceph-mon[35276]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-09-12T00:53:08.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:08 smithi002 ceph-mon[31210]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:08.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:08 smithi002 ceph-mon[31210]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-09-12T00:53:08.974 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-12T00:53:06.875387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1387693,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1104,"num_read_kb":922,"num_write":564,"num_write_kb":5036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":924,"ondisk_log_size":924,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376832,"kb_used_data":15024,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564992,"statfs":{"total":1151940427776,"available":1151554551808,"internally_reserved":0,"allocated":15384576,"data_stored":9408663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200331,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":349,"num_write":96,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.016788"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884145+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:52:54.884145+0000","last_peered":"2024-09-12T00:52:54.884145+0000","last_clean":"2024-09-12T00:52:54.884145+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:52:54.884145+0000","last_undegraded":"2024-09-12T00:52:54.884145+0000","last_fullsized":"2024-09-12T00:52:54.884145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880965+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:52:54.880965+0000","last_peered":"2024-09-12T00:52:54.880965+0000","last_clean":"2024-09-12T00:52:54.880965+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:52:54.880965+0000","last_undegraded":"2024-09-12T00:52:54.880965+0000","last_fullsized":"2024-09-12T00:52:54.880965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888565+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:52:54.888565+0000","last_peered":"2024-09-12T00:52:54.888565+0000","last_clean":"2024-09-12T00:52:54.888565+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:52:54.888565+0000","last_undegraded":"2024-09-12T00:52:54.888565+0000","last_fullsized":"2024-09-12T00:52:54.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871452+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:52:54.871452+0000","last_peered":"2024-09-12T00:52:54.871452+0000","last_clean":"2024-09-12T00:52:54.871452+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:52:54.871452+0000","last_undegraded":"2024-09-12T00:52:54.871452+0000","last_fullsized":"2024-09-12T00:52:54.871452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871301+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:52:54.871301+0000","last_peered":"2024-09-12T00:52:54.871301+0000","last_clean":"2024-09-12T00:52:54.871301+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:52:54.871301+0000","last_undegraded":"2024-09-12T00:52:54.871301+0000","last_fullsized":"2024-09-12T00:52:54.871301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890111+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:52:54.890111+0000","last_peered":"2024-09-12T00:52:54.890111+0000","last_clean":"2024-09-12T00:52:54.890111+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:52:54.890111+0000","last_undegraded":"2024-09-12T00:52:54.890111+0000","last_fullsized":"2024-09-12T00:52:54.890111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879651+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:52:54.879651+0000","last_peered":"2024-09-12T00:52:54.879651+0000","last_clean":"2024-09-12T00:52:54.879651+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:52:54.879651+0000","last_undegraded":"2024-09-12T00:52:54.879651+0000","last_fullsized":"2024-09-12T00:52:54.879651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880503+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:52:54.880503+0000","last_peered":"2024-09-12T00:52:54.880503+0000","last_clean":"2024-09-12T00:52:54.880503+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:52:54.880503+0000","last_undegraded":"2024-09-12T00:52:54.880503+0000","last_fullsized":"2024-09-12T00:52:54.880503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880321+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:52:54.880321+0000","last_peered":"2024-09-12T00:52:54.880321+0000","last_clean":"2024-09-12T00:52:54.880321+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:52:54.880321+0000","last_undegraded":"2024-09-12T00:52:54.880321+0000","last_fullsized":"2024-09-12T00:52:54.880321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878237+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:52:54.878237+0000","last_peered":"2024-09-12T00:52:54.878237+0000","last_clean":"2024-09-12T00:52:54.878237+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:52:54.878237+0000","last_undegraded":"2024-09-12T00:52:54.878237+0000","last_fullsized":"2024-09-12T00:52:54.878237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.881472+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:52:54.881472+0000","last_peered":"2024-09-12T00:52:54.881472+0000","last_clean":"2024-09-12T00:52:54.881472+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:52:54.881472+0000","last_undegraded":"2024-09-12T00:52:54.881472+0000","last_fullsized":"2024-09-12T00:52:54.881472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868621+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:52:54.868621+0000","last_peered":"2024-09-12T00:52:54.868621+0000","last_clean":"2024-09-12T00:52:54.868621+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:52:54.868621+0000","last_undegraded":"2024-09-12T00:52:54.868621+0000","last_fullsized":"2024-09-12T00:52:54.868621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884657+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:52:54.884657+0000","last_peered":"2024-09-12T00:52:54.884657+0000","last_clean":"2024-09-12T00:52:54.884657+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:52:54.884657+0000","last_undegraded":"2024-09-12T00:52:54.884657+0000","last_fullsized":"2024-09-12T00:52:54.884657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.886083+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:52:54.886083+0000","last_peered":"2024-09-12T00:52:54.886083+0000","last_clean":"2024-09-12T00:52:54.886083+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:52:54.886083+0000","last_undegraded":"2024-09-12T00:52:54.886083+0000","last_fullsized":"2024-09-12T00:52:54.886083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889586+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:52:54.889586+0000","last_peered":"2024-09-12T00:52:54.889586+0000","last_clean":"2024-09-12T00:52:54.889586+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:52:54.889586+0000","last_undegraded":"2024-09-12T00:52:54.889586+0000","last_fullsized":"2024-09-12T00:52:54.889586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887265+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:52:54.887265+0000","last_peered":"2024-09-12T00:52:54.887265+0000","last_clean":"2024-09-12T00:52:54.887265+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:52:54.887265+0000","last_undegraded":"2024-09-12T00:52:54.887265+0000","last_fullsized":"2024-09-12T00:52:54.887265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884255+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:52:54.884255+0000","last_peered":"2024-09-12T00:52:54.884255+0000","last_clean":"2024-09-12T00:52:54.884255+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:52:54.884255+0000","last_undegraded":"2024-09-12T00:52:54.884255+0000","last_fullsized":"2024-09-12T00:52:54.884255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889401+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:52:54.889401+0000","last_peered":"2024-09-12T00:52:54.889401+0000","last_clean":"2024-09-12T00:52:54.889401+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:52:54.889401+0000","last_undegraded":"2024-09-12T00:52:54.889401+0000","last_fullsized":"2024-09-12T00:52:54.889401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874518+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:52:54.874518+0000","last_peered":"2024-09-12T00:52:54.874518+0000","last_clean":"2024-09-12T00:52:54.874518+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:52:54.874518+0000","last_undegraded":"2024-09-12T00:52:54.874518+0000","last_fullsized":"2024-09-12T00:52:54.874518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871178+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:52:54.871178+0000","last_peered":"2024-09-12T00:52:54.871178+0000","last_clean":"2024-09-12T00:52:54.871178+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:52:54.871178+0000","last_undegraded":"2024-09-12T00:52:54.871178+0000","last_fullsized":"2024-09-12T00:52:54.871178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883483+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:52:54.883483+0000","last_peered":"2024-09-12T00:52:54.883483+0000","last_clean":"2024-09-12T00:52:54.883483+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:52:54.883483+0000","last_undegraded":"2024-09-12T00:52:54.883483+0000","last_fullsized":"2024-09-12T00:52:54.883483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.885630+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:52:54.885630+0000","last_peered":"2024-09-12T00:52:54.885630+0000","last_clean":"2024-09-12T00:52:54.885630+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:52:54.885630+0000","last_undegraded":"2024-09-12T00:52:54.885630+0000","last_fullsized":"2024-09-12T00:52:54.885630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876750+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:52:54.876750+0000","last_peered":"2024-09-12T00:52:54.876750+0000","last_clean":"2024-09-12T00:52:54.876750+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:52:54.876750+0000","last_undegraded":"2024-09-12T00:52:54.876750+0000","last_fullsized":"2024-09-12T00:52:54.876750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875520+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:52:54.875520+0000","last_peered":"2024-09-12T00:52:54.875520+0000","last_clean":"2024-09-12T00:52:54.875520+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:52:54.875520+0000","last_undegraded":"2024-09-12T00:52:54.875520+0000","last_fullsized":"2024-09-12T00:52:54.875520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874846+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:52:54.874846+0000","last_peered":"2024-09-12T00:52:54.874846+0000","last_clean":"2024-09-12T00:52:54.874846+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:52:54.874846+0000","last_undegraded":"2024-09-12T00:52:54.874846+0000","last_fullsized":"2024-09-12T00:52:54.874846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882315+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:52:54.882315+0000","last_peered":"2024-09-12T00:52:54.882315+0000","last_clean":"2024-09-12T00:52:54.882315+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:52:54.882315+0000","last_undegraded":"2024-09-12T00:52:54.882315+0000","last_fullsized":"2024-09-12T00:52:54.882315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876433+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:52:54.876433+0000","last_peered":"2024-09-12T00:52:54.876433+0000","last_clean":"2024-09-12T00:52:54.876433+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:52:54.876433+0000","last_undegraded":"2024-09-12T00:52:54.876433+0000","last_fullsized":"2024-09-12T00:52:54.876433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883390+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:52:54.883390+0000","last_peered":"2024-09-12T00:52:54.883390+0000","last_clean":"2024-09-12T00:52:54.883390+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:52:54.883390+0000","last_undegraded":"2024-09-12T00:52:54.883390+0000","last_fullsized":"2024-09-12T00:52:54.883390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889494+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:52:54.889494+0000","last_peered":"2024-09-12T00:52:54.889494+0000","last_clean":"2024-09-12T00:52:54.889494+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:52:54.889494+0000","last_undegraded":"2024-09-12T00:52:54.889494+0000","last_fullsized":"2024-09-12T00:52:54.889494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882408+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:52:54.882408+0000","last_peered":"2024-09-12T00:52:54.882408+0000","last_clean":"2024-09-12T00:52:54.882408+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:52:54.882408+0000","last_undegraded":"2024-09-12T00:52:54.882408+0000","last_fullsized":"2024-09-12T00:52:54.882408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871902+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:52:54.871902+0000","last_peered":"2024-09-12T00:52:54.871902+0000","last_clean":"2024-09-12T00:52:54.871902+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:52:54.871902+0000","last_undegraded":"2024-09-12T00:52:54.871902+0000","last_fullsized":"2024-09-12T00:52:54.871902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876051+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:52:54.876051+0000","last_peered":"2024-09-12T00:52:54.876051+0000","last_clean":"2024-09-12T00:52:54.876051+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:52:54.876051+0000","last_undegraded":"2024-09-12T00:52:54.876051+0000","last_fullsized":"2024-09-12T00:52:54.876051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868139+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:52:54.868139+0000","last_peered":"2024-09-12T00:52:54.868139+0000","last_clean":"2024-09-12T00:52:54.868139+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:52:54.868139+0000","last_undegraded":"2024-09-12T00:52:54.868139+0000","last_fullsized":"2024-09-12T00:52:54.868139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'10","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.223946+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:53:04.223946+0000","last_peered":"2024-09-12T00:53:04.223946+0000","last_clean":"2024-09-12T00:53:04.223946+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:53:04.223946+0000","last_undegraded":"2024-09-12T00:53:04.223946+0000","last_fullsized":"2024-09-12T00:53:04.223946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2335,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875141+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:52:54.875141+0000","last_peered":"2024-09-12T00:52:54.875141+0000","last_clean":"2024-09-12T00:52:54.875141+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:52:54.875141+0000","last_undegraded":"2024-09-12T00:52:54.875141+0000","last_fullsized":"2024-09-12T00:52:54.875141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.836360+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:52:54.836360+0000","last_peered":"2024-09-12T00:52:54.836360+0000","last_clean":"2024-09-12T00:52:54.836360+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:52:54.836360+0000","last_undegraded":"2024-09-12T00:52:54.836360+0000","last_fullsized":"2024-09-12T00:52:54.836360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.833879+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:52:54.833879+0000","last_peered":"2024-09-12T00:52:54.833879+0000","last_clean":"2024-09-12T00:52:54.833879+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:52:54.833879+0000","last_undegraded":"2024-09-12T00:52:54.833879+0000","last_fullsized":"2024-09-12T00:52:54.833879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888219+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:52:54.888219+0000","last_peered":"2024-09-12T00:52:54.888219+0000","last_clean":"2024-09-12T00:52:54.888219+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.888219+0000","last_undegraded":"2024-09-12T00:52:54.888219+0000","last_fullsized":"2024-09-12T00:52:54.888219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839021+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:52:54.839021+0000","last_peered":"2024-09-12T00:52:54.839021+0000","last_clean":"2024-09-12T00:52:54.839021+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:52:54.839021+0000","last_undegraded":"2024-09-12T00:52:54.839021+0000","last_fullsized":"2024-09-12T00:52:54.839021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887645+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:52:54.887645+0000","last_peered":"2024-09-12T00:52:54.887645+0000","last_clean":"2024-09-12T00:52:54.887645+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:52:54.887645+0000","last_undegraded":"2024-09-12T00:52:54.887645+0000","last_fullsized":"2024-09-12T00:52:54.887645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.223347+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:53:04.223347+0000","last_peered":"2024-09-12T00:53:04.223347+0000","last_clean":"2024-09-12T00:53:04.223347+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:53:04.223347+0000","last_undegraded":"2024-09-12T00:53:04.223347+0000","last_fullsized":"2024-09-12T00:53:04.223347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.891678+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:52:54.891678+0000","last_peered":"2024-09-12T00:52:54.891678+0000","last_clean":"2024-09-12T00:52:54.891678+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:52:54.891678+0000","last_undegraded":"2024-09-12T00:52:54.891678+0000","last_fullsized":"2024-09-12T00:52:54.891678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.843451+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:52:54.843451+0000","last_peered":"2024-09-12T00:52:54.843451+0000","last_clean":"2024-09-12T00:52:54.843451+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:52:54.843451+0000","last_undegraded":"2024-09-12T00:52:54.843451+0000","last_fullsized":"2024-09-12T00:52:54.843451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887219+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:52:54.887219+0000","last_peered":"2024-09-12T00:52:54.887219+0000","last_clean":"2024-09-12T00:52:54.887219+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:52:54.887219+0000","last_undegraded":"2024-09-12T00:52:54.887219+0000","last_fullsized":"2024-09-12T00:52:54.887219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839370+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:52:54.839370+0000","last_peered":"2024-09-12T00:52:54.839370+0000","last_clean":"2024-09-12T00:52:54.839370+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:52:54.839370+0000","last_undegraded":"2024-09-12T00:52:54.839370+0000","last_fullsized":"2024-09-12T00:52:54.839370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884249+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:52:54.884249+0000","last_peered":"2024-09-12T00:52:54.884249+0000","last_clean":"2024-09-12T00:52:54.884249+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:52:54.884249+0000","last_undegraded":"2024-09-12T00:52:54.884249+0000","last_fullsized":"2024-09-12T00:52:54.884249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'36","reported_seq":286,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.224883+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:53:05.224883+0000","last_peered":"2024-09-12T00:53:05.224883+0000","last_clean":"2024-09-12T00:53:05.224883+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:53:05.224883+0000","last_undegraded":"2024-09-12T00:53:05.224883+0000","last_fullsized":"2024-09-12T00:53:05.224883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":179,"num_write":37,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.866993+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:52:54.866993+0000","last_peered":"2024-09-12T00:52:54.866993+0000","last_clean":"2024-09-12T00:52:54.866993+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:52:54.866993+0000","last_undegraded":"2024-09-12T00:52:54.866993+0000","last_fullsized":"2024-09-12T00:52:54.866993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838847+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:52:54.838847+0000","last_peered":"2024-09-12T00:52:54.838847+0000","last_clean":"2024-09-12T00:52:54.838847+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:52:54.838847+0000","last_undegraded":"2024-09-12T00:52:54.838847+0000","last_fullsized":"2024-09-12T00:52:54.838847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884700+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:52:54.884700+0000","last_peered":"2024-09-12T00:52:54.884700+0000","last_clean":"2024-09-12T00:52:54.884700+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:52:54.884700+0000","last_undegraded":"2024-09-12T00:52:54.884700+0000","last_fullsized":"2024-09-12T00:52:54.884700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839358+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:52:54.839358+0000","last_peered":"2024-09-12T00:52:54.839358+0000","last_clean":"2024-09-12T00:52:54.839358+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:52:54.839358+0000","last_undegraded":"2024-09-12T00:52:54.839358+0000","last_fullsized":"2024-09-12T00:52:54.839358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883708+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:52:54.883708+0000","last_peered":"2024-09-12T00:52:54.883708+0000","last_clean":"2024-09-12T00:52:54.883708+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:52:54.883708+0000","last_undegraded":"2024-09-12T00:52:54.883708+0000","last_fullsized":"2024-09-12T00:52:54.883708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.219919+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:53:04.219919+0000","last_peered":"2024-09-12T00:53:04.219919+0000","last_clean":"2024-09-12T00:53:04.219919+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:53:04.219919+0000","last_undegraded":"2024-09-12T00:53:04.219919+0000","last_fullsized":"2024-09-12T00:53:04.219919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873525+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:52:54.873525+0000","last_peered":"2024-09-12T00:52:54.873525+0000","last_clean":"2024-09-12T00:52:54.873525+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:52:54.873525+0000","last_undegraded":"2024-09-12T00:52:54.873525+0000","last_fullsized":"2024-09-12T00:52:54.873525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.846569+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:52:54.846569+0000","last_peered":"2024-09-12T00:52:54.846569+0000","last_clean":"2024-09-12T00:52:54.846569+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:52:54.846569+0000","last_undegraded":"2024-09-12T00:52:54.846569+0000","last_fullsized":"2024-09-12T00:52:54.846569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.859661+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:52:54.859661+0000","last_peered":"2024-09-12T00:52:54.859661+0000","last_clean":"2024-09-12T00:52:54.859661+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:52:54.859661+0000","last_undegraded":"2024-09-12T00:52:54.859661+0000","last_fullsized":"2024-09-12T00:52:54.859661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848120+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:52:54.848120+0000","last_peered":"2024-09-12T00:52:54.848120+0000","last_clean":"2024-09-12T00:52:54.848120+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:52:54.848120+0000","last_undegraded":"2024-09-12T00:52:54.848120+0000","last_fullsized":"2024-09-12T00:52:54.848120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876330+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:52:54.876330+0000","last_peered":"2024-09-12T00:52:54.876330+0000","last_clean":"2024-09-12T00:52:54.876330+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:52:54.876330+0000","last_undegraded":"2024-09-12T00:52:54.876330+0000","last_fullsized":"2024-09-12T00:52:54.876330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.834098+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:52:54.834098+0000","last_peered":"2024-09-12T00:52:54.834098+0000","last_clean":"2024-09-12T00:52:54.834098+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:52:54.834098+0000","last_undegraded":"2024-09-12T00:52:54.834098+0000","last_fullsized":"2024-09-12T00:52:54.834098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873806+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:52:54.873806+0000","last_peered":"2024-09-12T00:52:54.873806+0000","last_clean":"2024-09-12T00:52:54.873806+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:52:54.873806+0000","last_undegraded":"2024-09-12T00:52:54.873806+0000","last_fullsized":"2024-09-12T00:52:54.873806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'57","reported_seq":103,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.684870+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:53:05.684870+0000","last_peered":"2024-09-12T00:53:05.684870+0000","last_clean":"2024-09-12T00:53:05.684870+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:53:05.684870+0000","last_undegraded":"2024-09-12T00:53:05.684870+0000","last_fullsized":"2024-09-12T00:53:05.684870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":68,"num_write_kb":807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878977+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:52:54.878977+0000","last_peered":"2024-09-12T00:52:54.878977+0000","last_clean":"2024-09-12T00:52:54.878977+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:52:54.878977+0000","last_undegraded":"2024-09-12T00:52:54.878977+0000","last_fullsized":"2024-09-12T00:52:54.878977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.845024+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:52:54.845024+0000","last_peered":"2024-09-12T00:52:54.845024+0000","last_clean":"2024-09-12T00:52:54.845024+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:52:54.845024+0000","last_undegraded":"2024-09-12T00:52:54.845024+0000","last_fullsized":"2024-09-12T00:52:54.845024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883108+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:52:54.883108+0000","last_peered":"2024-09-12T00:52:54.883108+0000","last_clean":"2024-09-12T00:52:54.883108+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:52:54.883108+0000","last_undegraded":"2024-09-12T00:52:54.883108+0000","last_fullsized":"2024-09-12T00:52:54.883108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"84'148","reported_seq":393,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.974099+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:52:56.974099+0000","last_peered":"2024-09-12T00:52:56.974099+0000","last_clean":"2024-09-12T00:52:56.974099+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:52:56.974099+0000","last_undegraded":"2024-09-12T00:52:56.974099+0000","last_fullsized":"2024-09-12T00:52:56.974099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.844886+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:52:54.844886+0000","last_peered":"2024-09-12T00:52:54.844886+0000","last_clean":"2024-09-12T00:52:54.844886+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:52:54.844886+0000","last_undegraded":"2024-09-12T00:52:54.844886+0000","last_fullsized":"2024-09-12T00:52:54.844886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883842+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:52:54.883842+0000","last_peered":"2024-09-12T00:52:54.883842+0000","last_clean":"2024-09-12T00:52:54.883842+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:52:54.883842+0000","last_undegraded":"2024-09-12T00:52:54.883842+0000","last_fullsized":"2024-09-12T00:52:54.883842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841723+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:52:54.841723+0000","last_peered":"2024-09-12T00:52:54.841723+0000","last_clean":"2024-09-12T00:52:54.841723+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:52:54.841723+0000","last_undegraded":"2024-09-12T00:52:54.841723+0000","last_fullsized":"2024-09-12T00:52:54.841723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874307+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:52:54.874307+0000","last_peered":"2024-09-12T00:52:54.874307+0000","last_clean":"2024-09-12T00:52:54.874307+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.874307+0000","last_undegraded":"2024-09-12T00:52:54.874307+0000","last_fullsized":"2024-09-12T00:52:54.874307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.219310+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:53:04.219310+0000","last_peered":"2024-09-12T00:53:04.219310+0000","last_clean":"2024-09-12T00:53:04.219310+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:53:04.219310+0000","last_undegraded":"2024-09-12T00:53:04.219310+0000","last_fullsized":"2024-09-12T00:53:04.219310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871701+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:52:54.871701+0000","last_peered":"2024-09-12T00:52:54.871701+0000","last_clean":"2024-09-12T00:52:54.871701+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:52:54.871701+0000","last_undegraded":"2024-09-12T00:52:54.871701+0000","last_fullsized":"2024-09-12T00:52:54.871701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850494+0000","last_change":"2024-09-12T00:52:22.594327+0000","last_active":"2024-09-12T00:52:54.850494+0000","last_peered":"2024-09-12T00:52:54.850494+0000","last_clean":"2024-09-12T00:52:54.850494+0000","last_became_active":"2024-09-12T00:52:22.593876+0000","last_became_peered":"2024-09-12T00:52:22.593876+0000","last_unstale":"2024-09-12T00:52:54.850494+0000","last_undegraded":"2024-09-12T00:52:54.850494+0000","last_fullsized":"2024-09-12T00:52:54.850494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:17.961428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876981+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:52:54.876981+0000","last_peered":"2024-09-12T00:52:54.876981+0000","last_clean":"2024-09-12T00:52:54.876981+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:52:54.876981+0000","last_undegraded":"2024-09-12T00:52:54.876981+0000","last_fullsized":"2024-09-12T00:52:54.876981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841926+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:52:54.841926+0000","last_peered":"2024-09-12T00:52:54.841926+0000","last_clean":"2024-09-12T00:52:54.841926+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:52:54.841926+0000","last_undegraded":"2024-09-12T00:52:54.841926+0000","last_fullsized":"2024-09-12T00:52:54.841926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875489+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:52:54.875489+0000","last_peered":"2024-09-12T00:52:54.875489+0000","last_clean":"2024-09-12T00:52:54.875489+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:52:54.875489+0000","last_undegraded":"2024-09-12T00:52:54.875489+0000","last_fullsized":"2024-09-12T00:52:54.875489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848626+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:52:54.848626+0000","last_peered":"2024-09-12T00:52:54.848626+0000","last_clean":"2024-09-12T00:52:54.848626+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:52:54.848626+0000","last_undegraded":"2024-09-12T00:52:54.848626+0000","last_fullsized":"2024-09-12T00:52:54.848626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884371+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:52:54.884371+0000","last_peered":"2024-09-12T00:52:54.884371+0000","last_clean":"2024-09-12T00:52:54.884371+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:52:54.884371+0000","last_undegraded":"2024-09-12T00:52:54.884371+0000","last_fullsized":"2024-09-12T00:52:54.884371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'72","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.690077+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:53:05.690077+0000","last_peered":"2024-09-12T00:53:05.690077+0000","last_clean":"2024-09-12T00:53:05.690077+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:53:05.690077+0000","last_undegraded":"2024-09-12T00:53:05.690077+0000","last_fullsized":"2024-09-12T00:53:05.690077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":160,"num_write":131,"num_write_kb":1159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873351+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:52:54.873351+0000","last_peered":"2024-09-12T00:52:54.873351+0000","last_clean":"2024-09-12T00:52:54.873351+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:52:54.873351+0000","last_undegraded":"2024-09-12T00:52:54.873351+0000","last_fullsized":"2024-09-12T00:52:54.873351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848558+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:52:54.848558+0000","last_peered":"2024-09-12T00:52:54.848558+0000","last_clean":"2024-09-12T00:52:54.848558+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:52:54.848558+0000","last_undegraded":"2024-09-12T00:52:54.848558+0000","last_fullsized":"2024-09-12T00:52:54.848558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890212+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:52:54.890212+0000","last_peered":"2024-09-12T00:52:54.890212+0000","last_clean":"2024-09-12T00:52:54.890212+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:52:54.890212+0000","last_undegraded":"2024-09-12T00:52:54.890212+0000","last_fullsized":"2024-09-12T00:52:54.890212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838291+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:52:54.838291+0000","last_peered":"2024-09-12T00:52:54.838291+0000","last_clean":"2024-09-12T00:52:54.838291+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:52:54.838291+0000","last_undegraded":"2024-09-12T00:52:54.838291+0000","last_fullsized":"2024-09-12T00:52:54.838291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875091+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:52:54.875091+0000","last_peered":"2024-09-12T00:52:54.875091+0000","last_clean":"2024-09-12T00:52:54.875091+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:52:54.875091+0000","last_undegraded":"2024-09-12T00:52:54.875091+0000","last_fullsized":"2024-09-12T00:52:54.875091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839819+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:52:54.839819+0000","last_peered":"2024-09-12T00:52:54.839819+0000","last_clean":"2024-09-12T00:52:54.839819+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:52:54.839819+0000","last_undegraded":"2024-09-12T00:52:54.839819+0000","last_fullsized":"2024-09-12T00:52:54.839819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878537+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:52:54.878537+0000","last_peered":"2024-09-12T00:52:54.878537+0000","last_clean":"2024-09-12T00:52:54.878537+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:52:54.878537+0000","last_undegraded":"2024-09-12T00:52:54.878537+0000","last_fullsized":"2024-09-12T00:52:54.878537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.061886+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:52:56.061886+0000","last_peered":"2024-09-12T00:52:56.061886+0000","last_clean":"2024-09-12T00:52:56.061886+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:52:56.061886+0000","last_undegraded":"2024-09-12T00:52:56.061886+0000","last_fullsized":"2024-09-12T00:52:56.061886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884443+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:52:54.884443+0000","last_peered":"2024-09-12T00:52:54.884443+0000","last_clean":"2024-09-12T00:52:54.884443+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:52:54.884443+0000","last_undegraded":"2024-09-12T00:52:54.884443+0000","last_fullsized":"2024-09-12T00:52:54.884443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850626+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:52:54.850626+0000","last_peered":"2024-09-12T00:52:54.850626+0000","last_clean":"2024-09-12T00:52:54.850626+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:52:54.850626+0000","last_undegraded":"2024-09-12T00:52:54.850626+0000","last_fullsized":"2024-09-12T00:52:54.850626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880746+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:52:54.880746+0000","last_peered":"2024-09-12T00:52:54.880746+0000","last_clean":"2024-09-12T00:52:54.880746+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:52:54.880746+0000","last_undegraded":"2024-09-12T00:52:54.880746+0000","last_fullsized":"2024-09-12T00:52:54.880746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889345+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:52:54.889345+0000","last_peered":"2024-09-12T00:52:54.889345+0000","last_clean":"2024-09-12T00:52:54.889345+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:52:54.889345+0000","last_undegraded":"2024-09-12T00:52:54.889345+0000","last_fullsized":"2024-09-12T00:52:54.889345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.847896+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:52:54.847896+0000","last_peered":"2024-09-12T00:52:54.847896+0000","last_clean":"2024-09-12T00:52:54.847896+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:52:54.847896+0000","last_undegraded":"2024-09-12T00:52:54.847896+0000","last_fullsized":"2024-09-12T00:52:54.847896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888948+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:52:54.888948+0000","last_peered":"2024-09-12T00:52:54.888948+0000","last_clean":"2024-09-12T00:52:54.888948+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:52:54.888948+0000","last_undegraded":"2024-09-12T00:52:54.888948+0000","last_fullsized":"2024-09-12T00:52:54.888948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848504+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:52:54.848504+0000","last_peered":"2024-09-12T00:52:54.848504+0000","last_clean":"2024-09-12T00:52:54.848504+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:52:54.848504+0000","last_undegraded":"2024-09-12T00:52:54.848504+0000","last_fullsized":"2024-09-12T00:52:54.848504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888796+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:52:54.888796+0000","last_peered":"2024-09-12T00:52:54.888796+0000","last_clean":"2024-09-12T00:52:54.888796+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:52:54.888796+0000","last_undegraded":"2024-09-12T00:52:54.888796+0000","last_fullsized":"2024-09-12T00:52:54.888796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839897+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:52:54.839897+0000","last_peered":"2024-09-12T00:52:54.839897+0000","last_clean":"2024-09-12T00:52:54.839897+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:52:54.839897+0000","last_undegraded":"2024-09-12T00:52:54.839897+0000","last_fullsized":"2024-09-12T00:52:54.839897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879161+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:52:54.879161+0000","last_peered":"2024-09-12T00:52:54.879161+0000","last_clean":"2024-09-12T00:52:54.879161+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:52:54.879161+0000","last_undegraded":"2024-09-12T00:52:54.879161+0000","last_fullsized":"2024-09-12T00:52:54.879161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.842345+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:52:54.842345+0000","last_peered":"2024-09-12T00:52:54.842345+0000","last_clean":"2024-09-12T00:52:54.842345+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:52:54.842345+0000","last_undegraded":"2024-09-12T00:52:54.842345+0000","last_fullsized":"2024-09-12T00:52:54.842345+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797091,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":867,"num_read_kb":592,"num_write":361,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2391273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612643,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":454100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841576,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28948,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716204,"statfs":{"total":95995035648,"available":95965392896,"internally_reserved":0,"allocated":1970176,"data_stored":1444133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40820,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704332,"statfs":{"total":95995035648,"available":95953235968,"internally_reserved":0,"allocated":1347584,"data_stored":847669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716816,"statfs":{"total":95995035648,"available":95966019584,"internally_reserved":0,"allocated":1343488,"data_stored":847472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1048435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593789,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":937984,"data_stored":453725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822721,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32896,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712256,"statfs":{"total":95995035648,"available":95961350144,"internally_reserved":0,"allocated":1691648,"data_stored":1178792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":455783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1675264,"data_stored":1175367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":525280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":522911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":454996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":71762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":400130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:53:08.978 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T00:53:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:08 smithi167 ceph-mon[35234]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:53:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:08 smithi167 ceph-mon[35234]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-09-12T00:53:09.239 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 -- 172.21.15.2:0/2418436978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec106f50 msgr2=0x7f9bec10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/2418436978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec106f50 0x7f9bec10eaf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009cd0 tx=0x7f9be402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 -- 172.21.15.2:0/2418436978 shutdown_connections 2024-09-12T00:53:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/2418436978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec106f50 0x7f9bec10eaf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/2418436978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bec100d00 0x7f9bec106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/2418436978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bec100350 0x7f9bec100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 -- 172.21.15.2:0/2418436978 >> 172.21.15.2:0/2418436978 conn(0x7f9bec077210 msgr2=0x7f9bec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 -- 172.21.15.2:0/2418436978 shutdown_connections 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.679+0000 7f9bf11b7640 1 -- 172.21.15.2:0/2418436978 wait complete. 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bf11b7640 1 Processor -- start 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bf11b7640 1 -- start start 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bf11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec100350 0x7f9bec198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bf11b7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bec100d00 0x7f9bec1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bf11b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bec106f50 0x7f9bec19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bf11b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec111fa0 con 0x7f9bec100350 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bf11b7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec111e20 con 0x7f9bec100d00 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bf11b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec112120 con 0x7f9bec106f50 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec100350 0x7f9bec198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec100350 0x7f9bec198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50958/0 (socket says 172.21.15.2:50958) 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bead9d640 1 -- 172.21.15.2:0/1365783825 learned_addr learned my addr 172.21.15.2:0/1365783825 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bea59c640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bec100d00 0x7f9bec1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9beb59e640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bec106f50 0x7f9bec19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bead9d640 1 -- 172.21.15.2:0/1365783825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bec106f50 msgr2=0x7f9bec19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.680+0000 7f9bead9d640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bec106f50 0x7f9bec19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bead9d640 1 -- 172.21.15.2:0/1365783825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bec100d00 msgr2=0x7f9bec1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bead9d640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bec100d00 0x7f9bec1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bead9d640 1 -- 172.21.15.2:0/1365783825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec19d410 con 0x7f9bec100350 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bead9d640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec100350 0x7f9bec198460 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00d950 tx=0x7f9bdc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bd3fff640 1 -- 172.21.15.2:0/1365783825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc017070 con 0x7f9bec100350 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bd3fff640 1 -- 172.21.15.2:0/1365783825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bdc009c30 con 0x7f9bec100350 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bd3fff640 1 -- 172.21.15.2:0/1365783825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00f6b0 con 0x7f9bec100350 2024-09-12T00:53:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bec19d700 con 0x7f9bec100350 2024-09-12T00:53:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.681+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bec1a4fe0 con 0x7f9bec100350 2024-09-12T00:53:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.682+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bec100730 con 0x7f9bec100350 2024-09-12T00:53:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.683+0000 7f9bd3fff640 1 -- 172.21.15.2:0/1365783825 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f9bdc0109d0 con 0x7f9bec100350 2024-09-12T00:53:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.684+0000 7f9bd3fff640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bd40a2e10 0x7f9bd40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.684+0000 7f9bea59c640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bd40a2e10 0x7f9bd40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.684+0000 7f9bd3fff640 1 -- 172.21.15.2:0/1365783825 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9bdc0cf440 con 0x7f9bec100350 2024-09-12T00:53:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.684+0000 7f9bea59c640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bd40a2e10 0x7f9bd40a52d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bec1048c0 tx=0x7f9be000b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.688+0000 7f9bd3fff640 1 -- 172.21.15.2:0/1365783825 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9bdc009de0 con 0x7f9bec100350 2024-09-12T00:53:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.860+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9bec062630 con 0x7f9bd40a2e10 2024-09-12T00:53:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.867+0000 7f9bd3fff640 1 -- 172.21.15.2:0/1365783825 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257765 (secure 0 0 0) 0x7f9bec062630 con 0x7f9bd40a2e10 2024-09-12T00:53:09.869 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:09.870 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bd40a2e10 msgr2=0x7f9bd40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bd40a2e10 0x7f9bd40a52d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bec1048c0 tx=0x7f9be000b390 comp rx=0 tx=0).stop 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec100350 msgr2=0x7f9bec198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec100350 0x7f9bec198460 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00d950 tx=0x7f9bdc00de10 comp rx=0 tx=0).stop 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 shutdown_connections 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bd40a2e10 0x7f9bd40a52d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bec106f50 0x7f9bec19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bec100d00 0x7f9bec1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 --2- 172.21.15.2:0/1365783825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bec100350 0x7f9bec198460 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 >> 172.21.15.2:0/1365783825 conn(0x7f9bec077210 msgr2=0x7f9bec105860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 shutdown_connections 2024-09-12T00:53:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:09.870+0000 7f9bf11b7640 1 -- 172.21.15.2:0/1365783825 wait complete. 2024-09-12T00:53:09.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:09 smithi071 ceph-mon[35276]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:09.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:09 smithi002 ceph-mon[31210]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:09 smithi167 ceph-mon[35234]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:10.629 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-12T00:53:08.875856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1387693,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1104,"num_read_kb":922,"num_write":564,"num_write_kb":5036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":924,"ondisk_log_size":924,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376832,"kb_used_data":15024,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564992,"statfs":{"total":1151940427776,"available":1151554551808,"internally_reserved":0,"allocated":15384576,"data_stored":9408663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200331,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":349,"num_write":96,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002461"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884145+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:52:54.884145+0000","last_peered":"2024-09-12T00:52:54.884145+0000","last_clean":"2024-09-12T00:52:54.884145+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:52:54.884145+0000","last_undegraded":"2024-09-12T00:52:54.884145+0000","last_fullsized":"2024-09-12T00:52:54.884145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880965+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:52:54.880965+0000","last_peered":"2024-09-12T00:52:54.880965+0000","last_clean":"2024-09-12T00:52:54.880965+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:52:54.880965+0000","last_undegraded":"2024-09-12T00:52:54.880965+0000","last_fullsized":"2024-09-12T00:52:54.880965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888565+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:52:54.888565+0000","last_peered":"2024-09-12T00:52:54.888565+0000","last_clean":"2024-09-12T00:52:54.888565+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:52:54.888565+0000","last_undegraded":"2024-09-12T00:52:54.888565+0000","last_fullsized":"2024-09-12T00:52:54.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871452+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:52:54.871452+0000","last_peered":"2024-09-12T00:52:54.871452+0000","last_clean":"2024-09-12T00:52:54.871452+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:52:54.871452+0000","last_undegraded":"2024-09-12T00:52:54.871452+0000","last_fullsized":"2024-09-12T00:52:54.871452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871301+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:52:54.871301+0000","last_peered":"2024-09-12T00:52:54.871301+0000","last_clean":"2024-09-12T00:52:54.871301+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:52:54.871301+0000","last_undegraded":"2024-09-12T00:52:54.871301+0000","last_fullsized":"2024-09-12T00:52:54.871301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890111+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:52:54.890111+0000","last_peered":"2024-09-12T00:52:54.890111+0000","last_clean":"2024-09-12T00:52:54.890111+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:52:54.890111+0000","last_undegraded":"2024-09-12T00:52:54.890111+0000","last_fullsized":"2024-09-12T00:52:54.890111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879651+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:52:54.879651+0000","last_peered":"2024-09-12T00:52:54.879651+0000","last_clean":"2024-09-12T00:52:54.879651+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:52:54.879651+0000","last_undegraded":"2024-09-12T00:52:54.879651+0000","last_fullsized":"2024-09-12T00:52:54.879651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880503+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:52:54.880503+0000","last_peered":"2024-09-12T00:52:54.880503+0000","last_clean":"2024-09-12T00:52:54.880503+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:52:54.880503+0000","last_undegraded":"2024-09-12T00:52:54.880503+0000","last_fullsized":"2024-09-12T00:52:54.880503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880321+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:52:54.880321+0000","last_peered":"2024-09-12T00:52:54.880321+0000","last_clean":"2024-09-12T00:52:54.880321+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:52:54.880321+0000","last_undegraded":"2024-09-12T00:52:54.880321+0000","last_fullsized":"2024-09-12T00:52:54.880321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878237+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:52:54.878237+0000","last_peered":"2024-09-12T00:52:54.878237+0000","last_clean":"2024-09-12T00:52:54.878237+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:52:54.878237+0000","last_undegraded":"2024-09-12T00:52:54.878237+0000","last_fullsized":"2024-09-12T00:52:54.878237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.881472+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:52:54.881472+0000","last_peered":"2024-09-12T00:52:54.881472+0000","last_clean":"2024-09-12T00:52:54.881472+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:52:54.881472+0000","last_undegraded":"2024-09-12T00:52:54.881472+0000","last_fullsized":"2024-09-12T00:52:54.881472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868621+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:52:54.868621+0000","last_peered":"2024-09-12T00:52:54.868621+0000","last_clean":"2024-09-12T00:52:54.868621+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:52:54.868621+0000","last_undegraded":"2024-09-12T00:52:54.868621+0000","last_fullsized":"2024-09-12T00:52:54.868621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884657+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:52:54.884657+0000","last_peered":"2024-09-12T00:52:54.884657+0000","last_clean":"2024-09-12T00:52:54.884657+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:52:54.884657+0000","last_undegraded":"2024-09-12T00:52:54.884657+0000","last_fullsized":"2024-09-12T00:52:54.884657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.886083+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:52:54.886083+0000","last_peered":"2024-09-12T00:52:54.886083+0000","last_clean":"2024-09-12T00:52:54.886083+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:52:54.886083+0000","last_undegraded":"2024-09-12T00:52:54.886083+0000","last_fullsized":"2024-09-12T00:52:54.886083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889586+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:52:54.889586+0000","last_peered":"2024-09-12T00:52:54.889586+0000","last_clean":"2024-09-12T00:52:54.889586+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:52:54.889586+0000","last_undegraded":"2024-09-12T00:52:54.889586+0000","last_fullsized":"2024-09-12T00:52:54.889586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887265+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:52:54.887265+0000","last_peered":"2024-09-12T00:52:54.887265+0000","last_clean":"2024-09-12T00:52:54.887265+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:52:54.887265+0000","last_undegraded":"2024-09-12T00:52:54.887265+0000","last_fullsized":"2024-09-12T00:52:54.887265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884255+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:52:54.884255+0000","last_peered":"2024-09-12T00:52:54.884255+0000","last_clean":"2024-09-12T00:52:54.884255+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:52:54.884255+0000","last_undegraded":"2024-09-12T00:52:54.884255+0000","last_fullsized":"2024-09-12T00:52:54.884255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889401+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:52:54.889401+0000","last_peered":"2024-09-12T00:52:54.889401+0000","last_clean":"2024-09-12T00:52:54.889401+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:52:54.889401+0000","last_undegraded":"2024-09-12T00:52:54.889401+0000","last_fullsized":"2024-09-12T00:52:54.889401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874518+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:52:54.874518+0000","last_peered":"2024-09-12T00:52:54.874518+0000","last_clean":"2024-09-12T00:52:54.874518+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:52:54.874518+0000","last_undegraded":"2024-09-12T00:52:54.874518+0000","last_fullsized":"2024-09-12T00:52:54.874518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871178+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:52:54.871178+0000","last_peered":"2024-09-12T00:52:54.871178+0000","last_clean":"2024-09-12T00:52:54.871178+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:52:54.871178+0000","last_undegraded":"2024-09-12T00:52:54.871178+0000","last_fullsized":"2024-09-12T00:52:54.871178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883483+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:52:54.883483+0000","last_peered":"2024-09-12T00:52:54.883483+0000","last_clean":"2024-09-12T00:52:54.883483+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:52:54.883483+0000","last_undegraded":"2024-09-12T00:52:54.883483+0000","last_fullsized":"2024-09-12T00:52:54.883483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.885630+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:52:54.885630+0000","last_peered":"2024-09-12T00:52:54.885630+0000","last_clean":"2024-09-12T00:52:54.885630+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:52:54.885630+0000","last_undegraded":"2024-09-12T00:52:54.885630+0000","last_fullsized":"2024-09-12T00:52:54.885630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876750+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:52:54.876750+0000","last_peered":"2024-09-12T00:52:54.876750+0000","last_clean":"2024-09-12T00:52:54.876750+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:52:54.876750+0000","last_undegraded":"2024-09-12T00:52:54.876750+0000","last_fullsized":"2024-09-12T00:52:54.876750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875520+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:52:54.875520+0000","last_peered":"2024-09-12T00:52:54.875520+0000","last_clean":"2024-09-12T00:52:54.875520+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:52:54.875520+0000","last_undegraded":"2024-09-12T00:52:54.875520+0000","last_fullsized":"2024-09-12T00:52:54.875520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874846+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:52:54.874846+0000","last_peered":"2024-09-12T00:52:54.874846+0000","last_clean":"2024-09-12T00:52:54.874846+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:52:54.874846+0000","last_undegraded":"2024-09-12T00:52:54.874846+0000","last_fullsized":"2024-09-12T00:52:54.874846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882315+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:52:54.882315+0000","last_peered":"2024-09-12T00:52:54.882315+0000","last_clean":"2024-09-12T00:52:54.882315+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:52:54.882315+0000","last_undegraded":"2024-09-12T00:52:54.882315+0000","last_fullsized":"2024-09-12T00:52:54.882315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876433+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:52:54.876433+0000","last_peered":"2024-09-12T00:52:54.876433+0000","last_clean":"2024-09-12T00:52:54.876433+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:52:54.876433+0000","last_undegraded":"2024-09-12T00:52:54.876433+0000","last_fullsized":"2024-09-12T00:52:54.876433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883390+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:52:54.883390+0000","last_peered":"2024-09-12T00:52:54.883390+0000","last_clean":"2024-09-12T00:52:54.883390+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:52:54.883390+0000","last_undegraded":"2024-09-12T00:52:54.883390+0000","last_fullsized":"2024-09-12T00:52:54.883390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889494+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:52:54.889494+0000","last_peered":"2024-09-12T00:52:54.889494+0000","last_clean":"2024-09-12T00:52:54.889494+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:52:54.889494+0000","last_undegraded":"2024-09-12T00:52:54.889494+0000","last_fullsized":"2024-09-12T00:52:54.889494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882408+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:52:54.882408+0000","last_peered":"2024-09-12T00:52:54.882408+0000","last_clean":"2024-09-12T00:52:54.882408+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:52:54.882408+0000","last_undegraded":"2024-09-12T00:52:54.882408+0000","last_fullsized":"2024-09-12T00:52:54.882408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871902+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:52:54.871902+0000","last_peered":"2024-09-12T00:52:54.871902+0000","last_clean":"2024-09-12T00:52:54.871902+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:52:54.871902+0000","last_undegraded":"2024-09-12T00:52:54.871902+0000","last_fullsized":"2024-09-12T00:52:54.871902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876051+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:52:54.876051+0000","last_peered":"2024-09-12T00:52:54.876051+0000","last_clean":"2024-09-12T00:52:54.876051+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:52:54.876051+0000","last_undegraded":"2024-09-12T00:52:54.876051+0000","last_fullsized":"2024-09-12T00:52:54.876051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868139+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:52:54.868139+0000","last_peered":"2024-09-12T00:52:54.868139+0000","last_clean":"2024-09-12T00:52:54.868139+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:52:54.868139+0000","last_undegraded":"2024-09-12T00:52:54.868139+0000","last_fullsized":"2024-09-12T00:52:54.868139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'10","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.223946+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:53:04.223946+0000","last_peered":"2024-09-12T00:53:04.223946+0000","last_clean":"2024-09-12T00:53:04.223946+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:53:04.223946+0000","last_undegraded":"2024-09-12T00:53:04.223946+0000","last_fullsized":"2024-09-12T00:53:04.223946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2335,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875141+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:52:54.875141+0000","last_peered":"2024-09-12T00:52:54.875141+0000","last_clean":"2024-09-12T00:52:54.875141+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:52:54.875141+0000","last_undegraded":"2024-09-12T00:52:54.875141+0000","last_fullsized":"2024-09-12T00:52:54.875141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.836360+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:52:54.836360+0000","last_peered":"2024-09-12T00:52:54.836360+0000","last_clean":"2024-09-12T00:52:54.836360+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:52:54.836360+0000","last_undegraded":"2024-09-12T00:52:54.836360+0000","last_fullsized":"2024-09-12T00:52:54.836360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.833879+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:52:54.833879+0000","last_peered":"2024-09-12T00:52:54.833879+0000","last_clean":"2024-09-12T00:52:54.833879+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:52:54.833879+0000","last_undegraded":"2024-09-12T00:52:54.833879+0000","last_fullsized":"2024-09-12T00:52:54.833879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888219+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:52:54.888219+0000","last_peered":"2024-09-12T00:52:54.888219+0000","last_clean":"2024-09-12T00:52:54.888219+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.888219+0000","last_undegraded":"2024-09-12T00:52:54.888219+0000","last_fullsized":"2024-09-12T00:52:54.888219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839021+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:52:54.839021+0000","last_peered":"2024-09-12T00:52:54.839021+0000","last_clean":"2024-09-12T00:52:54.839021+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:52:54.839021+0000","last_undegraded":"2024-09-12T00:52:54.839021+0000","last_fullsized":"2024-09-12T00:52:54.839021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887645+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:52:54.887645+0000","last_peered":"2024-09-12T00:52:54.887645+0000","last_clean":"2024-09-12T00:52:54.887645+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:52:54.887645+0000","last_undegraded":"2024-09-12T00:52:54.887645+0000","last_fullsized":"2024-09-12T00:52:54.887645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.223347+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:53:04.223347+0000","last_peered":"2024-09-12T00:53:04.223347+0000","last_clean":"2024-09-12T00:53:04.223347+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:53:04.223347+0000","last_undegraded":"2024-09-12T00:53:04.223347+0000","last_fullsized":"2024-09-12T00:53:04.223347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.891678+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:52:54.891678+0000","last_peered":"2024-09-12T00:52:54.891678+0000","last_clean":"2024-09-12T00:52:54.891678+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:52:54.891678+0000","last_undegraded":"2024-09-12T00:52:54.891678+0000","last_fullsized":"2024-09-12T00:52:54.891678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.843451+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:52:54.843451+0000","last_peered":"2024-09-12T00:52:54.843451+0000","last_clean":"2024-09-12T00:52:54.843451+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:52:54.843451+0000","last_undegraded":"2024-09-12T00:52:54.843451+0000","last_fullsized":"2024-09-12T00:52:54.843451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887219+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:52:54.887219+0000","last_peered":"2024-09-12T00:52:54.887219+0000","last_clean":"2024-09-12T00:52:54.887219+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:52:54.887219+0000","last_undegraded":"2024-09-12T00:52:54.887219+0000","last_fullsized":"2024-09-12T00:52:54.887219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839370+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:52:54.839370+0000","last_peered":"2024-09-12T00:52:54.839370+0000","last_clean":"2024-09-12T00:52:54.839370+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:52:54.839370+0000","last_undegraded":"2024-09-12T00:52:54.839370+0000","last_fullsized":"2024-09-12T00:52:54.839370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884249+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:52:54.884249+0000","last_peered":"2024-09-12T00:52:54.884249+0000","last_clean":"2024-09-12T00:52:54.884249+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:52:54.884249+0000","last_undegraded":"2024-09-12T00:52:54.884249+0000","last_fullsized":"2024-09-12T00:52:54.884249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'36","reported_seq":286,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.224883+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:53:05.224883+0000","last_peered":"2024-09-12T00:53:05.224883+0000","last_clean":"2024-09-12T00:53:05.224883+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:53:05.224883+0000","last_undegraded":"2024-09-12T00:53:05.224883+0000","last_fullsized":"2024-09-12T00:53:05.224883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":179,"num_write":37,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.866993+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:52:54.866993+0000","last_peered":"2024-09-12T00:52:54.866993+0000","last_clean":"2024-09-12T00:52:54.866993+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:52:54.866993+0000","last_undegraded":"2024-09-12T00:52:54.866993+0000","last_fullsized":"2024-09-12T00:52:54.866993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838847+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:52:54.838847+0000","last_peered":"2024-09-12T00:52:54.838847+0000","last_clean":"2024-09-12T00:52:54.838847+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:52:54.838847+0000","last_undegraded":"2024-09-12T00:52:54.838847+0000","last_fullsized":"2024-09-12T00:52:54.838847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884700+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:52:54.884700+0000","last_peered":"2024-09-12T00:52:54.884700+0000","last_clean":"2024-09-12T00:52:54.884700+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:52:54.884700+0000","last_undegraded":"2024-09-12T00:52:54.884700+0000","last_fullsized":"2024-09-12T00:52:54.884700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839358+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:52:54.839358+0000","last_peered":"2024-09-12T00:52:54.839358+0000","last_clean":"2024-09-12T00:52:54.839358+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:52:54.839358+0000","last_undegraded":"2024-09-12T00:52:54.839358+0000","last_fullsized":"2024-09-12T00:52:54.839358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883708+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:52:54.883708+0000","last_peered":"2024-09-12T00:52:54.883708+0000","last_clean":"2024-09-12T00:52:54.883708+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:52:54.883708+0000","last_undegraded":"2024-09-12T00:52:54.883708+0000","last_fullsized":"2024-09-12T00:52:54.883708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.219919+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:53:04.219919+0000","last_peered":"2024-09-12T00:53:04.219919+0000","last_clean":"2024-09-12T00:53:04.219919+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:53:04.219919+0000","last_undegraded":"2024-09-12T00:53:04.219919+0000","last_fullsized":"2024-09-12T00:53:04.219919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873525+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:52:54.873525+0000","last_peered":"2024-09-12T00:52:54.873525+0000","last_clean":"2024-09-12T00:52:54.873525+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:52:54.873525+0000","last_undegraded":"2024-09-12T00:52:54.873525+0000","last_fullsized":"2024-09-12T00:52:54.873525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.846569+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:52:54.846569+0000","last_peered":"2024-09-12T00:52:54.846569+0000","last_clean":"2024-09-12T00:52:54.846569+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:52:54.846569+0000","last_undegraded":"2024-09-12T00:52:54.846569+0000","last_fullsized":"2024-09-12T00:52:54.846569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.859661+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:52:54.859661+0000","last_peered":"2024-09-12T00:52:54.859661+0000","last_clean":"2024-09-12T00:52:54.859661+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:52:54.859661+0000","last_undegraded":"2024-09-12T00:52:54.859661+0000","last_fullsized":"2024-09-12T00:52:54.859661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848120+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:52:54.848120+0000","last_peered":"2024-09-12T00:52:54.848120+0000","last_clean":"2024-09-12T00:52:54.848120+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:52:54.848120+0000","last_undegraded":"2024-09-12T00:52:54.848120+0000","last_fullsized":"2024-09-12T00:52:54.848120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876330+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:52:54.876330+0000","last_peered":"2024-09-12T00:52:54.876330+0000","last_clean":"2024-09-12T00:52:54.876330+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:52:54.876330+0000","last_undegraded":"2024-09-12T00:52:54.876330+0000","last_fullsized":"2024-09-12T00:52:54.876330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.834098+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:52:54.834098+0000","last_peered":"2024-09-12T00:52:54.834098+0000","last_clean":"2024-09-12T00:52:54.834098+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:52:54.834098+0000","last_undegraded":"2024-09-12T00:52:54.834098+0000","last_fullsized":"2024-09-12T00:52:54.834098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873806+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:52:54.873806+0000","last_peered":"2024-09-12T00:52:54.873806+0000","last_clean":"2024-09-12T00:52:54.873806+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:52:54.873806+0000","last_undegraded":"2024-09-12T00:52:54.873806+0000","last_fullsized":"2024-09-12T00:52:54.873806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'57","reported_seq":103,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.684870+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:53:05.684870+0000","last_peered":"2024-09-12T00:53:05.684870+0000","last_clean":"2024-09-12T00:53:05.684870+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:53:05.684870+0000","last_undegraded":"2024-09-12T00:53:05.684870+0000","last_fullsized":"2024-09-12T00:53:05.684870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":68,"num_write_kb":807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878977+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:52:54.878977+0000","last_peered":"2024-09-12T00:52:54.878977+0000","last_clean":"2024-09-12T00:52:54.878977+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:52:54.878977+0000","last_undegraded":"2024-09-12T00:52:54.878977+0000","last_fullsized":"2024-09-12T00:52:54.878977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.845024+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:52:54.845024+0000","last_peered":"2024-09-12T00:52:54.845024+0000","last_clean":"2024-09-12T00:52:54.845024+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:52:54.845024+0000","last_undegraded":"2024-09-12T00:52:54.845024+0000","last_fullsized":"2024-09-12T00:52:54.845024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883108+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:52:54.883108+0000","last_peered":"2024-09-12T00:52:54.883108+0000","last_clean":"2024-09-12T00:52:54.883108+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:52:54.883108+0000","last_undegraded":"2024-09-12T00:52:54.883108+0000","last_fullsized":"2024-09-12T00:52:54.883108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"84'148","reported_seq":393,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.974099+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:52:56.974099+0000","last_peered":"2024-09-12T00:52:56.974099+0000","last_clean":"2024-09-12T00:52:56.974099+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:52:56.974099+0000","last_undegraded":"2024-09-12T00:52:56.974099+0000","last_fullsized":"2024-09-12T00:52:56.974099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.844886+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:52:54.844886+0000","last_peered":"2024-09-12T00:52:54.844886+0000","last_clean":"2024-09-12T00:52:54.844886+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:52:54.844886+0000","last_undegraded":"2024-09-12T00:52:54.844886+0000","last_fullsized":"2024-09-12T00:52:54.844886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883842+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:52:54.883842+0000","last_peered":"2024-09-12T00:52:54.883842+0000","last_clean":"2024-09-12T00:52:54.883842+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:52:54.883842+0000","last_undegraded":"2024-09-12T00:52:54.883842+0000","last_fullsized":"2024-09-12T00:52:54.883842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841723+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:52:54.841723+0000","last_peered":"2024-09-12T00:52:54.841723+0000","last_clean":"2024-09-12T00:52:54.841723+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:52:54.841723+0000","last_undegraded":"2024-09-12T00:52:54.841723+0000","last_fullsized":"2024-09-12T00:52:54.841723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874307+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:52:54.874307+0000","last_peered":"2024-09-12T00:52:54.874307+0000","last_clean":"2024-09-12T00:52:54.874307+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.874307+0000","last_undegraded":"2024-09-12T00:52:54.874307+0000","last_fullsized":"2024-09-12T00:52:54.874307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.219310+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:53:04.219310+0000","last_peered":"2024-09-12T00:53:04.219310+0000","last_clean":"2024-09-12T00:53:04.219310+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:53:04.219310+0000","last_undegraded":"2024-09-12T00:53:04.219310+0000","last_fullsized":"2024-09-12T00:53:04.219310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871701+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:52:54.871701+0000","last_peered":"2024-09-12T00:52:54.871701+0000","last_clean":"2024-09-12T00:52:54.871701+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:52:54.871701+0000","last_undegraded":"2024-09-12T00:52:54.871701+0000","last_fullsized":"2024-09-12T00:52:54.871701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850494+0000","last_change":"2024-09-12T00:52:22.594327+0000","last_active":"2024-09-12T00:52:54.850494+0000","last_peered":"2024-09-12T00:52:54.850494+0000","last_clean":"2024-09-12T00:52:54.850494+0000","last_became_active":"2024-09-12T00:52:22.593876+0000","last_became_peered":"2024-09-12T00:52:22.593876+0000","last_unstale":"2024-09-12T00:52:54.850494+0000","last_undegraded":"2024-09-12T00:52:54.850494+0000","last_fullsized":"2024-09-12T00:52:54.850494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:17.961428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876981+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:52:54.876981+0000","last_peered":"2024-09-12T00:52:54.876981+0000","last_clean":"2024-09-12T00:52:54.876981+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:52:54.876981+0000","last_undegraded":"2024-09-12T00:52:54.876981+0000","last_fullsized":"2024-09-12T00:52:54.876981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841926+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:52:54.841926+0000","last_peered":"2024-09-12T00:52:54.841926+0000","last_clean":"2024-09-12T00:52:54.841926+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:52:54.841926+0000","last_undegraded":"2024-09-12T00:52:54.841926+0000","last_fullsized":"2024-09-12T00:52:54.841926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875489+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:52:54.875489+0000","last_peered":"2024-09-12T00:52:54.875489+0000","last_clean":"2024-09-12T00:52:54.875489+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:52:54.875489+0000","last_undegraded":"2024-09-12T00:52:54.875489+0000","last_fullsized":"2024-09-12T00:52:54.875489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848626+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:52:54.848626+0000","last_peered":"2024-09-12T00:52:54.848626+0000","last_clean":"2024-09-12T00:52:54.848626+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:52:54.848626+0000","last_undegraded":"2024-09-12T00:52:54.848626+0000","last_fullsized":"2024-09-12T00:52:54.848626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884371+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:52:54.884371+0000","last_peered":"2024-09-12T00:52:54.884371+0000","last_clean":"2024-09-12T00:52:54.884371+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:52:54.884371+0000","last_undegraded":"2024-09-12T00:52:54.884371+0000","last_fullsized":"2024-09-12T00:52:54.884371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'72","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.690077+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:53:05.690077+0000","last_peered":"2024-09-12T00:53:05.690077+0000","last_clean":"2024-09-12T00:53:05.690077+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:53:05.690077+0000","last_undegraded":"2024-09-12T00:53:05.690077+0000","last_fullsized":"2024-09-12T00:53:05.690077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":160,"num_write":131,"num_write_kb":1159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873351+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:52:54.873351+0000","last_peered":"2024-09-12T00:52:54.873351+0000","last_clean":"2024-09-12T00:52:54.873351+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:52:54.873351+0000","last_undegraded":"2024-09-12T00:52:54.873351+0000","last_fullsized":"2024-09-12T00:52:54.873351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848558+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:52:54.848558+0000","last_peered":"2024-09-12T00:52:54.848558+0000","last_clean":"2024-09-12T00:52:54.848558+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:52:54.848558+0000","last_undegraded":"2024-09-12T00:52:54.848558+0000","last_fullsized":"2024-09-12T00:52:54.848558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890212+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:52:54.890212+0000","last_peered":"2024-09-12T00:52:54.890212+0000","last_clean":"2024-09-12T00:52:54.890212+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:52:54.890212+0000","last_undegraded":"2024-09-12T00:52:54.890212+0000","last_fullsized":"2024-09-12T00:52:54.890212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838291+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:52:54.838291+0000","last_peered":"2024-09-12T00:52:54.838291+0000","last_clean":"2024-09-12T00:52:54.838291+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:52:54.838291+0000","last_undegraded":"2024-09-12T00:52:54.838291+0000","last_fullsized":"2024-09-12T00:52:54.838291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875091+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:52:54.875091+0000","last_peered":"2024-09-12T00:52:54.875091+0000","last_clean":"2024-09-12T00:52:54.875091+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:52:54.875091+0000","last_undegraded":"2024-09-12T00:52:54.875091+0000","last_fullsized":"2024-09-12T00:52:54.875091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839819+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:52:54.839819+0000","last_peered":"2024-09-12T00:52:54.839819+0000","last_clean":"2024-09-12T00:52:54.839819+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:52:54.839819+0000","last_undegraded":"2024-09-12T00:52:54.839819+0000","last_fullsized":"2024-09-12T00:52:54.839819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878537+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:52:54.878537+0000","last_peered":"2024-09-12T00:52:54.878537+0000","last_clean":"2024-09-12T00:52:54.878537+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:52:54.878537+0000","last_undegraded":"2024-09-12T00:52:54.878537+0000","last_fullsized":"2024-09-12T00:52:54.878537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.061886+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:52:56.061886+0000","last_peered":"2024-09-12T00:52:56.061886+0000","last_clean":"2024-09-12T00:52:56.061886+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:52:56.061886+0000","last_undegraded":"2024-09-12T00:52:56.061886+0000","last_fullsized":"2024-09-12T00:52:56.061886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884443+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:52:54.884443+0000","last_peered":"2024-09-12T00:52:54.884443+0000","last_clean":"2024-09-12T00:52:54.884443+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:52:54.884443+0000","last_undegraded":"2024-09-12T00:52:54.884443+0000","last_fullsized":"2024-09-12T00:52:54.884443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850626+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:52:54.850626+0000","last_peered":"2024-09-12T00:52:54.850626+0000","last_clean":"2024-09-12T00:52:54.850626+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:52:54.850626+0000","last_undegraded":"2024-09-12T00:52:54.850626+0000","last_fullsized":"2024-09-12T00:52:54.850626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880746+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:52:54.880746+0000","last_peered":"2024-09-12T00:52:54.880746+0000","last_clean":"2024-09-12T00:52:54.880746+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:52:54.880746+0000","last_undegraded":"2024-09-12T00:52:54.880746+0000","last_fullsized":"2024-09-12T00:52:54.880746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889345+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:52:54.889345+0000","last_peered":"2024-09-12T00:52:54.889345+0000","last_clean":"2024-09-12T00:52:54.889345+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:52:54.889345+0000","last_undegraded":"2024-09-12T00:52:54.889345+0000","last_fullsized":"2024-09-12T00:52:54.889345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.847896+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:52:54.847896+0000","last_peered":"2024-09-12T00:52:54.847896+0000","last_clean":"2024-09-12T00:52:54.847896+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:52:54.847896+0000","last_undegraded":"2024-09-12T00:52:54.847896+0000","last_fullsized":"2024-09-12T00:52:54.847896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888948+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:52:54.888948+0000","last_peered":"2024-09-12T00:52:54.888948+0000","last_clean":"2024-09-12T00:52:54.888948+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:52:54.888948+0000","last_undegraded":"2024-09-12T00:52:54.888948+0000","last_fullsized":"2024-09-12T00:52:54.888948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848504+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:52:54.848504+0000","last_peered":"2024-09-12T00:52:54.848504+0000","last_clean":"2024-09-12T00:52:54.848504+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:52:54.848504+0000","last_undegraded":"2024-09-12T00:52:54.848504+0000","last_fullsized":"2024-09-12T00:52:54.848504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888796+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:52:54.888796+0000","last_peered":"2024-09-12T00:52:54.888796+0000","last_clean":"2024-09-12T00:52:54.888796+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:52:54.888796+0000","last_undegraded":"2024-09-12T00:52:54.888796+0000","last_fullsized":"2024-09-12T00:52:54.888796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839897+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:52:54.839897+0000","last_peered":"2024-09-12T00:52:54.839897+0000","last_clean":"2024-09-12T00:52:54.839897+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:52:54.839897+0000","last_undegraded":"2024-09-12T00:52:54.839897+0000","last_fullsized":"2024-09-12T00:52:54.839897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879161+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:52:54.879161+0000","last_peered":"2024-09-12T00:52:54.879161+0000","last_clean":"2024-09-12T00:52:54.879161+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:52:54.879161+0000","last_undegraded":"2024-09-12T00:52:54.879161+0000","last_fullsized":"2024-09-12T00:52:54.879161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.842345+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:52:54.842345+0000","last_peered":"2024-09-12T00:52:54.842345+0000","last_clean":"2024-09-12T00:52:54.842345+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:52:54.842345+0000","last_undegraded":"2024-09-12T00:52:54.842345+0000","last_fullsized":"2024-09-12T00:52:54.842345+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797091,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":867,"num_read_kb":592,"num_write":361,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2391273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612643,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":454100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841576,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28948,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716204,"statfs":{"total":95995035648,"available":95965392896,"internally_reserved":0,"allocated":1970176,"data_stored":1444133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40820,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704332,"statfs":{"total":95995035648,"available":95953235968,"internally_reserved":0,"allocated":1347584,"data_stored":847669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716816,"statfs":{"total":95995035648,"available":95966019584,"internally_reserved":0,"allocated":1343488,"data_stored":847472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1048435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593789,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":937984,"data_stored":453725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822721,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32896,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712256,"statfs":{"total":95995035648,"available":95961350144,"internally_reserved":0,"allocated":1691648,"data_stored":1178792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":455783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1675264,"data_stored":1175367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":525280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":522911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":454996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":71762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":400130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:53:10.634 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T00:53:10.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T00:53:10.895 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:10 smithi071 ceph-mon[35276]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-12T00:53:10.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:10 smithi002 ceph-mon[31210]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-12T00:53:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:10 smithi167 ceph-mon[35234]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-12T00:53:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 -- 172.21.15.2:0/1536403836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84100a80 msgr2=0x7f1b84100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 --2- 172.21.15.2:0/1536403836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84100a80 0x7f1b84100ee0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009930 tx=0x7f1b6c02a420 comp rx=0 tx=0).stop 2024-09-12T00:53:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 -- 172.21.15.2:0/1536403836 shutdown_connections 2024-09-12T00:53:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 --2- 172.21.15.2:0/1536403836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b84101420 0x7f1b8410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 --2- 172.21.15.2:0/1536403836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84100a80 0x7f1b84100ee0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 --2- 172.21.15.2:0/1536403836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b84106a80 0x7f1b84106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 -- 172.21.15.2:0/1536403836 >> 172.21.15.2:0/1536403836 conn(0x7f1b840fc7a0 msgr2=0x7f1b840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 -- 172.21.15.2:0/1536403836 shutdown_connections 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.345+0000 7f1b89833640 1 -- 172.21.15.2:0/1536403836 wait complete. 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b89833640 1 Processor -- start 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b89833640 1 -- start start 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b89833640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b84100a80 0x7f1b84197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b89833640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b84101420 0x7f1b84197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b89833640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84106a80 0x7f1b84197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b89833640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84110e80 con 0x7f1b84106a80 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b89833640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84110d00 con 0x7f1b84101420 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b89833640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84111000 con 0x7f1b84100a80 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84106a80 0x7f1b84197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84106a80 0x7f1b84197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50980/0 (socket says 172.21.15.2:50980) 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b837fe640 1 -- 172.21.15.2:0/2648336409 learned_addr learned my addr 172.21.15.2:0/2648336409 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:11.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.346+0000 7f1b7a7fc640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b84101420 0x7f1b84197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b82ffd640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b84100a80 0x7f1b84197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b837fe640 1 -- 172.21.15.2:0/2648336409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b84100a80 msgr2=0x7f1b84197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b837fe640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b84100a80 0x7f1b84197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b837fe640 1 -- 172.21.15.2:0/2648336409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b84101420 msgr2=0x7f1b84197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b837fe640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b84101420 0x7f1b84197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b837fe640 1 -- 172.21.15.2:0/2648336409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b841a6990 con 0x7f1b84106a80 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b837fe640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84106a80 0x7f1b84197ba0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00cad0 tx=0x7f1b7c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b88831640 1 -- 172.21.15.2:0/2648336409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00ae20 con 0x7f1b84106a80 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b88831640 1 -- 172.21.15.2:0/2648336409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b7c005020 con 0x7f1b84106a80 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b88831640 1 -- 172.21.15.2:0/2648336409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00f6f0 con 0x7f1b84106a80 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b841a6c80 con 0x7f1b84106a80 2024-09-12T00:53:11.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.347+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841a7190 con 0x7f1b84106a80 2024-09-12T00:53:11.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.348+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b84100ee0 con 0x7f1b84106a80 2024-09-12T00:53:11.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.350+0000 7f1b88831640 1 -- 172.21.15.2:0/2648336409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f1b7c0051d0 con 0x7f1b84106a80 2024-09-12T00:53:11.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.350+0000 7f1b88831640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b700a2e90 0x7f1b700a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:11.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.350+0000 7f1b88831640 1 -- 172.21.15.2:0/2648336409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f1b7c0cfb60 con 0x7f1b84106a80 2024-09-12T00:53:11.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.350+0000 7f1b82ffd640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b700a2e90 0x7f1b700a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:11.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.351+0000 7f1b82ffd640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b700a2e90 0x7f1b700a5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005fd0 tx=0x7f1b7400b510 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:11.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.353+0000 7f1b88831640 1 -- 172.21.15.2:0/2648336409 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b7c014030 con 0x7f1b84106a80 2024-09-12T00:53:11.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.525+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b84062630 con 0x7f1b700a2e90 2024-09-12T00:53:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.531+0000 7f1b88831640 1 -- 172.21.15.2:0/2648336409 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257771 (secure 0 0 0) 0x7f1b84062630 con 0x7f1b700a2e90 2024-09-12T00:53:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:11.534 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b700a2e90 msgr2=0x7f1b700a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b700a2e90 0x7f1b700a5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005fd0 tx=0x7f1b7400b510 comp rx=0 tx=0).stop 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84106a80 msgr2=0x7f1b84197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84106a80 0x7f1b84197ba0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00cad0 tx=0x7f1b7c00cf90 comp rx=0 tx=0).stop 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 shutdown_connections 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b700a2e90 0x7f1b700a5350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84106a80 0x7f1b84197ba0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b84101420 0x7f1b84197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 --2- 172.21.15.2:0/2648336409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b84100a80 0x7f1b84197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.534+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 >> 172.21.15.2:0/2648336409 conn(0x7f1b840fc7a0 msgr2=0x7f1b840fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.535+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 shutdown_connections 2024-09-12T00:53:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:11.535+0000 7f1b89833640 1 -- 172.21.15.2:0/2648336409 wait complete. 2024-09-12T00:53:11.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:11 smithi071 ceph-mon[35276]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:11.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:11 smithi002 ceph-mon[31210]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:12.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:11 smithi167 ceph-mon[35234]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:12.114 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-12T00:53:10.876163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1387693,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1277,"num_read_kb":1067,"num_write":626,"num_write_kb":5298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":960,"ondisk_log_size":960,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377324,"kb_used_data":15216,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564500,"statfs":{"total":1151940427776,"available":1151554048000,"internally_reserved":0,"allocated":15581184,"data_stored":9605295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200331,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":450,"num_read_kb":494,"num_write":158,"num_write_kb":924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002366"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884145+0000","last_change":"2024-09-12T00:51:11.023848+0000","last_active":"2024-09-12T00:52:54.884145+0000","last_peered":"2024-09-12T00:52:54.884145+0000","last_clean":"2024-09-12T00:52:54.884145+0000","last_became_active":"2024-09-12T00:51:11.023428+0000","last_became_peered":"2024-09-12T00:51:11.023428+0000","last_unstale":"2024-09-12T00:52:54.884145+0000","last_undegraded":"2024-09-12T00:52:54.884145+0000","last_fullsized":"2024-09-12T00:52:54.884145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.274529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880965+0000","last_change":"2024-09-12T00:51:11.026208+0000","last_active":"2024-09-12T00:52:54.880965+0000","last_peered":"2024-09-12T00:52:54.880965+0000","last_clean":"2024-09-12T00:52:54.880965+0000","last_became_active":"2024-09-12T00:51:11.025915+0000","last_became_peered":"2024-09-12T00:51:11.025915+0000","last_unstale":"2024-09-12T00:52:54.880965+0000","last_undegraded":"2024-09-12T00:52:54.880965+0000","last_fullsized":"2024-09-12T00:52:54.880965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:16.235561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888565+0000","last_change":"2024-09-12T00:51:11.026394+0000","last_active":"2024-09-12T00:52:54.888565+0000","last_peered":"2024-09-12T00:52:54.888565+0000","last_clean":"2024-09-12T00:52:54.888565+0000","last_became_active":"2024-09-12T00:51:11.025999+0000","last_became_peered":"2024-09-12T00:51:11.025999+0000","last_unstale":"2024-09-12T00:52:54.888565+0000","last_undegraded":"2024-09-12T00:52:54.888565+0000","last_fullsized":"2024-09-12T00:52:54.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:08.768212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871617+0000","last_change":"2024-09-12T00:51:11.026699+0000","last_active":"2024-09-12T00:52:54.871617+0000","last_peered":"2024-09-12T00:52:54.871617+0000","last_clean":"2024-09-12T00:52:54.871617+0000","last_became_active":"2024-09-12T00:51:11.026314+0000","last_became_peered":"2024-09-12T00:51:11.026314+0000","last_unstale":"2024-09-12T00:52:54.871617+0000","last_undegraded":"2024-09-12T00:52:54.871617+0000","last_fullsized":"2024-09-12T00:52:54.871617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.407674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871301+0000","last_change":"2024-09-12T00:51:11.018257+0000","last_active":"2024-09-12T00:52:54.871301+0000","last_peered":"2024-09-12T00:52:54.871301+0000","last_clean":"2024-09-12T00:52:54.871301+0000","last_became_active":"2024-09-12T00:51:11.015893+0000","last_became_peered":"2024-09-12T00:51:11.015893+0000","last_unstale":"2024-09-12T00:52:54.871301+0000","last_undegraded":"2024-09-12T00:52:54.871301+0000","last_fullsized":"2024-09-12T00:52:54.871301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:02.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890111+0000","last_change":"2024-09-12T00:51:11.021562+0000","last_active":"2024-09-12T00:52:54.890111+0000","last_peered":"2024-09-12T00:52:54.890111+0000","last_clean":"2024-09-12T00:52:54.890111+0000","last_became_active":"2024-09-12T00:51:11.021176+0000","last_became_peered":"2024-09-12T00:51:11.021176+0000","last_unstale":"2024-09-12T00:52:54.890111+0000","last_undegraded":"2024-09-12T00:52:54.890111+0000","last_fullsized":"2024-09-12T00:52:54.890111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:20.831444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.879651+0000","last_change":"2024-09-12T00:51:11.020896+0000","last_active":"2024-09-12T00:52:54.879651+0000","last_peered":"2024-09-12T00:52:54.879651+0000","last_clean":"2024-09-12T00:52:54.879651+0000","last_became_active":"2024-09-12T00:51:11.020529+0000","last_became_peered":"2024-09-12T00:51:11.020529+0000","last_unstale":"2024-09-12T00:52:54.879651+0000","last_undegraded":"2024-09-12T00:52:54.879651+0000","last_fullsized":"2024-09-12T00:52:54.879651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:52.491773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880503+0000","last_change":"2024-09-12T00:51:11.015390+0000","last_active":"2024-09-12T00:52:54.880503+0000","last_peered":"2024-09-12T00:52:54.880503+0000","last_clean":"2024-09-12T00:52:54.880503+0000","last_became_active":"2024-09-12T00:51:11.015025+0000","last_became_peered":"2024-09-12T00:51:11.015025+0000","last_unstale":"2024-09-12T00:52:54.880503+0000","last_undegraded":"2024-09-12T00:52:54.880503+0000","last_fullsized":"2024-09-12T00:52:54.880503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.581110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880321+0000","last_change":"2024-09-12T00:51:11.010103+0000","last_active":"2024-09-12T00:52:54.880321+0000","last_peered":"2024-09-12T00:52:54.880321+0000","last_clean":"2024-09-12T00:52:54.880321+0000","last_became_active":"2024-09-12T00:51:11.009609+0000","last_became_peered":"2024-09-12T00:51:11.009609+0000","last_unstale":"2024-09-12T00:52:54.880321+0000","last_undegraded":"2024-09-12T00:52:54.880321+0000","last_fullsized":"2024-09-12T00:52:54.880321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.401073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878237+0000","last_change":"2024-09-12T00:51:11.021349+0000","last_active":"2024-09-12T00:52:54.878237+0000","last_peered":"2024-09-12T00:52:54.878237+0000","last_clean":"2024-09-12T00:52:54.878237+0000","last_became_active":"2024-09-12T00:51:11.020948+0000","last_became_peered":"2024-09-12T00:51:11.020948+0000","last_unstale":"2024-09-12T00:52:54.878237+0000","last_undegraded":"2024-09-12T00:52:54.878237+0000","last_fullsized":"2024-09-12T00:52:54.878237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.002421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.881472+0000","last_change":"2024-09-12T00:51:11.025653+0000","last_active":"2024-09-12T00:52:54.881472+0000","last_peered":"2024-09-12T00:52:54.881472+0000","last_clean":"2024-09-12T00:52:54.881472+0000","last_became_active":"2024-09-12T00:51:11.025300+0000","last_became_peered":"2024-09-12T00:51:11.025300+0000","last_unstale":"2024-09-12T00:52:54.881472+0000","last_undegraded":"2024-09-12T00:52:54.881472+0000","last_fullsized":"2024-09-12T00:52:54.881472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:00.042087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868621+0000","last_change":"2024-09-12T00:51:11.016083+0000","last_active":"2024-09-12T00:52:54.868621+0000","last_peered":"2024-09-12T00:52:54.868621+0000","last_clean":"2024-09-12T00:52:54.868621+0000","last_became_active":"2024-09-12T00:51:11.015772+0000","last_became_peered":"2024-09-12T00:51:11.015772+0000","last_unstale":"2024-09-12T00:52:54.868621+0000","last_undegraded":"2024-09-12T00:52:54.868621+0000","last_fullsized":"2024-09-12T00:52:54.868621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:32.988575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884657+0000","last_change":"2024-09-12T00:51:22.065720+0000","last_active":"2024-09-12T00:52:54.884657+0000","last_peered":"2024-09-12T00:52:54.884657+0000","last_clean":"2024-09-12T00:52:54.884657+0000","last_became_active":"2024-09-12T00:51:22.065405+0000","last_became_peered":"2024-09-12T00:51:22.065405+0000","last_unstale":"2024-09-12T00:52:54.884657+0000","last_undegraded":"2024-09-12T00:52:54.884657+0000","last_fullsized":"2024-09-12T00:52:54.884657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:06.450135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.886083+0000","last_change":"2024-09-12T00:51:11.026587+0000","last_active":"2024-09-12T00:52:54.886083+0000","last_peered":"2024-09-12T00:52:54.886083+0000","last_clean":"2024-09-12T00:52:54.886083+0000","last_became_active":"2024-09-12T00:51:11.025870+0000","last_became_peered":"2024-09-12T00:51:11.025870+0000","last_unstale":"2024-09-12T00:52:54.886083+0000","last_undegraded":"2024-09-12T00:52:54.886083+0000","last_fullsized":"2024-09-12T00:52:54.886083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:50.588885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889586+0000","last_change":"2024-09-12T00:51:22.064358+0000","last_active":"2024-09-12T00:52:54.889586+0000","last_peered":"2024-09-12T00:52:54.889586+0000","last_clean":"2024-09-12T00:52:54.889586+0000","last_became_active":"2024-09-12T00:51:22.063933+0000","last_became_peered":"2024-09-12T00:51:22.063933+0000","last_unstale":"2024-09-12T00:52:54.889586+0000","last_undegraded":"2024-09-12T00:52:54.889586+0000","last_fullsized":"2024-09-12T00:52:54.889586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:24.434157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887265+0000","last_change":"2024-09-12T00:51:11.023380+0000","last_active":"2024-09-12T00:52:54.887265+0000","last_peered":"2024-09-12T00:52:54.887265+0000","last_clean":"2024-09-12T00:52:54.887265+0000","last_became_active":"2024-09-12T00:51:11.021811+0000","last_became_peered":"2024-09-12T00:51:11.021811+0000","last_unstale":"2024-09-12T00:52:54.887265+0000","last_undegraded":"2024-09-12T00:52:54.887265+0000","last_fullsized":"2024-09-12T00:52:54.887265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.035246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884255+0000","last_change":"2024-09-12T00:51:11.024836+0000","last_active":"2024-09-12T00:52:54.884255+0000","last_peered":"2024-09-12T00:52:54.884255+0000","last_clean":"2024-09-12T00:52:54.884255+0000","last_became_active":"2024-09-12T00:51:11.024495+0000","last_became_peered":"2024-09-12T00:51:11.024495+0000","last_unstale":"2024-09-12T00:52:54.884255+0000","last_undegraded":"2024-09-12T00:52:54.884255+0000","last_fullsized":"2024-09-12T00:52:54.884255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:18.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889401+0000","last_change":"2024-09-12T00:51:11.016509+0000","last_active":"2024-09-12T00:52:54.889401+0000","last_peered":"2024-09-12T00:52:54.889401+0000","last_clean":"2024-09-12T00:52:54.889401+0000","last_became_active":"2024-09-12T00:51:11.016244+0000","last_became_peered":"2024-09-12T00:51:11.016244+0000","last_unstale":"2024-09-12T00:52:54.889401+0000","last_undegraded":"2024-09-12T00:52:54.889401+0000","last_fullsized":"2024-09-12T00:52:54.889401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.490131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874518+0000","last_change":"2024-09-12T00:51:11.017850+0000","last_active":"2024-09-12T00:52:54.874518+0000","last_peered":"2024-09-12T00:52:54.874518+0000","last_clean":"2024-09-12T00:52:54.874518+0000","last_became_active":"2024-09-12T00:51:11.017294+0000","last_became_peered":"2024-09-12T00:51:11.017294+0000","last_unstale":"2024-09-12T00:52:54.874518+0000","last_undegraded":"2024-09-12T00:52:54.874518+0000","last_fullsized":"2024-09-12T00:52:54.874518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:10.149332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871178+0000","last_change":"2024-09-12T00:51:11.028648+0000","last_active":"2024-09-12T00:52:54.871178+0000","last_peered":"2024-09-12T00:52:54.871178+0000","last_clean":"2024-09-12T00:52:54.871178+0000","last_became_active":"2024-09-12T00:51:11.028093+0000","last_became_peered":"2024-09-12T00:51:11.028093+0000","last_unstale":"2024-09-12T00:52:54.871178+0000","last_undegraded":"2024-09-12T00:52:54.871178+0000","last_fullsized":"2024-09-12T00:52:54.871178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883483+0000","last_change":"2024-09-12T00:51:11.020588+0000","last_active":"2024-09-12T00:52:54.883483+0000","last_peered":"2024-09-12T00:52:54.883483+0000","last_clean":"2024-09-12T00:52:54.883483+0000","last_became_active":"2024-09-12T00:51:11.020287+0000","last_became_peered":"2024-09-12T00:51:11.020287+0000","last_unstale":"2024-09-12T00:52:54.883483+0000","last_undegraded":"2024-09-12T00:52:54.883483+0000","last_fullsized":"2024-09-12T00:52:54.883483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.348058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.885630+0000","last_change":"2024-09-12T00:51:11.024420+0000","last_active":"2024-09-12T00:52:54.885630+0000","last_peered":"2024-09-12T00:52:54.885630+0000","last_clean":"2024-09-12T00:52:54.885630+0000","last_became_active":"2024-09-12T00:51:11.024090+0000","last_became_peered":"2024-09-12T00:51:11.024090+0000","last_unstale":"2024-09-12T00:52:54.885630+0000","last_undegraded":"2024-09-12T00:52:54.885630+0000","last_fullsized":"2024-09-12T00:52:54.885630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.885481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876750+0000","last_change":"2024-09-12T00:51:11.021471+0000","last_active":"2024-09-12T00:52:54.876750+0000","last_peered":"2024-09-12T00:52:54.876750+0000","last_clean":"2024-09-12T00:52:54.876750+0000","last_became_active":"2024-09-12T00:51:11.019634+0000","last_became_peered":"2024-09-12T00:51:11.019634+0000","last_unstale":"2024-09-12T00:52:54.876750+0000","last_undegraded":"2024-09-12T00:52:54.876750+0000","last_fullsized":"2024-09-12T00:52:54.876750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:10.523955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875520+0000","last_change":"2024-09-12T00:51:11.009472+0000","last_active":"2024-09-12T00:52:54.875520+0000","last_peered":"2024-09-12T00:52:54.875520+0000","last_clean":"2024-09-12T00:52:54.875520+0000","last_became_active":"2024-09-12T00:51:11.009115+0000","last_became_peered":"2024-09-12T00:51:11.009115+0000","last_unstale":"2024-09-12T00:52:54.875520+0000","last_undegraded":"2024-09-12T00:52:54.875520+0000","last_fullsized":"2024-09-12T00:52:54.875520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:43.040912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874846+0000","last_change":"2024-09-12T00:51:11.017027+0000","last_active":"2024-09-12T00:52:54.874846+0000","last_peered":"2024-09-12T00:52:54.874846+0000","last_clean":"2024-09-12T00:52:54.874846+0000","last_became_active":"2024-09-12T00:51:11.016738+0000","last_became_peered":"2024-09-12T00:51:11.016738+0000","last_unstale":"2024-09-12T00:52:54.874846+0000","last_undegraded":"2024-09-12T00:52:54.874846+0000","last_fullsized":"2024-09-12T00:52:54.874846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:17.992728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882315+0000","last_change":"2024-09-12T00:51:11.024206+0000","last_active":"2024-09-12T00:52:54.882315+0000","last_peered":"2024-09-12T00:52:54.882315+0000","last_clean":"2024-09-12T00:52:54.882315+0000","last_became_active":"2024-09-12T00:51:11.023873+0000","last_became_peered":"2024-09-12T00:51:11.023873+0000","last_unstale":"2024-09-12T00:52:54.882315+0000","last_undegraded":"2024-09-12T00:52:54.882315+0000","last_fullsized":"2024-09-12T00:52:54.882315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876433+0000","last_change":"2024-09-12T00:51:11.022251+0000","last_active":"2024-09-12T00:52:54.876433+0000","last_peered":"2024-09-12T00:52:54.876433+0000","last_clean":"2024-09-12T00:52:54.876433+0000","last_became_active":"2024-09-12T00:51:11.021874+0000","last_became_peered":"2024-09-12T00:51:11.021874+0000","last_unstale":"2024-09-12T00:52:54.876433+0000","last_undegraded":"2024-09-12T00:52:54.876433+0000","last_fullsized":"2024-09-12T00:52:54.876433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:06.175361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883390+0000","last_change":"2024-09-12T00:51:11.018181+0000","last_active":"2024-09-12T00:52:54.883390+0000","last_peered":"2024-09-12T00:52:54.883390+0000","last_clean":"2024-09-12T00:52:54.883390+0000","last_became_active":"2024-09-12T00:51:11.017784+0000","last_became_peered":"2024-09-12T00:51:11.017784+0000","last_unstale":"2024-09-12T00:52:54.883390+0000","last_undegraded":"2024-09-12T00:52:54.883390+0000","last_fullsized":"2024-09-12T00:52:54.883390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:57.610949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889494+0000","last_change":"2024-09-12T00:51:11.022384+0000","last_active":"2024-09-12T00:52:54.889494+0000","last_peered":"2024-09-12T00:52:54.889494+0000","last_clean":"2024-09-12T00:52:54.889494+0000","last_became_active":"2024-09-12T00:51:11.020840+0000","last_became_peered":"2024-09-12T00:51:11.020840+0000","last_unstale":"2024-09-12T00:52:54.889494+0000","last_undegraded":"2024-09-12T00:52:54.889494+0000","last_fullsized":"2024-09-12T00:52:54.889494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.822176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.882408+0000","last_change":"2024-09-12T00:51:11.025334+0000","last_active":"2024-09-12T00:52:54.882408+0000","last_peered":"2024-09-12T00:52:54.882408+0000","last_clean":"2024-09-12T00:52:54.882408+0000","last_became_active":"2024-09-12T00:51:11.025011+0000","last_became_peered":"2024-09-12T00:51:11.025011+0000","last_unstale":"2024-09-12T00:52:54.882408+0000","last_undegraded":"2024-09-12T00:52:54.882408+0000","last_fullsized":"2024-09-12T00:52:54.882408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:56.275728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871902+0000","last_change":"2024-09-12T00:51:11.027947+0000","last_active":"2024-09-12T00:52:54.871902+0000","last_peered":"2024-09-12T00:52:54.871902+0000","last_clean":"2024-09-12T00:52:54.871902+0000","last_became_active":"2024-09-12T00:51:11.027600+0000","last_became_peered":"2024-09-12T00:51:11.027600+0000","last_unstale":"2024-09-12T00:52:54.871902+0000","last_undegraded":"2024-09-12T00:52:54.871902+0000","last_fullsized":"2024-09-12T00:52:54.871902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.612541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876051+0000","last_change":"2024-09-12T00:51:11.026196+0000","last_active":"2024-09-12T00:52:54.876051+0000","last_peered":"2024-09-12T00:52:54.876051+0000","last_clean":"2024-09-12T00:52:54.876051+0000","last_became_active":"2024-09-12T00:51:11.025282+0000","last_became_peered":"2024-09-12T00:51:11.025282+0000","last_unstale":"2024-09-12T00:52:54.876051+0000","last_undegraded":"2024-09-12T00:52:54.876051+0000","last_fullsized":"2024-09-12T00:52:54.876051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:04.973070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.868139+0000","last_change":"2024-09-12T00:51:11.014482+0000","last_active":"2024-09-12T00:52:54.868139+0000","last_peered":"2024-09-12T00:52:54.868139+0000","last_clean":"2024-09-12T00:52:54.868139+0000","last_became_active":"2024-09-12T00:51:11.014052+0000","last_became_peered":"2024-09-12T00:51:11.014052+0000","last_unstale":"2024-09-12T00:52:54.868139+0000","last_undegraded":"2024-09-12T00:52:54.868139+0000","last_fullsized":"2024-09-12T00:52:54.868139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:22.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'10","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:09.231013+0000","last_change":"2024-09-12T00:51:09.008533+0000","last_active":"2024-09-12T00:53:09.231013+0000","last_peered":"2024-09-12T00:53:09.231013+0000","last_clean":"2024-09-12T00:53:09.231013+0000","last_became_active":"2024-09-12T00:51:09.008186+0000","last_became_peered":"2024-09-12T00:51:09.008186+0000","last_unstale":"2024-09-12T00:53:09.231013+0000","last_undegraded":"2024-09-12T00:53:09.231013+0000","last_fullsized":"2024-09-12T00:53:09.231013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.126760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2335,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875141+0000","last_change":"2024-09-12T00:51:22.297202+0000","last_active":"2024-09-12T00:52:54.875141+0000","last_peered":"2024-09-12T00:52:54.875141+0000","last_clean":"2024-09-12T00:52:54.875141+0000","last_became_active":"2024-09-12T00:51:22.296902+0000","last_became_peered":"2024-09-12T00:51:22.296902+0000","last_unstale":"2024-09-12T00:52:54.875141+0000","last_undegraded":"2024-09-12T00:52:54.875141+0000","last_fullsized":"2024-09-12T00:52:54.875141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:41.364454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.836360+0000","last_change":"2024-09-12T00:51:22.183506+0000","last_active":"2024-09-12T00:52:54.836360+0000","last_peered":"2024-09-12T00:52:54.836360+0000","last_clean":"2024-09-12T00:52:54.836360+0000","last_became_active":"2024-09-12T00:51:22.180654+0000","last_became_peered":"2024-09-12T00:51:22.180654+0000","last_unstale":"2024-09-12T00:52:54.836360+0000","last_undegraded":"2024-09-12T00:52:54.836360+0000","last_fullsized":"2024-09-12T00:52:54.836360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.833879+0000","last_change":"2024-09-12T00:51:08.997872+0000","last_active":"2024-09-12T00:52:54.833879+0000","last_peered":"2024-09-12T00:52:54.833879+0000","last_clean":"2024-09-12T00:52:54.833879+0000","last_became_active":"2024-09-12T00:51:08.997481+0000","last_became_peered":"2024-09-12T00:51:08.997481+0000","last_unstale":"2024-09-12T00:52:54.833879+0000","last_undegraded":"2024-09-12T00:52:54.833879+0000","last_fullsized":"2024-09-12T00:52:54.833879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:49.101083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888219+0000","last_change":"2024-09-12T00:51:11.018154+0000","last_active":"2024-09-12T00:52:54.888219+0000","last_peered":"2024-09-12T00:52:54.888219+0000","last_clean":"2024-09-12T00:52:54.888219+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.888219+0000","last_undegraded":"2024-09-12T00:52:54.888219+0000","last_fullsized":"2024-09-12T00:52:54.888219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:34.127051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839021+0000","last_change":"2024-09-12T00:51:09.005682+0000","last_active":"2024-09-12T00:52:54.839021+0000","last_peered":"2024-09-12T00:52:54.839021+0000","last_clean":"2024-09-12T00:52:54.839021+0000","last_became_active":"2024-09-12T00:51:09.005316+0000","last_became_peered":"2024-09-12T00:51:09.005316+0000","last_unstale":"2024-09-12T00:52:54.839021+0000","last_undegraded":"2024-09-12T00:52:54.839021+0000","last_fullsized":"2024-09-12T00:52:54.839021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887645+0000","last_change":"2024-09-12T00:51:11.015875+0000","last_active":"2024-09-12T00:52:54.887645+0000","last_peered":"2024-09-12T00:52:54.887645+0000","last_clean":"2024-09-12T00:52:54.887645+0000","last_became_active":"2024-09-12T00:51:11.015529+0000","last_became_peered":"2024-09-12T00:51:11.015529+0000","last_unstale":"2024-09-12T00:52:54.887645+0000","last_undegraded":"2024-09-12T00:52:54.887645+0000","last_fullsized":"2024-09-12T00:52:54.887645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.288403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:09.230536+0000","last_change":"2024-09-12T00:51:09.003560+0000","last_active":"2024-09-12T00:53:09.230536+0000","last_peered":"2024-09-12T00:53:09.230536+0000","last_clean":"2024-09-12T00:53:09.230536+0000","last_became_active":"2024-09-12T00:51:09.003218+0000","last_became_peered":"2024-09-12T00:51:09.003218+0000","last_unstale":"2024-09-12T00:53:09.230536+0000","last_undegraded":"2024-09-12T00:53:09.230536+0000","last_fullsized":"2024-09-12T00:53:09.230536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.509600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.891678+0000","last_change":"2024-09-12T00:51:11.019375+0000","last_active":"2024-09-12T00:52:54.891678+0000","last_peered":"2024-09-12T00:52:54.891678+0000","last_clean":"2024-09-12T00:52:54.891678+0000","last_became_active":"2024-09-12T00:51:11.018955+0000","last_became_peered":"2024-09-12T00:51:11.018955+0000","last_unstale":"2024-09-12T00:52:54.891678+0000","last_undegraded":"2024-09-12T00:52:54.891678+0000","last_fullsized":"2024-09-12T00:52:54.891678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.235674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.843451+0000","last_change":"2024-09-12T00:51:09.008201+0000","last_active":"2024-09-12T00:52:54.843451+0000","last_peered":"2024-09-12T00:52:54.843451+0000","last_clean":"2024-09-12T00:52:54.843451+0000","last_became_active":"2024-09-12T00:51:09.007814+0000","last_became_peered":"2024-09-12T00:51:09.007814+0000","last_unstale":"2024-09-12T00:52:54.843451+0000","last_undegraded":"2024-09-12T00:52:54.843451+0000","last_fullsized":"2024-09-12T00:52:54.843451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.283475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.887219+0000","last_change":"2024-09-12T00:51:11.023199+0000","last_active":"2024-09-12T00:52:54.887219+0000","last_peered":"2024-09-12T00:52:54.887219+0000","last_clean":"2024-09-12T00:52:54.887219+0000","last_became_active":"2024-09-12T00:51:11.022223+0000","last_became_peered":"2024-09-12T00:51:11.022223+0000","last_unstale":"2024-09-12T00:52:54.887219+0000","last_undegraded":"2024-09-12T00:52:54.887219+0000","last_fullsized":"2024-09-12T00:52:54.887219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:08.491904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839370+0000","last_change":"2024-09-12T00:51:09.224321+0000","last_active":"2024-09-12T00:52:54.839370+0000","last_peered":"2024-09-12T00:52:54.839370+0000","last_clean":"2024-09-12T00:52:54.839370+0000","last_became_active":"2024-09-12T00:51:09.223889+0000","last_became_peered":"2024-09-12T00:51:09.223889+0000","last_unstale":"2024-09-12T00:52:54.839370+0000","last_undegraded":"2024-09-12T00:52:54.839370+0000","last_fullsized":"2024-09-12T00:52:54.839370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.103533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884249+0000","last_change":"2024-09-12T00:51:11.021211+0000","last_active":"2024-09-12T00:52:54.884249+0000","last_peered":"2024-09-12T00:52:54.884249+0000","last_clean":"2024-09-12T00:52:54.884249+0000","last_became_active":"2024-09-12T00:51:11.020897+0000","last_became_peered":"2024-09-12T00:51:11.020897+0000","last_unstale":"2024-09-12T00:52:54.884249+0000","last_undegraded":"2024-09-12T00:52:54.884249+0000","last_fullsized":"2024-09-12T00:52:54.884249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:41.156218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'36","reported_seq":296,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.231848+0000","last_change":"2024-09-12T00:51:09.008251+0000","last_active":"2024-09-12T00:53:10.231848+0000","last_peered":"2024-09-12T00:53:10.231848+0000","last_clean":"2024-09-12T00:53:10.231848+0000","last_became_active":"2024-09-12T00:51:09.007889+0000","last_became_peered":"2024-09-12T00:51:09.007889+0000","last_unstale":"2024-09-12T00:53:10.231848+0000","last_undegraded":"2024-09-12T00:53:10.231848+0000","last_fullsized":"2024-09-12T00:53:10.231848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:09.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":184,"num_write":37,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.866993+0000","last_change":"2024-09-12T00:51:11.019792+0000","last_active":"2024-09-12T00:52:54.866993+0000","last_peered":"2024-09-12T00:52:54.866993+0000","last_clean":"2024-09-12T00:52:54.866993+0000","last_became_active":"2024-09-12T00:51:11.019461+0000","last_became_peered":"2024-09-12T00:51:11.019461+0000","last_unstale":"2024-09-12T00:52:54.866993+0000","last_undegraded":"2024-09-12T00:52:54.866993+0000","last_fullsized":"2024-09-12T00:52:54.866993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.441723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838847+0000","last_change":"2024-09-12T00:51:09.007046+0000","last_active":"2024-09-12T00:52:54.838847+0000","last_peered":"2024-09-12T00:52:54.838847+0000","last_clean":"2024-09-12T00:52:54.838847+0000","last_became_active":"2024-09-12T00:51:09.006322+0000","last_became_peered":"2024-09-12T00:51:09.006322+0000","last_unstale":"2024-09-12T00:52:54.838847+0000","last_undegraded":"2024-09-12T00:52:54.838847+0000","last_fullsized":"2024-09-12T00:52:54.838847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:17.982801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884700+0000","last_change":"2024-09-12T00:51:11.018411+0000","last_active":"2024-09-12T00:52:54.884700+0000","last_peered":"2024-09-12T00:52:54.884700+0000","last_clean":"2024-09-12T00:52:54.884700+0000","last_became_active":"2024-09-12T00:51:11.018052+0000","last_became_peered":"2024-09-12T00:51:11.018052+0000","last_unstale":"2024-09-12T00:52:54.884700+0000","last_undegraded":"2024-09-12T00:52:54.884700+0000","last_fullsized":"2024-09-12T00:52:54.884700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.126031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839358+0000","last_change":"2024-09-12T00:51:09.005617+0000","last_active":"2024-09-12T00:52:54.839358+0000","last_peered":"2024-09-12T00:52:54.839358+0000","last_clean":"2024-09-12T00:52:54.839358+0000","last_became_active":"2024-09-12T00:51:09.005228+0000","last_became_peered":"2024-09-12T00:51:09.005228+0000","last_unstale":"2024-09-12T00:52:54.839358+0000","last_undegraded":"2024-09-12T00:52:54.839358+0000","last_fullsized":"2024-09-12T00:52:54.839358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:07.236393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883708+0000","last_change":"2024-09-12T00:51:11.022976+0000","last_active":"2024-09-12T00:52:54.883708+0000","last_peered":"2024-09-12T00:52:54.883708+0000","last_clean":"2024-09-12T00:52:54.883708+0000","last_became_active":"2024-09-12T00:51:11.022603+0000","last_became_peered":"2024-09-12T00:51:11.022603+0000","last_unstale":"2024-09-12T00:52:54.883708+0000","last_undegraded":"2024-09-12T00:52:54.883708+0000","last_fullsized":"2024-09-12T00:52:54.883708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.690233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:09.226389+0000","last_change":"2024-09-12T00:51:09.004939+0000","last_active":"2024-09-12T00:53:09.226389+0000","last_peered":"2024-09-12T00:53:09.226389+0000","last_clean":"2024-09-12T00:53:09.226389+0000","last_became_active":"2024-09-12T00:51:09.004572+0000","last_became_peered":"2024-09-12T00:51:09.004572+0000","last_unstale":"2024-09-12T00:53:09.226389+0000","last_undegraded":"2024-09-12T00:53:09.226389+0000","last_fullsized":"2024-09-12T00:53:09.226389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:47.414287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873525+0000","last_change":"2024-09-12T00:51:11.019757+0000","last_active":"2024-09-12T00:52:54.873525+0000","last_peered":"2024-09-12T00:52:54.873525+0000","last_clean":"2024-09-12T00:52:54.873525+0000","last_became_active":"2024-09-12T00:51:11.019433+0000","last_became_peered":"2024-09-12T00:51:11.019433+0000","last_unstale":"2024-09-12T00:52:54.873525+0000","last_undegraded":"2024-09-12T00:52:54.873525+0000","last_fullsized":"2024-09-12T00:52:54.873525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.751094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.846569+0000","last_change":"2024-09-12T00:51:22.082529+0000","last_active":"2024-09-12T00:52:54.846569+0000","last_peered":"2024-09-12T00:52:54.846569+0000","last_clean":"2024-09-12T00:52:54.846569+0000","last_became_active":"2024-09-12T00:51:22.067136+0000","last_became_peered":"2024-09-12T00:51:22.067136+0000","last_unstale":"2024-09-12T00:52:54.846569+0000","last_undegraded":"2024-09-12T00:52:54.846569+0000","last_fullsized":"2024-09-12T00:52:54.846569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:18.101437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.859661+0000","last_change":"2024-09-12T00:51:11.027216+0000","last_active":"2024-09-12T00:52:54.859661+0000","last_peered":"2024-09-12T00:52:54.859661+0000","last_clean":"2024-09-12T00:52:54.859661+0000","last_became_active":"2024-09-12T00:51:11.026858+0000","last_became_peered":"2024-09-12T00:51:11.026858+0000","last_unstale":"2024-09-12T00:52:54.859661+0000","last_undegraded":"2024-09-12T00:52:54.859661+0000","last_fullsized":"2024-09-12T00:52:54.859661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.268153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848120+0000","last_change":"2024-09-12T00:51:09.004541+0000","last_active":"2024-09-12T00:52:54.848120+0000","last_peered":"2024-09-12T00:52:54.848120+0000","last_clean":"2024-09-12T00:52:54.848120+0000","last_became_active":"2024-09-12T00:51:09.004166+0000","last_became_peered":"2024-09-12T00:51:09.004166+0000","last_unstale":"2024-09-12T00:52:54.848120+0000","last_undegraded":"2024-09-12T00:52:54.848120+0000","last_fullsized":"2024-09-12T00:52:54.848120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:28.796929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876330+0000","last_change":"2024-09-12T00:51:11.029069+0000","last_active":"2024-09-12T00:52:54.876330+0000","last_peered":"2024-09-12T00:52:54.876330+0000","last_clean":"2024-09-12T00:52:54.876330+0000","last_became_active":"2024-09-12T00:51:11.028695+0000","last_became_peered":"2024-09-12T00:51:11.028695+0000","last_unstale":"2024-09-12T00:52:54.876330+0000","last_undegraded":"2024-09-12T00:52:54.876330+0000","last_fullsized":"2024-09-12T00:52:54.876330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:49.918697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.834098+0000","last_change":"2024-09-12T00:51:09.005200+0000","last_active":"2024-09-12T00:52:54.834098+0000","last_peered":"2024-09-12T00:52:54.834098+0000","last_clean":"2024-09-12T00:52:54.834098+0000","last_became_active":"2024-09-12T00:51:09.004832+0000","last_became_peered":"2024-09-12T00:51:09.004832+0000","last_unstale":"2024-09-12T00:52:54.834098+0000","last_undegraded":"2024-09-12T00:52:54.834098+0000","last_fullsized":"2024-09-12T00:52:54.834098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:00.810752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873806+0000","last_change":"2024-09-12T00:51:11.018468+0000","last_active":"2024-09-12T00:52:54.873806+0000","last_peered":"2024-09-12T00:52:54.873806+0000","last_clean":"2024-09-12T00:52:54.873806+0000","last_became_active":"2024-09-12T00:51:11.018104+0000","last_became_peered":"2024-09-12T00:51:11.018104+0000","last_unstale":"2024-09-12T00:52:54.873806+0000","last_undegraded":"2024-09-12T00:52:54.873806+0000","last_fullsized":"2024-09-12T00:52:54.873806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.018515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'65","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:06.425601+0000","last_change":"2024-09-12T00:51:09.001196+0000","last_active":"2024-09-12T00:53:06.425601+0000","last_peered":"2024-09-12T00:53:06.425601+0000","last_clean":"2024-09-12T00:53:06.425601+0000","last_became_active":"2024-09-12T00:51:09.000826+0000","last_became_peered":"2024-09-12T00:51:09.000826+0000","last_unstale":"2024-09-12T00:53:06.425601+0000","last_undegraded":"2024-09-12T00:53:06.425601+0000","last_fullsized":"2024-09-12T00:53:06.425601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:54.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878977+0000","last_change":"2024-09-12T00:51:22.067225+0000","last_active":"2024-09-12T00:52:54.878977+0000","last_peered":"2024-09-12T00:52:54.878977+0000","last_clean":"2024-09-12T00:52:54.878977+0000","last_became_active":"2024-09-12T00:51:22.066760+0000","last_became_peered":"2024-09-12T00:51:22.066760+0000","last_unstale":"2024-09-12T00:52:54.878977+0000","last_undegraded":"2024-09-12T00:52:54.878977+0000","last_fullsized":"2024-09-12T00:52:54.878977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.845024+0000","last_change":"2024-09-12T00:51:22.072371+0000","last_active":"2024-09-12T00:52:54.845024+0000","last_peered":"2024-09-12T00:52:54.845024+0000","last_clean":"2024-09-12T00:52:54.845024+0000","last_became_active":"2024-09-12T00:51:22.067460+0000","last_became_peered":"2024-09-12T00:51:22.067460+0000","last_unstale":"2024-09-12T00:52:54.845024+0000","last_undegraded":"2024-09-12T00:52:54.845024+0000","last_fullsized":"2024-09-12T00:52:54.845024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:43.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883108+0000","last_change":"2024-09-12T00:51:11.020407+0000","last_active":"2024-09-12T00:52:54.883108+0000","last_peered":"2024-09-12T00:52:54.883108+0000","last_clean":"2024-09-12T00:52:54.883108+0000","last_became_active":"2024-09-12T00:51:11.020106+0000","last_became_peered":"2024-09-12T00:51:11.020106+0000","last_unstale":"2024-09-12T00:52:54.883108+0000","last_undegraded":"2024-09-12T00:52:54.883108+0000","last_fullsized":"2024-09-12T00:52:54.883108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.107649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"84'148","reported_seq":393,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.974099+0000","last_change":"2024-09-12T00:50:00.237516+0000","last_active":"2024-09-12T00:52:56.974099+0000","last_peered":"2024-09-12T00:52:56.974099+0000","last_clean":"2024-09-12T00:52:56.974099+0000","last_became_active":"2024-09-12T00:50:00.236957+0000","last_became_peered":"2024-09-12T00:50:00.236957+0000","last_unstale":"2024-09-12T00:52:56.974099+0000","last_undegraded":"2024-09-12T00:52:56.974099+0000","last_fullsized":"2024-09-12T00:52:56.974099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:35.317876+0000","last_clean_scrub_stamp":"2024-09-12T00:46:35.317876+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.690552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.844886+0000","last_change":"2024-09-12T00:51:09.001631+0000","last_active":"2024-09-12T00:52:54.844886+0000","last_peered":"2024-09-12T00:52:54.844886+0000","last_clean":"2024-09-12T00:52:54.844886+0000","last_became_active":"2024-09-12T00:51:09.001255+0000","last_became_peered":"2024-09-12T00:51:09.001255+0000","last_unstale":"2024-09-12T00:52:54.844886+0000","last_undegraded":"2024-09-12T00:52:54.844886+0000","last_fullsized":"2024-09-12T00:52:54.844886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:33.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.883842+0000","last_change":"2024-09-12T00:51:11.013216+0000","last_active":"2024-09-12T00:52:54.883842+0000","last_peered":"2024-09-12T00:52:54.883842+0000","last_clean":"2024-09-12T00:52:54.883842+0000","last_became_active":"2024-09-12T00:51:11.012883+0000","last_became_peered":"2024-09-12T00:51:11.012883+0000","last_unstale":"2024-09-12T00:52:54.883842+0000","last_undegraded":"2024-09-12T00:52:54.883842+0000","last_fullsized":"2024-09-12T00:52:54.883842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841768+0000","last_change":"2024-09-12T00:51:09.003440+0000","last_active":"2024-09-12T00:52:54.841768+0000","last_peered":"2024-09-12T00:52:54.841768+0000","last_clean":"2024-09-12T00:52:54.841768+0000","last_became_active":"2024-09-12T00:51:09.003109+0000","last_became_peered":"2024-09-12T00:51:09.003109+0000","last_unstale":"2024-09-12T00:52:54.841768+0000","last_undegraded":"2024-09-12T00:52:54.841768+0000","last_fullsized":"2024-09-12T00:52:54.841768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.910432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.874307+0000","last_change":"2024-09-12T00:51:11.018701+0000","last_active":"2024-09-12T00:52:54.874307+0000","last_peered":"2024-09-12T00:52:54.874307+0000","last_clean":"2024-09-12T00:52:54.874307+0000","last_became_active":"2024-09-12T00:51:11.017866+0000","last_became_peered":"2024-09-12T00:51:11.017866+0000","last_unstale":"2024-09-12T00:52:54.874307+0000","last_undegraded":"2024-09-12T00:52:54.874307+0000","last_fullsized":"2024-09-12T00:52:54.874307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:17.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:09.225516+0000","last_change":"2024-09-12T00:51:09.222565+0000","last_active":"2024-09-12T00:53:09.225516+0000","last_peered":"2024-09-12T00:53:09.225516+0000","last_clean":"2024-09-12T00:53:09.225516+0000","last_became_active":"2024-09-12T00:51:09.222185+0000","last_became_peered":"2024-09-12T00:51:09.222185+0000","last_unstale":"2024-09-12T00:53:09.225516+0000","last_undegraded":"2024-09-12T00:53:09.225516+0000","last_fullsized":"2024-09-12T00:53:09.225516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:24.710879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.871701+0000","last_change":"2024-09-12T00:51:22.068072+0000","last_active":"2024-09-12T00:52:54.871701+0000","last_peered":"2024-09-12T00:52:54.871701+0000","last_clean":"2024-09-12T00:52:54.871701+0000","last_became_active":"2024-09-12T00:51:22.067740+0000","last_became_peered":"2024-09-12T00:51:22.067740+0000","last_unstale":"2024-09-12T00:52:54.871701+0000","last_undegraded":"2024-09-12T00:52:54.871701+0000","last_fullsized":"2024-09-12T00:52:54.871701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850494+0000","last_change":"2024-09-12T00:52:22.594327+0000","last_active":"2024-09-12T00:52:54.850494+0000","last_peered":"2024-09-12T00:52:54.850494+0000","last_clean":"2024-09-12T00:52:54.850494+0000","last_became_active":"2024-09-12T00:52:22.593876+0000","last_became_peered":"2024-09-12T00:52:22.593876+0000","last_unstale":"2024-09-12T00:52:54.850494+0000","last_undegraded":"2024-09-12T00:52:54.850494+0000","last_fullsized":"2024-09-12T00:52:54.850494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:17.961428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.876981+0000","last_change":"2024-09-12T00:51:11.020418+0000","last_active":"2024-09-12T00:52:54.876981+0000","last_peered":"2024-09-12T00:52:54.876981+0000","last_clean":"2024-09-12T00:52:54.876981+0000","last_became_active":"2024-09-12T00:51:11.020092+0000","last_became_peered":"2024-09-12T00:51:11.020092+0000","last_unstale":"2024-09-12T00:52:54.876981+0000","last_undegraded":"2024-09-12T00:52:54.876981+0000","last_fullsized":"2024-09-12T00:52:54.876981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.841926+0000","last_change":"2024-09-12T00:51:09.222562+0000","last_active":"2024-09-12T00:52:54.841926+0000","last_peered":"2024-09-12T00:52:54.841926+0000","last_clean":"2024-09-12T00:52:54.841926+0000","last_became_active":"2024-09-12T00:51:09.222241+0000","last_became_peered":"2024-09-12T00:51:09.222241+0000","last_unstale":"2024-09-12T00:52:54.841926+0000","last_undegraded":"2024-09-12T00:52:54.841926+0000","last_fullsized":"2024-09-12T00:52:54.841926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:48.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875489+0000","last_change":"2024-09-12T00:51:11.024882+0000","last_active":"2024-09-12T00:52:54.875489+0000","last_peered":"2024-09-12T00:52:54.875489+0000","last_clean":"2024-09-12T00:52:54.875489+0000","last_became_active":"2024-09-12T00:51:11.024467+0000","last_became_peered":"2024-09-12T00:51:11.024467+0000","last_unstale":"2024-09-12T00:52:54.875489+0000","last_undegraded":"2024-09-12T00:52:54.875489+0000","last_fullsized":"2024-09-12T00:52:54.875489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:09.223972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848626+0000","last_change":"2024-09-12T00:51:09.224385+0000","last_active":"2024-09-12T00:52:54.848626+0000","last_peered":"2024-09-12T00:52:54.848626+0000","last_clean":"2024-09-12T00:52:54.848626+0000","last_became_active":"2024-09-12T00:51:09.223874+0000","last_became_peered":"2024-09-12T00:51:09.223874+0000","last_unstale":"2024-09-12T00:52:54.848626+0000","last_undegraded":"2024-09-12T00:52:54.848626+0000","last_fullsized":"2024-09-12T00:52:54.848626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:41.714396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884371+0000","last_change":"2024-09-12T00:51:11.014372+0000","last_active":"2024-09-12T00:52:54.884371+0000","last_peered":"2024-09-12T00:52:54.884371+0000","last_clean":"2024-09-12T00:52:54.884371+0000","last_became_active":"2024-09-12T00:51:11.014043+0000","last_became_peered":"2024-09-12T00:51:11.014043+0000","last_unstale":"2024-09-12T00:52:54.884371+0000","last_undegraded":"2024-09-12T00:52:54.884371+0000","last_fullsized":"2024-09-12T00:52:54.884371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:54.560908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'100","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:53:06.777483+0000","last_change":"2024-09-12T00:51:09.001897+0000","last_active":"2024-09-12T00:53:06.777483+0000","last_peered":"2024-09-12T00:53:06.777483+0000","last_clean":"2024-09-12T00:53:06.777483+0000","last_became_active":"2024-09-12T00:51:09.001456+0000","last_became_peered":"2024-09-12T00:51:09.001456+0000","last_unstale":"2024-09-12T00:53:06.777483+0000","last_undegraded":"2024-09-12T00:53:06.777483+0000","last_fullsized":"2024-09-12T00:53:06.777483+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:13.198162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":185,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.873351+0000","last_change":"2024-09-12T00:51:11.020498+0000","last_active":"2024-09-12T00:52:54.873351+0000","last_peered":"2024-09-12T00:52:54.873351+0000","last_clean":"2024-09-12T00:52:54.873351+0000","last_became_active":"2024-09-12T00:51:11.020198+0000","last_became_peered":"2024-09-12T00:51:11.020198+0000","last_unstale":"2024-09-12T00:52:54.873351+0000","last_undegraded":"2024-09-12T00:52:54.873351+0000","last_fullsized":"2024-09-12T00:52:54.873351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848558+0000","last_change":"2024-09-12T00:51:08.997875+0000","last_active":"2024-09-12T00:52:54.848558+0000","last_peered":"2024-09-12T00:52:54.848558+0000","last_clean":"2024-09-12T00:52:54.848558+0000","last_became_active":"2024-09-12T00:51:08.997542+0000","last_became_peered":"2024-09-12T00:51:08.997542+0000","last_unstale":"2024-09-12T00:52:54.848558+0000","last_undegraded":"2024-09-12T00:52:54.848558+0000","last_fullsized":"2024-09-12T00:52:54.848558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:45.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.890212+0000","last_change":"2024-09-12T00:51:11.022237+0000","last_active":"2024-09-12T00:52:54.890212+0000","last_peered":"2024-09-12T00:52:54.890212+0000","last_clean":"2024-09-12T00:52:54.890212+0000","last_became_active":"2024-09-12T00:51:11.019998+0000","last_became_peered":"2024-09-12T00:51:11.019998+0000","last_unstale":"2024-09-12T00:52:54.890212+0000","last_undegraded":"2024-09-12T00:52:54.890212+0000","last_fullsized":"2024-09-12T00:52:54.890212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:45.018187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.838291+0000","last_change":"2024-09-12T00:51:09.222599+0000","last_active":"2024-09-12T00:52:54.838291+0000","last_peered":"2024-09-12T00:52:54.838291+0000","last_clean":"2024-09-12T00:52:54.838291+0000","last_became_active":"2024-09-12T00:51:09.222279+0000","last_became_peered":"2024-09-12T00:51:09.222279+0000","last_unstale":"2024-09-12T00:52:54.838291+0000","last_undegraded":"2024-09-12T00:52:54.838291+0000","last_fullsized":"2024-09-12T00:52:54.838291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:27.064854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.875091+0000","last_change":"2024-09-12T00:51:11.026109+0000","last_active":"2024-09-12T00:52:54.875091+0000","last_peered":"2024-09-12T00:52:54.875091+0000","last_clean":"2024-09-12T00:52:54.875091+0000","last_became_active":"2024-09-12T00:51:11.025745+0000","last_became_peered":"2024-09-12T00:51:11.025745+0000","last_unstale":"2024-09-12T00:52:54.875091+0000","last_undegraded":"2024-09-12T00:52:54.875091+0000","last_fullsized":"2024-09-12T00:52:54.875091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.770745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839819+0000","last_change":"2024-09-12T00:51:09.002226+0000","last_active":"2024-09-12T00:52:54.839819+0000","last_peered":"2024-09-12T00:52:54.839819+0000","last_clean":"2024-09-12T00:52:54.839819+0000","last_became_active":"2024-09-12T00:51:09.001881+0000","last_became_peered":"2024-09-12T00:51:09.001881+0000","last_unstale":"2024-09-12T00:52:54.839819+0000","last_undegraded":"2024-09-12T00:52:54.839819+0000","last_fullsized":"2024-09-12T00:52:54.839819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:24.781979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.878537+0000","last_change":"2024-09-12T00:51:11.025765+0000","last_active":"2024-09-12T00:52:54.878537+0000","last_peered":"2024-09-12T00:52:54.878537+0000","last_clean":"2024-09-12T00:52:54.878537+0000","last_became_active":"2024-09-12T00:51:11.025380+0000","last_became_peered":"2024-09-12T00:51:11.025380+0000","last_unstale":"2024-09-12T00:52:54.878537+0000","last_undegraded":"2024-09-12T00:52:54.878537+0000","last_fullsized":"2024-09-12T00:52:54.878537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.411309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.061886+0000","last_change":"2024-09-12T00:51:09.005940+0000","last_active":"2024-09-12T00:52:56.061886+0000","last_peered":"2024-09-12T00:52:56.061886+0000","last_clean":"2024-09-12T00:52:56.061886+0000","last_became_active":"2024-09-12T00:51:09.004843+0000","last_became_peered":"2024-09-12T00:51:09.004843+0000","last_unstale":"2024-09-12T00:52:56.061886+0000","last_undegraded":"2024-09-12T00:52:56.061886+0000","last_fullsized":"2024-09-12T00:52:56.061886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.170006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.884443+0000","last_change":"2024-09-12T00:51:11.015250+0000","last_active":"2024-09-12T00:52:54.884443+0000","last_peered":"2024-09-12T00:52:54.884443+0000","last_clean":"2024-09-12T00:52:54.884443+0000","last_became_active":"2024-09-12T00:51:11.014962+0000","last_became_peered":"2024-09-12T00:51:11.014962+0000","last_unstale":"2024-09-12T00:52:54.884443+0000","last_undegraded":"2024-09-12T00:52:54.884443+0000","last_fullsized":"2024-09-12T00:52:54.884443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:08.284686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.850626+0000","last_change":"2024-09-12T00:51:22.071215+0000","last_active":"2024-09-12T00:52:54.850626+0000","last_peered":"2024-09-12T00:52:54.850626+0000","last_clean":"2024-09-12T00:52:54.850626+0000","last_became_active":"2024-09-12T00:51:22.067457+0000","last_became_peered":"2024-09-12T00:51:22.067457+0000","last_unstale":"2024-09-12T00:52:54.850626+0000","last_undegraded":"2024-09-12T00:52:54.850626+0000","last_fullsized":"2024-09-12T00:52:54.850626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.327804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880746+0000","last_change":"2024-09-12T00:51:11.026842+0000","last_active":"2024-09-12T00:52:54.880746+0000","last_peered":"2024-09-12T00:52:54.880746+0000","last_clean":"2024-09-12T00:52:54.880746+0000","last_became_active":"2024-09-12T00:51:11.026492+0000","last_became_peered":"2024-09-12T00:51:11.026492+0000","last_unstale":"2024-09-12T00:52:54.880746+0000","last_undegraded":"2024-09-12T00:52:54.880746+0000","last_fullsized":"2024-09-12T00:52:54.880746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:48.510745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.889345+0000","last_change":"2024-09-12T00:51:22.180241+0000","last_active":"2024-09-12T00:52:54.889345+0000","last_peered":"2024-09-12T00:52:54.889345+0000","last_clean":"2024-09-12T00:52:54.889345+0000","last_became_active":"2024-09-12T00:51:22.179835+0000","last_became_peered":"2024-09-12T00:51:22.179835+0000","last_unstale":"2024-09-12T00:52:54.889345+0000","last_undegraded":"2024-09-12T00:52:54.889345+0000","last_fullsized":"2024-09-12T00:52:54.889345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.847896+0000","last_change":"2024-09-12T00:51:09.007092+0000","last_active":"2024-09-12T00:52:54.847896+0000","last_peered":"2024-09-12T00:52:54.847896+0000","last_clean":"2024-09-12T00:52:54.847896+0000","last_became_active":"2024-09-12T00:51:09.004026+0000","last_became_peered":"2024-09-12T00:51:09.004026+0000","last_unstale":"2024-09-12T00:52:54.847896+0000","last_undegraded":"2024-09-12T00:52:54.847896+0000","last_fullsized":"2024-09-12T00:52:54.847896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:34.671274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888948+0000","last_change":"2024-09-12T00:51:11.019347+0000","last_active":"2024-09-12T00:52:54.888948+0000","last_peered":"2024-09-12T00:52:54.888948+0000","last_clean":"2024-09-12T00:52:54.888948+0000","last_became_active":"2024-09-12T00:51:11.018908+0000","last_became_peered":"2024-09-12T00:51:11.018908+0000","last_unstale":"2024-09-12T00:52:54.888948+0000","last_undegraded":"2024-09-12T00:52:54.888948+0000","last_fullsized":"2024-09-12T00:52:54.888948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.510231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.848504+0000","last_change":"2024-09-12T00:51:09.007979+0000","last_active":"2024-09-12T00:52:54.848504+0000","last_peered":"2024-09-12T00:52:54.848504+0000","last_clean":"2024-09-12T00:52:54.848504+0000","last_became_active":"2024-09-12T00:51:09.007563+0000","last_became_peered":"2024-09-12T00:51:09.007563+0000","last_unstale":"2024-09-12T00:52:54.848504+0000","last_undegraded":"2024-09-12T00:52:54.848504+0000","last_fullsized":"2024-09-12T00:52:54.848504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:55.502731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.888796+0000","last_change":"2024-09-12T00:51:11.021905+0000","last_active":"2024-09-12T00:52:54.888796+0000","last_peered":"2024-09-12T00:52:54.888796+0000","last_clean":"2024-09-12T00:52:54.888796+0000","last_became_active":"2024-09-12T00:51:11.021593+0000","last_became_peered":"2024-09-12T00:51:11.021593+0000","last_unstale":"2024-09-12T00:52:54.888796+0000","last_undegraded":"2024-09-12T00:52:54.888796+0000","last_fullsized":"2024-09-12T00:52:54.888796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.773862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.839949+0000","last_change":"2024-09-12T00:51:09.222612+0000","last_active":"2024-09-12T00:52:54.839949+0000","last_peered":"2024-09-12T00:52:54.839949+0000","last_clean":"2024-09-12T00:52:54.839949+0000","last_became_active":"2024-09-12T00:51:09.222254+0000","last_became_peered":"2024-09-12T00:51:09.222254+0000","last_unstale":"2024-09-12T00:52:54.839949+0000","last_undegraded":"2024-09-12T00:52:54.839949+0000","last_fullsized":"2024-09-12T00:52:54.839949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.342119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.880528+0000","last_change":"2024-09-12T00:51:11.024784+0000","last_active":"2024-09-12T00:52:54.880528+0000","last_peered":"2024-09-12T00:52:54.880528+0000","last_clean":"2024-09-12T00:52:54.880528+0000","last_became_active":"2024-09-12T00:51:11.024484+0000","last_became_peered":"2024-09-12T00:51:11.024484+0000","last_unstale":"2024-09-12T00:52:54.880528+0000","last_undegraded":"2024-09-12T00:52:54.880528+0000","last_fullsized":"2024-09-12T00:52:54.880528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:09.995132+0000","last_clean_scrub_stamp":"2024-09-12T00:51:09.995132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:23.686488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.842345+0000","last_change":"2024-09-12T00:51:09.005123+0000","last_active":"2024-09-12T00:52:54.842345+0000","last_peered":"2024-09-12T00:52:54.842345+0000","last_clean":"2024-09-12T00:52:54.842345+0000","last_became_active":"2024-09-12T00:51:09.004802+0000","last_became_peered":"2024-09-12T00:51:09.004802+0000","last_unstale":"2024-09-12T00:52:54.842345+0000","last_undegraded":"2024-09-12T00:52:54.842345+0000","last_fullsized":"2024-09-12T00:52:54.842345+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:07.981802+0000","last_clean_scrub_stamp":"2024-09-12T00:51:07.981802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.521654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797091,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1040,"num_read_kb":737,"num_write":423,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2391273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612644,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":454100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841577,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29068,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716084,"statfs":{"total":95995035648,"available":95965270016,"internally_reserved":0,"allocated":1970176,"data_stored":1444133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40820,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704332,"statfs":{"total":95995035648,"available":95953235968,"internally_reserved":0,"allocated":1347584,"data_stored":847669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201331,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716816,"statfs":{"total":95995035648,"available":95966019584,"internally_reserved":0,"allocated":1343488,"data_stored":847472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430264,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1048435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":937984,"data_stored":453725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33148,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712004,"statfs":{"total":95995035648,"available":95961092096,"internally_reserved":0,"allocated":1888256,"data_stored":1375424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":455783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28780,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716372,"statfs":{"total":95995035648,"available":95965564928,"internally_reserved":0,"allocated":1675264,"data_stored":1175367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":525280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":522911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":454996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":71762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":400130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:53:12.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:53:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:12.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:12 smithi002 ceph-mon[31210]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T00:53:12.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:12 smithi002 ceph-mon[31210]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:12.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 -- 172.21.15.2:0/2438042345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac103780 msgr2=0x7fb2ac107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:12.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 --2- 172.21.15.2:0/2438042345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac103780 0x7fb2ac107bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009930 tx=0x7fb2a002a420 comp rx=0 tx=0).stop 2024-09-12T00:53:12.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 -- 172.21.15.2:0/2438042345 shutdown_connections 2024-09-12T00:53:12.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 --2- 172.21.15.2:0/2438042345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2ac108300 0x7fb2ac10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:12.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 --2- 172.21.15.2:0/2438042345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac103780 0x7fb2ac107bc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:12.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 --2- 172.21.15.2:0/2438042345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac102dd0 0x7fb2ac1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 -- 172.21.15.2:0/2438042345 >> 172.21.15.2:0/2438042345 conn(0x7fb2ac0fc7d0 msgr2=0x7fb2ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 -- 172.21.15.2:0/2438042345 shutdown_connections 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 -- 172.21.15.2:0/2438042345 wait complete. 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 Processor -- start 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.839+0000 7fb2b2598640 1 -- start start 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b2598640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac102dd0 0x7fb2ac1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b2598640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2ac103780 0x7fb2ac198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b2598640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac108300 0x7fb2ac19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b2598640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac1120d0 con 0x7fb2ac108300 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b2598640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac111f50 con 0x7fb2ac103780 2024-09-12T00:53:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b2598640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac112250 con 0x7fb2ac102dd0 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b0b35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac108300 0x7fb2ac19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b0b35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac108300 0x7fb2ac19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51004/0 (socket says 172.21.15.2:51004) 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b0b35640 1 -- 172.21.15.2:0/756007424 learned_addr learned my addr 172.21.15.2:0/756007424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2abfff640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac102dd0 0x7fb2ac1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2ab7fe640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2ac103780 0x7fb2ac198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b0b35640 1 -- 172.21.15.2:0/756007424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac102dd0 msgr2=0x7fb2ac1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b0b35640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac102dd0 0x7fb2ac1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b0b35640 1 -- 172.21.15.2:0/756007424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2ac103780 msgr2=0x7fb2ac198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b0b35640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2ac103780 0x7fb2ac198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.840+0000 7fb2b0b35640 1 -- 172.21.15.2:0/756007424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac19d590 con 0x7fb2ac108300 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.841+0000 7fb2b0b35640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac108300 0x7fb2ac19ceb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400cce0 tx=0x7fb2a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.841+0000 7fb2a97fa640 1 -- 172.21.15.2:0/756007424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400f450 con 0x7fb2ac108300 2024-09-12T00:53:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.841+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac19d880 con 0x7fb2ac108300 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.841+0000 7fb2a97fa640 1 -- 172.21.15.2:0/756007424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2a400fad0 con 0x7fb2ac108300 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.841+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac1a5160 con 0x7fb2ac108300 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.841+0000 7fb2a97fa640 1 -- 172.21.15.2:0/756007424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4018b00 con 0x7fb2ac108300 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.842+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ac1031b0 con 0x7fb2ac108300 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.843+0000 7fb2a97fa640 1 -- 172.21.15.2:0/756007424 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fb2a400fc80 con 0x7fb2ac108300 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.844+0000 7fb2a97fa640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb2940a2e10 0x7fb2940a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.844+0000 7fb2abfff640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb2940a2e10 0x7fb2940a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.844+0000 7fb2a97fa640 1 -- 172.21.15.2:0/756007424 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb2a40cfcd0 con 0x7fb2ac108300 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.844+0000 7fb2abfff640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb2940a2e10 0x7fb2940a52d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009990 tx=0x7fb29c009110 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:12.848+0000 7fb2a97fa640 1 -- 172.21.15.2:0/756007424 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2a4014030 con 0x7fb2ac108300 2024-09-12T00:53:12.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:12 smithi071 ceph-mon[35276]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T00:53:12.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:12 smithi071 ceph-mon[35276]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:12 smithi167 ceph-mon[35234]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T00:53:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:12 smithi167 ceph-mon[35234]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T00:53:13.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.059+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2ac10a290 con 0x7fb2ac108300 2024-09-12T00:53:13.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.059+0000 7fb2a97fa640 1 -- 172.21.15.2:0/756007424 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fb2a409c650 con 0x7fb2ac108300 2024-09-12T00:53:13.058 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:13.058 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:53:13.059 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:53:13.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.061+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb2940a2e10 msgr2=0x7fb2940a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:13.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.061+0000 7fb2b2598640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb2940a2e10 0x7fb2940a52d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009990 tx=0x7fb29c009110 comp rx=0 tx=0).stop 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.061+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac108300 msgr2=0x7fb2ac19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.061+0000 7fb2b2598640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac108300 0x7fb2ac19ceb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400cce0 tx=0x7fb2a400a620 comp rx=0 tx=0).stop 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.062+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 shutdown_connections 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.062+0000 7fb2b2598640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb2940a2e10 0x7fb2940a52d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.062+0000 7fb2b2598640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ac108300 0x7fb2ac19ceb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.062+0000 7fb2b2598640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2ac103780 0x7fb2ac198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.062+0000 7fb2b2598640 1 --2- 172.21.15.2:0/756007424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac102dd0 0x7fb2ac1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.062+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 >> 172.21.15.2:0/756007424 conn(0x7fb2ac0fc7d0 msgr2=0x7fb2ac105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.062+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 shutdown_connections 2024-09-12T00:53:13.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:13.062+0000 7fb2b2598640 1 -- 172.21.15.2:0/756007424 wait complete. 2024-09-12T00:53:13.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:53:13.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:13 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/756007424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:13.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:13 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/756007424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:14.024 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:14.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:13 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/756007424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 -- 172.21.15.2:0/557842597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 msgr2=0x7fad7c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 --2- 172.21.15.2:0/557842597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 0x7fad7c1021c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009900 tx=0x7fad6c02a410 comp rx=0 tx=0).stop 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 -- 172.21.15.2:0/557842597 shutdown_connections 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 --2- 172.21.15.2:0/557842597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c106f10 0x7fad7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 --2- 172.21.15.2:0/557842597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7c102790 0x7fad7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 --2- 172.21.15.2:0/557842597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 0x7fad7c1021c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 -- 172.21.15.2:0/557842597 >> 172.21.15.2:0/557842597 conn(0x7fad7c0fd8c0 msgr2=0x7fad7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 -- 172.21.15.2:0/557842597 shutdown_connections 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 -- 172.21.15.2:0/557842597 wait complete. 2024-09-12T00:53:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.480+0000 7fad83240640 1 Processor -- start 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad83240640 1 -- start start 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad83240640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 0x7fad7c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad83240640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7c102790 0x7fad7c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad83240640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c106f10 0x7fad7c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad83240640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c111f70 con 0x7fad7c101de0 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad83240640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c111df0 con 0x7fad7c102790 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad83240640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c1120f0 con 0x7fad7c106f10 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad80fdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 0x7fad7c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad80fdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 0x7fad7c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51022/0 (socket says 172.21.15.2:51022) 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad80fdc640 1 -- 172.21.15.2:0/3713189142 learned_addr learned my addr 172.21.15.2:0/3713189142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad7bfff640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7c102790 0x7fad7c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:14.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad817dd640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c106f10 0x7fad7c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad80fdc640 1 -- 172.21.15.2:0/3713189142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c106f10 msgr2=0x7fad7c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad80fdc640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c106f10 0x7fad7c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad80fdc640 1 -- 172.21.15.2:0/3713189142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7c102790 msgr2=0x7fad7c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad80fdc640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7c102790 0x7fad7c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad80fdc640 1 -- 172.21.15.2:0/3713189142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c1a68f0 con 0x7fad7c101de0 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.481+0000 7fad7bfff640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7c102790 0x7fad7c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.482+0000 7fad80fdc640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 0x7fad7c0744f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006010 tx=0x7fad6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.482+0000 7fad79ffb640 1 -- 172.21.15.2:0/3713189142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c03f030 con 0x7fad7c101de0 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.482+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c1a6b80 con 0x7fad7c101de0 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.482+0000 7fad79ffb640 1 -- 172.21.15.2:0/3713189142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad6c003ce0 con 0x7fad7c101de0 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.482+0000 7fad79ffb640 1 -- 172.21.15.2:0/3713189142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c035070 con 0x7fad7c101de0 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.482+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c1a7060 con 0x7fad7c101de0 2024-09-12T00:53:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.483+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c1021c0 con 0x7fad7c101de0 2024-09-12T00:53:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.484+0000 7fad79ffb640 1 -- 172.21.15.2:0/3713189142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fad6c042030 con 0x7fad7c101de0 2024-09-12T00:53:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.485+0000 7fad79ffb640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fad640a2e10 0x7fad640a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.485+0000 7fad79ffb640 1 -- 172.21.15.2:0/3713189142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fad6c0efbb0 con 0x7fad7c101de0 2024-09-12T00:53:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.485+0000 7fad7bfff640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fad640a2e10 0x7fad640a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.485+0000 7fad7bfff640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fad640a2e10 0x7fad640a52d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad7c075f80 tx=0x7fad70005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.489+0000 7fad79ffb640 1 -- 172.21.15.2:0/3713189142 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad6c0bc070 con 0x7fad7c101de0 2024-09-12T00:53:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.704+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad7c109b60 con 0x7fad7c101de0 2024-09-12T00:53:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.705+0000 7fad79ffb640 1 -- 172.21.15.2:0/3713189142 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fad6c0c0370 con 0x7fad7c101de0 2024-09-12T00:53:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:14.704 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:53:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fad640a2e10 msgr2=0x7fad640a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fad640a2e10 0x7fad640a52d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad7c075f80 tx=0x7fad70005f90 comp rx=0 tx=0).stop 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 msgr2=0x7fad7c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 0x7fad7c0744f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006010 tx=0x7fad6c0042f0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 shutdown_connections 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fad640a2e10 0x7fad640a52d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c106f10 0x7fad7c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7c102790 0x7fad7c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 --2- 172.21.15.2:0/3713189142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad7c101de0 0x7fad7c0744f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 >> 172.21.15.2:0/3713189142 conn(0x7fad7c0fd8c0 msgr2=0x7fad7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 shutdown_connections 2024-09-12T00:53:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:14.707+0000 7fad83240640 1 -- 172.21.15.2:0/3713189142 wait complete. 2024-09-12T00:53:14.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:14 smithi002 ceph-mon[31210]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-12T00:53:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:14 smithi167 ceph-mon[35234]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-12T00:53:15.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:14 smithi071 ceph-mon[35276]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-12T00:53:15.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:53:15.687 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:15.955 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:15 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3713189142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:16.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:15 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3713189142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:16.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:15 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3713189142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 -- 172.21.15.2:0/3120893490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8101de0 msgr2=0x7f94e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3120893490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8101de0 0x7f94e81021c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009900 tx=0x7f94e402a410 comp rx=0 tx=0).stop 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 -- 172.21.15.2:0/3120893490 shutdown_connections 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3120893490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8106f10 0x7f94e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3120893490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e8102790 0x7f94e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3120893490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8101de0 0x7f94e81021c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 -- 172.21.15.2:0/3120893490 >> 172.21.15.2:0/3120893490 conn(0x7f94e80fd8c0 msgr2=0x7f94e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 -- 172.21.15.2:0/3120893490 shutdown_connections 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.180+0000 7f94f04ae640 1 -- 172.21.15.2:0/3120893490 wait complete. 2024-09-12T00:53:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94f04ae640 1 Processor -- start 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94f04ae640 1 -- start start 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94f04ae640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8101de0 0x7f94e819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94f04ae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e8102790 0x7f94e819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94f04ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8106f10 0x7f94e819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94f04ae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8111f70 con 0x7f94e8106f10 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94f04ae640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8111df0 con 0x7f94e8101de0 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94f04ae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81120f0 con 0x7f94e8102790 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94eea4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8106f10 0x7f94e819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94eea4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8106f10 0x7f94e819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41014/0 (socket says 172.21.15.2:41014) 2024-09-12T00:53:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94eea4b640 1 -- 172.21.15.2:0/3680254141 learned_addr learned my addr 172.21.15.2:0/3680254141 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94ee24a640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8101de0 0x7f94e819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.181+0000 7f94eda49640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e8102790 0x7f94e819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94eea4b640 1 -- 172.21.15.2:0/3680254141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e8102790 msgr2=0x7f94e819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94eea4b640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e8102790 0x7f94e819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94eea4b640 1 -- 172.21.15.2:0/3680254141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8101de0 msgr2=0x7f94e819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94eea4b640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8101de0 0x7f94e819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94eea4b640 1 -- 172.21.15.2:0/3680254141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e819f5a0 con 0x7f94e8106f10 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94eea4b640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8106f10 0x7f94e819eec0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94e000cce0 tx=0x7f94e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94df7fe640 1 -- 172.21.15.2:0/3680254141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e000f450 con 0x7f94e8106f10 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94df7fe640 1 -- 172.21.15.2:0/3680254141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e000fad0 con 0x7f94e8106f10 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e819f890 con 0x7f94e8106f10 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94df7fe640 1 -- 172.21.15.2:0/3680254141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0018c10 con 0x7f94e8106f10 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.182+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e81a7170 con 0x7f94e8106f10 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.183+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e81021c0 con 0x7f94e8106f10 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.184+0000 7f94df7fe640 1 -- 172.21.15.2:0/3680254141 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f94e000f5f0 con 0x7f94e8106f10 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.185+0000 7f94df7fe640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f94d40a2e90 0x7f94d40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.185+0000 7f94ee24a640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f94d40a2e90 0x7f94d40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.185+0000 7f94df7fe640 1 -- 172.21.15.2:0/3680254141 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f94e00cfd80 con 0x7f94e8106f10 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.186+0000 7f94ee24a640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f94d40a2e90 0x7f94d40a5350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94e4000c00 tx=0x7f94e40058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.189+0000 7f94df7fe640 1 -- 172.21.15.2:0/3680254141 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94e0014030 con 0x7f94e8106f10 2024-09-12T00:53:16.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.366+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94e81a74b0 con 0x7f94e8106f10 2024-09-12T00:53:16.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.367+0000 7f94df7fe640 1 -- 172.21.15.2:0/3680254141 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+23181 (secure 0 0 0) 0x7f94e009c6a0 con 0x7f94e8106f10 2024-09-12T00:53:16.366 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:16.367 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":84,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T00:52:54.829249+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/761407779":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3529963366":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/838113285":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/17217547":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6800/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/780422410":"2024-09-13T00:52:54.829221+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:53:16.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.369+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f94d40a2e90 msgr2=0x7f94d40a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:16.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.369+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f94d40a2e90 0x7f94d40a5350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94e4000c00 tx=0x7f94e40058d0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.369+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8106f10 msgr2=0x7f94e819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:16.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.369+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8106f10 0x7f94e819eec0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94e000cce0 tx=0x7f94e000a620 comp rx=0 tx=0).stop 2024-09-12T00:53:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.369+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 shutdown_connections 2024-09-12T00:53:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.369+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f94d40a2e90 0x7f94d40a5350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.369+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8106f10 0x7f94e819eec0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.369+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e8102790 0x7f94e819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.370+0000 7f94f04ae640 1 --2- 172.21.15.2:0/3680254141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8101de0 0x7f94e819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.370+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 >> 172.21.15.2:0/3680254141 conn(0x7f94e80fd8c0 msgr2=0x7f94e80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.370+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 shutdown_connections 2024-09-12T00:53:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:16.370+0000 7f94f04ae640 1 -- 172.21.15.2:0/3680254141 wait complete. 2024-09-12T00:53:16.945 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:16 smithi002 ceph-mon[31210]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-12T00:53:16.945 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:16 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:53:16.945 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:16 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3680254141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:53:16.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-12T00:53:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:16 smithi167 ceph-mon[35234]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-12T00:53:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:16 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:53:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:16 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3680254141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:53:17.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:16 smithi071 ceph-mon[35276]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-12T00:53:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:16 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:53:17.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:16 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3680254141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:53:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:18.287 INFO:teuthology.orchestra.run.smithi002.stdout:{"run_dir":"/var/run/ceph"} 2024-09-12T00:53:18.288 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-12T00:53:18.288 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-12T00:53:18.288 DEBUG:tasks.quiescer:Yielding 2024-09-12T00:53:18.289 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:53:18.304 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T00:53:18.305 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:53:18.305 INFO:tasks.workunit:timeout=3h 2024-09-12T00:53:18.305 INFO:tasks.workunit:cleanup=True 2024-09-12T00:53:18.306 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:53:18.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:53:18.324 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T00:53:18.324 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T00:53:18.324 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T00:53:18.324 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:53:18.324 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T00:53:18.325 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-12 00:51:29.491857874 +0000 2024-09-12T00:53:18.325 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-12 00:51:29.491857874 +0000 2024-09-12T00:53:18.325 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-12 00:52:54.847923969 +0000 2024-09-12T00:53:18.325 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-12 00:51:29.491857874 +0000 2024-09-12T00:53:18.325 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:53:18.325 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T00:53:18.399 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T00:53:18.456 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:53:18.572 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:18.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:18 smithi002 ceph-mon[31210]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-12T00:53:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:18 smithi167 ceph-mon[35234]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-12T00:53:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 -- 172.21.15.2:0/2906566958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 msgr2=0x7f0ce8107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 --2- 172.21.15.2:0/2906566958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 0x7f0ce8107b80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009930 tx=0x7f0cd802a420 comp rx=0 tx=0).stop 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 -- 172.21.15.2:0/2906566958 shutdown_connections 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 --2- 172.21.15.2:0/2906566958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce8108290 0x7f0ce810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 --2- 172.21.15.2:0/2906566958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 0x7f0ce8107b80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 --2- 172.21.15.2:0/2906566958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ce8102d90 0x7f0ce8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 -- 172.21.15.2:0/2906566958 >> 172.21.15.2:0/2906566958 conn(0x7f0ce80fc7d0 msgr2=0x7f0ce80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 -- 172.21.15.2:0/2906566958 shutdown_connections 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 -- 172.21.15.2:0/2906566958 wait complete. 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 Processor -- start 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.075+0000 7f0cf0364640 1 -- start start 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0cf0364640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ce8102d90 0x7f0ce81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0cf0364640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 0x7f0ce8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0cf0364640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce8108290 0x7f0ce819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0cf0364640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8112090 con 0x7f0ce8103740 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0cf0364640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8111f10 con 0x7f0ce8108290 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0cf0364640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8112210 con 0x7f0ce8102d90 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0ced8ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 0x7f0ce8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0ced8ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 0x7f0ce8198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41034/0 (socket says 172.21.15.2:41034) 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0ced8ff640 1 -- 172.21.15.2:0/1007962395 learned_addr learned my addr 172.21.15.2:0/1007962395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0cee100640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ce8102d90 0x7f0ce81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0cee901640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce8108290 0x7f0ce819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0ced8ff640 1 -- 172.21.15.2:0/1007962395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ce8102d90 msgr2=0x7f0ce81985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0ced8ff640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ce8102d90 0x7f0ce81985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0ced8ff640 1 -- 172.21.15.2:0/1007962395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce8108290 msgr2=0x7f0ce819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0ced8ff640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce8108290 0x7f0ce819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.076+0000 7f0ced8ff640 1 -- 172.21.15.2:0/1007962395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce819d570 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.077+0000 7f0ced8ff640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 0x7f0ce8198b00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8005940 tx=0x7f0cd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.077+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1007962395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd803f030 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.077+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1007962395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd8003ad0 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.077+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce819d800 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.077+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1007962395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8035070 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.077+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce81a5140 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.078+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce806a7f0 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.079+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1007962395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f0cd8042030 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.080+0000 7f0cdf7fe640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0cd40a2e90 0x7f0cd40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.080+0000 7f0cee100640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0cd40a2e90 0x7f0cd40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.080+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1007962395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f0cd80efc40 con 0x7f0ce8103740 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.080+0000 7f0cee100640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0cd40a2e90 0x7f0cd40a5350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009bd0 tx=0x7f0ce4005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:19.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.084+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1007962395 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cd80bbfe0 con 0x7f0ce8103740 2024-09-12T00:53:19.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:18 smithi071 ceph-mon[35276]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-12T00:53:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.295+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ce8199950 con 0x7f0ce8103740 2024-09-12T00:53:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.296+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1007962395 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f0ce8199950 con 0x7f0ce8103740 2024-09-12T00:53:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:19.295 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:53:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.297+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0cd40a2e90 msgr2=0x7f0cd40a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.297+0000 7f0cf0364640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0cd40a2e90 0x7f0cd40a5350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009bd0 tx=0x7f0ce4005f90 comp rx=0 tx=0).stop 2024-09-12T00:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 msgr2=0x7f0ce8198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 0x7f0ce8198b00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8005940 tx=0x7f0cd8004270 comp rx=0 tx=0).stop 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 shutdown_connections 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0cd40a2e90 0x7f0cd40a5350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce8108290 0x7f0ce819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce8103740 0x7f0ce8198b00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 --2- 172.21.15.2:0/1007962395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ce8102d90 0x7f0ce81985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 >> 172.21.15.2:0/1007962395 conn(0x7f0ce80fc7d0 msgr2=0x7f0ce8105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 shutdown_connections 2024-09-12T00:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:19.298+0000 7f0cf0364640 1 -- 172.21.15.2:0/1007962395 wait complete. 2024-09-12T00:53:19.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T00:51:11.599964+0000', 'modified': '2024-09-12T00:52:55.573499+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24494, 'mds_1': 24487, 'mds_2': 24470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/659790149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 659790149}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 659790149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/3315294973', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 3315294973}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 3315294973}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6837/2094252120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 2094252120}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2094252120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.71:6837/2619227560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 2619227560}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 2619227560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.167:6839/3375026686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 3375026686}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 3375026686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.71:6839/3061730891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3061730891}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3061730891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24494, 'qdb_cluster': [24494, 24487, 24470]} 2024-09-12T00:53:19.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T00:53:19.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T00:53:19.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:19 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1007962395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:20.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:19 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1007962395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:20.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:19 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1007962395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:20.215 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3156619198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8100a80 msgr2=0x7fd0e8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3156619198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8100a80 0x7fd0e8100ee0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009930 tx=0x7fd0d802a420 comp rx=0 tx=0).stop 2024-09-12T00:53:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3156619198 shutdown_connections 2024-09-12T00:53:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3156619198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e8101420 0x7fd0e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3156619198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8100a80 0x7fd0e8100ee0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3156619198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e8106a80 0x7fd0e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3156619198 >> 172.21.15.2:0/3156619198 conn(0x7fd0e80fc7a0 msgr2=0x7fd0e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3156619198 shutdown_connections 2024-09-12T00:53:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.687+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3156619198 wait complete. 2024-09-12T00:53:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0f06aa640 1 Processor -- start 2024-09-12T00:53:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0f06aa640 1 -- start start 2024-09-12T00:53:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0f06aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e8100a80 0x7fd0e8197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0f06aa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e8101420 0x7fd0e81978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0f06aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8106a80 0x7fd0e819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0f06aa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8110ef0 con 0x7fd0e8106a80 2024-09-12T00:53:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0f06aa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8110d70 con 0x7fd0e8101420 2024-09-12T00:53:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0f06aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8111070 con 0x7fd0e8100a80 2024-09-12T00:53:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8106a80 0x7fd0e819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8106a80 0x7fd0e819bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41044/0 (socket says 172.21.15.2:41044) 2024-09-12T00:53:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0eec47640 1 -- 172.21.15.2:0/3903561676 learned_addr learned my addr 172.21.15.2:0/3903561676 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0edc45640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e8101420 0x7fd0e81978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0ee446640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e8100a80 0x7fd0e8197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0eec47640 1 -- 172.21.15.2:0/3903561676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e8100a80 msgr2=0x7fd0e8197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0eec47640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e8100a80 0x7fd0e8197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0eec47640 1 -- 172.21.15.2:0/3903561676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e8101420 msgr2=0x7fd0e81978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0eec47640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e8101420 0x7fd0e81978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0eec47640 1 -- 172.21.15.2:0/3903561676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e819c320 con 0x7fd0e8106a80 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.688+0000 7fd0edc45640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e8101420 0x7fd0e81978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.689+0000 7fd0eec47640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8106a80 0x7fd0e819bc40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0007cb0 tx=0x7fd0e000e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.689+0000 7fd0df7fe640 1 -- 172.21.15.2:0/3903561676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000eb30 con 0x7fd0e8106a80 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.689+0000 7fd0df7fe640 1 -- 172.21.15.2:0/3903561676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e000ecd0 con 0x7fd0e8106a80 2024-09-12T00:53:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.689+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3903561676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e819c610 con 0x7fd0e8106a80 2024-09-12T00:53:20.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.689+0000 7fd0df7fe640 1 -- 172.21.15.2:0/3903561676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0015650 con 0x7fd0e8106a80 2024-09-12T00:53:20.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.689+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3903561676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e806a790 con 0x7fd0e8106a80 2024-09-12T00:53:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.692+0000 7fd0df7fe640 1 -- 172.21.15.2:0/3903561676 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fd0e000a440 con 0x7fd0e8106a80 2024-09-12T00:53:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.692+0000 7fd0f2a83740 1 Processor -- start 2024-09-12T00:53:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.692+0000 7fd0f2a83740 1 -- start start 2024-09-12T00:53:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 0x56051235dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd0d40a2e10 0x7fd0d40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x56051236ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605122c4090 con 0x56051236cfc0 2024-09-12T00:53:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56051226ba70 con 0x56051235e210 2024-09-12T00:53:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5605122c0050 con 0x56051235d8f0 2024-09-12T00:53:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0ee446640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd0d40a2e10 0x7fd0d40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41046/0 (socket says 172.21.15.2:41046) 2024-09-12T00:53:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 -- 172.21.15.2:0/845524331 learned_addr learned my addr 172.21.15.2:0/845524331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0df7fe640 1 -- 172.21.15.2:0/3903561676 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd0e00d1420 con 0x7fd0e8106a80 2024-09-12T00:53:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0edc45640 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 0x56051235dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0edc45640 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x56051236ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 -- 172.21.15.2:0/845524331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 msgr2=0x56051235dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 0x56051235dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 -- 172.21.15.2:0/845524331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 msgr2=0x56051236ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x56051236ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 -- 172.21.15.2:0/845524331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560512278130 con 0x56051236cfc0 2024-09-12T00:53:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0ee446640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd0d40a2e10 0x7fd0d40a52d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009890 tx=0x7fd0e4008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.693+0000 7fd0eec47640 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236f3b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd0e009a070 tx=0x7fd0e000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96995ba5023c52b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0dcff9640 1 -- 172.21.15.2:0/845524331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e009d1e0 con 0x56051236cfc0 2024-09-12T00:53:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0dcff9640 1 -- 172.21.15.2:0/845524331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e009dda0 con 0x56051236cfc0 2024-09-12T00:53:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0dcff9640 1 -- 172.21.15.2:0/845524331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0010130 con 0x56051236cfc0 2024-09-12T00:53:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0f2a83740 1 -- 172.21.15.2:0/845524331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 msgr2=0x56051236f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236f3b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd0e009a070 tx=0x7fd0e000ef40 comp rx=0 tx=0).stop 2024-09-12T00:53:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0f2a83740 1 -- 172.21.15.2:0/845524331 shutdown_connections 2024-09-12T00:53:20.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236f3b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x56051236ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/845524331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 0x56051235dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.694+0000 7fd0f2a83740 1 -- 172.21.15.2:0/845524331 >> 172.21.15.2:0/845524331 conn(0x560512359f60 msgr2=0x56051235a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:20.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 -- 172.21.15.2:0/845524331 shutdown_connections 2024-09-12T00:53:20.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 -- 172.21.15.2:0/845524331 wait complete. 2024-09-12T00:53:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 -- start start 2024-09-12T00:53:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 Processor -- start 2024-09-12T00:53:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 0x56051236c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x560512369c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56051236fb30 con 0x56051236cfc0 2024-09-12T00:53:20.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56051227ef20 con 0x56051235e210 2024-09-12T00:53:20.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56051236fcb0 con 0x56051235d8f0 2024-09-12T00:53:20.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0f2a83740 10 client.0 _ll_register_callbacks cb 0x560512248030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:20.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41056/0 (socket says 172.21.15.2:41056) 2024-09-12T00:53:20.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.695+0000 7fd0eec47640 1 -- 172.21.15.2:0/1703791191 learned_addr learned my addr 172.21.15.2:0/1703791191 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0ee446640 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 0x56051236c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0edc45640 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x560512369c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0eec47640 1 -- 172.21.15.2:0/1703791191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 msgr2=0x56051236c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0eec47640 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 0x56051236c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0eec47640 1 -- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 msgr2=0x560512369c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0eec47640 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x560512369c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0eec47640 1 -- 172.21.15.2:0/1703791191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605120352b0 con 0x56051236cfc0 2024-09-12T00:53:20.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0edc45640 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x560512369c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:20.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0eec47640 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236a190 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00a5de0 tx=0x7fd0e00a6480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf58e15deb07a459 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:20.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:20.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/1703791191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0075620 con 0x56051236cfc0 2024-09-12T00:53:20.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/1703791191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd0e00751b0 con 0x56051236cfc0 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0f2a83740 1 -- 172.21.15.2:0/1703791191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0e009dda0 con 0x56051236cfc0 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/1703791191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0e009d000 con 0x56051236cfc0 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0f2a83740 10 client.15381 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0f2a83740 1 -- 172.21.15.2:0/1703791191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56051237b520 con 0x56051236cfc0 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.696+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/1703791191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e009dda0 con 0x56051236cfc0 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/1703791191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0e0014070 con 0x56051236cfc0 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0f2a83740 10 client.15381 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0f2a83740 10 client.15381 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T00:53:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0f2a83740 20 client.15381 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56051237d610 0x56051237c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0f2a83740 4 client.15381 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0f2a83740 1 -- 172.21.15.2:0/1703791191 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605122d1600 con 0x56051237d610 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0ee446640 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56051237d610 0x56051237c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0ee446640 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56051237d610 0x56051237c870 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6be96cb5a41c03e6 server_cookie=ee22a2be8f4e4cf8 in_seq=0 out_seq=0 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.697+0000 7fd0d1ffb640 10 client.15381 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/1703791191 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605122d1600 con 0x56051237d610 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0d1ffb640 10 client.15381 handle_command_reply: tid=0 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 client.15381 shutdown 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 -- 172.21.15.2:0/1703791191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 msgr2=0x56051236a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236a190 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00a5de0 tx=0x7fd0e00a6480 comp rx=0 tx=0).stop 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 -- 172.21.15.2:0/1703791191 shutdown_connections 2024-09-12T00:53:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56051237d610 0x56051237c870 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x56051236a190 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235e210 0x560512369c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0d1ffb640 0 client.15381 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/1703791191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235d8f0 0x56051236c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 -- 172.21.15.2:0/1703791191 >> 172.21.15.2:0/1703791191 conn(0x560512359f60 msgr2=0x56051235fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 -- 172.21.15.2:0/1703791191 shutdown_connections 2024-09-12T00:53:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.698+0000 7fd0f2a83740 1 -- 172.21.15.2:0/1703791191 wait complete. 2024-09-12T00:53:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.699+0000 7fd0f2a83740 20 client.15381 trim_cache size 0 max 16384 2024-09-12T00:53:20.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.718+0000 7fd0f2a83740 1 Processor -- start 2024-09-12T00:53:20.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.718+0000 7fd0f2a83740 1 -- start start 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 0x56051237cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 0x56051237e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x560512378f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56051237cdc0 con 0x56051236cfc0 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56051237d490 con 0x56051235d8f0 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56051237db60 con 0x56051235e210 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x560512378f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x560512378f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41064/0 (socket says 172.21.15.2:41064) 2024-09-12T00:53:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0eec47640 1 -- 172.21.15.2:0/2829103017 learned_addr learned my addr 172.21.15.2:0/2829103017 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:20.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0edc45640 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 0x56051237e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0ee446640 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 0x56051237cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0eec47640 1 -- 172.21.15.2:0/2829103017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 msgr2=0x56051237e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:20.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0eec47640 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 0x56051237e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0eec47640 1 -- 172.21.15.2:0/2829103017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 msgr2=0x56051237cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:20.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0eec47640 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 0x56051237cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.719+0000 7fd0eec47640 1 -- 172.21.15.2:0/2829103017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051236c520 con 0x56051236cfc0 2024-09-12T00:53:20.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.720+0000 7fd0eec47640 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x560512378f50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000c0a0 tx=0x7fd0e000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f716ef30290ac51c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:20.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.720+0000 7fd0d3fff640 1 -- 172.21.15.2:0/2829103017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ba070 con 0x56051236cfc0 2024-09-12T00:53:20.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.720+0000 7fd0d3fff640 1 -- 172.21.15.2:0/2829103017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e00ce8e0 con 0x56051236cfc0 2024-09-12T00:53:20.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.720+0000 7fd0d3fff640 1 -- 172.21.15.2:0/2829103017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0010130 con 0x56051236cfc0 2024-09-12T00:53:20.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.720+0000 7fd0f2a83740 1 -- 172.21.15.2:0/2829103017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 msgr2=0x560512378f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.720+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x560512378f50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000c0a0 tx=0x7fd0e000ef40 comp rx=0 tx=0).stop 2024-09-12T00:53:20.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 -- 172.21.15.2:0/2829103017 shutdown_connections 2024-09-12T00:53:20.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x560512378f50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 0x56051237e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/2829103017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 0x56051237cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 -- 172.21.15.2:0/2829103017 >> 172.21.15.2:0/2829103017 conn(0x560512359f60 msgr2=0x560512365240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 -- 172.21.15.2:0/2829103017 shutdown_connections 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 -- 172.21.15.2:0/2829103017 wait complete. 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 -- start start 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 Processor -- start 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 0x560512382260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 0x5605123827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x5605123e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56051237e900 con 0x56051236cfc0 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56051237e230 con 0x56051235d8f0 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56051237efd0 con 0x56051235e210 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0f2a83740 10 client.0 _ll_register_callbacks cb 0x7fd0d8004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x5605123e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0eec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x5605123e5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41076/0 (socket says 172.21.15.2:41076) 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.721+0000 7fd0eec47640 1 -- 172.21.15.2:0/3041716458 learned_addr learned my addr 172.21.15.2:0/3041716458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0ee446640 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 0x560512382260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0edc45640 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 0x5605123827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0eec47640 1 -- 172.21.15.2:0/3041716458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 msgr2=0x5605123827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0eec47640 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 0x5605123827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0eec47640 1 -- 172.21.15.2:0/3041716458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 msgr2=0x560512382260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:20.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0eec47640 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 0x560512382260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0eec47640 1 -- 172.21.15.2:0/3041716458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605123e62d0 con 0x56051236cfc0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0eec47640 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x5605123e5d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd0e009d630 tx=0x7fd0e00b1df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd1dec337ab724 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/3041716458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ba030 con 0x56051236cfc0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/3041716458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd0e0062ba0 con 0x56051236cfc0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0f2a83740 1 -- 172.21.15.2:0/3041716458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0e00ce8e0 con 0x56051236cfc0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/3041716458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0e009d1e0 con 0x56051236cfc0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0f2a83740 10 client.15387 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.722+0000 7fd0f2a83740 1 -- 172.21.15.2:0/3041716458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605123e62d0 con 0x56051236cfc0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/3041716458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e00ce8e0 con 0x56051236cfc0 2024-09-12T00:53:20.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/3041716458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0e0013b60 con 0x56051236cfc0 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0f2a83740 10 client.15387 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0f2a83740 10 client.15387 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0f2a83740 20 client.15387 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5605123eb900 0x5605123ea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0f2a83740 4 client.15387 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0f2a83740 1 -- 172.21.15.2:0/3041716458 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "status"}) -- 0x5605122cbb10 con 0x5605123eb900 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.723+0000 7fd0ee446640 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5605123eb900 0x5605123ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0d1ffb640 10 client.15387 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0ee446640 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5605123eb900 0x5605123ea610 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a503162bc73f6186 server_cookie=a653a8a5e37e2823 in_seq=0 out_seq=0 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0d1ffb640 1 -- 172.21.15.2:0/3041716458 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5605122cbb10 con 0x5605123eb900 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0d1ffb640 10 client.15387 handle_command_reply: tid=0 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 client.15387 shutdown 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 -- 172.21.15.2:0/3041716458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 msgr2=0x5605123e5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x5605123e5d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd0e009d630 tx=0x7fd0e00b1df0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 -- 172.21.15.2:0/3041716458 shutdown_connections 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5605123eb900 0x5605123ea610 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56051236cfc0 0x5605123e5d10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56051235e210 0x5605123827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0d1ffb640 0 client.15387 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 --2- 172.21.15.2:0/3041716458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56051235d8f0 0x560512382260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 -- 172.21.15.2:0/3041716458 >> 172.21.15.2:0/3041716458 conn(0x560512359f60 msgr2=0x5605123587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 -- 172.21.15.2:0/3041716458 shutdown_connections 2024-09-12T00:53:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 1 -- 172.21.15.2:0/3041716458 wait complete. 2024-09-12T00:53:20.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.724+0000 7fd0f2a83740 20 client.15387 trim_cache size 0 max 16384 2024-09-12T00:53:20.732 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:20.732 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:53:20.732 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-09-12T00:53:20.732 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24470, 2024-09-12T00:53:20.732 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:53:20.733 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:53:20.733 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:53:20.733 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 120.677337721, 2024-09-12T00:53:20.733 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-12T00:53:20.733 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 84, 2024-09-12T00:53:20.734 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 84, 2024-09-12T00:53:20.734 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 150.52003250300001 2024-09-12T00:53:20.734 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd0d40a2e10 msgr2=0x7fd0d40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd0d40a2e10 0x7fd0d40a52d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009890 tx=0x7fd0e4008040 comp rx=0 tx=0).stop 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8106a80 msgr2=0x7fd0e819bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8106a80 0x7fd0e819bc40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0007cb0 tx=0x7fd0e000e420 comp rx=0 tx=0).stop 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3903561676 shutdown_connections 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd0d40a2e10 0x7fd0d40a52d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e8106a80 0x7fd0e819bc40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e8101420 0x7fd0e81978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 --2- 172.21.15.2:0/3903561676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e8100a80 0x7fd0e8197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:20.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3903561676 >> 172.21.15.2:0/3903561676 conn(0x7fd0e80fc7a0 msgr2=0x7fd0e80fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:20.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3903561676 shutdown_connections 2024-09-12T00:53:20.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:20.725+0000 7fd0f06aa640 1 -- 172.21.15.2:0/3903561676 wait complete. 2024-09-12T00:53:20.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:20 smithi002 ceph-mon[31210]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T00:53:21.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:20 smithi167 ceph-mon[35234]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T00:53:21.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:20 smithi071 ceph-mon[35276]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T00:53:21.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T00:53:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:22.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 -- 172.21.15.2:0/679357455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 msgr2=0x7f4e50101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/679357455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 0x7f4e50101200 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009900 tx=0x7f4e4002a480 comp rx=0 tx=0).stop 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 -- 172.21.15.2:0/679357455 shutdown_connections 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/679357455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e50102ef0 0x7f4e5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/679357455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102570 0x7f4e501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/679357455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 0x7f4e50101200 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 -- 172.21.15.2:0/679357455 >> 172.21.15.2:0/679357455 conn(0x7f4e500fc7d0 msgr2=0x7f4e500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 -- 172.21.15.2:0/679357455 shutdown_connections 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.238+0000 7f4e54cb0640 1 -- 172.21.15.2:0/679357455 wait complete. 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e54cb0640 1 Processor -- start 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e54cb0640 1 -- start start 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e54cb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 0x7f4e501992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e54cb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102570 0x7f4e50199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e54cb0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e50102ef0 0x7f4e501a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e54cb0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110f80 con 0x7f4e50100e20 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e54cb0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110e00 con 0x7f4e50102ef0 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e54cb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50111100 con 0x7f4e50102570 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 0x7f4e501992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 0x7f4e501992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41092/0 (socket says 172.21.15.2:41092) 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e4e59c640 1 -- 172.21.15.2:0/198423796 learned_addr learned my addr 172.21.15.2:0/198423796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.239+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102570 0x7f4e50199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e50102ef0 0x7f4e501a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e4e59c640 1 -- 172.21.15.2:0/198423796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102570 msgr2=0x7f4e50199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102570 0x7f4e50199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e4e59c640 1 -- 172.21.15.2:0/198423796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e50102ef0 msgr2=0x7f4e501a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e50102ef0 0x7f4e501a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e4e59c640 1 -- 172.21.15.2:0/198423796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e501a48b0 con 0x7f4e50100e20 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 0x7f4e501992f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4e40006010 tx=0x7f4e40003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e3f7fe640 1 -- 172.21.15.2:0/198423796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4003f070 con 0x7f4e50100e20 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e3f7fe640 1 -- 172.21.15.2:0/198423796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e40031c30 con 0x7f4e50100e20 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e54cb0640 1 -- 172.21.15.2:0/198423796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e501a4a80 con 0x7f4e50100e20 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e3f7fe640 1 -- 172.21.15.2:0/198423796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40035030 con 0x7f4e50100e20 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.240+0000 7f4e54cb0640 1 -- 172.21.15.2:0/198423796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e501a4ed0 con 0x7f4e50100e20 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.243+0000 7f4e3f7fe640 1 -- 172.21.15.2:0/198423796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f4e40042070 con 0x7f4e50100e20 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.243+0000 7f4e57089740 1 Processor -- start 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.243+0000 7f4e57089740 1 -- start start 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e57089740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb689ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e57089740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68aba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e57089740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e57089740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560eb6803090 con 0x560eb689c8d0 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e57089740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560eb67aaa70 con 0x560eb689d1f0 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e57089740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560eb67ff050 con 0x560eb68abfc0 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb689ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb689ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41104/0 (socket says 172.21.15.2:41104) 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 -- 172.21.15.2:0/1513942248 learned_addr learned my addr 172.21.15.2:0/1513942248 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e3f7fe640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4e380a2e10 0x7f4e380a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4e380a2e10 0x7f4e380a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 -- 172.21.15.2:0/1513942248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 msgr2=0x560eb68ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 -- 172.21.15.2:0/1513942248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 msgr2=0x560eb68aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4ed9d640 1 -- 172.21.15.2:0/1513942248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb67b7130 con 0x560eb689c8d0 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.244+0000 7f4e3f7fe640 1 -- 172.21.15.2:0/198423796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f4e400efe30 con 0x7f4e50100e20 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.245+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb689ccb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4e480139d0 tx=0x7f4e48013e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4aae9f38f4e8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.245+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4e380a2e10 0x7f4e380a52d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800a000 tx=0x7f4e4801d000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.245+0000 7f4e3cff9640 1 -- 172.21.15.2:0/1513942248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4801c770 con 0x560eb689c8d0 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.245+0000 7f4e3cff9640 1 -- 172.21.15.2:0/1513942248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e4801cdf0 con 0x560eb689c8d0 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.245+0000 7f4e3cff9640 1 -- 172.21.15.2:0/1513942248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4801dd00 con 0x560eb689c8d0 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 -- 172.21.15.2:0/1513942248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 msgr2=0x560eb689ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb689ccb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4e480139d0 tx=0x7f4e48013e90 comp rx=0 tx=0).stop 2024-09-12T00:53:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 -- 172.21.15.2:0/1513942248 shutdown_connections 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 --2- 172.21.15.2:0/1513942248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb689ccb0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 -- 172.21.15.2:0/1513942248 >> 172.21.15.2:0/1513942248 conn(0x560eb6898f60 msgr2=0x560eb6899340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 -- 172.21.15.2:0/1513942248 shutdown_connections 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 -- 172.21.15.2:0/1513942248 wait complete. 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 -- start start 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.246+0000 7f4e57089740 1 Processor -- start 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e57089740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68ab850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e57089740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689d1f0 0x560eb68a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e57089740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e57089740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560eb68aeb30 con 0x560eb689d1f0 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e57089740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560eb67bdf20 con 0x560eb689c8d0 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e57089740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560eb68aecb0 con 0x560eb68abfc0 2024-09-12T00:53:22.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e57089740 10 client.0 _ll_register_callbacks cb 0x560eb6787030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689d1f0 0x560eb68a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689d1f0 0x560eb68a8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41106/0 (socket says 172.21.15.2:41106) 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 -- 172.21.15.2:0/3157289436 learned_addr learned my addr 172.21.15.2:0/3157289436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 -- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 msgr2=0x560eb68a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 -- 172.21.15.2:0/3157289436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 msgr2=0x560eb68ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 -- 172.21.15.2:0/3157289436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb65742b0 con 0x560eb689d1f0 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:22.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689d1f0 0x560eb68a8ba0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400b920 tx=0x7f4e4400bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977a573b6403109f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.247+0000 7f4e35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e35ffb640 1 -- 172.21.15.2:0/3157289436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44003ea0 con 0x560eb689d1f0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e35ffb640 1 -- 172.21.15.2:0/3157289436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f4e4401b640 con 0x560eb689d1f0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 1 -- 172.21.15.2:0/3157289436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e4801cdf0 con 0x560eb689d1f0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e35ffb640 1 -- 172.21.15.2:0/3157289436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4e4401b840 con 0x560eb689d1f0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 10 client.15399 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 1 -- 172.21.15.2:0/3157289436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560eb68ba4e0 con 0x560eb689d1f0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e35ffb640 1 -- 172.21.15.2:0/3157289436 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e4801cdf0 con 0x560eb689d1f0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e35ffb640 1 -- 172.21.15.2:0/3157289436 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4e44019020 con 0x560eb689d1f0 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 10 client.15399 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 10 client.15399 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 20 client.15399 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:22.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x560eb68bcb50 0x560eb68bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 4 client.15399 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.248+0000 7f4e57089740 1 -- 172.21.15.2:0/3157289436 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eb6810600 con 0x560eb68bcb50 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.249+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x560eb68bcb50 0x560eb68bdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.249+0000 7f4e35ffb640 10 client.15399 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.249+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x560eb68bcb50 0x560eb68bdfc0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=837c040df7eea876 server_cookie=4c3a9ad7062e1bf0 in_seq=0 out_seq=0 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e35ffb640 1 -- 172.21.15.2:0/3157289436 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560eb6810600 con 0x560eb68bcb50 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e35ffb640 10 client.15399 handle_command_reply: tid=0 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 client.15399 shutdown 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 -- 172.21.15.2:0/3157289436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689d1f0 msgr2=0x560eb68a8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689d1f0 0x560eb68a8ba0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400b920 tx=0x7f4e4400bde0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 -- 172.21.15.2:0/3157289436 shutdown_connections 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x560eb68bcb50 0x560eb68bdfc0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e35ffb640 0 client.15399 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:22.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689d1f0 0x560eb68a8ba0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 --2- 172.21.15.2:0/3157289436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 -- 172.21.15.2:0/3157289436 >> 172.21.15.2:0/3157289436 conn(0x560eb6898f60 msgr2=0x560eb689ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:22.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 -- 172.21.15.2:0/3157289436 shutdown_connections 2024-09-12T00:53:22.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 1 -- 172.21.15.2:0/3157289436 wait complete. 2024-09-12T00:53:22.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.250+0000 7f4e57089740 20 client.15399 trim_cache size 0 max 16384 2024-09-12T00:53:22.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.268+0000 7f4e57089740 1 Processor -- start 2024-09-12T00:53:22.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.268+0000 7f4e57089740 1 -- start start 2024-09-12T00:53:22.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.268+0000 7f4e57089740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb68bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.268+0000 7f4e57089740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.268+0000 7f4e57089740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.268+0000 7f4e57089740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560eb68bc300 con 0x560eb689c8d0 2024-09-12T00:53:22.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.268+0000 7f4e57089740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560eb68bc9d0 con 0x560eb689d1f0 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.268+0000 7f4e57089740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560eb68bd0a0 con 0x560eb68abfc0 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb68bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb68bd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41108/0 (socket says 172.21.15.2:41108) 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 -- 172.21.15.2:0/3236069241 learned_addr learned my addr 172.21.15.2:0/3236069241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 -- 172.21.15.2:0/3236069241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 msgr2=0x560eb68a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 -- 172.21.15.2:0/3236069241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 msgr2=0x560eb68a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:22.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 -- 172.21.15.2:0/3236069241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb68a9960 con 0x560eb689c8d0 2024-09-12T00:53:22.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb68bd220 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4e400ed4c0 tx=0x7f4e40036b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38d4017aea352a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:22.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e37fff640 1 -- 172.21.15.2:0/3236069241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40049040 con 0x560eb689c8d0 2024-09-12T00:53:22.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e37fff640 1 -- 172.21.15.2:0/3236069241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e400c0530 con 0x560eb689c8d0 2024-09-12T00:53:22.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.269+0000 7f4e37fff640 1 -- 172.21.15.2:0/3236069241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400c0160 con 0x560eb689c8d0 2024-09-12T00:53:22.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 -- 172.21.15.2:0/3236069241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 msgr2=0x560eb68bd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb68bd220 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4e400ed4c0 tx=0x7f4e40036b60 comp rx=0 tx=0).stop 2024-09-12T00:53:22.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 -- 172.21.15.2:0/3236069241 shutdown_connections 2024-09-12T00:53:22.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb68abfc0 0x560eb68a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689d1f0 0x560eb68a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 --2- 172.21.15.2:0/3236069241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb689c8d0 0x560eb68bd220 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 -- 172.21.15.2:0/3236069241 >> 172.21.15.2:0/3236069241 conn(0x560eb6898f60 msgr2=0x560eb68a4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 -- 172.21.15.2:0/3236069241 shutdown_connections 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.270+0000 7f4e57089740 1 -- 172.21.15.2:0/3236069241 wait complete. 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 1 -- start start 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 1 Processor -- start 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68bf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb689d1f0 0x560eb68bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb68abfc0 0x560eb6925250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560eb68bde40 con 0x560eb68abfc0 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560eb68bd770 con 0x560eb689c8d0 2024-09-12T00:53:22.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560eb68be510 con 0x560eb689d1f0 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e57089740 10 client.0 _ll_register_callbacks cb 0x7f4e44004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e4ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb68abfc0 0x560eb6925250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e4ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb68abfc0 0x560eb6925250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41116/0 (socket says 172.21.15.2:41116) 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e4ed9d640 1 -- 172.21.15.2:0/337502397 learned_addr learned my addr 172.21.15.2:0/337502397 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.271+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb689d1f0 0x560eb68bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e4e59c640 1 -- 172.21.15.2:0/337502397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb689d1f0 msgr2=0x560eb68bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb689d1f0 0x560eb68bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e4e59c640 1 -- 172.21.15.2:0/337502397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb68abfc0 msgr2=0x560eb6925250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb68abfc0 0x560eb6925250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e4e59c640 1 -- 172.21.15.2:0/337502397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb6925790 con 0x560eb689c8d0 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e4ed9d640 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb68abfc0 0x560eb6925250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e4e59c640 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68bf580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e400c4fb0 tx=0x7f4e400c4df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e70402a9d67621 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:22.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e35ffb640 1 -- 172.21.15.2:0/337502397 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400d4070 con 0x560eb689c8d0 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e57089740 1 -- 172.21.15.2:0/337502397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e400c0530 con 0x560eb689c8d0 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e35ffb640 1 -- 172.21.15.2:0/337502397 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f4e400b88a0 con 0x560eb689c8d0 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e35ffb640 1 -- 172.21.15.2:0/337502397 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4e40049050 con 0x560eb689c8d0 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e57089740 10 client.25106 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e57089740 1 -- 172.21.15.2:0/337502397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560eb6926910 con 0x560eb689c8d0 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.272+0000 7f4e35ffb640 1 -- 172.21.15.2:0/337502397 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e400c0530 con 0x560eb689c8d0 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e35ffb640 1 -- 172.21.15.2:0/337502397 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4e400c4960 con 0x560eb689c8d0 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e57089740 10 client.25106 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e57089740 10 client.25106 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e57089740 20 client.25106 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e57089740 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x560eb68bcb50 0x560eb6929f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:22.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e57089740 4 client.25106 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e57089740 1 -- 172.21.15.2:0/337502397 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "status"}) -- 0x560eb680ab10 con 0x560eb68bcb50 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x560eb68bcb50 0x560eb6929f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e4dd9b640 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x560eb68bcb50 0x560eb6929f90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36cc998a09b6bb66 server_cookie=486f64caf0c85494 in_seq=0 out_seq=0 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.273+0000 7f4e35ffb640 10 client.25106 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e35ffb640 1 -- 172.21.15.2:0/337502397 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560eb680ab10 con 0x560eb68bcb50 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e35ffb640 10 client.25106 handle_command_reply: tid=0 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 client.25106 shutdown 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 -- 172.21.15.2:0/337502397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 msgr2=0x560eb68bf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68bf580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e400c4fb0 tx=0x7f4e400c4df0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 -- 172.21.15.2:0/337502397 shutdown_connections 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x560eb68bcb50 0x560eb6929f90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560eb68abfc0 0x560eb6925250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560eb689d1f0 0x560eb68bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e35ffb640 0 client.25106 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 --2- 172.21.15.2:0/337502397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560eb689c8d0 0x560eb68bf580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 -- 172.21.15.2:0/337502397 >> 172.21.15.2:0/337502397 conn(0x560eb6898f60 msgr2=0x560eb68a7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 -- 172.21.15.2:0/337502397 shutdown_connections 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 1 -- 172.21.15.2:0/337502397 wait complete. 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.274+0000 7f4e57089740 20 client.25106 trim_cache size 0 max 16384 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:22.281 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24487, 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 123.230029194, 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 84, 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 84, 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 149.49434450199999 2024-09-12T00:53:22.282 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 -- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4e380a2e10 msgr2=0x7f4e380a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4e380a2e10 0x7f4e380a52d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800a000 tx=0x7f4e4801d000 comp rx=0 tx=0).stop 2024-09-12T00:53:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 -- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 msgr2=0x7f4e501992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 0x7f4e501992f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4e40006010 tx=0x7f4e40003c10 comp rx=0 tx=0).stop 2024-09-12T00:53:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 -- 172.21.15.2:0/198423796 shutdown_connections 2024-09-12T00:53:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4e380a2e10 0x7f4e380a52d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e50102ef0 0x7f4e501a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102570 0x7f4e50199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 --2- 172.21.15.2:0/198423796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e50100e20 0x7f4e501992f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 -- 172.21.15.2:0/198423796 >> 172.21.15.2:0/198423796 conn(0x7f4e500fc7d0 msgr2=0x7f4e500fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 -- 172.21.15.2:0/198423796 shutdown_connections 2024-09-12T00:53:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:22.275+0000 7f4e54cb0640 1 -- 172.21.15.2:0/198423796 wait complete. 2024-09-12T00:53:22.957 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:22 smithi002 ceph-mon[31210]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-12T00:53:22.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T00:53:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:22 smithi167 ceph-mon[35234]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-12T00:53:23.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:22 smithi071 ceph-mon[35276]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-12T00:53:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:23.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.670+0000 7f07c77fe640 1 -- 172.21.15.2:0/2015491440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0031cc0 con 0x7f07c8101420 2024-09-12T00:53:23.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.670+0000 7f07ceff8640 1 -- 172.21.15.2:0/2015491440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8101420 msgr2=0x7f07c810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.670+0000 7f07ceff8640 1 --2- 172.21.15.2:0/2015491440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8101420 0x7f07c810d950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009cd0 tx=0x7f07c002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.670+0000 7f07ceff8640 1 -- 172.21.15.2:0/2015491440 shutdown_connections 2024-09-12T00:53:23.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.670+0000 7f07ceff8640 1 --2- 172.21.15.2:0/2015491440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8101420 0x7f07c810d950 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.670+0000 7f07ceff8640 1 --2- 172.21.15.2:0/2015491440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c8100a80 0x7f07c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.670+0000 7f07ceff8640 1 --2- 172.21.15.2:0/2015491440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07c8106a80 0x7f07c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.670+0000 7f07ceff8640 1 -- 172.21.15.2:0/2015491440 >> 172.21.15.2:0/2015491440 conn(0x7f07c80fc7a0 msgr2=0x7f07c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:23.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.671+0000 7f07ceff8640 1 -- 172.21.15.2:0/2015491440 shutdown_connections 2024-09-12T00:53:23.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.671+0000 7f07ceff8640 1 -- 172.21.15.2:0/2015491440 wait complete. 2024-09-12T00:53:23.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.671+0000 7f07ceff8640 1 Processor -- start 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.671+0000 7f07ceff8640 1 -- start start 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.671+0000 7f07ceff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8100a80 0x7f07c8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.671+0000 7f07ceff8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c8101420 0x7f07c81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.671+0000 7f07ceff8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07c8106a80 0x7f07c819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ceff8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8110e80 con 0x7f07c8100a80 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ceff8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8110d00 con 0x7f07c8101420 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ceff8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8111000 con 0x7f07c8106a80 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8100a80 0x7f07c8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8100a80 0x7f07c8198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41136/0 (socket says 172.21.15.2:41136) 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 -- 172.21.15.2:0/1317039320 learned_addr learned my addr 172.21.15.2:0/1317039320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:23.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07c7fff640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c8101420 0x7f07c81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07cd595640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07c8106a80 0x7f07c819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 -- 172.21.15.2:0/1317039320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07c8106a80 msgr2=0x7f07c819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07c8106a80 0x7f07c819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 -- 172.21.15.2:0/1317039320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c8101420 msgr2=0x7f07c81988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c8101420 0x7f07c81988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 -- 172.21.15.2:0/1317039320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c819d320 con 0x7f07c8100a80 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ccd94640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8100a80 0x7f07c8198370 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00c920 tx=0x7f07bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07c5ffb640 1 -- 172.21.15.2:0/1317039320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc007c70 con 0x7f07c8100a80 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07c5ffb640 1 -- 172.21.15.2:0/1317039320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07bc007e10 con 0x7f07c8100a80 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07ceff8640 1 -- 172.21.15.2:0/1317039320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c819d610 con 0x7f07c8100a80 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.672+0000 7f07c5ffb640 1 -- 172.21.15.2:0/1317039320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc018890 con 0x7f07c8100a80 2024-09-12T00:53:23.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.673+0000 7f07ceff8640 1 -- 172.21.15.2:0/1317039320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c81a4ef0 con 0x7f07c8100a80 2024-09-12T00:53:23.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.675+0000 7f07c5ffb640 1 -- 172.21.15.2:0/1317039320 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f07bc018a70 con 0x7f07c8100a80 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.675+0000 7f07d13d1740 1 Processor -- start 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.675+0000 7f07d13d1740 1 -- start start 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.675+0000 7f07c5ffb640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f07b80a2e90 0x7f07b80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.675+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbd4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.675+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.675+0000 7f07cd595640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f07b80a2e90 0x7f07b80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07d13d1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbb3b090 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07d13d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbae2a70 con 0x55b5dbbd48d0 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07d13d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbb37050 con 0x55b5dbbd51f0 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07c5ffb640 1 -- 172.21.15.2:0/1317039320 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f07bc0cf700 con 0x7f07c8100a80 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07cd595640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07c7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07cd595640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41148/0 (socket says 172.21.15.2:41148) 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07cd595640 1 -- 172.21.15.2:0/655830501 learned_addr learned my addr 172.21.15.2:0/655830501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07ccd94640 1 --2- 172.21.15.2:0/655830501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbd4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07c7fff640 1 -- 172.21.15.2:0/655830501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd48d0 msgr2=0x55b5dbbd4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07c7fff640 1 --2- 172.21.15.2:0/655830501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbd4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07c7fff640 1 -- 172.21.15.2:0/655830501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 msgr2=0x55b5dbbe63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07c7fff640 1 --2- 172.21.15.2:0/655830501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07c7fff640 1 -- 172.21.15.2:0/655830501 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5dbaef130 con 0x55b5dbbd51f0 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07cd595640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f07b80a2e90 0x7f07b80a5350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f07c002ae00 tx=0x7f07c0031540 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.676+0000 7f07c7fff640 1 --2- 172.21.15.2:0/655830501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe3a80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07b40058c0 tx=0x7f07b400f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d8fef3f1309bb5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07b2ffd640 1 -- 172.21.15.2:0/655830501 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4004020 con 0x55b5dbbd51f0 2024-09-12T00:53:23.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07b2ffd640 1 -- 172.21.15.2:0/655830501 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07b40041c0 con 0x55b5dbbd51f0 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07b2ffd640 1 -- 172.21.15.2:0/655830501 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b40187b0 con 0x55b5dbbd51f0 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 -- 172.21.15.2:0/655830501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 msgr2=0x55b5dbbe3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 --2- 172.21.15.2:0/655830501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe3a80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07b40058c0 tx=0x7f07b400f3c0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 -- 172.21.15.2:0/655830501 shutdown_connections 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 --2- 172.21.15.2:0/655830501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 --2- 172.21.15.2:0/655830501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe3a80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 --2- 172.21.15.2:0/655830501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbd4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 -- 172.21.15.2:0/655830501 >> 172.21.15.2:0/655830501 conn(0x55b5dbbd0f60 msgr2=0x55b5dbbd1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 -- 172.21.15.2:0/655830501 shutdown_connections 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.677+0000 7f07d13d1740 1 -- 172.21.15.2:0/655830501 wait complete. 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 1 -- start start 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 1 Processor -- start 2024-09-12T00:53:23.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbe3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbbe6bf0 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbaf5f20 con 0x55b5dbbd51f0 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbbe6d70 con 0x55b5dbbd48d0 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07d13d1740 10 client.0 _ll_register_callbacks cb 0x55b5dbabf030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07cd595640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07ccd94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbe3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07ccd94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbe3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:40606/0 (socket says 172.21.15.2:40606) 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07cd595640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41150/0 (socket says 172.21.15.2:41150) 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07ccd94640 1 -- 172.21.15.2:0/3081554327 learned_addr learned my addr 172.21.15.2:0/3081554327 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.678+0000 7f07c7fff640 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07ccd94640 1 -- 172.21.15.2:0/3081554327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 msgr2=0x55b5dbbe0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07ccd94640 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07ccd94640 1 -- 172.21.15.2:0/3081554327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 msgr2=0x55b5dbbe10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07ccd94640 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07ccd94640 1 -- 172.21.15.2:0/3081554327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5db8ac2b0 con 0x55b5dbbd48d0 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07cd595640 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07ccd94640 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbe3830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f07bc000c00 tx=0x7f07bc09ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd37afffb12baf48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07a7fff640 1 -- 172.21.15.2:0/3081554327 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0b3030 con 0x55b5dbbd48d0 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07d13d1740 1 -- 172.21.15.2:0/3081554327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07b40041c0 con 0x55b5dbbd48d0 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07a7fff640 1 -- 172.21.15.2:0/3081554327 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f07bc00fb30 con 0x55b5dbbd48d0 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07a7fff640 1 -- 172.21.15.2:0/3081554327 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07bc0ba360 con 0x55b5dbbd48d0 2024-09-12T00:53:23.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07d13d1740 10 client.25075 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.679+0000 7f07d13d1740 1 -- 172.21.15.2:0/3081554327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5dbbf25d0 con 0x55b5dbbd48d0 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07a7fff640 1 -- 172.21.15.2:0/3081554327 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07b40041c0 con 0x55b5dbbd48d0 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07a7fff640 1 -- 172.21.15.2:0/3081554327 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f07bc0860b0 con 0x55b5dbbd48d0 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07d13d1740 10 client.25075 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07d13d1740 10 client.25075 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07d13d1740 20 client.25075 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5dbbf4b30 0x55b5dbbf5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07d13d1740 4 client.25075 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07d13d1740 1 -- 172.21.15.2:0/3081554327 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5dbb48600 con 0x55b5dbbf4b30 2024-09-12T00:53:23.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.680+0000 7f07c7fff640 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5dbbf4b30 0x55b5dbbf5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.681+0000 7f07c7fff640 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5dbbf4b30 0x55b5dbbf5fa0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=992b2dfcdf062aca server_cookie=9dadaa587260f45d in_seq=0 out_seq=0 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.681+0000 7f07a7fff640 10 client.25075 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.681+0000 7f07a7fff640 1 -- 172.21.15.2:0/3081554327 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5dbb48600 con 0x55b5dbbf4b30 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.681+0000 7f07a7fff640 10 client.25075 handle_command_reply: tid=0 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.681+0000 7f07d13d1740 1 client.25075 shutdown 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 -- 172.21.15.2:0/3081554327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 msgr2=0x55b5dbbe3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbe3830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f07bc000c00 tx=0x7f07bc09ba40 comp rx=0 tx=0).stop 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 -- 172.21.15.2:0/3081554327 shutdown_connections 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5dbbf4b30 0x55b5dbbf5fa0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbe10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07a7fff640 0 client.25075 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbe0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3081554327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbe3830 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 -- 172.21.15.2:0/3081554327 >> 172.21.15.2:0/3081554327 conn(0x55b5dbbd0f60 msgr2=0x55b5dbbd6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 -- 172.21.15.2:0/3081554327 shutdown_connections 2024-09-12T00:53:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 1 -- 172.21.15.2:0/3081554327 wait complete. 2024-09-12T00:53:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.682+0000 7f07d13d1740 20 client.25075 trim_cache size 0 max 16384 2024-09-12T00:53:23.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.699+0000 7f07d13d1740 1 Processor -- start 2024-09-12T00:53:23.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07d13d1740 1 -- start start 2024-09-12T00:53:23.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbf4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbf5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbdf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07d13d1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbbf42e0 con 0x55b5dbbd48d0 2024-09-12T00:53:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07d13d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbbf49b0 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07d13d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbbf5080 con 0x55b5dbbd51f0 2024-09-12T00:53:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbf4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbf4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41160/0 (socket says 172.21.15.2:41160) 2024-09-12T00:53:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 -- 172.21.15.2:0/2448804177 learned_addr learned my addr 172.21.15.2:0/2448804177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:23.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 -- 172.21.15.2:0/2448804177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 msgr2=0x55b5dbbf5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:23.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 --2- 172.21.15.2:0/2448804177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbf5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 -- 172.21.15.2:0/2448804177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbe3fc0 msgr2=0x55b5dbbdf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:23.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 --2- 172.21.15.2:0/2448804177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbdf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 -- 172.21.15.2:0/2448804177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5dbbe3ba0 con 0x55b5dbbd48d0 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07ccd94640 1 --2- 172.21.15.2:0/2448804177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbf4460 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f07bc097de0 tx=0x7f07bc0b4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be78c69c5c8e4f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.700+0000 7f07b27fc640 1 -- 172.21.15.2:0/2448804177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0b3030 con 0x55b5dbbd48d0 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07b27fc640 1 -- 172.21.15.2:0/2448804177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07bc00fb30 con 0x55b5dbbd48d0 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07b27fc640 1 -- 172.21.15.2:0/2448804177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc086210 con 0x55b5dbbd48d0 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 -- 172.21.15.2:0/2448804177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbd48d0 msgr2=0x55b5dbbf4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 --2- 172.21.15.2:0/2448804177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbf4460 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f07bc097de0 tx=0x7f07bc0b4f90 comp rx=0 tx=0).stop 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 -- 172.21.15.2:0/2448804177 shutdown_connections 2024-09-12T00:53:23.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 --2- 172.21.15.2:0/2448804177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbdf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 --2- 172.21.15.2:0/2448804177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbf5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 --2- 172.21.15.2:0/2448804177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbf4460 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 -- 172.21.15.2:0/2448804177 >> 172.21.15.2:0/2448804177 conn(0x55b5dbbd0f60 msgr2=0x55b5dbbe0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 -- 172.21.15.2:0/2448804177 shutdown_connections 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 -- 172.21.15.2:0/2448804177 wait complete. 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.701+0000 7f07d13d1740 1 -- start start 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07d13d1740 1 Processor -- start 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbdd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07d13d1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbfd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07d13d1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbbf5e20 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07d13d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbbf5750 con 0x55b5dbbd51f0 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07d13d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5dbbf64f0 con 0x55b5dbbd48d0 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07d13d1740 10 client.0 _ll_register_callbacks cb 0x7f07bc09b510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07cd595640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbfd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07cd595640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbfd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41166/0 (socket says 172.21.15.2:41166) 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07cd595640 1 -- 172.21.15.2:0/3481062938 learned_addr learned my addr 172.21.15.2:0/3481062938 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07c7fff640 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07ccd94640 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbdd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07cd595640 1 -- 172.21.15.2:0/3481062938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 msgr2=0x55b5dbbdd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07cd595640 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbdd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07cd595640 1 -- 172.21.15.2:0/3481062938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 msgr2=0x55b5dbbddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.702+0000 7f07cd595640 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbddab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07cd595640 1 -- 172.21.15.2:0/3481062938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5dbbfd820 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07cd595640 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbfd260 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f07c0030d80 tx=0x7f07c00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ef4b6058c08b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07a7fff640 1 -- 172.21.15.2:0/3481062938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0009890 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07a7fff640 1 -- 172.21.15.2:0/3481062938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f07c0048400 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07d13d1740 1 -- 172.21.15.2:0/3481062938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07bc00fb30 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07a7fff640 1 -- 172.21.15.2:0/3481062938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07c0048600 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07d13d1740 10 client.15423 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07d13d1740 1 -- 172.21.15.2:0/3481062938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5dbbfeb20 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07a7fff640 1 -- 172.21.15.2:0/3481062938 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07bc00fb30 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.703+0000 7f07a7fff640 1 -- 172.21.15.2:0/3481062938 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f07c0051070 con 0x55b5dbbe3fc0 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07d13d1740 10 client.15423 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07d13d1740 10 client.15423 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07d13d1740 20 client.15423 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5dbc63870 0x55b5dbc62580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07d13d1740 4 client.15423 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T00:53:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07d13d1740 1 -- 172.21.15.2:0/3481062938 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "status"}) -- 0x55b5dbb42b10 con 0x55b5dbc63870 2024-09-12T00:53:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07ccd94640 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5dbc63870 0x55b5dbc62580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07ccd94640 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5dbc63870 0x55b5dbc62580 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=567b9ae43fff12dc server_cookie=1593baf7556109d4 in_seq=0 out_seq=0 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.704+0000 7f07a7fff640 10 client.15423 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07a7fff640 1 -- 172.21.15.2:0/3481062938 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b5dbb42b10 con 0x55b5dbc63870 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07a7fff640 10 client.15423 handle_command_reply: tid=0 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 client.15423 shutdown 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 -- 172.21.15.2:0/3481062938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 msgr2=0x55b5dbbfd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbfd260 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f07c0030d80 tx=0x7f07c00095c0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 -- 172.21.15.2:0/3481062938 shutdown_connections 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5dbc63870 0x55b5dbc62580 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5dbbe3fc0 0x55b5dbbfd260 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5dbbd51f0 0x55b5dbbddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 --2- 172.21.15.2:0/3481062938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5dbbd48d0 0x55b5dbbdd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 -- 172.21.15.2:0/3481062938 >> 172.21.15.2:0/3481062938 conn(0x55b5dbbd0f60 msgr2=0x55b5dbbdf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07a7fff640 0 client.15423 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 -- 172.21.15.2:0/3481062938 shutdown_connections 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 1 -- 172.21.15.2:0/3481062938 wait complete. 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.705+0000 7f07d13d1740 20 client.15423 trim_cache size 0 max 16384 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c8315cee-709f-11ef-bcea-c7b262605968", 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24494, 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-12T00:53:23.709 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-12T00:53:23.710 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-12T00:53:23.710 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 131.67963706500001, 2024-09-12T00:53:23.710 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-12T00:53:23.710 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 84, 2024-09-12T00:53:23.710 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 84, 2024-09-12T00:53:23.710 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 142.58762591199999 2024-09-12T00:53:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:23.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 -- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f07b80a2e90 msgr2=0x7f07b80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f07b80a2e90 0x7f07b80a5350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f07c002ae00 tx=0x7f07c0031540 comp rx=0 tx=0).stop 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 -- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8100a80 msgr2=0x7f07c8198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8100a80 0x7f07c8198370 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00c920 tx=0x7f07bc00cde0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 -- 172.21.15.2:0/1317039320 shutdown_connections 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f07b80a2e90 0x7f07b80a5350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07c8106a80 0x7f07c819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c8101420 0x7f07c81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 --2- 172.21.15.2:0/1317039320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07c8100a80 0x7f07c8198370 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 -- 172.21.15.2:0/1317039320 >> 172.21.15.2:0/1317039320 conn(0x7f07c80fc7a0 msgr2=0x7f07c80fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 -- 172.21.15.2:0/1317039320 shutdown_connections 2024-09-12T00:53:23.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:23.706+0000 7f07ceff8640 1 -- 172.21.15.2:0/1317039320 wait complete. 2024-09-12T00:53:24.407 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-12T00:53:24.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:24 smithi002 ceph-mon[31210]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:24 smithi167 ceph-mon[35234]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:25.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:24 smithi071 ceph-mon[35276]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:26.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:26 smithi002 ceph-mon[31210]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:26 smithi167 ceph-mon[35234]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:27.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:26 smithi071 ceph-mon[35276]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:28.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:28 smithi002 ceph-mon[31210]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:53:29.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:28 smithi167 ceph-mon[35234]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:53:29.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:28 smithi071 ceph-mon[35276]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:53:30.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:29 smithi167 ceph-mon[35234]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:30.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:29 smithi071 ceph-mon[35276]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:30.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:29 smithi002 ceph-mon[31210]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T00:53:32.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:31 smithi167 ceph-mon[35234]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:53:32.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:31 smithi071 ceph-mon[35276]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:53:32.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:31 smithi002 ceph-mon[31210]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:53:34.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:33 smithi071 ceph-mon[35276]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:34.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:33 smithi002 ceph-mon[31210]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:34.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:33 smithi167 ceph-mon[35234]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:36.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:35 smithi071 ceph-mon[35276]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:36.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:35 smithi002 ceph-mon[31210]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:36.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:35 smithi167 ceph-mon[35234]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:37.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:53:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:38.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:37 smithi002 ceph-mon[31210]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:38.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:37 smithi071 ceph-mon[35276]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:38.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 -- 172.21.15.2:0/3722784424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a54101e10 msgr2=0x7f8a541021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 --2- 172.21.15.2:0/3722784424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a54101e10 0x7f8a541021f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009900 tx=0x7f8a4402a410 comp rx=0 tx=0).stop 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 -- 172.21.15.2:0/3722784424 shutdown_connections 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 --2- 172.21.15.2:0/3722784424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a54106f40 0x7f8a5410eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 --2- 172.21.15.2:0/3722784424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a541027c0 0x7f8a54106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 --2- 172.21.15.2:0/3722784424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a54101e10 0x7f8a541021f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 -- 172.21.15.2:0/3722784424 >> 172.21.15.2:0/3722784424 conn(0x7f8a540fd8d0 msgr2=0x7f8a540ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 -- 172.21.15.2:0/3722784424 shutdown_connections 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.230+0000 7f8a59e63640 1 -- 172.21.15.2:0/3722784424 wait complete. 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a59e63640 1 Processor -- start 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a59e63640 1 -- start start 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a59e63640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a54101e10 0x7f8a54198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a59e63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a541027c0 0x7f8a54198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a59e63640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a54106f40 0x7f8a5419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a59e63640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a54111fa0 con 0x7f8a541027c0 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a59e63640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a54111e20 con 0x7f8a54101e10 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a59e63640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a54112120 con 0x7f8a54106f40 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a52ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a541027c0 0x7f8a54198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a52ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a541027c0 0x7f8a54198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40056/0 (socket says 172.21.15.2:40056) 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a52ffd640 1 -- 172.21.15.2:0/293668175 learned_addr learned my addr 172.21.15.2:0/293668175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.231+0000 7f8a537fe640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a54101e10 0x7f8a54198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a53fff640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a54106f40 0x7f8a5419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a52ffd640 1 -- 172.21.15.2:0/293668175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a54106f40 msgr2=0x7f8a5419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a54106f40 0x7f8a5419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a52ffd640 1 -- 172.21.15.2:0/293668175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a54101e10 msgr2=0x7f8a54198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a54101e10 0x7f8a54198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a52ffd640 1 -- 172.21.15.2:0/293668175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5419d3e0 con 0x7f8a541027c0 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a541027c0 0x7f8a54198970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800e9f0 tx=0x7f8a4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a50ff9640 1 -- 172.21.15.2:0/293668175 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4800cd80 con 0x7f8a541027c0 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a59e63640 1 -- 172.21.15.2:0/293668175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5419d6d0 con 0x7f8a541027c0 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a50ff9640 1 -- 172.21.15.2:0/293668175 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a48010910 con 0x7f8a541027c0 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a50ff9640 1 -- 172.21.15.2:0/293668175 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48018990 con 0x7f8a541027c0 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.232+0000 7f8a59e63640 1 -- 172.21.15.2:0/293668175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a54074420 con 0x7f8a541027c0 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.235+0000 7f8a5c23c740 1 Processor -- start 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.235+0000 7f8a50ff9640 1 -- 172.21.15.2:0/293668175 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f8a48010ac0 con 0x7f8a541027c0 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.235+0000 7f8a5c23c740 1 -- start start 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335ee4a0 0x55b8335ee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335eedc0 0x55b8335f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335f9680 0x55b8335fba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b8335542e0 con 0x55b8335eedc0 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b8334fbce0 con 0x55b8335f9680 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b8335502a0 con 0x55b8335ee4a0 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335eedc0 0x55b8335f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335eedc0 0x55b8335f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40060/0 (socket says 172.21.15.2:40060) 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a537fe640 1 -- 172.21.15.2:0/875931366 learned_addr learned my addr 172.21.15.2:0/875931366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a53fff640 1 --2- 172.21.15.2:0/875931366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335ee4a0 0x55b8335ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a537fe640 1 -- 172.21.15.2:0/875931366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335ee4a0 msgr2=0x55b8335ee880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a537fe640 1 --2- 172.21.15.2:0/875931366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335ee4a0 0x55b8335ee880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a537fe640 1 -- 172.21.15.2:0/875931366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335f9680 msgr2=0x55b8335fba70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a537fe640 1 --2- 172.21.15.2:0/875931366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335f9680 0x55b8335fba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.236+0000 7f8a537fe640 1 -- 172.21.15.2:0/875931366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8334e0440 con 0x55b8335eedc0 2024-09-12T00:53:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.237+0000 7f8a50ff9640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a3c0a2e10 0x7f8a3c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.237+0000 7f8a53fff640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a3c0a2e10 0x7f8a3c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.237+0000 7f8a50ff9640 1 -- 172.21.15.2:0/293668175 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8a480cfb10 con 0x7f8a541027c0 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.237+0000 7f8a537fe640 1 --2- 172.21.15.2:0/875931366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335eedc0 0x55b8335f9140 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009900 tx=0x7f8a44005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49741ac1a5421260 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.237+0000 7f8a39ffb640 1 -- 172.21.15.2:0/875931366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44040070 con 0x55b8335eedc0 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.237+0000 7f8a39ffb640 1 -- 172.21.15.2:0/875931366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a44031870 con 0x55b8335eedc0 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.237+0000 7f8a39ffb640 1 -- 172.21.15.2:0/875931366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44035040 con 0x55b8335eedc0 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 -- 172.21.15.2:0/875931366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335eedc0 msgr2=0x55b8335f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a53fff640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a3c0a2e10 0x7f8a3c0a52d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c005fd0 tx=0x7f8a4c009500 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/875931366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335eedc0 0x55b8335f9140 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009900 tx=0x7f8a44005be0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 -- 172.21.15.2:0/875931366 shutdown_connections 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/875931366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335f9680 0x55b8335fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/875931366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335eedc0 0x55b8335f9140 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/875931366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335ee4a0 0x55b8335ee880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 -- 172.21.15.2:0/875931366 >> 172.21.15.2:0/875931366 conn(0x55b8335eaa30 msgr2=0x55b8335eae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 -- 172.21.15.2:0/875931366 shutdown_connections 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 -- 172.21.15.2:0/875931366 wait complete. 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.238+0000 7f8a5c23c740 1 -- start start 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a5c23c740 1 Processor -- start 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b8335f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b8335f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 0x55b8335f6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b8335fc250 con 0x55b8335ee4a0 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b83350f050 con 0x55b8335eedc0 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b8335fc3d0 con 0x55b8335f9680 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a5c23c740 10 client.0 _ll_register_callbacks cb 0x55b83354f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b8335f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b8335f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40072/0 (socket says 172.21.15.2:40072) 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a537fe640 1 -- 172.21.15.2:0/3207740261 learned_addr learned my addr 172.21.15.2:0/3207740261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b8335f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a53fff640 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 0x55b8335f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a537fe640 1 -- 172.21.15.2:0/3207740261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 msgr2=0x55b8335f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a537fe640 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 0x55b8335f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a537fe640 1 -- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 msgr2=0x55b8335f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.239+0000 7f8a537fe640 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b8335f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a537fe640 1 -- 172.21.15.2:0/3207740261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8332c53c0 con 0x55b8335ee4a0 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b8335f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a537fe640 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b8335f8ff0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8a4402a930 tx=0x7f8a44005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1429b8942d836d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a32ffd640 1 -- 172.21.15.2:0/3207740261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4404b070 con 0x55b8335ee4a0 2024-09-12T00:53:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a32ffd640 1 -- 172.21.15.2:0/3207740261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8a44004250 con 0x55b8335ee4a0 2024-09-12T00:53:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a5c23c740 1 -- 172.21.15.2:0/3207740261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a44031870 con 0x55b8335ee4a0 2024-09-12T00:53:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a32ffd640 1 -- 172.21.15.2:0/3207740261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a44057050 con 0x55b8335ee4a0 2024-09-12T00:53:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a5c23c740 10 client.15435 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a5c23c740 1 -- 172.21.15.2:0/3207740261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b833607c20 con 0x55b8335ee4a0 2024-09-12T00:53:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.240+0000 7f8a32ffd640 1 -- 172.21.15.2:0/3207740261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a44031870 con 0x55b8335ee4a0 2024-09-12T00:53:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.241+0000 7f8a32ffd640 1 -- 172.21.15.2:0/3207740261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a44003780 con 0x55b8335ee4a0 2024-09-12T00:53:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.241+0000 7f8a5c23c740 10 client.15435 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.241+0000 7f8a5c23c740 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.241+0000 7f8a5c23c740 20 client.15435 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.241+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b833608f70 0x55b83360b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.241+0000 7f8a5c23c740 4 client.15435 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.241+0000 7f8a5c23c740 1 -- 172.21.15.2:0/3207740261 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b833561850 con 0x55b833608f70 2024-09-12T00:53:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.241+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b833608f70 0x55b83360b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.242+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b833608f70 0x55b83360b360 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b15cda25c87e57f server_cookie=436ddec836c40993 in_seq=0 out_seq=0 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.242+0000 7f8a32ffd640 10 client.15435 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.242+0000 7f8a32ffd640 1 -- 172.21.15.2:0/3207740261 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b833561850 con 0x55b833608f70 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.242+0000 7f8a32ffd640 10 client.15435 handle_command_reply: tid=0 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.242+0000 7f8a5c23c740 1 client.15435 shutdown 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.242+0000 7f8a5c23c740 1 -- 172.21.15.2:0/3207740261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 msgr2=0x55b8335f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.242+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b8335f8ff0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8a4402a930 tx=0x7f8a44005660 comp rx=0 tx=0).stop 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.242+0000 7f8a5c23c740 1 -- 172.21.15.2:0/3207740261 shutdown_connections 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b833608f70 0x55b83360b360 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 0x55b8335f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b8335f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a32ffd640 0 client.15435 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/3207740261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b8335f8ff0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a5c23c740 1 -- 172.21.15.2:0/3207740261 >> 172.21.15.2:0/3207740261 conn(0x55b8335eaa30 msgr2=0x55b8335f0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a5c23c740 1 -- 172.21.15.2:0/3207740261 shutdown_connections 2024-09-12T00:53:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a5c23c740 1 -- 172.21.15.2:0/3207740261 wait complete. 2024-09-12T00:53:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.243+0000 7f8a5c23c740 20 client.15435 trim_cache size 0 max 16384 2024-09-12T00:53:38.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.265+0000 7f8a5c23c740 1 Processor -- start 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.265+0000 7f8a5c23c740 1 -- start start 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.265+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335ee4a0 0x55b8336054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.265+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335eedc0 0x55b833610900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.265+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335f9680 0x55b833610e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541b2420 con 0x55b8335f9680 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541afcf0 con 0x55b8335ee4a0 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541adb40 con 0x55b8335eedc0 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335f9680 0x55b833610e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335f9680 0x55b833610e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40074/0 (socket says 172.21.15.2:40074) 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 -- 172.21.15.2:0/207887465 learned_addr learned my addr 172.21.15.2:0/207887465 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335eedc0 0x55b833610900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a537fe640 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335ee4a0 0x55b8336054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 -- 172.21.15.2:0/207887465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335eedc0 msgr2=0x55b833610900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335eedc0 0x55b833610900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 -- 172.21.15.2:0/207887465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335ee4a0 msgr2=0x55b8336054b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335ee4a0 0x55b8336054b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 -- 172.21.15.2:0/207887465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8335eebf0 con 0x55b8335f9680 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.266+0000 7f8a53fff640 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335f9680 0x55b833610e40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c004960 tx=0x7f8a4c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1bb89ee3802f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.267+0000 7f8a397fa640 1 -- 172.21.15.2:0/207887465 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c01b450 con 0x55b8335f9680 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.267+0000 7f8a397fa640 1 -- 172.21.15.2:0/207887465 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a4c01bad0 con 0x55b8335f9680 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.267+0000 7f8a397fa640 1 -- 172.21.15.2:0/207887465 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c010a50 con 0x55b8335f9680 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.267+0000 7f8a5c23c740 1 -- 172.21.15.2:0/207887465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335f9680 msgr2=0x55b833610e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.267+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335f9680 0x55b833610e40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c004960 tx=0x7f8a4c015000 comp rx=0 tx=0).stop 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 -- 172.21.15.2:0/207887465 shutdown_connections 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335f9680 0x55b833610e40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335eedc0 0x55b833610900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/207887465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335ee4a0 0x55b8336054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 -- 172.21.15.2:0/207887465 >> 172.21.15.2:0/207887465 conn(0x55b8335eaa30 msgr2=0x55b8335f18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 -- 172.21.15.2:0/207887465 shutdown_connections 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 -- 172.21.15.2:0/207887465 wait complete. 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 -- start start 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.268+0000 7f8a5c23c740 1 Processor -- start 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b833601800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b833601d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a5c23c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 0x55b8335f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541ae1b0 con 0x55b8335ee4a0 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541af620 con 0x55b8335eedc0 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a5c23c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541ae880 con 0x55b8335f9680 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a5c23c740 10 client.0 _ll_register_callbacks cb 0x7f8a44009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b833601800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b833601800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40076/0 (socket says 172.21.15.2:40076) 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 -- 172.21.15.2:0/463917408 learned_addr learned my addr 172.21.15.2:0/463917408 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b833601d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a53fff640 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 0x55b8335f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 -- 172.21.15.2:0/463917408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 msgr2=0x55b8335f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 0x55b8335f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 -- 172.21.15.2:0/463917408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 msgr2=0x55b833601d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b833601d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 -- 172.21.15.2:0/463917408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8335f32b0 con 0x55b8335ee4a0 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a537fe640 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b833601800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a44031bf0 tx=0x7f8a44003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15766906cbf948b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.269+0000 7f8a32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.270+0000 7f8a32ffd640 1 -- 172.21.15.2:0/463917408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4404b040 con 0x55b8335ee4a0 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.270+0000 7f8a32ffd640 1 -- 172.21.15.2:0/463917408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8a44031670 con 0x55b8335ee4a0 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.270+0000 7f8a5c23c740 1 -- 172.21.15.2:0/463917408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a4c01bad0 con 0x55b8335ee4a0 2024-09-12T00:53:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.270+0000 7f8a32ffd640 1 -- 172.21.15.2:0/463917408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a44035030 con 0x55b8335ee4a0 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.270+0000 7f8a5c23c740 10 client.15441 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.270+0000 7f8a5c23c740 1 -- 172.21.15.2:0/463917408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b833673340 con 0x55b8335ee4a0 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.270+0000 7f8a32ffd640 1 -- 172.21.15.2:0/463917408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a4c01bad0 con 0x55b8335ee4a0 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.270+0000 7f8a32ffd640 1 -- 172.21.15.2:0/463917408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a44004860 con 0x55b8335ee4a0 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.271+0000 7f8a5c23c740 10 client.15441 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.271+0000 7f8a5c23c740 10 client.15441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.271+0000 7f8a5c23c740 20 client.15441 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.271+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b833673b10 0x55b833675f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.271+0000 7f8a5c23c740 4 client.15441 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.271+0000 7f8a5c23c740 1 -- 172.21.15.2:0/463917408 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b83355bd60 con 0x55b833673b10 2024-09-12T00:53:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.271+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b833673b10 0x55b833675f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a52ffd640 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b833673b10 0x55b833675f30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3cf08db2b640a0e server_cookie=2f2aba72ffc371ec in_seq=0 out_seq=0 2024-09-12T00:53:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a32ffd640 10 client.15441 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a32ffd640 1 -- 172.21.15.2:0/463917408 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b83355bd60 con 0x55b833673b10 2024-09-12T00:53:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a32ffd640 10 client.15441 handle_command_reply: tid=0 2024-09-12T00:53:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a5c23c740 1 client.15441 shutdown 2024-09-12T00:53:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a5c23c740 1 -- 172.21.15.2:0/463917408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 msgr2=0x55b833601800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b833601800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a44031bf0 tx=0x7f8a44003f80 comp rx=0 tx=0).stop 2024-09-12T00:53:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a5c23c740 1 -- 172.21.15.2:0/463917408 shutdown_connections 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b833673b10 0x55b833675f30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8335f9680 0x55b8335f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.272+0000 7f8a32ffd640 0 client.15441 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8335eedc0 0x55b833601d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a5c23c740 1 --2- 172.21.15.2:0/463917408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ee4a0 0x55b833601800 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a5c23c740 1 -- 172.21.15.2:0/463917408 >> 172.21.15.2:0/463917408 conn(0x55b8335eaa30 msgr2=0x55b8335e9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a5c23c740 1 -- 172.21.15.2:0/463917408 shutdown_connections 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a5c23c740 1 -- 172.21.15.2:0/463917408 wait complete. 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a5c23c740 20 client.15441 trim_cache size 0 max 16384 2024-09-12T00:53:38.277 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:38.278 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:53:38.278 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:53:38.278 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a59e63640 1 -- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a3c0a2e10 msgr2=0x7f8a3c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a59e63640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a3c0a2e10 0x7f8a3c0a52d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c005fd0 tx=0x7f8a4c009500 comp rx=0 tx=0).stop 2024-09-12T00:53:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a59e63640 1 -- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a541027c0 msgr2=0x7f8a54198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.273+0000 7f8a59e63640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a541027c0 0x7f8a54198970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800e9f0 tx=0x7f8a4800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.274+0000 7f8a59e63640 1 -- 172.21.15.2:0/293668175 shutdown_connections 2024-09-12T00:53:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.274+0000 7f8a59e63640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a3c0a2e10 0x7f8a3c0a52d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.274+0000 7f8a59e63640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a54106f40 0x7f8a5419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.274+0000 7f8a59e63640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a541027c0 0x7f8a54198970 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.274+0000 7f8a59e63640 1 --2- 172.21.15.2:0/293668175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a54101e10 0x7f8a54198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:38.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.274+0000 7f8a59e63640 1 -- 172.21.15.2:0/293668175 >> 172.21.15.2:0/293668175 conn(0x7f8a540fd8d0 msgr2=0x7f8a540fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:38.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.274+0000 7f8a59e63640 1 -- 172.21.15.2:0/293668175 shutdown_connections 2024-09-12T00:53:38.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:38.274+0000 7f8a59e63640 1 -- 172.21.15.2:0/293668175 wait complete. 2024-09-12T00:53:38.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:37 smithi167 ceph-mon[35234]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:38.992 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:53:38.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:53:39.258 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:39.409 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T00:53:39.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:53:40.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:39 smithi002 ceph-mon[31210]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:40.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:39 smithi167 ceph-mon[35234]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:40.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:39 smithi071 ceph-mon[35276]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.419+0000 7f4115a87640 1 -- 172.21.15.2:0/882871445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 msgr2=0x7f41101043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.419+0000 7f4115a87640 1 --2- 172.21.15.2:0/882871445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 0x7f41101043d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4100009900 tx=0x7f410002a410 comp rx=0 tx=0).stop 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 -- 172.21.15.2:0/882871445 shutdown_connections 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 --2- 172.21.15.2:0/882871445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4110109120 0x7f4110110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 --2- 172.21.15.2:0/882871445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41101049a0 0x7f41101089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 --2- 172.21.15.2:0/882871445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 0x7f41101043d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 -- 172.21.15.2:0/882871445 >> 172.21.15.2:0/882871445 conn(0x7f41100ffab0 msgr2=0x7f4110101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 -- 172.21.15.2:0/882871445 shutdown_connections 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 -- 172.21.15.2:0/882871445 wait complete. 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 Processor -- start 2024-09-12T00:53:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.420+0000 7f4115a87640 1 -- start start 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f4115a87640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 0x7f411019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f4115a87640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41101049a0 0x7f411019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f4115a87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4110109120 0x7f411019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f4115a87640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4110114150 con 0x7f4110103ff0 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f4115a87640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4110113fd0 con 0x7f41101049a0 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f4115a87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f41101142d0 con 0x7f4110109120 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 0x7f411019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 0x7f411019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40094/0 (socket says 172.21.15.2:40094) 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410f7fe640 1 -- 172.21.15.2:0/609882308 learned_addr learned my addr 172.21.15.2:0/609882308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410ffff640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4110109120 0x7f411019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410effd640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41101049a0 0x7f411019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410f7fe640 1 -- 172.21.15.2:0/609882308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4110109120 msgr2=0x7f411019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410f7fe640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4110109120 0x7f411019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410f7fe640 1 -- 172.21.15.2:0/609882308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41101049a0 msgr2=0x7f411019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410f7fe640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41101049a0 0x7f411019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410f7fe640 1 -- 172.21.15.2:0/609882308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411019f620 con 0x7f4110103ff0 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410ffff640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4110109120 0x7f411019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.421+0000 7f410effd640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41101049a0 0x7f411019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.422+0000 7f410f7fe640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 0x7f411019a670 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4100006010 tx=0x7f41000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.422+0000 7f410cff9640 1 -- 172.21.15.2:0/609882308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410003f030 con 0x7f4110103ff0 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.422+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411019f8b0 con 0x7f4110103ff0 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.422+0000 7f410cff9640 1 -- 172.21.15.2:0/609882308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4100003ce0 con 0x7f4110103ff0 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.422+0000 7f410cff9640 1 -- 172.21.15.2:0/609882308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100035070 con 0x7f4110103ff0 2024-09-12T00:53:41.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.422+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41101a71f0 con 0x7f4110103ff0 2024-09-12T00:53:41.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:41.701 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:53:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.423+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41101043d0 con 0x7f4110103ff0 2024-09-12T00:53:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.424+0000 7f410cff9640 1 -- 172.21.15.2:0/609882308 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f4100042030 con 0x7f4110103ff0 2024-09-12T00:53:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.425+0000 7f410cff9640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f40f80a2e10 0x7f40f80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.425+0000 7f410effd640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f40f80a2e10 0x7f40f80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:41.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.425+0000 7f410cff9640 1 -- 172.21.15.2:0/609882308 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f41000efd10 con 0x7f4110103ff0 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.425+0000 7f410effd640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f40f80a2e10 0x7f40f80a52d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f41100fffd0 tx=0x7f4104005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.433+0000 7f410cff9640 1 -- 172.21.15.2:0/609882308 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41000bc820 con 0x7f4110103ff0 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.656+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f411019b9d0 con 0x7f4110103ff0 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.657+0000 7f410cff9640 1 -- 172.21.15.2:0/609882308 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f41000bc120 con 0x7f4110103ff0 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f40f80a2e10 msgr2=0x7f40f80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f40f80a2e10 0x7f40f80a52d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f41100fffd0 tx=0x7f4104005f90 comp rx=0 tx=0).stop 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 msgr2=0x7f411019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 0x7f411019a670 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4100006010 tx=0x7f41000042f0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 shutdown_connections 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f40f80a2e10 0x7f40f80a52d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4110109120 0x7f411019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41101049a0 0x7f411019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 --2- 172.21.15.2:0/609882308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110103ff0 0x7f411019a670 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 >> 172.21.15.2:0/609882308 conn(0x7f41100ffab0 msgr2=0x7f4110100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 shutdown_connections 2024-09-12T00:53:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:41.659+0000 7f4115a87640 1 -- 172.21.15.2:0/609882308 wait complete. 2024-09-12T00:53:41.973 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:42.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:41 smithi002 ceph-mon[31210]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:42.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:41 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/609882308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:42.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:41 smithi167 ceph-mon[35234]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:42.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:41 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/609882308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:42.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:41 smithi071 ceph-mon[35276]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:42.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:41 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/609882308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:42.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 -- 172.21.15.2:0/198542737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 msgr2=0x7fab3c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 --2- 172.21.15.2:0/198542737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 0x7fab3c1089f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009900 tx=0x7fab2c02a410 comp rx=0 tx=0).stop 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 -- 172.21.15.2:0/198542737 shutdown_connections 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 --2- 172.21.15.2:0/198542737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3c109120 0x7fab3c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 --2- 172.21.15.2:0/198542737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 0x7fab3c1089f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 --2- 172.21.15.2:0/198542737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c103ff0 0x7fab3c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 -- 172.21.15.2:0/198542737 >> 172.21.15.2:0/198542737 conn(0x7fab3c0ffa90 msgr2=0x7fab3c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 -- 172.21.15.2:0/198542737 shutdown_connections 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.891+0000 7fab4446c640 1 -- 172.21.15.2:0/198542737 wait complete. 2024-09-12T00:53:42.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.892+0000 7fab4446c640 1 Processor -- start 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.892+0000 7fab4446c640 1 -- start start 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab4446c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c103ff0 0x7fab3c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab4446c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 0x7fab3c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab4446c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3c109120 0x7fab3c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab4446c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c114120 con 0x7fab3c1049a0 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab4446c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c113fa0 con 0x7fab3c103ff0 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab4446c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1142a0 con 0x7fab3c109120 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab42208640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c103ff0 0x7fab3c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab42208640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c103ff0 0x7fab3c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:55902/0 (socket says 172.21.15.2:55902) 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab42208640 1 -- 172.21.15.2:0/3207380169 learned_addr learned my addr 172.21.15.2:0/3207380169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab41a07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 0x7fab3c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.893+0000 7fab42a09640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3c109120 0x7fab3c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab41a07640 1 -- 172.21.15.2:0/3207380169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3c109120 msgr2=0x7fab3c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:42.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab41a07640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3c109120 0x7fab3c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab41a07640 1 -- 172.21.15.2:0/3207380169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c103ff0 msgr2=0x7fab3c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab41a07640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c103ff0 0x7fab3c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab41a07640 1 -- 172.21.15.2:0/3207380169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c19f5f0 con 0x7fab3c1049a0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab42208640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c103ff0 0x7fab3c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab41a07640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 0x7fab3c19ab80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fab2c005940 tx=0x7fab2c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab337fe640 1 -- 172.21.15.2:0/3207380169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c03f030 con 0x7fab3c1049a0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab337fe640 1 -- 172.21.15.2:0/3207380169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2c003ce0 con 0x7fab3c1049a0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab337fe640 1 -- 172.21.15.2:0/3207380169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c035070 con 0x7fab3c1049a0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab4446c640 1 -- 172.21.15.2:0/3207380169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3c19f880 con 0x7fab3c1049a0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.894+0000 7fab4446c640 1 -- 172.21.15.2:0/3207380169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3c19fc50 con 0x7fab3c1049a0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.895+0000 7fab317fa640 1 -- 172.21.15.2:0/3207380169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab24005290 con 0x7fab3c1049a0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.897+0000 7fab337fe640 1 -- 172.21.15.2:0/3207380169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fab2c042030 con 0x7fab3c1049a0 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.898+0000 7fab337fe640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab280a2e90 0x7fab280a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:42.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.898+0000 7fab337fe640 1 -- 172.21.15.2:0/3207380169 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fab2c0f00f0 con 0x7fab3c1049a0 2024-09-12T00:53:42.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.898+0000 7fab42208640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab280a2e90 0x7fab280a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:42.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.899+0000 7fab42208640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab280a2e90 0x7fab280a5350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab38005fd0 tx=0x7fab3800b480 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:42.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:42.901+0000 7fab337fe640 1 -- 172.21.15.2:0/3207380169 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab2c0bcb40 con 0x7fab3c1049a0 2024-09-12T00:53:43.007 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:43.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.138+0000 7fab317fa640 1 -- 172.21.15.2:0/3207380169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab24005580 con 0x7fab3c1049a0 2024-09-12T00:53:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.139+0000 7fab337fe640 1 -- 172.21.15.2:0/3207380169 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fab2c0bc440 con 0x7fab3c1049a0 2024-09-12T00:53:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:53:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:53:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.141+0000 7fab317fa640 1 -- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab280a2e90 msgr2=0x7fab280a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.141+0000 7fab317fa640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab280a2e90 0x7fab280a5350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab38005fd0 tx=0x7fab3800b480 comp rx=0 tx=0).stop 2024-09-12T00:53:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.141+0000 7fab317fa640 1 -- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 msgr2=0x7fab3c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.141+0000 7fab317fa640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 0x7fab3c19ab80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fab2c005940 tx=0x7fab2c0042f0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.142+0000 7fab317fa640 1 -- 172.21.15.2:0/3207380169 shutdown_connections 2024-09-12T00:53:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.142+0000 7fab317fa640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab280a2e90 0x7fab280a5350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.142+0000 7fab317fa640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3c109120 0x7fab3c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.142+0000 7fab317fa640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab3c1049a0 0x7fab3c19ab80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.142+0000 7fab317fa640 1 --2- 172.21.15.2:0/3207380169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab3c103ff0 0x7fab3c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.142+0000 7fab317fa640 1 -- 172.21.15.2:0/3207380169 >> 172.21.15.2:0/3207380169 conn(0x7fab3c0ffa90 msgr2=0x7fab3c100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.142+0000 7fab317fa640 1 -- 172.21.15.2:0/3207380169 shutdown_connections 2024-09-12T00:53:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.142+0000 7fab317fa640 1 -- 172.21.15.2:0/3207380169 wait complete. 2024-09-12T00:53:43.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 -- 172.21.15.2:0/808353154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 msgr2=0x7fb8901021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 --2- 172.21.15.2:0/808353154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 0x7fb8901021d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009900 tx=0x7fb88c02a410 comp rx=0 tx=0).stop 2024-09-12T00:53:43.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 -- 172.21.15.2:0/808353154 shutdown_connections 2024-09-12T00:53:43.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 --2- 172.21.15.2:0/808353154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb890106f20 0x7fb89010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 --2- 172.21.15.2:0/808353154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8901027a0 0x7fb8901067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 --2- 172.21.15.2:0/808353154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 0x7fb8901021d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 -- 172.21.15.2:0/808353154 >> 172.21.15.2:0/808353154 conn(0x7fb8900fd8f0 msgr2=0x7fb8900ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 -- 172.21.15.2:0/808353154 shutdown_connections 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.700+0000 7fb89788d640 1 -- 172.21.15.2:0/808353154 wait complete. 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb89788d640 1 Processor -- start 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb89788d640 1 -- start start 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb89788d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 0x7fb89019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb89788d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8901027a0 0x7fb89019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb89788d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb890106f20 0x7fb89019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb89788d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb890111ff0 con 0x7fb890101df0 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb89788d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb890111e70 con 0x7fb890106f20 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb89788d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb890112170 con 0x7fb8901027a0 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb895629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 0x7fb89019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb895629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 0x7fb89019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40136/0 (socket says 172.21.15.2:40136) 2024-09-12T00:53:43.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.701+0000 7fb895629640 1 -- 172.21.15.2:0/1807986638 learned_addr learned my addr 172.21.15.2:0/1807986638 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb895e2a640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb890106f20 0x7fb89019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb894e28640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8901027a0 0x7fb89019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb895629640 1 -- 172.21.15.2:0/1807986638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8901027a0 msgr2=0x7fb89019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb895629640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8901027a0 0x7fb89019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb895629640 1 -- 172.21.15.2:0/1807986638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb890106f20 msgr2=0x7fb89019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb895629640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb890106f20 0x7fb89019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb895629640 1 -- 172.21.15.2:0/1807986638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89019f610 con 0x7fb890101df0 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb895e2a640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb890106f20 0x7fb89019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb894e28640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8901027a0 0x7fb89019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb895629640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 0x7fb89019a660 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb88c006010 tx=0x7fb88c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb8867fc640 1 -- 172.21.15.2:0/1807986638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c03f070 con 0x7fb890101df0 2024-09-12T00:53:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb89788d640 1 -- 172.21.15.2:0/1807986638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89019f8a0 con 0x7fb890101df0 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb8867fc640 1 -- 172.21.15.2:0/1807986638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb88c031c90 con 0x7fb890101df0 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb8867fc640 1 -- 172.21.15.2:0/1807986638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c035030 con 0x7fb890101df0 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.702+0000 7fb89788d640 1 -- 172.21.15.2:0/1807986638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8901a71e0 con 0x7fb890101df0 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.705+0000 7fb899c66740 1 Processor -- start 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb899c66740 1 -- start start 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb8867fc640 1 -- 172.21.15.2:0/1807986638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fb88c042070 con 0x7fb890101df0 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb899c66740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 0x55b577834090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb899c66740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b577834a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb899c66740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b57783f370 0x55b577841760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb899c66740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b57779a2f0 con 0x55b5778345d0 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb899c66740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b577741cf0 con 0x55b57783f370 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb899c66740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5777962b0 con 0x55b577835b40 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b577834a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b577834a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40140/0 (socket says 172.21.15.2:40140) 2024-09-12T00:53:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895629640 1 -- 172.21.15.2:0/3668484997 learned_addr learned my addr 172.21.15.2:0/3668484997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895e2a640 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 0x55b577834090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb894e28640 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b57783f370 0x55b577841760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895629640 1 -- 172.21.15.2:0/3668484997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 msgr2=0x55b577834090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895629640 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 0x55b577834090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895629640 1 -- 172.21.15.2:0/3668484997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b57783f370 msgr2=0x55b577841760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895629640 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b57783f370 0x55b577841760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.706+0000 7fb895629640 1 -- 172.21.15.2:0/3668484997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5777263a0 con 0x55b5778345d0 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.707+0000 7fb894e28640 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b57783f370 0x55b577841760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.707+0000 7fb8867fc640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb87c0a3010 0x7fb87c0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.707+0000 7fb895629640 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b577834a10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0ed100 tx=0x7fb88c0f5cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210cfafbb22fe466 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.707+0000 7fb895e2a640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb87c0a3010 0x7fb87c0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.707+0000 7fb8867fc640 1 -- 172.21.15.2:0/1807986638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb88c03bc90 con 0x7fb890101df0 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.707+0000 7fb87b7fe640 1 -- 172.21.15.2:0/3668484997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0b8060 con 0x55b5778345d0 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.707+0000 7fb87b7fe640 1 -- 172.21.15.2:0/3668484997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb88c0bc4c0 con 0x55b5778345d0 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.707+0000 7fb87b7fe640 1 -- 172.21.15.2:0/3668484997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0bb720 con 0x55b5778345d0 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 -- 172.21.15.2:0/3668484997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 msgr2=0x55b577834a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b577834a10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0ed100 tx=0x7fb88c0f5cd0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb895e2a640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb87c0a3010 0x7fb87c0a54d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb888007f90 tx=0x7fb888007720 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 -- 172.21.15.2:0/3668484997 shutdown_connections 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b57783f370 0x55b577841760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b577834a10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 --2- 172.21.15.2:0/3668484997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 0x55b577834090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 -- 172.21.15.2:0/3668484997 >> 172.21.15.2:0/3668484997 conn(0x55b5777fd310 msgr2=0x55b577830c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 -- 172.21.15.2:0/3668484997 shutdown_connections 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 -- 172.21.15.2:0/3668484997 wait complete. 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.708+0000 7fb899c66740 1 -- start start 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb899c66740 1 Processor -- start 2024-09-12T00:53:43.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb899c66740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b57783ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb899c66740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 0x55b57783c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb899c66740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b57783f370 0x55b57783c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb899c66740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b577841e30 con 0x55b57783f370 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb899c66740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b577755060 con 0x55b5778345d0 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb899c66740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b577841fb0 con 0x55b577835b40 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb899c66740 10 client.0 _ll_register_callbacks cb 0x55b5774a88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb895e2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b57783f370 0x55b57783c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb895629640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b57783ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb895e2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b57783f370 0x55b57783c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40152/0 (socket says 172.21.15.2:40152) 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb895e2a640 1 -- 172.21.15.2:0/125770898 learned_addr learned my addr 172.21.15.2:0/125770898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:43.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb895629640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b57783ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:55938/0 (socket says 172.21.15.2:55938) 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.709+0000 7fb894e28640 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 0x55b57783c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb895e2a640 1 -- 172.21.15.2:0/125770898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 msgr2=0x55b57783c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb895e2a640 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 0x55b57783c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb895e2a640 1 -- 172.21.15.2:0/125770898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 msgr2=0x55b57783ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb895e2a640 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b57783ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb895e2a640 1 -- 172.21.15.2:0/125770898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b57750b3c0 con 0x55b57783f370 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb895629640 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b57783ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb895e2a640 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b57783f370 0x55b57783c7d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb88800fe80 tx=0x7fb888004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef4df4fc10fe520 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb878ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb878ff9640 1 -- 172.21.15.2:0/125770898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88800ec30 con 0x55b57783f370 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb878ff9640 1 -- 172.21.15.2:0/125770898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb88800edd0 con 0x55b57783f370 2024-09-12T00:53:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb899c66740 1 -- 172.21.15.2:0/125770898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb88c0bc4c0 con 0x55b57783f370 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb878ff9640 1 -- 172.21.15.2:0/125770898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb888026430 con 0x55b57783f370 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb899c66740 10 client.15465 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb899c66740 1 -- 172.21.15.2:0/125770898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b57784d900 con 0x55b57783f370 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.710+0000 7fb878ff9640 1 -- 172.21.15.2:0/125770898 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb88c0bc4c0 con 0x55b57783f370 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.711+0000 7fb878ff9640 1 -- 172.21.15.2:0/125770898 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb88801c7b0 con 0x55b57783f370 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.711+0000 7fb899c66740 10 client.15465 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.711+0000 7fb899c66740 10 client.15465 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.711+0000 7fb899c66740 20 client.15465 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.711+0000 7fb899c66740 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55b57784edc0 0x55b577851240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.711+0000 7fb899c66740 4 client.15465 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.711+0000 7fb899c66740 1 -- 172.21.15.2:0/125770898 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5777a7860 con 0x55b57784edc0 2024-09-12T00:53:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.711+0000 7fb895629640 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55b57784edc0 0x55b577851240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb895629640 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55b57784edc0 0x55b577851240 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed02436f2b2d1055 server_cookie=eb1b5ca176532e7b in_seq=0 out_seq=0 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb878ff9640 10 client.15465 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb878ff9640 1 -- 172.21.15.2:0/125770898 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5777a7860 con 0x55b57784edc0 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb878ff9640 10 client.15465 handle_command_reply: tid=0 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb899c66740 1 client.15465 shutdown 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb899c66740 1 -- 172.21.15.2:0/125770898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b57783f370 msgr2=0x55b57783c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb899c66740 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b57783f370 0x55b57783c7d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb88800fe80 tx=0x7fb888004a40 comp rx=0 tx=0).stop 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb899c66740 1 -- 172.21.15.2:0/125770898 shutdown_connections 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.712+0000 7fb899c66740 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55b57784edc0 0x55b577851240 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.713+0000 7fb899c66740 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b57783f370 0x55b57783c7d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.713+0000 7fb899c66740 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b577835b40 0x55b57783c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.713+0000 7fb899c66740 1 --2- 172.21.15.2:0/125770898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b57783ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.713+0000 7fb899c66740 1 -- 172.21.15.2:0/125770898 >> 172.21.15.2:0/125770898 conn(0x55b5777fd310 msgr2=0x55b577836960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.713+0000 7fb878ff9640 0 client.15465 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.713+0000 7fb899c66740 1 -- 172.21.15.2:0/125770898 shutdown_connections 2024-09-12T00:53:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.713+0000 7fb899c66740 1 -- 172.21.15.2:0/125770898 wait complete. 2024-09-12T00:53:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.713+0000 7fb899c66740 20 client.15465 trim_cache size 0 max 16384 2024-09-12T00:53:43.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb899c66740 1 Processor -- start 2024-09-12T00:53:43.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb899c66740 1 -- start start 2024-09-12T00:53:43.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb899c66740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b57784b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb899c66740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b577835b40 0x55b57783b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb899c66740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 0x55b577856b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb899c66740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb8901b2520 con 0x55b5778345d0 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb899c66740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8901afdf0 con 0x55b577835b40 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb899c66740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8901adc40 con 0x55b57783f370 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb895629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b57784b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb895629640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b57784b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40168/0 (socket says 172.21.15.2:40168) 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb895629640 1 -- 172.21.15.2:0/799758842 learned_addr learned my addr 172.21.15.2:0/799758842 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.727+0000 7fb894e28640 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b577835b40 0x55b57783b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb895e2a640 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 0x55b577856b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb895629640 1 -- 172.21.15.2:0/799758842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 msgr2=0x55b577856b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb895629640 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 0x55b577856b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb895629640 1 -- 172.21.15.2:0/799758842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b577835b40 msgr2=0x55b57783b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb895629640 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b577835b40 0x55b57783b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb895629640 1 -- 172.21.15.2:0/799758842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b57783b5b0 con 0x55b5778345d0 2024-09-12T00:53:43.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb895629640 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b57784b090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0bbd50 tx=0x7fb88c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd617f82e287e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb87affd640 1 -- 172.21.15.2:0/799758842 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c049070 con 0x55b5778345d0 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb87affd640 1 -- 172.21.15.2:0/799758842 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb88c0bc4c0 con 0x55b5778345d0 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.728+0000 7fb87affd640 1 -- 172.21.15.2:0/799758842 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0bb900 con 0x55b5778345d0 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 -- 172.21.15.2:0/799758842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 msgr2=0x55b57784b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b57784b090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0bbd50 tx=0x7fb88c009560 comp rx=0 tx=0).stop 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 -- 172.21.15.2:0/799758842 shutdown_connections 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 0x55b577856b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b577835b40 0x55b57783b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 --2- 172.21.15.2:0/799758842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5778345d0 0x55b57784b090 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 -- 172.21.15.2:0/799758842 >> 172.21.15.2:0/799758842 conn(0x55b5777fd310 msgr2=0x55b57783a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 -- 172.21.15.2:0/799758842 shutdown_connections 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 -- 172.21.15.2:0/799758842 wait complete. 2024-09-12T00:53:43.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 -- start start 2024-09-12T00:53:43.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.729+0000 7fb899c66740 1 Processor -- start 2024-09-12T00:53:43.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb899c66740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b577847620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb899c66740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b577835b40 0x55b577842950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb899c66740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 0x55b577842e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb899c66740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb8901ae2b0 con 0x55b577835b40 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb899c66740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8901af720 con 0x55b5778345d0 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb899c66740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8901ae980 con 0x55b57783f370 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb899c66740 10 client.0 _ll_register_callbacks cb 0x7fb88800fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb894e28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b577835b40 0x55b577842950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb894e28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b577835b40 0x55b577842950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40182/0 (socket says 172.21.15.2:40182) 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb894e28640 1 -- 172.21.15.2:0/378124915 learned_addr learned my addr 172.21.15.2:0/378124915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb895629640 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b577847620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb894e28640 1 -- 172.21.15.2:0/378124915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 msgr2=0x55b577842e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.730+0000 7fb894e28640 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 0x55b577842e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb894e28640 1 -- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 msgr2=0x55b577847620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb894e28640 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b577847620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb894e28640 1 -- 172.21.15.2:0/378124915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5778433d0 con 0x55b577835b40 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb895629640 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b577847620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb894e28640 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b577835b40 0x55b577842950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55b577835070 tx=0x7fb880014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971d6814bac53b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb878ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb878ff9640 1 -- 172.21.15.2:0/378124915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88001a070 con 0x55b577835b40 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb878ff9640 1 -- 172.21.15.2:0/378124915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb880016700 con 0x55b577835b40 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb899c66740 1 -- 172.21.15.2:0/378124915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb88c0bc4c0 con 0x55b577835b40 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb878ff9640 1 -- 172.21.15.2:0/378124915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb880016900 con 0x55b577835b40 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb899c66740 10 client.15471 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb899c66740 1 -- 172.21.15.2:0/378124915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5778b9840 con 0x55b577835b40 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.731+0000 7fb878ff9640 1 -- 172.21.15.2:0/378124915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb88c0bc4c0 con 0x55b577835b40 2024-09-12T00:53:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb878ff9640 1 -- 172.21.15.2:0/378124915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb88001fcc0 con 0x55b577835b40 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb899c66740 10 client.15471 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb899c66740 10 client.15471 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb899c66740 20 client.15471 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb899c66740 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55b5778ba020 0x55b5778bc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb899c66740 4 client.15471 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb899c66740 1 -- 172.21.15.2:0/378124915 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b5777a1d70 con 0x55b5778ba020 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb895629640 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55b5778ba020 0x55b5778bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb895629640 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55b5778ba020 0x55b5778bc440 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2a18e85dea1bf3a7 server_cookie=3978a1a5d7976a3c in_seq=0 out_seq=0 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.732+0000 7fb878ff9640 10 client.15471 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb878ff9640 1 -- 172.21.15.2:0/378124915 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b5777a1d70 con 0x55b5778ba020 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb878ff9640 10 client.15471 handle_command_reply: tid=0 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 client.15471 shutdown 2024-09-12T00:53:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 -- 172.21.15.2:0/378124915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b577835b40 msgr2=0x55b577842950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b577835b40 0x55b577842950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55b577835070 tx=0x7fb880014830 comp rx=0 tx=0).stop 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 -- 172.21.15.2:0/378124915 shutdown_connections 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55b5778ba020 0x55b5778bc440 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b57783f370 0x55b577842e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b577835b40 0x55b577842950 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 --2- 172.21.15.2:0/378124915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5778345d0 0x55b577847620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 -- 172.21.15.2:0/378124915 >> 172.21.15.2:0/378124915 conn(0x55b5777fd310 msgr2=0x55b57783d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb878ff9640 0 client.15471 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 -- 172.21.15.2:0/378124915 shutdown_connections 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 1 -- 172.21.15.2:0/378124915 wait complete. 2024-09-12T00:53:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.733+0000 7fb899c66740 20 client.15471 trim_cache size 0 max 16384 2024-09-12T00:53:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:53:43.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 -- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb87c0a3010 msgr2=0x7fb87c0a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb87c0a3010 0x7fb87c0a54d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb888007f90 tx=0x7fb888007720 comp rx=0 tx=0).stop 2024-09-12T00:53:43.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 -- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 msgr2=0x7fb89019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:43.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 0x7fb89019a660 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb88c006010 tx=0x7fb88c003ba0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 -- 172.21.15.2:0/1807986638 shutdown_connections 2024-09-12T00:53:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb87c0a3010 0x7fb87c0a54d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb890106f20 0x7fb89019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8901027a0 0x7fb89019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 --2- 172.21.15.2:0/1807986638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb890101df0 0x7fb89019a660 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 -- 172.21.15.2:0/1807986638 >> 172.21.15.2:0/1807986638 conn(0x7fb8900fd8f0 msgr2=0x7fb8900feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 -- 172.21.15.2:0/1807986638 shutdown_connections 2024-09-12T00:53:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:43.734+0000 7fb89788d640 1 -- 172.21.15.2:0/1807986638 wait complete. 2024-09-12T00:53:44.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:43 smithi002 ceph-mon[31210]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:44.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:43 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3207380169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:44.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:43 smithi167 ceph-mon[35234]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:44.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:43 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3207380169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:44.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:53:44.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:43 smithi071 ceph-mon[35276]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:44.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:43 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3207380169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:44.950 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T00:53:44.951 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T00:53:45.036 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:45.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 -- 172.21.15.2:0/4120064610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 msgr2=0x7fde5010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 --2- 172.21.15.2:0/4120064610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 0x7fde5010ec40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fde48009cd0 tx=0x7fde4802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 -- 172.21.15.2:0/4120064610 shutdown_connections 2024-09-12T00:53:45.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 --2- 172.21.15.2:0/4120064610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 0x7fde5010ec40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 --2- 172.21.15.2:0/4120064610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde501036e0 0x7fde50107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 --2- 172.21.15.2:0/4120064610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde50102d30 0x7fde50103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 -- 172.21.15.2:0/4120064610 >> 172.21.15.2:0/4120064610 conn(0x7fde500fc7d0 msgr2=0x7fde500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 -- 172.21.15.2:0/4120064610 shutdown_connections 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.547+0000 7fde56e8f640 1 -- 172.21.15.2:0/4120064610 wait complete. 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde56e8f640 1 Processor -- start 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde56e8f640 1 -- start start 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde56e8f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde50102d30 0x7fde50100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde56e8f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde501036e0 0x7fde50100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde56e8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 0x7fde50101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde56e8f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fde501120a0 con 0x7fde501082a0 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde56e8f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde50111f20 con 0x7fde501036e0 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde56e8f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde50112220 con 0x7fde50102d30 2024-09-12T00:53:45.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde5542c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 0x7fde50101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde5542c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 0x7fde50101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40196/0 (socket says 172.21.15.2:40196) 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde501036e0 0x7fde50100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.548+0000 7fde5542c640 1 -- 172.21.15.2:0/3944042594 learned_addr learned my addr 172.21.15.2:0/3944042594 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde54c2b640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde50102d30 0x7fde50100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde5542c640 1 -- 172.21.15.2:0/3944042594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde50102d30 msgr2=0x7fde50100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde5542c640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde50102d30 0x7fde50100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde5542c640 1 -- 172.21.15.2:0/3944042594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde501036e0 msgr2=0x7fde50100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde5542c640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde501036e0 0x7fde50100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde5542c640 1 -- 172.21.15.2:0/3944042594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde501a6a00 con 0x7fde501082a0 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde4ffff640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde501036e0 0x7fde50100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde5542c640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 0x7fde50101410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fde48005cc0 tx=0x7fde48032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde4dffb640 1 -- 172.21.15.2:0/3944042594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48004040 con 0x7fde501082a0 2024-09-12T00:53:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde4dffb640 1 -- 172.21.15.2:0/3944042594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde480046c0 con 0x7fde501082a0 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde56e8f640 1 -- 172.21.15.2:0/3944042594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde501a6c90 con 0x7fde501082a0 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.549+0000 7fde4dffb640 1 -- 172.21.15.2:0/3944042594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48030e00 con 0x7fde501082a0 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.550+0000 7fde56e8f640 1 -- 172.21.15.2:0/3944042594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde501a7220 con 0x7fde501082a0 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.552+0000 7fde4dffb640 1 -- 172.21.15.2:0/3944042594 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fde480305a0 con 0x7fde501082a0 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.552+0000 7fde59268740 1 Processor -- start 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.552+0000 7fde59268740 1 -- start start 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde59268740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032adb40 0x5650032ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde59268740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 0x5650032aca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde59268740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032b7370 0x5650032b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde59268740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650032122f0 con 0x5650032b7370 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde59268740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5650031b9cf0 con 0x5650032adb40 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde59268740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56500320e2b0 con 0x5650032ac5d0 2024-09-12T00:53:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032b7370 0x5650032b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4dffb640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fde400a2e90 0x7fde400a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032b7370 0x5650032b9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40200/0 (socket says 172.21.15.2:40200) 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 -- 172.21.15.2:0/449571271 learned_addr learned my addr 172.21.15.2:0/449571271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde54c2b640 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 0x5650032aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032adb40 0x5650032ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde5542c640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fde400a2e90 0x7fde400a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 -- 172.21.15.2:0/449571271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 msgr2=0x5650032aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 0x5650032aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 -- 172.21.15.2:0/449571271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032adb40 msgr2=0x5650032ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032adb40 0x5650032ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4ffff640 1 -- 172.21.15.2:0/449571271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500319e3a0 con 0x5650032b7370 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.553+0000 7fde4dffb640 1 -- 172.21.15.2:0/3944042594 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fde4802e030 con 0x7fde501082a0 2024-09-12T00:53:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.554+0000 7fde4ffff640 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032b7370 0x5650032b9760 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fde3c011ae0 tx=0x7fde3c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9eae2b58fff044 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.554+0000 7fde5542c640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fde400a2e90 0x7fde400a5350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fde480ee3d0 tx=0x7fde480b8be0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.554+0000 7fde3affd640 1 -- 172.21.15.2:0/449571271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c011110 con 0x5650032b7370 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.554+0000 7fde3affd640 1 -- 172.21.15.2:0/449571271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde3c0112b0 con 0x5650032b7370 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.554+0000 7fde3affd640 1 -- 172.21.15.2:0/449571271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c003810 con 0x5650032b7370 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 -- 172.21.15.2:0/449571271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032b7370 msgr2=0x5650032b9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032b7370 0x5650032b9760 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fde3c011ae0 tx=0x7fde3c0096c0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 -- 172.21.15.2:0/449571271 shutdown_connections 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032b7370 0x5650032b9760 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 0x5650032aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 --2- 172.21.15.2:0/449571271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032adb40 0x5650032ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 -- 172.21.15.2:0/449571271 >> 172.21.15.2:0/449571271 conn(0x565003275310 msgr2=0x5650032a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 -- 172.21.15.2:0/449571271 shutdown_connections 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 -- 172.21.15.2:0/449571271 wait complete. 2024-09-12T00:53:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 -- start start 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.555+0000 7fde59268740 1 Processor -- start 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde59268740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde59268740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde59268740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde59268740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650032ba010 con 0x5650032adb40 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde59268740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5650031cd060 con 0x5650032ac5d0 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde59268740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5650032ba190 con 0x5650032b7370 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde59268740 10 client.0 _ll_register_callbacks cb 0x565002f208c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde54c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde54c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40212/0 (socket says 172.21.15.2:40212) 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde54c2b640 1 -- 172.21.15.2:0/634708101 learned_addr learned my addr 172.21.15.2:0/634708101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde4ffff640 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde4ffff640 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde54c2b640 1 -- 172.21.15.2:0/634708101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 msgr2=0x5650032b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde54c2b640 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde54c2b640 1 -- 172.21.15.2:0/634708101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 msgr2=0x5650032b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde54c2b640 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde54c2b640 1 -- 172.21.15.2:0/634708101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565002f833c0 con 0x5650032adb40 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.556+0000 7fde4ffff640 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde54c2b640 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b4030 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fde4400bfc0 tx=0x7fde440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da76b0e762d909ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde2ffff640 1 -- 172.21.15.2:0/634708101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44004020 con 0x5650032adb40 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde2ffff640 1 -- 172.21.15.2:0/634708101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fde440041c0 con 0x5650032adb40 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 1 -- 172.21.15.2:0/634708101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde3c0112b0 con 0x5650032adb40 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde2ffff640 1 -- 172.21.15.2:0/634708101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fde440043c0 con 0x5650032adb40 2024-09-12T00:53:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 10 client.15483 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 1 -- 172.21.15.2:0/634708101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5650032c5b10 con 0x5650032adb40 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde2ffff640 1 -- 172.21.15.2:0/634708101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde3c0112b0 con 0x5650032adb40 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde2ffff640 1 -- 172.21.15.2:0/634708101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fde44003b90 con 0x5650032adb40 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 10 client.15483 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 10 client.15483 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 20 client.15483 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5650032c6fd0 0x5650032c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 4 client.15483 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.557+0000 7fde59268740 1 -- 172.21.15.2:0/634708101 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56500321f860 con 0x5650032c6fd0 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.558+0000 7fde4ffff640 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5650032c6fd0 0x5650032c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.558+0000 7fde2ffff640 10 client.15483 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.558+0000 7fde4ffff640 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5650032c6fd0 0x5650032c9430 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5bf3ab8545364a02 server_cookie=236caa70d8a17da7 in_seq=0 out_seq=0 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde2ffff640 1 -- 172.21.15.2:0/634708101 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56500321f860 con 0x5650032c6fd0 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde2ffff640 10 client.15483 handle_command_reply: tid=0 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 client.15483 shutdown 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 -- 172.21.15.2:0/634708101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 msgr2=0x5650032b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b4030 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fde4400bfc0 tx=0x7fde440118d0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 -- 172.21.15.2:0/634708101 shutdown_connections 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5650032c6fd0 0x5650032c9430 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b4030 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 --2- 172.21.15.2:0/634708101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde2ffff640 0 client.15483 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 -- 172.21.15.2:0/634708101 >> 172.21.15.2:0/634708101 conn(0x565003275310 msgr2=0x5650032ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 -- 172.21.15.2:0/634708101 shutdown_connections 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 1 -- 172.21.15.2:0/634708101 wait complete. 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.559+0000 7fde59268740 20 client.15483 trim_cache size 0 max 16384 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde59268740 1 Processor -- start 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde59268740 1 -- start start 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde59268740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde59268740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde59268740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde59268740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fde501b23f0 con 0x5650032adb40 2024-09-12T00:53:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde59268740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde501afcc0 con 0x5650032ac5d0 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde59268740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde501adb10 con 0x5650032b7370 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde54c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde54c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40220/0 (socket says 172.21.15.2:40220) 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde54c2b640 1 -- 172.21.15.2:0/1288166933 learned_addr learned my addr 172.21.15.2:0/1288166933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.573+0000 7fde4ffff640 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde4ffff640 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde54c2b640 1 -- 172.21.15.2:0/1288166933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 msgr2=0x5650032a7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde54c2b640 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032a7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde54c2b640 1 -- 172.21.15.2:0/1288166933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 msgr2=0x5650032c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde54c2b640 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032c32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde54c2b640 1 -- 172.21.15.2:0/1288166933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650032b3020 con 0x5650032adb40 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde4ffff640 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032a7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde54c2b640 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b38f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fde44005d00 tx=0x7fde44005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c447689d4ae8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde3a7fc640 1 -- 172.21.15.2:0/1288166933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44003fd0 con 0x5650032adb40 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde3a7fc640 1 -- 172.21.15.2:0/1288166933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde44004170 con 0x5650032adb40 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.574+0000 7fde3a7fc640 1 -- 172.21.15.2:0/1288166933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440055d0 con 0x5650032adb40 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 -- 172.21.15.2:0/1288166933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 msgr2=0x5650032b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b38f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fde44005d00 tx=0x7fde44005900 comp rx=0 tx=0).stop 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 -- 172.21.15.2:0/1288166933 shutdown_connections 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032b7370 0x5650032a7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b38f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 --2- 172.21.15.2:0/1288166933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032ac5d0 0x5650032c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 -- 172.21.15.2:0/1288166933 >> 172.21.15.2:0/1288166933 conn(0x565003275310 msgr2=0x5650032a74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 -- 172.21.15.2:0/1288166933 shutdown_connections 2024-09-12T00:53:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.575+0000 7fde59268740 1 -- 172.21.15.2:0/1288166933 wait complete. 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 1 -- start start 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 1 Processor -- start 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 0x5650032b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032b7370 0x5650032b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fde501ae180 con 0x5650032adb40 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde501af5f0 con 0x5650032b7370 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde501ae850 con 0x5650032ac5d0 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde59268740 10 client.0 _ll_register_callbacks cb 0x7fde4400bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde54c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde54c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40234/0 (socket says 172.21.15.2:40234) 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.576+0000 7fde54c2b640 1 -- 172.21.15.2:0/2493691365 learned_addr learned my addr 172.21.15.2:0/2493691365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde4ffff640 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 0x5650032b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde54c2b640 1 -- 172.21.15.2:0/2493691365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 msgr2=0x5650032b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde54c2b640 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 0x5650032b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde54c2b640 1 -- 172.21.15.2:0/2493691365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032b7370 msgr2=0x5650032b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde54c2b640 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032b7370 0x5650032b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde54c2b640 1 -- 172.21.15.2:0/2493691365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565003339530 con 0x5650032adb40 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde54c2b640 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b1600 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fde44011910 tx=0x7fde44012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2ec1f95cc824cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde2ffff640 1 -- 172.21.15.2:0/2493691365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44039020 con 0x5650032adb40 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde2ffff640 1 -- 172.21.15.2:0/2493691365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fde440107c0 con 0x5650032adb40 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.577+0000 7fde59268740 1 -- 172.21.15.2:0/2493691365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde44004170 con 0x5650032adb40 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde2ffff640 1 -- 172.21.15.2:0/2493691365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fde44044050 con 0x5650032adb40 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde59268740 10 client.15489 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde59268740 1 -- 172.21.15.2:0/2493691365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56500333a780 con 0x5650032adb40 2024-09-12T00:53:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde2ffff640 1 -- 172.21.15.2:0/2493691365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde44004170 con 0x5650032adb40 2024-09-12T00:53:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde2ffff640 1 -- 172.21.15.2:0/2493691365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fde440035f0 con 0x5650032adb40 2024-09-12T00:53:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde59268740 10 client.15489 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde59268740 10 client.15489 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:53:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde59268740 20 client.15489 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde59268740 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56500333af10 0x56500333d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde59268740 4 client.15489 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:53:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.578+0000 7fde59268740 1 -- 172.21.15.2:0/2493691365 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565003219d70 con 0x56500333af10 2024-09-12T00:53:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.579+0000 7fde4ffff640 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56500333af10 0x56500333d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.579+0000 7fde2ffff640 10 client.15489 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.579+0000 7fde4ffff640 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56500333af10 0x56500333d330 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2258aec04f0f6a07 server_cookie=4b87913a3481fcd6 in_seq=0 out_seq=0 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.579+0000 7fde2ffff640 1 -- 172.21.15.2:0/2493691365 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565003219d70 con 0x56500333af10 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.579+0000 7fde2ffff640 10 client.15489 handle_command_reply: tid=0 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.579+0000 7fde59268740 1 client.15489 shutdown 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.579+0000 7fde59268740 1 -- 172.21.15.2:0/2493691365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 msgr2=0x5650032b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.579+0000 7fde59268740 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b1600 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fde44011910 tx=0x7fde44012fd0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 1 -- 172.21.15.2:0/2493691365 shutdown_connections 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56500333af10 0x56500333d330 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650032b7370 0x5650032b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650032adb40 0x5650032b1600 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 1 --2- 172.21.15.2:0/2493691365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650032ac5d0 0x5650032b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde2ffff640 0 client.15489 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 1 -- 172.21.15.2:0/2493691365 >> 172.21.15.2:0/2493691365 conn(0x565003275310 msgr2=0x5650032a74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 1 -- 172.21.15.2:0/2493691365 shutdown_connections 2024-09-12T00:53:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 1 -- 172.21.15.2:0/2493691365 wait complete. 2024-09-12T00:53:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde59268740 20 client.15489 trim_cache size 0 max 16384 2024-09-12T00:53:45.595 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde56e8f640 1 -- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fde400a2e90 msgr2=0x7fde400a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde56e8f640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fde400a2e90 0x7fde400a5350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fde480ee3d0 tx=0x7fde480b8be0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde56e8f640 1 -- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 msgr2=0x7fde50101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.580+0000 7fde56e8f640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 0x7fde50101410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fde48005cc0 tx=0x7fde48032f40 comp rx=0 tx=0).stop 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.581+0000 7fde56e8f640 1 -- 172.21.15.2:0/3944042594 shutdown_connections 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.581+0000 7fde56e8f640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fde400a2e90 0x7fde400a5350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.581+0000 7fde56e8f640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde501082a0 0x7fde50101410 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.581+0000 7fde56e8f640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde501036e0 0x7fde50100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.581+0000 7fde56e8f640 1 --2- 172.21.15.2:0/3944042594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde50102d30 0x7fde50100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.581+0000 7fde56e8f640 1 -- 172.21.15.2:0/3944042594 >> 172.21.15.2:0/3944042594 conn(0x7fde500fc7d0 msgr2=0x7fde50105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.581+0000 7fde56e8f640 1 -- 172.21.15.2:0/3944042594 shutdown_connections 2024-09-12T00:53:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:45.581+0000 7fde56e8f640 1 -- 172.21.15.2:0/3944042594 wait complete. 2024-09-12T00:53:46.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:45 smithi002 ceph-mon[31210]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:46.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:53:46.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:45 smithi167 ceph-mon[35234]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:46.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:45 smithi071 ceph-mon[35276]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:46.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 -- 172.21.15.2:0/4192394375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0101de0 msgr2=0x7f63a01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 --2- 172.21.15.2:0/4192394375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0101de0 0x7f63a01021c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f639c009900 tx=0x7f639c02a410 comp rx=0 tx=0).stop 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 -- 172.21.15.2:0/4192394375 shutdown_connections 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 --2- 172.21.15.2:0/4192394375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63a0106f10 0x7f63a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 --2- 172.21.15.2:0/4192394375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0102790 0x7f63a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 --2- 172.21.15.2:0/4192394375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0101de0 0x7f63a01021c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 -- 172.21.15.2:0/4192394375 >> 172.21.15.2:0/4192394375 conn(0x7f63a00fd880 msgr2=0x7f63a00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 -- 172.21.15.2:0/4192394375 shutdown_connections 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.856+0000 7f63a810b640 1 -- 172.21.15.2:0/4192394375 wait complete. 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.857+0000 7f63a810b640 1 Processor -- start 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.857+0000 7f63a810b640 1 -- start start 2024-09-12T00:53:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.857+0000 7f63a810b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0101de0 0x7f63a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.857+0000 7f63a810b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0102790 0x7f63a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a810b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63a0106f10 0x7f63a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a810b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63a0111f70 con 0x7f63a0102790 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a810b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63a0111df0 con 0x7f63a0101de0 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a810b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63a01120f0 con 0x7f63a0106f10 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0102790 0x7f63a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0102790 0x7f63a0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60540/0 (socket says 172.21.15.2:60540) 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 -- 172.21.15.2:0/480400657 learned_addr learned my addr 172.21.15.2:0/480400657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a66a8640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63a0106f10 0x7f63a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0101de0 0x7f63a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 -- 172.21.15.2:0/480400657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63a0106f10 msgr2=0x7f63a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63a0106f10 0x7f63a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 -- 172.21.15.2:0/480400657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0101de0 msgr2=0x7f63a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0101de0 0x7f63a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 -- 172.21.15.2:0/480400657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a01a68b0 con 0x7f63a0102790 2024-09-12T00:53:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f63a56a6640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0102790 0x7f63a0074a30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f639000e9f0 tx=0x7f639000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.858+0000 7f6396ffd640 1 -- 172.21.15.2:0/480400657 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639000cd80 con 0x7f63a0102790 2024-09-12T00:53:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.859+0000 7f63a810b640 1 -- 172.21.15.2:0/480400657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a01a6ba0 con 0x7f63a0102790 2024-09-12T00:53:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.859+0000 7f6396ffd640 1 -- 172.21.15.2:0/480400657 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6390010910 con 0x7f63a0102790 2024-09-12T00:53:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.859+0000 7f6396ffd640 1 -- 172.21.15.2:0/480400657 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63900188f0 con 0x7f63a0102790 2024-09-12T00:53:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.859+0000 7f63a810b640 1 -- 172.21.15.2:0/480400657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a01a7130 con 0x7f63a0102790 2024-09-12T00:53:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.862+0000 7f6396ffd640 1 -- 172.21.15.2:0/480400657 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f6390010ac0 con 0x7f63a0102790 2024-09-12T00:53:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.862+0000 7f63aa4e4740 1 Processor -- start 2024-09-12T00:53:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63aa4e4740 1 -- start start 2024-09-12T00:53:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f6396ffd640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f638c0a2e90 0x7f638c0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a375b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a376080 0x56192a380400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a382d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56192a2db2a0 con 0x56192a380940 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56192a282b10 con 0x56192a376080 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56192a2d7260 con 0x56192a375760 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63a66a8640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f638c0a2e90 0x7f638c0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63a5ea7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a375b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63a5ea7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a375b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:39394/0 (socket says 172.21.15.2:39394) 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63a66a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a382d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63a5ea7640 1 -- 172.21.15.2:0/3809034223 learned_addr learned my addr 172.21.15.2:0/3809034223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.863+0000 7f63a56a6640 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a376080 0x56192a380400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f6396ffd640 1 -- 172.21.15.2:0/480400657 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f63900cfa60 con 0x7f63a0102790 2024-09-12T00:53:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f63a66a8640 1 -- 172.21.15.2:0/3809034223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 msgr2=0x56192a375b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f63a66a8640 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a375b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f63a66a8640 1 -- 172.21.15.2:0/3809034223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a376080 msgr2=0x56192a380400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f63a66a8640 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a376080 0x56192a380400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f63a66a8640 1 -- 172.21.15.2:0/3809034223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56192a04cb90 con 0x56192a380940 2024-09-12T00:53:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a375b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f63a66a8640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f638c0a2e90 0x7f638c0a5350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6398009fd0 tx=0x7f6398009da0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f63a66a8640 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a382d30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6398005fd0 tx=0x7f6398012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a670edc9e655d24f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f638bfff640 1 -- 172.21.15.2:0/3809034223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398004b20 con 0x56192a380940 2024-09-12T00:53:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.864+0000 7f638bfff640 1 -- 172.21.15.2:0/3809034223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6398004cc0 con 0x56192a380940 2024-09-12T00:53:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.865+0000 7f638bfff640 1 -- 172.21.15.2:0/3809034223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63980052c0 con 0x56192a380940 2024-09-12T00:53:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.865+0000 7f63aa4e4740 1 -- 172.21.15.2:0/3809034223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 msgr2=0x56192a382d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.865+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a382d30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6398005fd0 tx=0x7f6398012f90 comp rx=0 tx=0).stop 2024-09-12T00:53:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.865+0000 7f63aa4e4740 1 -- 172.21.15.2:0/3809034223 shutdown_connections 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.865+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a382d30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.865+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a376080 0x56192a380400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.865+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/3809034223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a375b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.865+0000 7f63aa4e4740 1 -- 172.21.15.2:0/3809034223 >> 172.21.15.2:0/3809034223 conn(0x56192a371cf0 msgr2=0x56192a3720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.866+0000 7f63aa4e4740 1 -- 172.21.15.2:0/3809034223 shutdown_connections 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.866+0000 7f63aa4e4740 1 -- 172.21.15.2:0/3809034223 wait complete. 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.866+0000 7f63aa4e4740 1 -- start start 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.866+0000 7f63aa4e4740 1 Processor -- start 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a37d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a376080 0x56192a37ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a380940 0x56192a37e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56192a383510 con 0x56192a376080 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56192a2636e0 con 0x56192a380940 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56192a383690 con 0x56192a375760 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63aa4e4740 10 client.0 _ll_register_callbacks cb 0x56192a287a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a56a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a376080 0x56192a37ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a66a8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a380940 0x56192a37e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a56a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a376080 0x56192a37ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60558/0 (socket says 172.21.15.2:60558) 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a56a6640 1 -- 172.21.15.2:0/4205162706 learned_addr learned my addr 172.21.15.2:0/4205162706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a66a8640 1 -- 172.21.15.2:0/4205162706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 msgr2=0x56192a37d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a66a8640 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a37d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a66a8640 1 -- 172.21.15.2:0/4205162706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a376080 msgr2=0x56192a37ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a66a8640 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a376080 0x56192a37ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.867+0000 7f63a66a8640 1 -- 172.21.15.2:0/4205162706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56192a38caa0 con 0x56192a380940 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63a56a6640 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a376080 0x56192a37ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63a66a8640 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a380940 0x56192a37e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f639800e730 tx=0x7f6398003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7200d2b96013934e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63897fa640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63897fa640 1 -- 172.21.15.2:0/4205162706 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639802d070 con 0x56192a380940 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63aa4e4740 1 -- 172.21.15.2:0/4205162706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6398004cc0 con 0x56192a380940 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63897fa640 1 -- 172.21.15.2:0/4205162706 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6398003d70 con 0x56192a380940 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63897fa640 1 -- 172.21.15.2:0/4205162706 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6398037050 con 0x56192a380940 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63aa4e4740 10 client.25187 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.868+0000 7f63aa4e4740 1 -- 172.21.15.2:0/4205162706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56192a397c40 con 0x56192a380940 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63897fa640 1 -- 172.21.15.2:0/4205162706 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6398004cc0 con 0x56192a380940 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63897fa640 1 -- 172.21.15.2:0/4205162706 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f639801f070 con 0x56192a380940 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63aa4e4740 10 client.25187 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63aa4e4740 10 client.25187 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63aa4e4740 20 client.25187 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56192a398ff0 0x56192a39b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63aa4e4740 4 client.25187 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63aa4e4740 1 -- 172.21.15.2:0/4205162706 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56192a2e89d0 con 0x56192a398ff0 2024-09-12T00:53:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.869+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56192a398ff0 0x56192a39b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.870+0000 7f63897fa640 10 client.25187 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.870+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56192a398ff0 0x56192a39b3e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=993bc347603671e4 server_cookie=d8509fe94926245f in_seq=0 out_seq=0 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.870+0000 7f63897fa640 1 -- 172.21.15.2:0/4205162706 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56192a2e89d0 con 0x56192a398ff0 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.870+0000 7f63897fa640 10 client.25187 handle_command_reply: tid=0 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.870+0000 7f63aa4e4740 1 client.25187 shutdown 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 -- 172.21.15.2:0/4205162706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a380940 msgr2=0x56192a37e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a380940 0x56192a37e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f639800e730 tx=0x7f6398003970 comp rx=0 tx=0).stop 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 -- 172.21.15.2:0/4205162706 shutdown_connections 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56192a398ff0 0x56192a39b3e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a380940 0x56192a37e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a376080 0x56192a37ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/4205162706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a375760 0x56192a37d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 -- 172.21.15.2:0/4205162706 >> 172.21.15.2:0/4205162706 conn(0x56192a371cf0 msgr2=0x56192a377a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63897fa640 0 client.25187 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 -- 172.21.15.2:0/4205162706 shutdown_connections 2024-09-12T00:53:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 1 -- 172.21.15.2:0/4205162706 wait complete. 2024-09-12T00:53:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.871+0000 7f63aa4e4740 20 client.25187 trim_cache size 0 max 16384 2024-09-12T00:53:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.891+0000 7f63aa4e4740 1 Processor -- start 2024-09-12T00:53:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63aa4e4740 1 -- start start 2024-09-12T00:53:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a39b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a37c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63a01ae0c0 con 0x56192a380940 2024-09-12T00:53:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63a01ab990 con 0x56192a375760 2024-09-12T00:53:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63a01a97e0 con 0x56192a376080 2024-09-12T00:53:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63a66a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63a66a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60568/0 (socket says 172.21.15.2:60568) 2024-09-12T00:53:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63a66a8640 1 -- 172.21.15.2:0/81624229 learned_addr learned my addr 172.21.15.2:0/81624229 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.892+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a39b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f63a56a6640 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a37c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f63a66a8640 1 -- 172.21.15.2:0/81624229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 msgr2=0x56192a37c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f63a66a8640 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a37c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f63a66a8640 1 -- 172.21.15.2:0/81624229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 msgr2=0x56192a39b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f63a66a8640 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a39b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f63a66a8640 1 -- 172.21.15.2:0/81624229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56192a36d260 con 0x56192a380940 2024-09-12T00:53:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a39b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f63a66a8640 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3a0bc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6398006010 tx=0x7f6398012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbca3e778670a6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f638b7fe640 1 -- 172.21.15.2:0/81624229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639802d040 con 0x56192a380940 2024-09-12T00:53:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f638b7fe640 1 -- 172.21.15.2:0/81624229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f639800e820 con 0x56192a380940 2024-09-12T00:53:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.893+0000 7f638b7fe640 1 -- 172.21.15.2:0/81624229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639803c800 con 0x56192a380940 2024-09-12T00:53:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.894+0000 7f63aa4e4740 1 -- 172.21.15.2:0/81624229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 msgr2=0x56192a3a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.894+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3a0bc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6398006010 tx=0x7f6398012f90 comp rx=0 tx=0).stop 2024-09-12T00:53:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.894+0000 7f63aa4e4740 1 -- 172.21.15.2:0/81624229 shutdown_connections 2024-09-12T00:53:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.894+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3a0bc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.894+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a37c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.894+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/81624229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a39b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.895+0000 7f63aa4e4740 1 -- 172.21.15.2:0/81624229 >> 172.21.15.2:0/81624229 conn(0x56192a371cf0 msgr2=0x56192a37f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.895+0000 7f63aa4e4740 1 -- 172.21.15.2:0/81624229 shutdown_connections 2024-09-12T00:53:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.895+0000 7f63aa4e4740 1 -- 172.21.15.2:0/81624229 wait complete. 2024-09-12T00:53:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.895+0000 7f63aa4e4740 1 -- start start 2024-09-12T00:53:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.895+0000 7f63aa4e4740 1 Processor -- start 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a384650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a384b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63aa4e4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3850d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a66a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3850d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63aa4e4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63a01a9e50 con 0x56192a380940 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a66a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3850d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60584/0 (socket says 172.21.15.2:60584) 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a66a8640 1 -- 172.21.15.2:0/2307341399 learned_addr learned my addr 172.21.15.2:0/2307341399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63a01ab2c0 con 0x56192a375760 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63a01aa520 con 0x56192a376080 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a56a6640 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a384b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a384650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63aa4e4740 10 client.0 _ll_register_callbacks cb 0x7f63980050c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a66a8640 1 -- 172.21.15.2:0/2307341399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 msgr2=0x56192a384b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a66a8640 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a384b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a66a8640 1 -- 172.21.15.2:0/2307341399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 msgr2=0x56192a384650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a66a8640 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a384650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a66a8640 1 -- 172.21.15.2:0/2307341399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56192a402b90 con 0x56192a380940 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.896+0000 7f63a56a6640 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a384b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.897+0000 7f63a66a8640 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3850d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6398010870 tx=0x7f639800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f441d90ecd1f3805 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.897+0000 7f63897fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.897+0000 7f63897fa640 1 -- 172.21.15.2:0/2307341399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398049060 con 0x56192a380940 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.897+0000 7f63897fa640 1 -- 172.21.15.2:0/2307341399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6398005380 con 0x56192a380940 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.897+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f639800e820 con 0x56192a380940 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.897+0000 7f63897fa640 1 -- 172.21.15.2:0/2307341399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f639802d070 con 0x56192a380940 2024-09-12T00:53:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.897+0000 7f63aa4e4740 10 client.15507 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.897+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56192a403e00 con 0x56192a380940 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.898+0000 7f63897fa640 1 -- 172.21.15.2:0/2307341399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f639800e820 con 0x56192a380940 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.898+0000 7f63897fa640 1 -- 172.21.15.2:0/2307341399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f639800f040 con 0x56192a380940 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.898+0000 7f63aa4e4740 10 client.15507 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.898+0000 7f63aa4e4740 10 client.15507 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.898+0000 7f63aa4e4740 20 client.15507 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.898+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56192a404480 0x56192a406870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.898+0000 7f63aa4e4740 4 client.15507 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.898+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x56192a2e2d20 con 0x56192a404480 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.899+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56192a404480 0x56192a406870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.899+0000 7f63897fa640 10 client.15507 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.899+0000 7f63a5ea7640 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56192a404480 0x56192a406870 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c44db80083a2cb7e server_cookie=aebc2e78ce301a67 in_seq=0 out_seq=0 2024-09-12T00:53:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.914+0000 7f63897fa640 1 -- 172.21.15.2:0/2307341399 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56192a2e2d20 con 0x56192a404480 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.914+0000 7f63897fa640 10 client.15507 handle_command_reply: tid=0 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.914+0000 7f63aa4e4740 1 client.15507 shutdown 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.914+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 msgr2=0x56192a3850d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.914+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3850d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6398010870 tx=0x7f639800ec80 comp rx=0 tx=0).stop 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.914+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 shutdown_connections 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.914+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56192a404480 0x56192a406870 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.914+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56192a380940 0x56192a3850d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.915+0000 7f63897fa640 0 client.15507 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.915+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56192a376080 0x56192a384b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.915+0000 7f63aa4e4740 1 --2- 172.21.15.2:0/2307341399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192a375760 0x56192a384650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.915+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 >> 172.21.15.2:0/2307341399 conn(0x56192a371cf0 msgr2=0x56192a370650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.915+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 shutdown_connections 2024-09-12T00:53:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.915+0000 7f63aa4e4740 1 -- 172.21.15.2:0/2307341399 wait complete. 2024-09-12T00:53:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.915+0000 7f63aa4e4740 20 client.15507 trim_cache size 0 max 16384 2024-09-12T00:53:46.916 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:46.916 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 25, 2024-09-12T00:53:46.916 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:53:46.916 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 2, 2024-09-12T00:53:46.916 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:53:46.916 INFO:teuthology.orchestra.run.smithi002.stdout: "5d610cbc": { 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 2, 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 144.5, 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:53:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:53:46.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:53:46.918 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:53:46.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:53:46.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:53:46.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:53:46.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:53:46.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:53:46.919 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 -- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f638c0a2e90 msgr2=0x7f638c0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f638c0a2e90 0x7f638c0a5350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6398009fd0 tx=0x7f6398009da0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 -- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0102790 msgr2=0x7f63a0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0102790 0x7f63a0074a30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f639000e9f0 tx=0x7f639000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 -- 172.21.15.2:0/480400657 shutdown_connections 2024-09-12T00:53:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f638c0a2e90 0x7f638c0a5350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63a0106f10 0x7f63a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a0102790 0x7f63a0074a30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 --2- 172.21.15.2:0/480400657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0101de0 0x7f63a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 -- 172.21.15.2:0/480400657 >> 172.21.15.2:0/480400657 conn(0x7f63a00fd880 msgr2=0x7f63a00feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 -- 172.21.15.2:0/480400657 shutdown_connections 2024-09-12T00:53:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:46.916+0000 7f63a810b640 1 -- 172.21.15.2:0/480400657 wait complete. 2024-09-12T00:53:47.744 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5d610cbc', quiesce took 8.3 seconds. Will release after: 16.2 2024-09-12T00:53:48.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:47 smithi002 ceph-mon[31210]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:48.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.191+0000 7f13af938640 1 -- 172.21.15.2:0/1954432198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a81036e0 msgr2=0x7f13a8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.191+0000 7f13af938640 1 --2- 172.21.15.2:0/1954432198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a81036e0 0x7f13a8107b90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1398009930 tx=0x7f139802a420 comp rx=0 tx=0).stop 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.191+0000 7f13af938640 1 -- 172.21.15.2:0/1954432198 shutdown_connections 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.191+0000 7f13af938640 1 --2- 172.21.15.2:0/1954432198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a81082a0 0x7f13a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.191+0000 7f13af938640 1 --2- 172.21.15.2:0/1954432198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a81036e0 0x7f13a8107b90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.191+0000 7f13af938640 1 --2- 172.21.15.2:0/1954432198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a8102d30 0x7f13a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.191+0000 7f13af938640 1 -- 172.21.15.2:0/1954432198 >> 172.21.15.2:0/1954432198 conn(0x7f13a80fc7d0 msgr2=0x7f13a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.192+0000 7f13af938640 1 -- 172.21.15.2:0/1954432198 shutdown_connections 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.192+0000 7f13af938640 1 -- 172.21.15.2:0/1954432198 wait complete. 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.193+0000 7f13af938640 1 Processor -- start 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.193+0000 7f13af938640 1 -- start start 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.193+0000 7f13af938640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.193+0000 7f13af938640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.193+0000 7f13ad6d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13ad6d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60602/0 (socket says 172.21.15.2:60602) 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13af938640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a81082a0 0x7f13a8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13af938640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8112060 con 0x7f13a8102d30 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13af938640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8111ee0 con 0x7f13a81036e0 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13af938640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81121e0 con 0x7f13a81082a0 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13ad6d4640 1 -- 172.21.15.2:0/358471571 learned_addr learned my addr 172.21.15.2:0/358471571 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13aced3640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13aded5640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a81082a0 0x7f13a8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13ad6d4640 1 -- 172.21.15.2:0/358471571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a81082a0 msgr2=0x7f13a8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13ad6d4640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a81082a0 0x7f13a8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13ad6d4640 1 -- 172.21.15.2:0/358471571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a81036e0 msgr2=0x7f13a8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13ad6d4640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13ad6d4640 1 -- 172.21.15.2:0/358471571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a81a6ac0 con 0x7f13a8102d30 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.194+0000 7f13ad6d4640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f13a400ea60 tx=0x7f13a400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.195+0000 7f139e7fc640 1 -- 172.21.15.2:0/358471571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a400cde0 con 0x7f13a8102d30 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.195+0000 7f139e7fc640 1 -- 172.21.15.2:0/358471571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a40035f0 con 0x7f13a8102d30 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.195+0000 7f139e7fc640 1 -- 172.21.15.2:0/358471571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4010670 con 0x7f13a8102d30 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.195+0000 7f13af938640 1 -- 172.21.15.2:0/358471571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a81a6db0 con 0x7f13a8102d30 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.196+0000 7f13af938640 1 -- 172.21.15.2:0/358471571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a81a7210 con 0x7f13a8102d30 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13b1d11740 1 Processor -- start 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13b1d11740 1 -- start start 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205cb40 0x55ae9205b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9205ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae92070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13b1d11740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ae91fc12f0 con 0x55ae9205b5d0 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13b1d11740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae91f68cf0 con 0x55ae9205cb40 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13b1d11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae91fbd2b0 con 0x55ae9206eb80 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13aded5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205cb40 0x55ae9205b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f139e7fc640 1 -- 172.21.15.2:0/358471571 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f13a40037a0 con 0x7f13a8102d30 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13aded5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205cb40 0x55ae9205b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:48532/0 (socket says 172.21.15.2:48532) 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13aded5640 1 -- 172.21.15.2:0/659489865 learned_addr learned my addr 172.21.15.2:0/659489865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.199+0000 7f13aced3640 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae92070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.200+0000 7f13aded5640 1 -- 172.21.15.2:0/659489865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 msgr2=0x55ae92070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.200+0000 7f13aded5640 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae92070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.200+0000 7f13aded5640 1 -- 172.21.15.2:0/659489865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 msgr2=0x55ae9205ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.200+0000 7f13ad6d4640 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9205ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.200+0000 7f13aded5640 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9205ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.200+0000 7f13aded5640 1 -- 172.21.15.2:0/659489865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae91f4d3a0 con 0x55ae9205cb40 2024-09-12T00:53:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.200+0000 7f13ad6d4640 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9205ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.200+0000 7f13aded5640 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205cb40 0x55ae9205b090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009f90 tx=0x7f13a0010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1d688c8302dad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f13937fe640 1 -- 172.21.15.2:0/659489865 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0011700 con 0x55ae9205cb40 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f13937fe640 1 -- 172.21.15.2:0/659489865 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a0011d80 con 0x55ae9205cb40 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f13937fe640 1 -- 172.21.15.2:0/659489865 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0018380 con 0x55ae9205cb40 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f139e7fc640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f13940a2e10 0x7f13940a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f13ad6d4640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f13940a2e10 0x7f13940a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f139e7fc640 1 -- 172.21.15.2:0/358471571 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f13a40cfd30 con 0x7f13a8102d30 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f13b1d11740 1 -- 172.21.15.2:0/659489865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205cb40 msgr2=0x55ae9205b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f13b1d11740 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205cb40 0x55ae9205b090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009f90 tx=0x7f13a0010860 comp rx=0 tx=0).stop 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.201+0000 7f13ad6d4640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f13940a2e10 0x7f13940a52d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13a40cd310 tx=0x7f13a4003f30 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 -- 172.21.15.2:0/659489865 shutdown_connections 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae92070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9205ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 --2- 172.21.15.2:0/659489865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205cb40 0x55ae9205b090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 -- 172.21.15.2:0/659489865 >> 172.21.15.2:0/659489865 conn(0x55ae92024310 msgr2=0x55ae92057c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 -- 172.21.15.2:0/659489865 shutdown_connections 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 -- 172.21.15.2:0/659489865 wait complete. 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 -- start start 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.202+0000 7f13b1d11740 1 Processor -- start 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.203+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae9206e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.203+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae9206b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.203+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae9206be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13b1d11740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ae92071880 con 0x55ae9205cb40 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae9206e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae9206e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:48544/0 (socket says 172.21.15.2:48544) 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 -- 172.21.15.2:0/2821794745 learned_addr learned my addr 172.21.15.2:0/2821794745 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13b1d11740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae91f7c060 con 0x55ae9205b5d0 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae92071a00 con 0x55ae9206eb80 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aced3640 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae9206b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13b1d11740 10 client.0 _ll_register_callbacks cb 0x55ae91ccf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 -- 172.21.15.2:0/2821794745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 msgr2=0x55ae9206be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae9206be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 -- 172.21.15.2:0/2821794745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 msgr2=0x55ae9206b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae9206b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 -- 172.21.15.2:0/2821794745 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae91d323c0 con 0x55ae9205b5d0 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aced3640 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae9206b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f13aded5640 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae9206e520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13a0005f40 tx=0x7f13a0009c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0df569749e20572 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.204+0000 7f1390ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.205+0000 7f1390ff9640 1 -- 172.21.15.2:0/2821794745 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0027030 con 0x55ae9205b5d0 2024-09-12T00:53:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.205+0000 7f1390ff9640 1 -- 172.21.15.2:0/2821794745 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f13a001f070 con 0x55ae9205b5d0 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.205+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13a0011d80 con 0x55ae9205b5d0 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.205+0000 7f1390ff9640 1 -- 172.21.15.2:0/2821794745 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f13a0019ad0 con 0x55ae9205b5d0 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.205+0000 7f13b1d11740 10 client.25205 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.205+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ae9207d280 con 0x55ae9205b5d0 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.205+0000 7f1390ff9640 1 -- 172.21.15.2:0/2821794745 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a0011d80 con 0x55ae9205b5d0 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.205+0000 7f1390ff9640 1 -- 172.21.15.2:0/2821794745 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f13a0011a30 con 0x55ae9205b5d0 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f13b1d11740 10 client.25205 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f13b1d11740 10 client.25205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f13b1d11740 20 client.25205 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae9207e900 0x55ae92080cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f13b1d11740 4 client.25205 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae91fce860 con 0x55ae9207e900 2024-09-12T00:53:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f13aced3640 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae9207e900 0x55ae92080cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f13aced3640 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae9207e900 0x55ae92080cf0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e10639633b44480 server_cookie=ac2243ce4a9cc14d in_seq=0 out_seq=0 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.206+0000 7f1390ff9640 10 client.25205 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f1390ff9640 1 -- 172.21.15.2:0/2821794745 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae91fce860 con 0x55ae9207e900 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f1390ff9640 10 client.25205 handle_command_reply: tid=0 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 client.25205 shutdown 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 msgr2=0x55ae9206e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae9206e520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13a0005f40 tx=0x7f13a0009c80 comp rx=0 tx=0).stop 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 shutdown_connections 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae9207e900 0x55ae92080cf0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae9206be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f1390ff9640 0 client.25205 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae9206b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2821794745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae9206e520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 >> 172.21.15.2:0/2821794745 conn(0x55ae92024310 msgr2=0x55ae9205d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:48.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 shutdown_connections 2024-09-12T00:53:48.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.207+0000 7f13b1d11740 1 -- 172.21.15.2:0/2821794745 wait complete. 2024-09-12T00:53:48.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.208+0000 7f13b1d11740 20 client.25205 trim_cache size 0 max 16384 2024-09-12T00:53:48.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13b1d11740 1 Processor -- start 2024-09-12T00:53:48.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13b1d11740 1 -- start start 2024-09-12T00:53:48.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9207aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9205cb40 0x55ae9206a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9206eb80 0x55ae9206a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13b1d11740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81ae200 con 0x55ae9205b5d0 2024-09-12T00:53:48.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13aded5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9207aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13aded5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9207aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60630/0 (socket says 172.21.15.2:60630) 2024-09-12T00:53:48.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13b1d11740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81abad0 con 0x55ae9206eb80 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13aded5640 1 -- 172.21.15.2:0/2474584242 learned_addr learned my addr 172.21.15.2:0/2474584242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13b1d11740 1 -- 172.21.15.2:0/2474584242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81a9920 con 0x55ae9205cb40 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13aced3640 1 --2- 172.21.15.2:0/2474584242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9205cb40 0x55ae9206a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.226+0000 7f13aded5640 1 -- 172.21.15.2:0/2474584242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9205cb40 msgr2=0x55ae9206a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.227+0000 7f13aded5640 1 --2- 172.21.15.2:0/2474584242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9205cb40 0x55ae9206a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.227+0000 7f13aded5640 1 -- 172.21.15.2:0/2474584242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9206eb80 msgr2=0x55ae9206a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.227+0000 7f13aded5640 1 --2- 172.21.15.2:0/2474584242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9206eb80 0x55ae9206a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.227+0000 7f13aded5640 1 -- 172.21.15.2:0/2474584242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9206c1a0 con 0x55ae9205b5d0 2024-09-12T00:53:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.227+0000 7f13aded5640 1 --2- 172.21.15.2:0/2474584242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9207aca0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009a80 tx=0x7f13a0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4a5f178628e2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.227+0000 7f1392ffd640 1 -- 172.21.15.2:0/2474584242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0027040 con 0x55ae9205b5d0 2024-09-12T00:53:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.227+0000 7f1392ffd640 1 -- 172.21.15.2:0/2474584242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a0003e50 con 0x55ae9205b5d0 2024-09-12T00:53:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.227+0000 7f1392ffd640 1 -- 172.21.15.2:0/2474584242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0005750 con 0x55ae9205b5d0 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 -- 172.21.15.2:0/2474584242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 msgr2=0x55ae9207aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2474584242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9207aca0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009a80 tx=0x7f13a0005fd0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 -- 172.21.15.2:0/2474584242 shutdown_connections 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2474584242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9206eb80 0x55ae9206a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2474584242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9205cb40 0x55ae9206a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 --2- 172.21.15.2:0/2474584242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205b5d0 0x55ae9207aca0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 -- 172.21.15.2:0/2474584242 >> 172.21.15.2:0/2474584242 conn(0x55ae92024310 msgr2=0x55ae92066b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 -- 172.21.15.2:0/2474584242 shutdown_connections 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.228+0000 7f13b1d11740 1 -- 172.21.15.2:0/2474584242 wait complete. 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 1 -- start start 2024-09-12T00:53:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 1 Processor -- start 2024-09-12T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae920845a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae92080930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae92080f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81a9f90 con 0x55ae9205cb40 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81ab400 con 0x55ae9205b5d0 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81aa660 con 0x55ae9206eb80 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13b1d11740 10 client.0 _ll_register_callbacks cb 0x7f1398009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.229+0000 7f13aced3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae92080930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae920845a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae920845a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:48552/0 (socket says 172.21.15.2:48552) 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 -- 172.21.15.2:0/1445336730 learned_addr learned my addr 172.21.15.2:0/1445336730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae92080f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 -- 172.21.15.2:0/1445336730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 msgr2=0x55ae92080f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:48.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae92080f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 -- 172.21.15.2:0/1445336730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 msgr2=0x55ae92080930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae92080930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 -- 172.21.15.2:0/1445336730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae92081770 con 0x55ae9205b5d0 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aced3640 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae92080930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f13aded5640 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae920845a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13a0005d70 tx=0x7f13a0019f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b999e927e8cfa922 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.230+0000 7f1390ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f1390ff9640 1 -- 172.21.15.2:0/1445336730 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a001f040 con 0x55ae9205b5d0 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f1390ff9640 1 -- 172.21.15.2:0/1445336730 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f13a0019c70 con 0x55ae9205b5d0 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f13b1d11740 1 -- 172.21.15.2:0/1445336730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13a0003e50 con 0x55ae9205b5d0 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f1390ff9640 1 -- 172.21.15.2:0/1445336730 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f13a0003970 con 0x55ae9205b5d0 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f13b1d11740 10 client.25208 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:48.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f13b1d11740 1 -- 172.21.15.2:0/1445336730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ae920e8360 con 0x55ae9205b5d0 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f1390ff9640 1 -- 172.21.15.2:0/1445336730 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a0003b10 con 0x55ae9205b5d0 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f1390ff9640 1 -- 172.21.15.2:0/1445336730 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f13a001a430 con 0x55ae9205b5d0 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f13b1d11740 10 client.25208 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.231+0000 7f13b1d11740 10 client.25208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f13b1d11740 20 client.25208 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f13b1d11740 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae9207e900 0x55ae920ea920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f13b1d11740 4 client.25208 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f13b1d11740 1 -- 172.21.15.2:0/1445336730 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f13a0003e50 con 0x55ae9207e900 2024-09-12T00:53:48.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f13aced3640 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae9207e900 0x55ae920ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f13aced3640 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae9207e900 0x55ae920ea920 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd4a26cbc94cbc63 server_cookie=c6c89e8b9f229337 in_seq=0 out_seq=0 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f1390ff9640 10 client.25208 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f1390ff9640 1 -- 172.21.15.2:0/1445336730 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f13a0003e50 con 0x55ae9207e900 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f1390ff9640 10 client.25208 handle_command_reply: tid=0 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.232+0000 7f13b1d11740 1 client.25208 shutdown 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 -- 172.21.15.2:0/1445336730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 msgr2=0x55ae920845a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae920845a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13a0005d70 tx=0x7f13a0019f90 comp rx=0 tx=0).stop 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 -- 172.21.15.2:0/1445336730 shutdown_connections 2024-09-12T00:53:48.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae9207e900 0x55ae920ea920 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae9206eb80 0x55ae92080f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae9205cb40 0x55ae92080930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 --2- 172.21.15.2:0/1445336730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae9205b5d0 0x55ae920845a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 -- 172.21.15.2:0/1445336730 >> 172.21.15.2:0/1445336730 conn(0x55ae92024310 msgr2=0x55ae9206a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f1390ff9640 0 client.25208 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 -- 172.21.15.2:0/1445336730 shutdown_connections 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 1 -- 172.21.15.2:0/1445336730 wait complete. 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.233+0000 7f13b1d11740 20 client.25208 trim_cache size 0 max 16384 2024-09-12T00:53:48.237 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:53:48.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 -- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f13940a2e10 msgr2=0x7f13940a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f13940a2e10 0x7f13940a52d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13a40cd310 tx=0x7f13a4003f30 comp rx=0 tx=0).stop 2024-09-12T00:53:48.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 -- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a8102d30 msgr2=0x7f13a8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:48.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f13a400ea60 tx=0x7f13a400ef20 comp rx=0 tx=0).stop 2024-09-12T00:53:48.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 -- 172.21.15.2:0/358471571 shutdown_connections 2024-09-12T00:53:48.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f13940a2e10 0x7f13940a52d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a81082a0 0x7f13a8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 --2- 172.21.15.2:0/358471571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:48.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 -- 172.21.15.2:0/358471571 >> 172.21.15.2:0/358471571 conn(0x7f13a80fc7d0 msgr2=0x7f13a8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:48.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 -- 172.21.15.2:0/358471571 shutdown_connections 2024-09-12T00:53:48.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:48.234+0000 7f13af938640 1 -- 172.21.15.2:0/358471571 wait complete. 2024-09-12T00:53:48.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:47 smithi167 ceph-mon[35234]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:48.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:47 smithi071 ceph-mon[35276]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T00:53:49.920 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:53:49.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:53:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:50.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:49 smithi002 ceph-mon[31210]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:50.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:49 smithi167 ceph-mon[35234]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:50.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:49 smithi071 ceph-mon[35276]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T00:53:50.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.715+0000 7f9f061b9640 1 -- 172.21.15.2:0/947901967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001082a0 msgr2=0x7f9f0010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.715+0000 7f9f061b9640 1 --2- 172.21.15.2:0/947901967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001082a0 0x7f9f0010ec40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009cd0 tx=0x7f9ef802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.715+0000 7f9f061b9640 1 -- 172.21.15.2:0/947901967 shutdown_connections 2024-09-12T00:53:50.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.715+0000 7f9f061b9640 1 --2- 172.21.15.2:0/947901967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001082a0 0x7f9f0010ec40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.715+0000 7f9f061b9640 1 --2- 172.21.15.2:0/947901967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f001036e0 0x7f9f00107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.715+0000 7f9f061b9640 1 --2- 172.21.15.2:0/947901967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f00102d30 0x7f9f00103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.715+0000 7f9f061b9640 1 -- 172.21.15.2:0/947901967 >> 172.21.15.2:0/947901967 conn(0x7f9f000fc7d0 msgr2=0x7f9f000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.716+0000 7f9f061b9640 1 -- 172.21.15.2:0/947901967 shutdown_connections 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.716+0000 7f9f061b9640 1 -- 172.21.15.2:0/947901967 wait complete. 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.716+0000 7f9f061b9640 1 Processor -- start 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9f061b9640 1 -- start start 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9f061b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00102d30 0x7f9f00198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9f061b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001036e0 0x7f9f00198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9f061b9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f001082a0 0x7f9f0019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9f061b9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001120a0 con 0x7f9f001036e0 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9f061b9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00111f20 con 0x7f9f001082a0 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9f061b9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00112220 con 0x7f9f00102d30 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9efeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001036e0 0x7f9f00198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9efeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001036e0 0x7f9f00198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60668/0 (socket says 172.21.15.2:60668) 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9efeffd640 1 -- 172.21.15.2:0/3593019559 learned_addr learned my addr 172.21.15.2:0/3593019559 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.717+0000 7f9efffff640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f001082a0 0x7f9f0019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00102d30 0x7f9f00198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9efeffd640 1 -- 172.21.15.2:0/3593019559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00102d30 msgr2=0x7f9f00198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9efeffd640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00102d30 0x7f9f00198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9efeffd640 1 -- 172.21.15.2:0/3593019559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f001082a0 msgr2=0x7f9f0019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9efeffd640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f001082a0 0x7f9f0019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9efeffd640 1 -- 172.21.15.2:0/3593019559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0019d500 con 0x7f9f001036e0 2024-09-12T00:53:50.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9efeffd640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001036e0 0x7f9f00198a90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400d740 tx=0x7f9ef400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9efcff9640 1 -- 172.21.15.2:0/3593019559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4017070 con 0x7f9f001036e0 2024-09-12T00:53:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.718+0000 7f9f061b9640 1 -- 172.21.15.2:0/3593019559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0019d7f0 con 0x7f9f001036e0 2024-09-12T00:53:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.719+0000 7f9f061b9640 1 -- 172.21.15.2:0/3593019559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f001a50d0 con 0x7f9f001036e0 2024-09-12T00:53:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.719+0000 7f9efcff9640 1 -- 172.21.15.2:0/3593019559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef400de50 con 0x7f9f001036e0 2024-09-12T00:53:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.719+0000 7f9efcff9640 1 -- 172.21.15.2:0/3593019559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4021060 con 0x7f9f001036e0 2024-09-12T00:53:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9efcff9640 1 -- 172.21.15.2:0/3593019559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f9ef401a070 con 0x7f9f001036e0 2024-09-12T00:53:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9f08592740 1 Processor -- start 2024-09-12T00:53:50.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9f08592740 1 -- start start 2024-09-12T00:53:50.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9f08592740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd6a00 0x561150bd6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9f08592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd7320 0x561150be5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9f08592740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150be8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9f08592740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561150b3c280 con 0x561150bd6a00 2024-09-12T00:53:50.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9f08592740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561150ae3b10 con 0x561150be6150 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.722+0000 7f9f08592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561150b38240 con 0x561150bd7320 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd6a00 0x561150bd6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd6a00 0x561150bd6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60682/0 (socket says 172.21.15.2:60682) 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 -- 172.21.15.2:0/3867258477 learned_addr learned my addr 172.21.15.2:0/3867258477 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efcff9640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ee80a2e90 0x7f9ee80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efeffd640 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150be8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd7320 0x561150be5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ee80a2e90 0x7f9ee80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efcff9640 1 -- 172.21.15.2:0/3593019559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9ef40cee90 con 0x7f9f001036e0 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 -- 172.21.15.2:0/3867258477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd7320 msgr2=0x561150be5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd7320 0x561150be5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 -- 172.21.15.2:0/3867258477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 msgr2=0x561150be8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150be8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efffff640 1 -- 172.21.15.2:0/3867258477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561150af01f0 con 0x561150bd6a00 2024-09-12T00:53:50.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.723+0000 7f9efeffd640 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150be8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:50.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.724+0000 7f9efffff640 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd6a00 0x561150bd6de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8004ab0 tx=0x7f9ef8031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a412b883052c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:50.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.724+0000 7f9ee5ffb640 1 -- 172.21.15.2:0/3867258477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8044040 con 0x561150bd6a00 2024-09-12T00:53:50.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.724+0000 7f9efffff640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ee80a2e90 0x7f9ee80a5350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009cd0 tx=0x7f9ef804a000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:50.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.724+0000 7f9ee5ffb640 1 -- 172.21.15.2:0/3867258477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef8036050 con 0x561150bd6a00 2024-09-12T00:53:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 -- 172.21.15.2:0/3867258477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd6a00 msgr2=0x561150bd6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd6a00 0x561150bd6de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8004ab0 tx=0x7f9ef8031b00 comp rx=0 tx=0).stop 2024-09-12T00:53:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 -- 172.21.15.2:0/3867258477 shutdown_connections 2024-09-12T00:53:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150be8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd7320 0x561150be5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 --2- 172.21.15.2:0/3867258477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd6a00 0x561150bd6de0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 -- 172.21.15.2:0/3867258477 >> 172.21.15.2:0/3867258477 conn(0x561150bd30f0 msgr2=0x561150bd34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 -- 172.21.15.2:0/3867258477 shutdown_connections 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.725+0000 7f9f08592740 1 -- 172.21.15.2:0/3867258477 wait complete. 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.726+0000 7f9f08592740 1 -- start start 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.726+0000 7f9f08592740 1 Processor -- start 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9f08592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150be3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9f08592740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150be35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9f08592740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150be3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9f08592740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561150be8d60 con 0x561150be6150 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9efffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150be3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9eff7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150be3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9efffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150be3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60688/0 (socket says 172.21.15.2:60688) 2024-09-12T00:53:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9efffff640 1 -- 172.21.15.2:0/458272910 learned_addr learned my addr 172.21.15.2:0/458272910 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.727+0000 7f9efeffd640 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150be35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561150af6f10 con 0x561150bd7320 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561150be8ee0 con 0x561150bd6a00 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9f08592740 10 client.0 _ll_register_callbacks cb 0x561150abfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9efeffd640 1 -- 172.21.15.2:0/458272910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 msgr2=0x561150be3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9efeffd640 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150be3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9efeffd640 1 -- 172.21.15.2:0/458272910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 msgr2=0x561150be3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9efeffd640 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150be3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9efeffd640 1 -- 172.21.15.2:0/458272910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611508ad6a0 con 0x561150bd7320 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9efffff640 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150be3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561150b497f0 con 0x561150bd7320 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9efeffd640 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150be35a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40cc410 tx=0x7f9ef406b250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5636afece81388e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.728+0000 7f9edeffd640 10 client.25217 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:53:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9edeffd640 1 -- 172.21.15.2:0/458272910 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef409b1c0 con 0x561150bd7320 2024-09-12T00:53:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9edeffd640 1 -- 172.21.15.2:0/458272910 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9ef409f100 con 0x561150bd7320 2024-09-12T00:53:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9edeffd640 1 -- 172.21.15.2:0/458272910 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ef409f4c0 con 0x561150bd7320 2024-09-12T00:53:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9f08592740 10 client.25217 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({fsmap=25}) -- 0x561150bf49e0 con 0x561150bd7320 2024-09-12T00:53:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9edeffd640 1 -- 172.21.15.2:0/458272910 <== mon.2 v2:172.21.15.71:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ef40ccce0 con 0x561150bd7320 2024-09-12T00:53:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9f08592740 10 client.25217 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9f08592740 10 client.25217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9f08592740 20 client.25217 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9f08592740 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561150bf6340 0x561150bf87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9f08592740 4 client.25217 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.729+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561150b43d00 con 0x561150bf6340 2024-09-12T00:53:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.730+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561150bf6340 0x561150bf87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.730+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561150bf6340 0x561150bf87c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f36ac5d8801ec5e7 server_cookie=2a16b4aa4903e59c in_seq=0 out_seq=0 2024-09-12T00:53:50.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.730+0000 7f9edeffd640 10 client.25217 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:50.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9edeffd640 1 -- 172.21.15.2:0/458272910 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561150b43d00 con 0x561150bf6340 2024-09-12T00:53:50.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9edeffd640 10 client.25217 handle_command_reply: tid=0 2024-09-12T00:53:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 client.25217 shutdown 2024-09-12T00:53:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 msgr2=0x561150be35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150be35a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40cc410 tx=0x7f9ef406b250 comp rx=0 tx=0).stop 2024-09-12T00:53:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 shutdown_connections 2024-09-12T00:53:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561150bf6340 0x561150bf87c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150be3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150be35a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 --2- 172.21.15.2:0/458272910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150be3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 >> 172.21.15.2:0/458272910 conn(0x561150bd30f0 msgr2=0x561150bd8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9edeffd640 0 client.25217 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 shutdown_connections 2024-09-12T00:53:50.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.731+0000 7f9f08592740 1 -- 172.21.15.2:0/458272910 wait complete. 2024-09-12T00:53:50.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.732+0000 7f9f08592740 20 client.25217 trim_cache size 0 max 16384 2024-09-12T00:53:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.766+0000 7f9f08592740 1 Processor -- start 2024-09-12T00:53:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.766+0000 7f9f08592740 1 -- start start 2024-09-12T00:53:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9f08592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150bd2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9f08592740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150bfe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9f08592740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150bfe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9f08592740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec011120 con 0x561150be6150 2024-09-12T00:53:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9f08592740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec00e9f0 con 0x561150bd7320 2024-09-12T00:53:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150bfe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9f08592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec00c840 con 0x561150bd6a00 2024-09-12T00:53:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150bfe5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60694/0 (socket says 172.21.15.2:60694) 2024-09-12T00:53:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efffff640 1 -- 172.21.15.2:0/2224318156 learned_addr learned my addr 172.21.15.2:0/2224318156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150bd2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efeffd640 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150bfe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efffff640 1 -- 172.21.15.2:0/2224318156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 msgr2=0x561150bd2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efffff640 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150bd2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efffff640 1 -- 172.21.15.2:0/2224318156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 msgr2=0x561150bfe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efffff640 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150bfe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9efffff640 1 -- 172.21.15.2:0/2224318156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561150bd3c30 con 0x561150be6150 2024-09-12T00:53:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.767+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150bd2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.768+0000 7f9efffff640 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150bfe5d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8004ab0 tx=0x7f9ef802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673c59d1b96bea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.768+0000 7f9ee57fa640 1 -- 172.21.15.2:0/2224318156 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8058070 con 0x561150be6150 2024-09-12T00:53:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.768+0000 7f9ee57fa640 1 -- 172.21.15.2:0/2224318156 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef8036040 con 0x561150be6150 2024-09-12T00:53:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.768+0000 7f9ee57fa640 1 -- 172.21.15.2:0/2224318156 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8044040 con 0x561150be6150 2024-09-12T00:53:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 -- 172.21.15.2:0/2224318156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 msgr2=0x561150bfe5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150bfe5d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8004ab0 tx=0x7f9ef802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 -- 172.21.15.2:0/2224318156 shutdown_connections 2024-09-12T00:53:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150be6150 0x561150bfe5d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150bd7320 0x561150bfe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 --2- 172.21.15.2:0/2224318156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150bd2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 -- 172.21.15.2:0/2224318156 >> 172.21.15.2:0/2224318156 conn(0x561150bd30f0 msgr2=0x561150bd1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 -- 172.21.15.2:0/2224318156 shutdown_connections 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.769+0000 7f9f08592740 1 -- 172.21.15.2:0/2224318156 wait complete. 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 1 -- start start 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 1 Processor -- start 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150be9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd7320 0x561150bea410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150bea950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec00ceb0 con 0x561150bd7320 2024-09-12T00:53:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec00e320 con 0x561150be6150 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec00d580 con 0x561150bd6a00 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.770+0000 7f9f08592740 10 client.0 _ll_register_callbacks cb 0x7f9ef4005d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd7320 0x561150bea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd7320 0x561150bea410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60704/0 (socket says 172.21.15.2:60704) 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 -- 172.21.15.2:0/848278060 learned_addr learned my addr 172.21.15.2:0/848278060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efffff640 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150bea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150be9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 -- 172.21.15.2:0/848278060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 msgr2=0x561150be9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150be9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 -- 172.21.15.2:0/848278060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 msgr2=0x561150bea950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150bea950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 -- 172.21.15.2:0/848278060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561150bcd680 con 0x561150bd7320 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9efeffd640 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd7320 0x561150bea410 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4097b40 tx=0x7f9ef40d13a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a156e86e1ee348 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9edeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9edeffd640 1 -- 172.21.15.2:0/848278060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef409ad00 con 0x561150bd7320 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9edeffd640 1 -- 172.21.15.2:0/848278060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9ef40cc6f0 con 0x561150bd7320 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.771+0000 7f9f08592740 1 -- 172.21.15.2:0/848278060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ef8036040 con 0x561150bd7320 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9edeffd640 1 -- 172.21.15.2:0/848278060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ef4097460 con 0x561150bd7320 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9f08592740 10 client.15537 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9f08592740 1 -- 172.21.15.2:0/848278060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561150c61110 con 0x561150bd7320 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9edeffd640 1 -- 172.21.15.2:0/848278060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef8036040 con 0x561150bd7320 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9edeffd640 1 -- 172.21.15.2:0/848278060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ef40ccce0 con 0x561150bd7320 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9f08592740 10 client.15537 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9f08592740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9f08592740 20 client.15537 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9f08592740 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561150c618e0 0x561150c63d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9f08592740 4 client.15537 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9f08592740 1 -- 172.21.15.2:0/848278060 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561150ac0110 con 0x561150c618e0 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.772+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561150c618e0 0x561150c63d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.773+0000 7f9eff7fe640 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561150c618e0 0x561150c63d00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8393c170a4ef466 server_cookie=14ac75beba1b1d12 in_seq=0 out_seq=0 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.773+0000 7f9edeffd640 10 client.15537 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9edeffd640 1 -- 172.21.15.2:0/848278060 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561150ac0110 con 0x561150c618e0 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9edeffd640 10 client.15537 handle_command_reply: tid=0 2024-09-12T00:53:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 client.15537 shutdown 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 -- 172.21.15.2:0/848278060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd7320 msgr2=0x561150bea410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd7320 0x561150bea410 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4097b40 tx=0x7f9ef40d13a0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 -- 172.21.15.2:0/848278060 shutdown_connections 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561150c618e0 0x561150c63d00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561150be6150 0x561150bea950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561150bd7320 0x561150bea410 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 --2- 172.21.15.2:0/848278060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561150bd6a00 0x561150be9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.774+0000 7f9f08592740 1 -- 172.21.15.2:0/848278060 >> 172.21.15.2:0/848278060 conn(0x561150bd30f0 msgr2=0x561150bd8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.775+0000 7f9edeffd640 0 client.15537 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.775+0000 7f9f08592740 1 -- 172.21.15.2:0/848278060 shutdown_connections 2024-09-12T00:53:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.775+0000 7f9f08592740 1 -- 172.21.15.2:0/848278060 wait complete. 2024-09-12T00:53:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.775+0000 7f9f08592740 20 client.15537 trim_cache size 0 max 16384 2024-09-12T00:53:50.782 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:53:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "22a6694a-d08f-43b5-b417-ef5c9ec75f49", 2024-09-12T00:53:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:53:50.782 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.775+0000 7f9f061b9640 1 -- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ee80a2e90 msgr2=0x7f9ee80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.775+0000 7f9f061b9640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ee80a2e90 0x7f9ee80a5350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009cd0 tx=0x7f9ef804a000 comp rx=0 tx=0).stop 2024-09-12T00:53:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.775+0000 7f9f061b9640 1 -- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001036e0 msgr2=0x7f9f00198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.775+0000 7f9f061b9640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001036e0 0x7f9f00198a90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400d740 tx=0x7f9ef400dc00 comp rx=0 tx=0).stop 2024-09-12T00:53:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.776+0000 7f9f061b9640 1 -- 172.21.15.2:0/3593019559 shutdown_connections 2024-09-12T00:53:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.776+0000 7f9f061b9640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9ee80a2e90 0x7f9ee80a5350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.776+0000 7f9f061b9640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f001082a0 0x7f9f0019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.776+0000 7f9f061b9640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f001036e0 0x7f9f00198a90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.776+0000 7f9f061b9640 1 --2- 172.21.15.2:0/3593019559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00102d30 0x7f9f00198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.776+0000 7f9f061b9640 1 -- 172.21.15.2:0/3593019559 >> 172.21.15.2:0/3593019559 conn(0x7f9f000fc7d0 msgr2=0x7f9f00105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.776+0000 7f9f061b9640 1 -- 172.21.15.2:0/3593019559 shutdown_connections 2024-09-12T00:53:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:50.776+0000 7f9f061b9640 1 -- 172.21.15.2:0/3593019559 wait complete. 2024-09-12T00:53:51.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:53:51.823 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:52.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:51 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:53:52.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:51 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:52.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:51 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:53:52.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:51 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:52.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:51 smithi002 ceph-mon[31210]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T00:53:52.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:51 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:53:52.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:51 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:53:52.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:51 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:52.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:51 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:53:52.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:51 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:52.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:51 smithi167 ceph-mon[35234]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T00:53:52.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:51 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:53:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.393+0000 7fd391ff7640 1 -- 172.21.15.2:0/1223061286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c106f00 msgr2=0x7fd38c10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.393+0000 7fd391ff7640 1 --2- 172.21.15.2:0/1223061286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c106f00 0x7fd38c10ea80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd384009ca0 tx=0x7fd38402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.394+0000 7fd391ff7640 1 -- 172.21.15.2:0/1223061286 shutdown_connections 2024-09-12T00:53:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.394+0000 7fd391ff7640 1 --2- 172.21.15.2:0/1223061286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c106f00 0x7fd38c10ea80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.394+0000 7fd391ff7640 1 --2- 172.21.15.2:0/1223061286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38c102780 0x7fd38c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.394+0000 7fd391ff7640 1 --2- 172.21.15.2:0/1223061286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38c101dd0 0x7fd38c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.394+0000 7fd391ff7640 1 -- 172.21.15.2:0/1223061286 >> 172.21.15.2:0/1223061286 conn(0x7fd38c0fd8b0 msgr2=0x7fd38c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:52.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.394+0000 7fd391ff7640 1 -- 172.21.15.2:0/1223061286 shutdown_connections 2024-09-12T00:53:52.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.394+0000 7fd391ff7640 1 -- 172.21.15.2:0/1223061286 wait complete. 2024-09-12T00:53:52.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.394+0000 7fd391ff7640 1 Processor -- start 2024-09-12T00:53:52.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd391ff7640 1 -- start start 2024-09-12T00:53:52.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd391ff7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c101dd0 0x7fd38c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd391ff7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38c102780 0x7fd38c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd391ff7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38c106f00 0x7fd38c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd391ff7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c111fb0 con 0x7fd38c101dd0 2024-09-12T00:53:52.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd391ff7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c111e30 con 0x7fd38c102780 2024-09-12T00:53:52.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd391ff7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c112130 con 0x7fd38c106f00 2024-09-12T00:53:52.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd38b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c101dd0 0x7fd38c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd38b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c101dd0 0x7fd38c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60724/0 (socket says 172.21.15.2:60724) 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.395+0000 7fd38b7fe640 1 -- 172.21.15.2:0/993126420 learned_addr learned my addr 172.21.15.2:0/993126420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38bfff640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38c106f00 0x7fd38c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38affd640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38c102780 0x7fd38c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38b7fe640 1 -- 172.21.15.2:0/993126420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38c106f00 msgr2=0x7fd38c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38c106f00 0x7fd38c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38b7fe640 1 -- 172.21.15.2:0/993126420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38c102780 msgr2=0x7fd38c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38c102780 0x7fd38c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38b7fe640 1 -- 172.21.15.2:0/993126420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c19d380 con 0x7fd38c101dd0 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38affd640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38c102780 0x7fd38c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c101dd0 0x7fd38c1983d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00bea0 tx=0x7fd37c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd388ff9640 1 -- 172.21.15.2:0/993126420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c018070 con 0x7fd38c101dd0 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd391ff7640 1 -- 172.21.15.2:0/993126420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38c19d670 con 0x7fd38c101dd0 2024-09-12T00:53:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.396+0000 7fd391ff7640 1 -- 172.21.15.2:0/993126420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38c074420 con 0x7fd38c101dd0 2024-09-12T00:53:52.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.397+0000 7fd388ff9640 1 -- 172.21.15.2:0/993126420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd37c012c40 con 0x7fd38c101dd0 2024-09-12T00:53:52.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.397+0000 7fd388ff9640 1 -- 172.21.15.2:0/993126420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c01b9a0 con 0x7fd38c101dd0 2024-09-12T00:53:52.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.399+0000 7fd3943d0740 1 Processor -- start 2024-09-12T00:53:52.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.399+0000 7fd3943d0740 1 -- start start 2024-09-12T00:53:52.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcfba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd3943d0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d4efc542e0 con 0x55d4efcf9680 2024-09-12T00:53:52.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd3943d0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d4efbfbce0 con 0x55d4efcee4a0 2024-09-12T00:53:52.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd3943d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d4efc502a0 con 0x55d4efceedc0 2024-09-12T00:53:52.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd38affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcfba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd38affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcfba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60740/0 (socket says 172.21.15.2:60740) 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd38affd640 1 -- 172.21.15.2:0/2392232632 learned_addr learned my addr 172.21.15.2:0/2392232632 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd388ff9640 1 -- 172.21.15.2:0/993126420 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7fd37c01bb40 con 0x7fd38c101dd0 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd38bfff640 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.400+0000 7fd38affd640 1 -- 172.21.15.2:0/2392232632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 msgr2=0x55d4efcf9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd38affd640 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd38affd640 1 -- 172.21.15.2:0/2392232632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 msgr2=0x55d4efcee880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd38affd640 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcee880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd38affd640 1 -- 172.21.15.2:0/2392232632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4efbe0440 con 0x55d4efcf9680 2024-09-12T00:53:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd38bfff640 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcee880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd38affd640 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcfba70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd380009ba0 tx=0x7fd38000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ade36633a34433 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.401+0000 7fd388ff9640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3740a2e90 0x7fd3740a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.402+0000 7fd388ff9640 1 -- 172.21.15.2:0/993126420 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd37c0d34f0 con 0x7fd38c101dd0 2024-09-12T00:53:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.402+0000 7fd371ffb640 1 -- 172.21.15.2:0/2392232632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380016070 con 0x55d4efcf9680 2024-09-12T00:53:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.402+0000 7fd38bfff640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3740a2e90 0x7fd3740a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.402+0000 7fd371ffb640 1 -- 172.21.15.2:0/2392232632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd380011950 con 0x55d4efcf9680 2024-09-12T00:53:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.402+0000 7fd371ffb640 1 -- 172.21.15.2:0/2392232632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380010870 con 0x55d4efcf9680 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 -- 172.21.15.2:0/2392232632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 msgr2=0x55d4efcfba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcfba70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd380009ba0 tx=0x7fd38000e6c0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd38bfff640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3740a2e90 0x7fd3740a5350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd384009430 tx=0x7fd384005f50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 -- 172.21.15.2:0/2392232632 shutdown_connections 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcfba70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 --2- 172.21.15.2:0/2392232632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcee880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 -- 172.21.15.2:0/2392232632 >> 172.21.15.2:0/2392232632 conn(0x55d4efceaa30 msgr2=0x55d4efceae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 -- 172.21.15.2:0/2392232632 shutdown_connections 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 -- 172.21.15.2:0/2392232632 wait complete. 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.403+0000 7fd3943d0740 1 -- start start 2024-09-12T00:53:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd3943d0740 1 Processor -- start 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcf8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcf6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcf9680 0x55d4efcf67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd3943d0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d4efcfc250 con 0x55d4efceedc0 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd3943d0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d4efc0f050 con 0x55d4efcee4a0 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd3943d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d4efcfc3d0 con 0x55d4efcf9680 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd3943d0740 10 client.0 _ll_register_callbacks cb 0x55d4efc4f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd38affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcf6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd38b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcf8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd38b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcf8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:48648/0 (socket says 172.21.15.2:48648) 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.404+0000 7fd38b7fe640 1 -- 172.21.15.2:0/336342572 learned_addr learned my addr 172.21.15.2:0/336342572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38bfff640 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcf9680 0x55d4efcf67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38affd640 1 -- 172.21.15.2:0/336342572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcf9680 msgr2=0x55d4efcf67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38affd640 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcf9680 0x55d4efcf67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38affd640 1 -- 172.21.15.2:0/336342572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 msgr2=0x55d4efcf8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38affd640 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcf8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38affd640 1 -- 172.21.15.2:0/336342572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4ef9c53c0 con 0x55d4efceedc0 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38bfff640 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcf9680 0x55d4efcf67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcf8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd38affd640 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcf6260 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd380010410 tx=0x7fd380011680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafcf397fdca4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.405+0000 7fd36affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:52.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.406+0000 7fd36affd640 1 -- 172.21.15.2:0/336342572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380016050 con 0x55d4efceedc0 2024-09-12T00:53:52.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.406+0000 7fd36affd640 1 -- 172.21.15.2:0/336342572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd380004020 con 0x55d4efceedc0 2024-09-12T00:53:52.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.406+0000 7fd3943d0740 1 -- 172.21.15.2:0/336342572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd380011950 con 0x55d4efceedc0 2024-09-12T00:53:52.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.406+0000 7fd36affd640 1 -- 172.21.15.2:0/336342572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd380011770 con 0x55d4efceedc0 2024-09-12T00:53:52.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.406+0000 7fd3943d0740 10 client.15549 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:52.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.406+0000 7fd3943d0740 1 -- 172.21.15.2:0/336342572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d4efd07b70 con 0x55d4efceedc0 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd36affd640 1 -- 172.21.15.2:0/336342572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3800097a0 con 0x55d4efceedc0 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd36affd640 1 -- 172.21.15.2:0/336342572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd38000f040 con 0x55d4efceedc0 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd3943d0740 10 client.15549 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd3943d0740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd3943d0740 20 client.15549 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd3943d0740 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d4efd08f80 0x55d4efd0b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd3943d0740 4 client.15549 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd3943d0740 1 -- 172.21.15.2:0/336342572 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd380011950 con 0x55d4efd08f80 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.407+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d4efd08f80 0x55d4efd0b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.408+0000 7fd36affd640 10 client.15549 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.408+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d4efd08f80 0x55d4efd0b370 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe0755e1af155009 server_cookie=f0cffc170a226ccc in_seq=0 out_seq=0 2024-09-12T00:53:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd36affd640 1 -- 172.21.15.2:0/336342572 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd380011950 con 0x55d4efd08f80 2024-09-12T00:53:52.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd36affd640 10 client.15549 handle_command_reply: tid=0 2024-09-12T00:53:52.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd3943d0740 1 client.15549 shutdown 2024-09-12T00:53:52.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd3943d0740 1 -- 172.21.15.2:0/336342572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 msgr2=0x55d4efcf6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd3943d0740 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcf6260 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd380010410 tx=0x7fd380011680 comp rx=0 tx=0).stop 2024-09-12T00:53:52.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd3943d0740 1 -- 172.21.15.2:0/336342572 shutdown_connections 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd3943d0740 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d4efd08f80 0x55d4efd0b370 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd3943d0740 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcf9680 0x55d4efcf67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd3943d0740 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcf6260 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.409+0000 7fd3943d0740 1 --2- 172.21.15.2:0/336342572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efcf8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.410+0000 7fd3943d0740 1 -- 172.21.15.2:0/336342572 >> 172.21.15.2:0/336342572 conn(0x55d4efceaa30 msgr2=0x55d4efcf0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.410+0000 7fd36affd640 0 client.15549 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.410+0000 7fd3943d0740 1 -- 172.21.15.2:0/336342572 shutdown_connections 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.410+0000 7fd3943d0740 1 -- 172.21.15.2:0/336342572 wait complete. 2024-09-12T00:53:52.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.410+0000 7fd3943d0740 20 client.15549 trim_cache size 0 max 16384 2024-09-12T00:53:52.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.427+0000 7fd3943d0740 1 Processor -- start 2024-09-12T00:53:52.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd3943d0740 1 -- start start 2024-09-12T00:53:52.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efd054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcf0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd3943d0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c1ae1a0 con 0x55d4efcf9680 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd3943d0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c1aba70 con 0x55d4efcee4a0 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd3943d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c1a98c0 con 0x55d4efceedc0 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd38b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efd054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd38bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcf0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd38b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efd054b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:48658/0 (socket says 172.21.15.2:48658) 2024-09-12T00:53:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd38b7fe640 1 -- 172.21.15.2:0/370027804 learned_addr learned my addr 172.21.15.2:0/370027804 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.428+0000 7fd38affd640 1 --2- 172.21.15.2:0/370027804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.429+0000 7fd38bfff640 1 -- 172.21.15.2:0/370027804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 msgr2=0x55d4efcf4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.429+0000 7fd38bfff640 1 --2- 172.21.15.2:0/370027804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.429+0000 7fd38bfff640 1 -- 172.21.15.2:0/370027804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 msgr2=0x55d4efd054b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.429+0000 7fd38bfff640 1 --2- 172.21.15.2:0/370027804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efd054b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.429+0000 7fd38bfff640 1 -- 172.21.15.2:0/370027804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4efcebbc0 con 0x55d4efcf9680 2024-09-12T00:53:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.429+0000 7fd38bfff640 1 --2- 172.21.15.2:0/370027804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcf0600 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd384006010 tx=0x7fd384048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d629f1765eb2dbec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3717fa640 1 -- 172.21.15.2:0/370027804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384031c00 con 0x55d4efcf9680 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3717fa640 1 -- 172.21.15.2:0/370027804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd384036040 con 0x55d4efcf9680 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3717fa640 1 -- 172.21.15.2:0/370027804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384004810 con 0x55d4efcf9680 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3943d0740 1 -- 172.21.15.2:0/370027804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 msgr2=0x55d4efcf0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3943d0740 1 --2- 172.21.15.2:0/370027804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcf0600 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd384006010 tx=0x7fd384048000 comp rx=0 tx=0).stop 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3943d0740 1 -- 172.21.15.2:0/370027804 shutdown_connections 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3943d0740 1 --2- 172.21.15.2:0/370027804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efcf9680 0x55d4efcf0600 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3943d0740 1 --2- 172.21.15.2:0/370027804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efceedc0 0x55d4efcf4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3943d0740 1 --2- 172.21.15.2:0/370027804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcee4a0 0x55d4efd054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3943d0740 1 -- 172.21.15.2:0/370027804 >> 172.21.15.2:0/370027804 conn(0x55d4efceaa30 msgr2=0x55d4efcefef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.430+0000 7fd3943d0740 1 -- 172.21.15.2:0/370027804 shutdown_connections 2024-09-12T00:53:52.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.431+0000 7fd3943d0740 1 -- 172.21.15.2:0/370027804 wait complete. 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.431+0000 7fd3943d0740 1 -- start start 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.431+0000 7fd3943d0740 1 Processor -- start 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.431+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcee4a0 0x55d4efd01c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.431+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcfcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.431+0000 7fd3943d0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcf9680 0x55d4efcfd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd3943d0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c1a9f30 con 0x55d4efceedc0 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd3943d0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c1ab3a0 con 0x55d4efcf9680 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd3943d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c1aa600 con 0x55d4efcee4a0 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd3943d0740 10 client.0 _ll_register_callbacks cb 0x7fd384009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcfcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcfcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60772/0 (socket says 172.21.15.2:60772) 2024-09-12T00:53:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 -- 172.21.15.2:0/3187007675 learned_addr learned my addr 172.21.15.2:0/3187007675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcee4a0 0x55d4efd01c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38bfff640 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcf9680 0x55d4efcfd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 -- 172.21.15.2:0/3187007675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcee4a0 msgr2=0x55d4efd01c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:52.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcee4a0 0x55d4efd01c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.436 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:53:52.436 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:53:52.436 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:53:52.436 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:53:52.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 -- 172.21.15.2:0/3187007675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcf9680 msgr2=0x55d4efcfd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcf9680 0x55d4efcfd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 -- 172.21.15.2:0/3187007675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4efcfdb10 con 0x55d4efceedc0 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd38affd640 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcfcf30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd38000eda0 tx=0x7fd380004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2675601b32c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.432+0000 7fd36affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.433+0000 7fd36affd640 1 -- 172.21.15.2:0/3187007675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380016040 con 0x55d4efceedc0 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.433+0000 7fd36affd640 1 -- 172.21.15.2:0/3187007675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd380005bb0 con 0x55d4efceedc0 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.433+0000 7fd3943d0740 1 -- 172.21.15.2:0/3187007675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd384036040 con 0x55d4efceedc0 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.433+0000 7fd36affd640 1 -- 172.21.15.2:0/3187007675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd380009a20 con 0x55d4efceedc0 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.433+0000 7fd3943d0740 10 client.15555 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.433+0000 7fd3943d0740 1 -- 172.21.15.2:0/3187007675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d4efd72940 con 0x55d4efceedc0 2024-09-12T00:53:52.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.433+0000 7fd36affd640 1 -- 172.21.15.2:0/3187007675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd384036040 con 0x55d4efceedc0 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.433+0000 7fd36affd640 1 -- 172.21.15.2:0/3187007675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd38001b980 con 0x55d4efceedc0 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd3943d0740 10 client.15555 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd3943d0740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd3943d0740 20 client.15555 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd3943d0740 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d4efd73000 0x55d4efd75420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd3943d0740 4 client.15555 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd3943d0740 1 -- 172.21.15.2:0/3187007675 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d4efc61850 con 0x55d4efd73000 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d4efd73000 0x55d4efd75420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd36affd640 10 client.15555 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd38b7fe640 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d4efd73000 0x55d4efd75420 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=422d1c6e3697cc46 server_cookie=8a96ecc14ac98c7d in_seq=0 out_seq=0 2024-09-12T00:53:52.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd36affd640 1 -- 172.21.15.2:0/3187007675 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d4efc61850 con 0x55d4efd73000 2024-09-12T00:53:52.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.434+0000 7fd36affd640 10 client.15555 handle_command_reply: tid=0 2024-09-12T00:53:52.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 client.15555 shutdown 2024-09-12T00:53:52.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 -- 172.21.15.2:0/3187007675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 msgr2=0x55d4efcfcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcfcf30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd38000eda0 tx=0x7fd380004fb0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 -- 172.21.15.2:0/3187007675 shutdown_connections 2024-09-12T00:53:52.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d4efd73000 0x55d4efd75420 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4efcf9680 0x55d4efcfd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4efceedc0 0x55d4efcfcf30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 --2- 172.21.15.2:0/3187007675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4efcee4a0 0x55d4efd01c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 -- 172.21.15.2:0/3187007675 >> 172.21.15.2:0/3187007675 conn(0x55d4efceaa30 msgr2=0x55d4efce9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:52.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd36affd640 0 client.15555 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:52.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 -- 172.21.15.2:0/3187007675 shutdown_connections 2024-09-12T00:53:52.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:51 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:53:52.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:51 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:52.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:51 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:53:52.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:51 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:53:52.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:51 smithi071 ceph-mon[35276]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T00:53:52.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:51 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:53:52.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 1 -- 172.21.15.2:0/3187007675 wait complete. 2024-09-12T00:53:52.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.435+0000 7fd3943d0740 20 client.15555 trim_cache size 0 max 16384 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 -- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3740a2e90 msgr2=0x7fd3740a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3740a2e90 0x7fd3740a5350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd384009430 tx=0x7fd384005f50 comp rx=0 tx=0).stop 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 -- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c101dd0 msgr2=0x7fd38c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c101dd0 0x7fd38c1983d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00bea0 tx=0x7fd37c00bf90 comp rx=0 tx=0).stop 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 -- 172.21.15.2:0/993126420 shutdown_connections 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3740a2e90 0x7fd3740a5350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38c106f00 0x7fd38c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38c102780 0x7fd38c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 --2- 172.21.15.2:0/993126420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd38c101dd0 0x7fd38c1983d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 -- 172.21.15.2:0/993126420 >> 172.21.15.2:0/993126420 conn(0x7fd38c0fd8b0 msgr2=0x7fd38c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 -- 172.21.15.2:0/993126420 shutdown_connections 2024-09-12T00:53:52.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:52.436+0000 7fd391ff7640 1 -- 172.21.15.2:0/993126420 wait complete. 2024-09-12T00:53:53.198 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:53:53.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:53:53.478 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:53.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.964+0000 7f677edcf640 1 -- 172.21.15.2:0/254107976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67781082a0 msgr2=0x7f677810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:53.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.964+0000 7f677edcf640 1 --2- 172.21.15.2:0/254107976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67781082a0 0x7f677810ec40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6770009cd0 tx=0x7f677002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:53:53.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.964+0000 7f677edcf640 1 -- 172.21.15.2:0/254107976 shutdown_connections 2024-09-12T00:53:53.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.964+0000 7f677edcf640 1 --2- 172.21.15.2:0/254107976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67781082a0 0x7f677810ec40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:53.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.965+0000 7f677edcf640 1 --2- 172.21.15.2:0/254107976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67781036e0 0x7f6778107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:53.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.965+0000 7f677edcf640 1 --2- 172.21.15.2:0/254107976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6778102d30 0x7f6778103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:53.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.965+0000 7f677edcf640 1 -- 172.21.15.2:0/254107976 >> 172.21.15.2:0/254107976 conn(0x7f67780fc7d0 msgr2=0x7f67780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:53.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.965+0000 7f677edcf640 1 -- 172.21.15.2:0/254107976 shutdown_connections 2024-09-12T00:53:53.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.965+0000 7f677edcf640 1 -- 172.21.15.2:0/254107976 wait complete. 2024-09-12T00:53:53.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677edcf640 1 Processor -- start 2024-09-12T00:53:53.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677edcf640 1 -- start start 2024-09-12T00:53:53.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677edcf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6778102d30 0x7f6778100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:53.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677edcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67781036e0 0x7f6778100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:53.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677edcf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67781082a0 0x7f6778101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:53.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677edcf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67781120a0 con 0x7f67781082a0 2024-09-12T00:53:53.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677edcf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6778111f20 con 0x7f6778102d30 2024-09-12T00:53:53.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677edcf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6778112220 con 0x7f67781036e0 2024-09-12T00:53:53.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677cb6b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6778102d30 0x7f6778100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:53.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677cb6b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6778102d30 0x7f6778100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:48688/0 (socket says 172.21.15.2:48688) 2024-09-12T00:53:53.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677cb6b640 1 -- 172.21.15.2:0/2751069204 learned_addr learned my addr 172.21.15.2:0/2751069204 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:53.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f677d36c640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67781082a0 0x7f6778101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:53.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.966+0000 7f6777fff640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67781036e0 0x7f6778100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f677cb6b640 1 -- 172.21.15.2:0/2751069204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67781036e0 msgr2=0x7f6778100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f677cb6b640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67781036e0 0x7f6778100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f677cb6b640 1 -- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67781082a0 msgr2=0x7f6778101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f677cb6b640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67781082a0 0x7f6778101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f677cb6b640 1 -- 172.21.15.2:0/2751069204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67781a69f0 con 0x7f6778102d30 2024-09-12T00:53:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f677cb6b640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6778102d30 0x7f6778100990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e9f0 tx=0x7f676c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f6775ffb640 1 -- 172.21.15.2:0/2751069204 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c00cd80 con 0x7f6778102d30 2024-09-12T00:53:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f6775ffb640 1 -- 172.21.15.2:0/2751069204 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f676c010910 con 0x7f6778102d30 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.967+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67781a6ce0 con 0x7f6778102d30 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.968+0000 7f6775ffb640 1 -- 172.21.15.2:0/2751069204 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c018990 con 0x7f6778102d30 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.968+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67781a7210 con 0x7f6778102d30 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.969+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6778103110 con 0x7f6778102d30 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.970+0000 7f6775ffb640 1 -- 172.21.15.2:0/2751069204 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f676c010ac0 con 0x7f6778102d30 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.971+0000 7f6775ffb640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f67680a2e90 0x7f67680a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.971+0000 7f6777fff640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f67680a2e90 0x7f67680a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.971+0000 7f6775ffb640 1 -- 172.21.15.2:0/2751069204 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f676c0cf9c0 con 0x7f6778102d30 2024-09-12T00:53:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.971+0000 7f6777fff640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f67680a2e90 0x7f67680a5350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6778102420 tx=0x7f676400b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:53.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:53.975+0000 7f6775ffb640 1 -- 172.21.15.2:0/2751069204 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f676c0d1e20 con 0x7f6778102d30 2024-09-12T00:53:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.190+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f677810a2b0 con 0x7f6778102d30 2024-09-12T00:53:54.190 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:53 smithi002 ceph-mon[31210]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:53:54.191 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:53:54.191 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:53:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.191+0000 7f6775ffb640 1 -- 172.21.15.2:0/2751069204 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f676c09bcf0 con 0x7f6778102d30 2024-09-12T00:53:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:53:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f67680a2e90 msgr2=0x7f67680a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f67680a2e90 0x7f67680a5350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6778102420 tx=0x7f676400b410 comp rx=0 tx=0).stop 2024-09-12T00:53:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6778102d30 msgr2=0x7f6778100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6778102d30 0x7f6778100990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e9f0 tx=0x7f676c00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:53:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 shutdown_connections 2024-09-12T00:53:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f67680a2e90 0x7f67680a5350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67781082a0 0x7f6778101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67781036e0 0x7f6778100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 --2- 172.21.15.2:0/2751069204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6778102d30 0x7f6778100990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.194+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 >> 172.21.15.2:0/2751069204 conn(0x7f67780fc7d0 msgr2=0x7f6778105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.195+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 shutdown_connections 2024-09-12T00:53:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:54.195+0000 7f677edcf640 1 -- 172.21.15.2:0/2751069204 wait complete. 2024-09-12T00:53:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:53 smithi167 ceph-mon[35234]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:53:54.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:53 smithi071 ceph-mon[35276]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:53:54.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:53:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:55.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:54 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2751069204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:55.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:54 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2751069204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:55.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:54 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2751069204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:53:55.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 -- 172.21.15.2:0/3135270322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 msgr2=0x7f5fc01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/3135270322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 0x7f5fc01029b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009900 tx=0x7f5fa802a480 comp rx=0 tx=0).stop 2024-09-12T00:53:55.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 -- 172.21.15.2:0/3135270322 shutdown_connections 2024-09-12T00:53:55.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/3135270322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc0102ef0 0x7f5fc010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/3135270322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 0x7f5fc01029b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/3135270322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fc0100e20 0x7f5fc0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 -- 172.21.15.2:0/3135270322 >> 172.21.15.2:0/3135270322 conn(0x7f5fc00fc7d0 msgr2=0x7f5fc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:55.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 -- 172.21.15.2:0/3135270322 shutdown_connections 2024-09-12T00:53:55.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.690+0000 7f5fc63fa640 1 -- 172.21.15.2:0/3135270322 wait complete. 2024-09-12T00:53:55.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.691+0000 7f5fc63fa640 1 Processor -- start 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.691+0000 7f5fc63fa640 1 -- start start 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fc63fa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fc0100e20 0x7f5fc0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fc63fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 0x7f5fc0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 0x7f5fc0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 0x7f5fc0198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60822/0 (socket says 172.21.15.2:60822) 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fb7fff640 1 -- 172.21.15.2:0/1719950339 learned_addr learned my addr 172.21.15.2:0/1719950339 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc0102ef0 0x7f5fc019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fbffff640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fc0100e20 0x7f5fc0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc01120d0 con 0x7f5fc0102570 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0111f50 con 0x7f5fc0102ef0 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0112250 con 0x7f5fc0100e20 2024-09-12T00:53:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fbffff640 1 -- 172.21.15.2:0/1719950339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc0102ef0 msgr2=0x7f5fc019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fbffff640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc0102ef0 0x7f5fc019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fbffff640 1 -- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 msgr2=0x7f5fc0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fbffff640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 0x7f5fc0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fbffff640 1 -- 172.21.15.2:0/1719950339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc019d4c0 con 0x7f5fc0100e20 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.692+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 0x7f5fc0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.693+0000 7f5fbffff640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fc0100e20 0x7f5fc0198510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000d720 tx=0x7f5fb000dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.693+0000 7f5fbdffb640 1 -- 172.21.15.2:0/1719950339 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0017070 con 0x7f5fc0100e20 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.693+0000 7f5fbdffb640 1 -- 172.21.15.2:0/1719950339 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb000de30 con 0x7f5fc0100e20 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.693+0000 7f5fbdffb640 1 -- 172.21.15.2:0/1719950339 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00047a0 con 0x7f5fc0100e20 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.693+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc019d7b0 con 0x7f5fc0100e20 2024-09-12T00:53:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.693+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc019dbb0 con 0x7f5fc0100e20 2024-09-12T00:53:55.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.697+0000 7f5fc87d3740 1 Processor -- start 2024-09-12T00:53:55.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.697+0000 7f5fbdffb640 1 -- 172.21.15.2:0/1719950339 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f5fb00099d0 con 0x7f5fc0100e20 2024-09-12T00:53:55.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.697+0000 7f5fc87d3740 1 -- start start 2024-09-12T00:53:55.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.697+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.697+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.697+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e5a1d362f0 con 0x55e5a1ddb370 2024-09-12T00:53:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e5a1cddcf0 con 0x55e5a1dd1b40 2024-09-12T00:53:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e5a1d322b0 con 0x55e5a1dd05d0 2024-09-12T00:53:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc4997640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc4997640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:48718/0 (socket says 172.21.15.2:48718) 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc4997640 1 -- 172.21.15.2:0/3269205777 learned_addr learned my addr 172.21.15.2:0/3269205777 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fbffff640 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc4997640 1 -- 172.21.15.2:0/3269205777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 msgr2=0x55e5a1dd0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc4997640 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc4997640 1 -- 172.21.15.2:0/3269205777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1ddb370 msgr2=0x55e5a1ddd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc4997640 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.698+0000 7f5fc4997640 1 -- 172.21.15.2:0/3269205777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a1cc23a0 con 0x55e5a1dd1b40 2024-09-12T00:53:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.699+0000 7f5fc4997640 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd0090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009ea0 tx=0x7f5fb8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f30b61eb183063 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.699+0000 7f5fbdffb640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5fac0a2e10 0x7f5fac0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.699+0000 7f5fb67fc640 1 -- 172.21.15.2:0/3269205777 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8004d20 con 0x55e5a1dd1b40 2024-09-12T00:53:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.699+0000 7f5fbdffb640 1 -- 172.21.15.2:0/1719950339 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5fb00cf410 con 0x7f5fc0100e20 2024-09-12T00:53:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.699+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.699+0000 7f5fb67fc640 1 -- 172.21.15.2:0/3269205777 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb800ee60 con 0x55e5a1dd1b40 2024-09-12T00:53:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.699+0000 7f5fb67fc640 1 -- 172.21.15.2:0/3269205777 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8010850 con 0x55e5a1dd1b40 2024-09-12T00:53:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.699+0000 7f5fbffff640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5fac0a2e10 0x7f5fac0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.700+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3269205777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1dd1b40 msgr2=0x55e5a1dd0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.700+0000 7f5fbffff640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5fac0a2e10 0x7f5fac0a52d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00cc990 tx=0x7f5fb00d2ea0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.700+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd0090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009ea0 tx=0x7f5fb8009f90 comp rx=0 tx=0).stop 2024-09-12T00:53:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.700+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3269205777 shutdown_connections 2024-09-12T00:53:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.700+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.700+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.700+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3269205777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd0090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.700+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3269205777 >> 172.21.15.2:0/3269205777 conn(0x55e5a1d99310 msgr2=0x55e5a1dccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.701+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3269205777 shutdown_connections 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.701+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3269205777 wait complete. 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.701+0000 7f5fc87d3740 1 -- start start 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.701+0000 7f5fc87d3740 1 Processor -- start 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd05d0 0x55e5a1ddad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1dd8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e5a1dde070 con 0x55e5a1dd05d0 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e5a1cf1060 con 0x55e5a1ddb370 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e5a1dde1f0 con 0x55e5a1dd1b40 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc87d3740 10 client.0 _ll_register_callbacks cb 0x55e5a1a448c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc4997640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd05d0 0x55e5a1ddad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc4997640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd05d0 0x55e5a1ddad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60846/0 (socket says 172.21.15.2:60846) 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc4997640 1 -- 172.21.15.2:0/2448755009 learned_addr learned my addr 172.21.15.2:0/2448755009 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc4997640 1 -- 172.21.15.2:0/2448755009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd1b40 msgr2=0x55e5a1dd7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc4997640 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc4997640 1 -- 172.21.15.2:0/2448755009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 msgr2=0x55e5a1dd8530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc4997640 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1dd8530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.702+0000 7f5fc4997640 1 -- 172.21.15.2:0/2448755009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a1aa73c0 con 0x55e5a1dd05d0 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.703+0000 7f5fc4997640 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd05d0 0x55e5a1ddad00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8005b10 tx=0x7f5fb8010bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cda22c917175a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.703+0000 7f5f9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.703+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/2448755009 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb801d040 con 0x55e5a1dd05d0 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.703+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/2448755009 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5fb8005020 con 0x55e5a1dd05d0 2024-09-12T00:53:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.703+0000 7f5fc87d3740 1 -- 172.21.15.2:0/2448755009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fb800ee60 con 0x55e5a1dd05d0 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/2448755009 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5fb8005220 con 0x55e5a1dd05d0 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5fc87d3740 10 client.15573 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5fc87d3740 1 -- 172.21.15.2:0/2448755009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5a1dfaab0 con 0x55e5a1dd05d0 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/2448755009 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb800ee60 con 0x55e5a1dd05d0 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/2448755009 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5fb80189b0 con 0x55e5a1dd05d0 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5fc87d3740 10 client.15573 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5fc87d3740 10 client.15573 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5fc87d3740 20 client.15573 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e5a1dfbf10 0x55e5a1dfe300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5fc87d3740 4 client.15573 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.704+0000 7f5fc87d3740 1 -- 172.21.15.2:0/2448755009 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5a1d43860 con 0x55e5a1dfbf10 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.705+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e5a1dfbf10 0x55e5a1dfe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.706+0000 7f5f9f7fe640 10 client.15573 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.706+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e5a1dfbf10 0x55e5a1dfe300 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=193f39bba6d23fe5 server_cookie=1dab2bde2aede9e7 in_seq=0 out_seq=0 2024-09-12T00:53:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.706+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/2448755009 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5a1d43860 con 0x55e5a1dfbf10 2024-09-12T00:53:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.706+0000 7f5f9f7fe640 10 client.15573 handle_command_reply: tid=0 2024-09-12T00:53:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.706+0000 7f5fc87d3740 1 client.15573 shutdown 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 -- 172.21.15.2:0/2448755009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd05d0 msgr2=0x55e5a1ddad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd05d0 0x55e5a1ddad00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8005b10 tx=0x7f5fb8010bc0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 -- 172.21.15.2:0/2448755009 shutdown_connections 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e5a1dfbf10 0x55e5a1dfe300 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5f9f7fe640 0 client.15573 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1dd8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/2448755009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd05d0 0x55e5a1ddad00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 -- 172.21.15.2:0/2448755009 >> 172.21.15.2:0/2448755009 conn(0x55e5a1d99310 msgr2=0x55e5a1dd2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 -- 172.21.15.2:0/2448755009 shutdown_connections 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 1 -- 172.21.15.2:0/2448755009 wait complete. 2024-09-12T00:53:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.707+0000 7f5fc87d3740 20 client.15573 trim_cache size 0 max 16384 2024-09-12T00:53:55.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.733+0000 7f5fc87d3740 1 Processor -- start 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.733+0000 7f5fc87d3740 1 -- start start 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.733+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.733+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.733+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1dd3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0070890 con 0x55e5a1dd1b40 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc006e160 con 0x55e5a1ddb370 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc006bfb0 con 0x55e5a1dd05d0 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:39636/0 (socket says 172.21.15.2:39636) 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 -- 172.21.15.2:0/993128156 learned_addr learned my addr 172.21.15.2:0/993128156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:55.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1dd3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 -- 172.21.15.2:0/993128156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 msgr2=0x55e5a1dd3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1dd3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 -- 172.21.15.2:0/993128156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 msgr2=0x55e5a1dd30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 -- 172.21.15.2:0/993128156 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a1dd88a0 con 0x55e5a1dd05d0 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fc4997640 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd7890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80105a0 tx=0x7f5fb8018430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81b5af8f775d3ced server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.734+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.735+0000 7f5fb5ffb640 1 -- 172.21.15.2:0/993128156 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8009500 con 0x55e5a1dd05d0 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.735+0000 7f5fb5ffb640 1 -- 172.21.15.2:0/993128156 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb8009b40 con 0x55e5a1dd05d0 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.735+0000 7f5fb5ffb640 1 -- 172.21.15.2:0/993128156 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8022b10 con 0x55e5a1dd05d0 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.736+0000 7f5fc87d3740 1 -- 172.21.15.2:0/993128156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 msgr2=0x55e5a1dd7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.736+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd7890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80105a0 tx=0x7f5fb8018430 comp rx=0 tx=0).stop 2024-09-12T00:53:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.736+0000 7f5fc87d3740 1 -- 172.21.15.2:0/993128156 shutdown_connections 2024-09-12T00:53:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.736+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1dd3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.736+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1dd30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.736+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/993128156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1dd7890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.736+0000 7f5fc87d3740 1 -- 172.21.15.2:0/993128156 >> 172.21.15.2:0/993128156 conn(0x55e5a1d99310 msgr2=0x55e5a1dda030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:55.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.736+0000 7f5fc87d3740 1 -- 172.21.15.2:0/993128156 shutdown_connections 2024-09-12T00:53:55.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.737+0000 7f5fc87d3740 1 -- 172.21.15.2:0/993128156 wait complete. 2024-09-12T00:53:55.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.737+0000 7f5fc87d3740 1 -- start start 2024-09-12T00:53:55.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.738+0000 7f5fc87d3740 1 Processor -- start 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.738+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1e5eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.738+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1e5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.738+0000 7f5fc87d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc006c620 con 0x55e5a1dd1b40 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc006da90 con 0x55e5a1ddb370 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc87d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc006ccf0 con 0x55e5a1dd05d0 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1e5eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1e5eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:39646/0 (socket says 172.21.15.2:39646) 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 -- 172.21.15.2:0/3987299623 learned_addr learned my addr 172.21.15.2:0/3987299623 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc87d3740 10 client.0 _ll_register_callbacks cb 0x7f5fb00d2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 -- 172.21.15.2:0/3987299623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 msgr2=0x55e5a1ddea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1e5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 -- 172.21.15.2:0/3987299623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 msgr2=0x55e5a1e5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1e5f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fc4997640 1 -- 172.21.15.2:0/3987299623 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a1ddf230 con 0x55e5a1dd05d0 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.739+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1e5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5fc4997640 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1e5eb60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80104d0 tx=0x7f5fb80224f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f4d9983a230874 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5f9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:53:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/3987299623 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800ee60 con 0x55e5a1dd05d0 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/3987299623 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5fb8004f80 con 0x55e5a1dd05d0 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3987299623 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fb8009b40 con 0x55e5a1dd05d0 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/3987299623 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5fb8022ac0 con 0x55e5a1dd05d0 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5fc87d3740 10 client.25216 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3987299623 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5a1e66250 con 0x55e5a1dd05d0 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.740+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/3987299623 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb803d070 con 0x55e5a1dd05d0 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.741+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/3987299623 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5fb802b710 con 0x55e5a1dd05d0 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.741+0000 7f5fc87d3740 10 client.25216 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.741+0000 7f5fc87d3740 10 client.25216 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.741+0000 7f5fc87d3740 20 client.25216 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.741+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e5a1dfbf10 0x55e5a1e68920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.741+0000 7f5fc87d3740 4 client.25216 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:53:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.741+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3987299623 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5fb8009b40 con 0x55e5a1dfbf10 2024-09-12T00:53:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.741+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e5a1dfbf10 0x55e5a1e68920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fb7fff640 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e5a1dfbf10 0x55e5a1e68920 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea35bc8b3307638e server_cookie=7a65f7b40f3c7bd3 in_seq=0 out_seq=0 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5f9f7fe640 10 client.25216 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5f9f7fe640 1 -- 172.21.15.2:0/3987299623 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5fb8009b40 con 0x55e5a1dfbf10 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5f9f7fe640 10 client.25216 handle_command_reply: tid=0 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 client.25216 shutdown 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3987299623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 msgr2=0x55e5a1e5eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1e5eb60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80104d0 tx=0x7f5fb80224f0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3987299623 shutdown_connections 2024-09-12T00:53:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e5a1dfbf10 0x55e5a1e68920 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5a1ddb370 0x55e5a1ddea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e5a1dd1b40 0x55e5a1e5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5f9f7fe640 0 client.25216 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 --2- 172.21.15.2:0/3987299623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e5a1dd05d0 0x55e5a1e5eb60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3987299623 >> 172.21.15.2:0/3987299623 conn(0x55e5a1d99310 msgr2=0x55e5a1dcb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.742+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3987299623 shutdown_connections 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.743+0000 7f5fc87d3740 1 -- 172.21.15.2:0/3987299623 wait complete. 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.743+0000 7f5fc87d3740 20 client.25216 trim_cache size 0 max 16384 2024-09-12T00:53:55.744 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:53:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.743+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5fac0a2e10 msgr2=0x7f5fac0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.743+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5fac0a2e10 0x7f5fac0a52d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00cc990 tx=0x7f5fb00d2ea0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.743+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fc0100e20 msgr2=0x7f5fc0198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.743+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fc0100e20 0x7f5fc0198510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000d720 tx=0x7f5fb000dbe0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.744+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 shutdown_connections 2024-09-12T00:53:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.744+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5fac0a2e10 0x7f5fac0a52d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.744+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc0102ef0 0x7f5fc019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.744+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0102570 0x7f5fc0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.744+0000 7f5fc63fa640 1 --2- 172.21.15.2:0/1719950339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fc0100e20 0x7f5fc0198510 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.744+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 >> 172.21.15.2:0/1719950339 conn(0x7f5fc00fc7d0 msgr2=0x7f5fc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.744+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 shutdown_connections 2024-09-12T00:53:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:55.744+0000 7f5fc63fa640 1 -- 172.21.15.2:0/1719950339 wait complete. 2024-09-12T00:53:56.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:55 smithi002 ceph-mon[31210]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:53:56.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:55 smithi167 ceph-mon[35234]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:53:56.422 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:53:56.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:55 smithi071 ceph-mon[35276]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:53:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:57.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 -- 172.21.15.2:0/1693267807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8102d30 msgr2=0x7f83c8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/1693267807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8102d30 0x7f83c8103110 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009930 tx=0x7f83c402a420 comp rx=0 tx=0).stop 2024-09-12T00:53:57.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 -- 172.21.15.2:0/1693267807 shutdown_connections 2024-09-12T00:53:57.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/1693267807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c81082a0 0x7f83c810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/1693267807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c81036e0 0x7f83c8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/1693267807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8102d30 0x7f83c8103110 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 -- 172.21.15.2:0/1693267807 >> 172.21.15.2:0/1693267807 conn(0x7f83c80fc7d0 msgr2=0x7f83c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:57.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 -- 172.21.15.2:0/1693267807 shutdown_connections 2024-09-12T00:53:57.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.264+0000 7f83cfbd3640 1 -- 172.21.15.2:0/1693267807 wait complete. 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.265+0000 7f83cfbd3640 1 Processor -- start 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83cfbd3640 1 -- start start 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83cfbd3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8102d30 0x7f83c8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83cfbd3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c81036e0 0x7f83c8198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83cfbd3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c81082a0 0x7f83c819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83cfbd3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81120f0 con 0x7f83c81036e0 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83cfbd3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83c8111f70 con 0x7f83c81082a0 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83cfbd3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83c8112270 con 0x7f83c8102d30 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83ce170640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c81082a0 0x7f83c819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83ce170640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c81082a0 0x7f83c819cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38964/0 (socket says 172.21.15.2:38964) 2024-09-12T00:53:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.266+0000 7f83ce170640 1 -- 172.21.15.2:0/3299893186 learned_addr learned my addr 172.21.15.2:0/3299893186 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83cd96f640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8102d30 0x7f83c8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c81036e0 0x7f83c8198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83ce170640 1 -- 172.21.15.2:0/3299893186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8102d30 msgr2=0x7f83c8198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83ce170640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8102d30 0x7f83c8198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83ce170640 1 -- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c81036e0 msgr2=0x7f83c8198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83ce170640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c81036e0 0x7f83c8198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83ce170640 1 -- 172.21.15.2:0/3299893186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c819d620 con 0x7f83c81082a0 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c81036e0 0x7f83c8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.267+0000 7f83ce170640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c81082a0 0x7f83c819cf40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009f60 tx=0x7f83c0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:57.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.268+0000 7f83beffd640 1 -- 172.21.15.2:0/3299893186 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c000cd80 con 0x7f83c81082a0 2024-09-12T00:53:57.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.268+0000 7f83cfbd3640 1 -- 172.21.15.2:0/3299893186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c819d910 con 0x7f83c81082a0 2024-09-12T00:53:57.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.268+0000 7f83cfbd3640 1 -- 172.21.15.2:0/3299893186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c81008c0 con 0x7f83c81082a0 2024-09-12T00:53:57.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.268+0000 7f83beffd640 1 -- 172.21.15.2:0/3299893186 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83c0013770 con 0x7f83c81082a0 2024-09-12T00:53:57.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.268+0000 7f83beffd640 1 -- 172.21.15.2:0/3299893186 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0005440 con 0x7f83c81082a0 2024-09-12T00:53:57.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.271+0000 7f83d1fac740 1 Processor -- start 2024-09-12T00:53:57.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.271+0000 7f83beffd640 1 -- 172.21.15.2:0/3299893186 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f83c0005600 con 0x7f83c81082a0 2024-09-12T00:53:57.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83d1fac740 1 -- start start 2024-09-12T00:53:57.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83d1fac740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eb678012f0 con 0x55eb678a5350 2024-09-12T00:53:57.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83d1fac740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55eb677a8cf0 con 0x55eb678a3de0 2024-09-12T00:53:57.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83d1fac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb677fd2b0 con 0x55eb678aeb80 2024-09-12T00:53:57.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83cd16e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83cd96f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83cd96f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38974/0 (socket says 172.21.15.2:38974) 2024-09-12T00:53:57.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.272+0000 7f83cd96f640 1 -- 172.21.15.2:0/771932140 learned_addr learned my addr 172.21.15.2:0/771932140 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:57.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83cd16e640 1 --2- 172.21.15.2:0/771932140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83beffd640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b40a2e90 0x7f83b40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83cd16e640 1 -- 172.21.15.2:0/771932140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 msgr2=0x55eb678a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83cd16e640 1 --2- 172.21.15.2:0/771932140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83cd16e640 1 -- 172.21.15.2:0/771932140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 msgr2=0x55eb678a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83cd16e640 1 --2- 172.21.15.2:0/771932140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678a38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83cd16e640 1 -- 172.21.15.2:0/771932140 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb6778d3a0 con 0x55eb678aeb80 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83beffd640 1 -- 172.21.15.2:0/3299893186 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f83c00cf4c0 con 0x7f83c81082a0 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83cd16e640 1 --2- 172.21.15.2:0/771932140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678b0f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83c80fed40 tx=0x7f83b8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f4bf61e4ae91ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.273+0000 7f83ce170640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b40a2e90 0x7f83b40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.274+0000 7f83b3fff640 1 -- 172.21.15.2:0/771932140 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8014250 con 0x55eb678aeb80 2024-09-12T00:53:57.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.274+0000 7f83b3fff640 1 -- 172.21.15.2:0/771932140 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b80098b0 con 0x55eb678aeb80 2024-09-12T00:53:57.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.274+0000 7f83b3fff640 1 -- 172.21.15.2:0/771932140 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b80035f0 con 0x55eb678aeb80 2024-09-12T00:53:57.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 -- 172.21.15.2:0/771932140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 msgr2=0x55eb678b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83ce170640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b40a2e90 0x7f83b40a5350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83c00ccbb0 tx=0x7f83c0009270 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:57.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 --2- 172.21.15.2:0/771932140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678b0f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83c80fed40 tx=0x7f83b8004730 comp rx=0 tx=0).stop 2024-09-12T00:53:57.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 -- 172.21.15.2:0/771932140 shutdown_connections 2024-09-12T00:53:57.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 --2- 172.21.15.2:0/771932140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678b0f70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 --2- 172.21.15.2:0/771932140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 --2- 172.21.15.2:0/771932140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 -- 172.21.15.2:0/771932140 >> 172.21.15.2:0/771932140 conn(0x55eb67864310 msgr2=0x55eb678a0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:57.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 -- 172.21.15.2:0/771932140 shutdown_connections 2024-09-12T00:53:57.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.275+0000 7f83d1fac740 1 -- 172.21.15.2:0/771932140 wait complete. 2024-09-12T00:53:57.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.276+0000 7f83d1fac740 1 -- start start 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.276+0000 7f83d1fac740 1 Processor -- start 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.276+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678ae570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.276+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a5350 0x55eb678ab820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.276+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678aeb80 0x55eb678abe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83d1fac740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eb678b1880 con 0x55eb678aeb80 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83d1fac740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55eb677bc060 con 0x55eb678a3de0 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83d1fac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb678b1a00 con 0x55eb678a5350 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678aeb80 0x55eb678abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678aeb80 0x55eb678abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54490/0 (socket says 172.21.15.2:54490) 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83d1fac740 10 client.0 _ll_register_callbacks cb 0x55eb6750f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:57.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 -- 172.21.15.2:0/3391681743 learned_addr learned my addr 172.21.15.2:0/3391681743 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:57.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd96f640 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a5350 0x55eb678ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 -- 172.21.15.2:0/3391681743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a5350 msgr2=0x55eb678ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:57.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a5350 0x55eb678ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 -- 172.21.15.2:0/3391681743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 msgr2=0x55eb678ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:57.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 -- 172.21.15.2:0/3391681743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb675723c0 con 0x55eb678aeb80 2024-09-12T00:53:57.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678aeb80 0x55eb678abe10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f83b8012cd0 tx=0x7f83b8012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62aef1608c17d4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:57.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.277+0000 7f83b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.278+0000 7f83b17fa640 1 -- 172.21.15.2:0/3391681743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8021640 con 0x55eb678aeb80 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.278+0000 7f83d1fac740 1 -- 172.21.15.2:0/3391681743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83b80098b0 con 0x55eb678aeb80 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.278+0000 7f83b17fa640 1 -- 172.21.15.2:0/3391681743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f83b80217e0 con 0x55eb678aeb80 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.278+0000 7f83b17fa640 1 -- 172.21.15.2:0/3391681743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f83b8034050 con 0x55eb678aeb80 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.278+0000 7f83d1fac740 10 client.15582 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.278+0000 7f83d1fac740 1 -- 172.21.15.2:0/3391681743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eb678bd320 con 0x55eb678aeb80 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.278+0000 7f83b17fa640 1 -- 172.21.15.2:0/3391681743 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b80098b0 con 0x55eb678aeb80 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.278+0000 7f83b17fa640 1 -- 172.21.15.2:0/3391681743 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f83b8020aa0 con 0x55eb678aeb80 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83d1fac740 10 client.15582 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83d1fac740 10 client.15582 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83d1fac740 20 client.15582 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55eb678be670 0x55eb678c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83d1fac740 4 client.15582 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:57.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83d1fac740 1 -- 172.21.15.2:0/3391681743 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb6780e860 con 0x55eb678be670 2024-09-12T00:53:57.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83cd96f640 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55eb678be670 0x55eb678c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83cd96f640 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55eb678be670 0x55eb678c0a60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=14bb4a2f551a1726 server_cookie=26747a983867e2ae in_seq=0 out_seq=0 2024-09-12T00:53:57.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.279+0000 7f83b17fa640 10 client.15582 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:57.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.280+0000 7f83b17fa640 1 -- 172.21.15.2:0/3391681743 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb6780e860 con 0x55eb678be670 2024-09-12T00:53:57.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.280+0000 7f83b17fa640 10 client.15582 handle_command_reply: tid=0 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.280+0000 7f83d1fac740 1 client.15582 shutdown 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.280+0000 7f83d1fac740 1 -- 172.21.15.2:0/3391681743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678aeb80 msgr2=0x55eb678abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.280+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678aeb80 0x55eb678abe10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f83b8012cd0 tx=0x7f83b8012bd0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 1 -- 172.21.15.2:0/3391681743 shutdown_connections 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55eb678be670 0x55eb678c0a60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678aeb80 0x55eb678abe10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a5350 0x55eb678ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3391681743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a3de0 0x55eb678ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83b17fa640 0 client.15582 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 1 -- 172.21.15.2:0/3391681743 >> 172.21.15.2:0/3391681743 conn(0x55eb67864310 msgr2=0x55eb678a6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 1 -- 172.21.15.2:0/3391681743 shutdown_connections 2024-09-12T00:53:57.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 1 -- 172.21.15.2:0/3391681743 wait complete. 2024-09-12T00:53:57.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.281+0000 7f83d1fac740 20 client.15582 trim_cache size 0 max 16384 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.307+0000 7f83d1fac740 1 Processor -- start 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.307+0000 7f83d1fac740 1 -- start start 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a3de0 0x55eb678bab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a5350 0x55eb678964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83d1fac740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81ae280 con 0x55eb678a3de0 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83d1fac740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81abb50 con 0x55eb678a5350 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83d1fac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81a99a0 con 0x55eb678aeb80 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a3de0 0x55eb678bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a3de0 0x55eb678bab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54498/0 (socket says 172.21.15.2:54498) 2024-09-12T00:53:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 -- 172.21.15.2:0/386773830 learned_addr learned my addr 172.21.15.2:0/386773830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd96f640 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a5350 0x55eb678964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 -- 172.21.15.2:0/386773830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 msgr2=0x55eb678c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 -- 172.21.15.2:0/386773830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a5350 msgr2=0x55eb678964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a5350 0x55eb678964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.308+0000 7f83cd16e640 1 -- 172.21.15.2:0/386773830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb67897390 con 0x55eb678a3de0 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.309+0000 7f83cd16e640 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a3de0 0x55eb678bab20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f83b8001eb0 tx=0x7f83b8005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181c60a57da8fab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.309+0000 7f83b37fe640 1 -- 172.21.15.2:0/386773830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b802f5d0 con 0x55eb678a3de0 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.309+0000 7f83b37fe640 1 -- 172.21.15.2:0/386773830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b8018070 con 0x55eb678a3de0 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.309+0000 7f83b37fe640 1 -- 172.21.15.2:0/386773830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8021a30 con 0x55eb678a3de0 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.310+0000 7f83d1fac740 1 -- 172.21.15.2:0/386773830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a3de0 msgr2=0x55eb678bab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.310+0000 7f83d1fac740 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a3de0 0x55eb678bab20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f83b8001eb0 tx=0x7f83b8005990 comp rx=0 tx=0).stop 2024-09-12T00:53:57.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.310+0000 7f83d1fac740 1 -- 172.21.15.2:0/386773830 shutdown_connections 2024-09-12T00:53:57.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.310+0000 7f83d1fac740 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678aeb80 0x55eb678c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.310+0000 7f83d1fac740 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678a5350 0x55eb678964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.310+0000 7f83d1fac740 1 --2- 172.21.15.2:0/386773830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a3de0 0x55eb678bab20 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.310+0000 7f83d1fac740 1 -- 172.21.15.2:0/386773830 >> 172.21.15.2:0/386773830 conn(0x55eb67864310 msgr2=0x55eb678ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:57.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.311+0000 7f83d1fac740 1 -- 172.21.15.2:0/386773830 shutdown_connections 2024-09-12T00:53:57.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.311+0000 7f83d1fac740 1 -- 172.21.15.2:0/386773830 wait complete. 2024-09-12T00:53:57.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.311+0000 7f83d1fac740 1 -- start start 2024-09-12T00:53:57.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.311+0000 7f83d1fac740 1 Processor -- start 2024-09-12T00:53:57.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a3de0 0x55eb678b7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83d1fac740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678aeb80 0x55eb678b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83d1fac740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81aa010 con 0x55eb678a5350 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83d1fac740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81ab480 con 0x55eb678aeb80 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83d1fac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81aa6e0 con 0x55eb678a3de0 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83d1fac740 10 client.0 _ll_register_callbacks cb 0x7f83b8009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83cd96f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83cd96f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54508/0 (socket says 172.21.15.2:54508) 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83cd96f640 1 -- 172.21.15.2:0/3984188832 learned_addr learned my addr 172.21.15.2:0/3984188832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.312+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a3de0 0x55eb678b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678aeb80 0x55eb678b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83cd96f640 1 -- 172.21.15.2:0/3984188832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a3de0 msgr2=0x55eb678b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83cd96f640 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a3de0 0x55eb678b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83cd96f640 1 -- 172.21.15.2:0/3984188832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678aeb80 msgr2=0x55eb678b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83cd96f640 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678aeb80 0x55eb678b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83cd96f640 1 -- 172.21.15.2:0/3984188832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb678b3180 con 0x55eb678a5350 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678aeb80 0x55eb678b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83cd96f640 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678b25a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009900 tx=0x7f83c40044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64e1ebf8c5399a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83b17fa640 1 -- 172.21.15.2:0/3984188832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4035040 con 0x55eb678a5350 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83b17fa640 1 -- 172.21.15.2:0/3984188832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f83c4005510 con 0x55eb678a5350 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83d1fac740 1 -- 172.21.15.2:0/3984188832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83b8018070 con 0x55eb678a5350 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.313+0000 7f83b17fa640 1 -- 172.21.15.2:0/3984188832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f83c40046c0 con 0x55eb678a5350 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83d1fac740 10 client.15588 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83d1fac740 1 -- 172.21.15.2:0/3984188832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eb67929010 con 0x55eb678a5350 2024-09-12T00:53:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83b17fa640 1 -- 172.21.15.2:0/3984188832 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b8018070 con 0x55eb678a5350 2024-09-12T00:53:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83b17fa640 1 -- 172.21.15.2:0/3984188832 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f83c4031b40 con 0x55eb678a5350 2024-09-12T00:53:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83d1fac740 10 client.15588 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83d1fac740 10 client.15588 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:53:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83d1fac740 20 client.15588 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55eb67929770 0x55eb6792bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83d1fac740 4 client.15588 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:53:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.314+0000 7f83d1fac740 1 -- 172.21.15.2:0/3984188832 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eb67808d70 con 0x55eb67929770 2024-09-12T00:53:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.315+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55eb67929770 0x55eb6792bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.315+0000 7f83cd16e640 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55eb67929770 0x55eb6792bb90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f1a45d57754a8bcb server_cookie=fb8842116f35e1b4 in_seq=0 out_seq=0 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.315+0000 7f83b17fa640 10 client.15588 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.315+0000 7f83b17fa640 1 -- 172.21.15.2:0/3984188832 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eb67808d70 con 0x55eb67929770 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.315+0000 7f83b17fa640 10 client.15588 handle_command_reply: tid=0 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.315+0000 7f83d1fac740 1 client.15588 shutdown 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.315+0000 7f83d1fac740 1 -- 172.21.15.2:0/3984188832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 msgr2=0x55eb678b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.315+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678b25a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009900 tx=0x7f83c40044f0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 1 -- 172.21.15.2:0/3984188832 shutdown_connections 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55eb67929770 0x55eb6792bb90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83b17fa640 0 client.15588 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eb678aeb80 0x55eb678b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eb678a5350 0x55eb678b25a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 1 --2- 172.21.15.2:0/3984188832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb678a3de0 0x55eb678b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 1 -- 172.21.15.2:0/3984188832 >> 172.21.15.2:0/3984188832 conn(0x55eb67864310 msgr2=0x55eb678a9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 1 -- 172.21.15.2:0/3984188832 shutdown_connections 2024-09-12T00:53:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 1 -- 172.21.15.2:0/3984188832 wait complete. 2024-09-12T00:53:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.316+0000 7f83d1fac740 20 client.15588 trim_cache size 0 max 16384 2024-09-12T00:53:57.318 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:53:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 -- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b40a2e90 msgr2=0x7f83b40a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b40a2e90 0x7f83b40a5350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83c00ccbb0 tx=0x7f83c0009270 comp rx=0 tx=0).stop 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 -- 172.21.15.2:0/3299893186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c81082a0 msgr2=0x7f83c819cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c81082a0 0x7f83c819cf40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009f60 tx=0x7f83c0009f90 comp rx=0 tx=0).stop 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 -- 172.21.15.2:0/3299893186 shutdown_connections 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b40a2e90 0x7f83b40a5350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c81082a0 0x7f83c819cf40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c81036e0 0x7f83c8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 --2- 172.21.15.2:0/3299893186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8102d30 0x7f83c8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 -- 172.21.15.2:0/3299893186 >> 172.21.15.2:0/3299893186 conn(0x7f83c80fc7d0 msgr2=0x7f83c8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 -- 172.21.15.2:0/3299893186 shutdown_connections 2024-09-12T00:53:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:57.317+0000 7f83cfbd3640 1 -- 172.21.15.2:0/3299893186 wait complete. 2024-09-12T00:53:58.022 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:53:58.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:57 smithi002 ceph-mon[31210]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T00:53:58.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:57 smithi167 ceph-mon[35234]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T00:53:58.318 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:53:58.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:57 smithi071 ceph-mon[35276]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T00:53:58.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.831+0000 7f7aaa536640 1 -- 172.21.15.2:0/512225513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4102780 msgr2=0x7f7aa41067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.831+0000 7f7aaa536640 1 --2- 172.21.15.2:0/512225513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4102780 0x7f7aa41067d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009900 tx=0x7f7a9802a410 comp rx=0 tx=0).stop 2024-09-12T00:53:58.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.831+0000 7f7aaa536640 1 -- 172.21.15.2:0/512225513 shutdown_connections 2024-09-12T00:53:58.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.831+0000 7f7aaa536640 1 --2- 172.21.15.2:0/512225513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4106f00 0x7f7aa410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.831+0000 7f7aaa536640 1 --2- 172.21.15.2:0/512225513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4102780 0x7f7aa41067d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.831+0000 7f7aaa536640 1 --2- 172.21.15.2:0/512225513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aa4101dd0 0x7f7aa41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.831+0000 7f7aaa536640 1 -- 172.21.15.2:0/512225513 >> 172.21.15.2:0/512225513 conn(0x7f7aa40fd8b0 msgr2=0x7f7aa40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:58.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.832+0000 7f7aaa536640 1 -- 172.21.15.2:0/512225513 shutdown_connections 2024-09-12T00:53:58.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.832+0000 7f7aaa536640 1 -- 172.21.15.2:0/512225513 wait complete. 2024-09-12T00:53:58.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.833+0000 7f7aaa536640 1 Processor -- start 2024-09-12T00:53:58.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.833+0000 7f7aaa536640 1 -- start start 2024-09-12T00:53:58.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aaa536640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4101dd0 0x7f7aa4198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aaa536640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4106f00 0x7f7aa4198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aaa536640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aa419cf50 0x7f7aa419d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aaa536640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa4111fb0 con 0x7f7aa4101dd0 2024-09-12T00:53:58.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aa3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4101dd0 0x7f7aa4198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aaa536640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa4111e30 con 0x7f7aa4106f00 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aaa536640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa4112130 con 0x7f7aa419cf50 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aa3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4101dd0 0x7f7aa4198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54514/0 (socket says 172.21.15.2:54514) 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aa3fff640 1 -- 172.21.15.2:0/1358501511 learned_addr learned my addr 172.21.15.2:0/1358501511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.834+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4106f00 0x7f7aa4198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa3fff640 1 -- 172.21.15.2:0/1358501511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aa419cf50 msgr2=0x7f7aa419d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aa419cf50 0x7f7aa419d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa3fff640 1 -- 172.21.15.2:0/1358501511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4106f00 msgr2=0x7f7aa4198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4106f00 0x7f7aa4198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa3fff640 1 -- 172.21.15.2:0/1358501511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa419da10 con 0x7f7aa4101dd0 2024-09-12T00:53:58.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4106f00 0x7f7aa4198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:58.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4101dd0 0x7f7aa4198680 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400d770 tx=0x7f7a9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:58.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa17fa640 1 -- 172.21.15.2:0/1358501511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94017070 con 0x7f7aa4101dd0 2024-09-12T00:53:58.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aaa536640 1 -- 172.21.15.2:0/1358501511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa419dd00 con 0x7f7aa4101dd0 2024-09-12T00:53:58.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa17fa640 1 -- 172.21.15.2:0/1358501511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a94005500 con 0x7f7aa4101dd0 2024-09-12T00:53:58.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aaa536640 1 -- 172.21.15.2:0/1358501511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa41a54e0 con 0x7f7aa4101dd0 2024-09-12T00:53:58.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.835+0000 7f7aa17fa640 1 -- 172.21.15.2:0/1358501511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94020060 con 0x7f7aa4101dd0 2024-09-12T00:53:58.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aac90f740 1 Processor -- start 2024-09-12T00:53:58.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aac90f740 1 -- start start 2024-09-12T00:53:58.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aa17fa640 1 -- 172.21.15.2:0/1358501511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138059+0+0 (secure 0 0 0) 0x7f7a94010460 con 0x7f7aa4101dd0 2024-09-12T00:53:58.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b91ffe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b91ffea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aac90f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b91f642f0 con 0x557b92009370 2024-09-12T00:53:58.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aac90f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b91f0bcf0 con 0x557b91fffb40 2024-09-12T00:53:58.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aac90f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557b91f602b0 con 0x557b91ffe5d0 2024-09-12T00:53:58.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aa37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aa37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54530/0 (socket says 172.21.15.2:54530) 2024-09-12T00:53:58.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aa37fe640 1 -- 172.21.15.2:0/2682369971 learned_addr learned my addr 172.21.15.2:0/2682369971 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.839+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b91ffea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.840+0000 7f7aa8ad3640 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b91ffe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.840+0000 7f7aa37fe640 1 -- 172.21.15.2:0/2682369971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 msgr2=0x557b91ffea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.840+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b91ffea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.840+0000 7f7aa37fe640 1 -- 172.21.15.2:0/2682369971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 msgr2=0x557b91ffe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.840+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b91ffe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.840+0000 7f7aa37fe640 1 -- 172.21.15.2:0/2682369971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b91ef03a0 con 0x557b92009370 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.840+0000 7f7aa8ad3640 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b91ffe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.840+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b91ffea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:53:58.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.841+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200b760 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4102ce0 tx=0x7f7a98004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac54c6f432531c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:58.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.841+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/2682369971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98040070 con 0x557b92009370 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.841+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/2682369971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a98004750 con 0x557b92009370 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.841+0000 7f7a8a7fc640 1 -- 172.21.15.2:0/2682369971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98035040 con 0x557b92009370 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.841+0000 7f7aa17fa640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7a8c0a2e10 0x7f7a8c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aa17fa640 1 -- 172.21.15.2:0/1358501511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f7a940cf2b0 con 0x7f7aa4101dd0 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aa8ad3640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7a8c0a2e10 0x7f7a8c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 -- 172.21.15.2:0/2682369971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 msgr2=0x557b9200b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200b760 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4102ce0 tx=0x7f7a98004470 comp rx=0 tx=0).stop 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 -- 172.21.15.2:0/2682369971 shutdown_connections 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200b760 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b91ffea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 --2- 172.21.15.2:0/2682369971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b91ffe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 -- 172.21.15.2:0/2682369971 >> 172.21.15.2:0/2682369971 conn(0x557b91fc7310 msgr2=0x557b91ffac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:58.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 -- 172.21.15.2:0/2682369971 shutdown_connections 2024-09-12T00:53:58.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.842+0000 7f7aac90f740 1 -- 172.21.15.2:0/2682369971 wait complete. 2024-09-12T00:53:58.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.843+0000 7f7aac90f740 1 -- start start 2024-09-12T00:53:58.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.843+0000 7f7aa8ad3640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7a8c0a2e10 0x7f7a8c0a52d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009a00 tx=0x7f7a9c009560 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:58.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.843+0000 7f7aac90f740 1 Processor -- start 2024-09-12T00:53:58.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b91ffe5d0 0x557b92008c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91fffb40 0x557b92005eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b92009370 0x557b920063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aac90f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b9200c010 con 0x557b91ffe5d0 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aac90f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b91f1f060 con 0x557b92009370 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aac90f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557b9200c190 con 0x557b91fffb40 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aac90f740 10 client.0 _ll_register_callbacks cb 0x557b91c728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aa8ad3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b92009370 0x557b920063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aa37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91fffb40 0x557b92005eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aa37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91fffb40 0x557b92005eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:43604/0 (socket says 172.21.15.2:43604) 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aa37fe640 1 -- 172.21.15.2:0/346422724 learned_addr learned my addr 172.21.15.2:0/346422724 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.844+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b91ffe5d0 0x557b92008c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7aa37fe640 1 -- 172.21.15.2:0/346422724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b92009370 msgr2=0x557b920063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b92009370 0x557b920063f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7aa37fe640 1 -- 172.21.15.2:0/346422724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b91ffe5d0 msgr2=0x557b92008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b91ffe5d0 0x557b92008c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7aa37fe640 1 -- 172.21.15.2:0/346422724 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b91cd53c0 con 0x557b91fffb40 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b91ffe5d0 0x557b92008c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91fffb40 0x557b92005eb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009900 tx=0x7f7a98004b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c33667c744d82d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7a837fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7a837fe640 1 -- 172.21.15.2:0/346422724 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9804d020 con 0x557b91fffb40 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.845+0000 7f7a837fe640 1 -- 172.21.15.2:0/346422724 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f7a98005410 con 0x557b91fffb40 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.846+0000 7f7aac90f740 1 -- 172.21.15.2:0/346422724 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a98004750 con 0x557b91fffb40 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.846+0000 7f7a837fe640 1 -- 172.21.15.2:0/346422724 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a98040070 con 0x557b91fffb40 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.846+0000 7f7aac90f740 10 client.25240 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.846+0000 7f7aac90f740 1 -- 172.21.15.2:0/346422724 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557b9200c010 con 0x557b91fffb40 2024-09-12T00:53:58.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.846+0000 7f7a837fe640 1 -- 172.21.15.2:0/346422724 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a98004750 con 0x557b91fffb40 2024-09-12T00:53:58.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.847+0000 7f7a837fe640 1 -- 172.21.15.2:0/346422724 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a98031740 con 0x557b91fffb40 2024-09-12T00:53:58.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.847+0000 7f7aac90f740 10 client.25240 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:58.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.847+0000 7f7aac90f740 10 client.25240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:58.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.847+0000 7f7aac90f740 20 client.25240 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:58.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.847+0000 7f7aac90f740 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b92018a50 0x557b9201ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.847+0000 7f7aac90f740 4 client.25240 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:53:58.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.847+0000 7f7aac90f740 1 -- 172.21.15.2:0/346422724 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b91f71860 con 0x557b92018a50 2024-09-12T00:53:58.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.847+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b92018a50 0x557b9201ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.848+0000 7f7a837fe640 10 client.25240 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:58.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.848+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b92018a50 0x557b9201ae40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31d97e3eb4792fff server_cookie=fa3249098deccc05 in_seq=0 out_seq=0 2024-09-12T00:53:58.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7a837fe640 1 -- 172.21.15.2:0/346422724 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b91f71860 con 0x557b92018a50 2024-09-12T00:53:58.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7a837fe640 10 client.25240 handle_command_reply: tid=0 2024-09-12T00:53:58.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 client.25240 shutdown 2024-09-12T00:53:58.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 -- 172.21.15.2:0/346422724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91fffb40 msgr2=0x557b92005eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91fffb40 0x557b92005eb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009900 tx=0x7f7a98004b30 comp rx=0 tx=0).stop 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 -- 172.21.15.2:0/346422724 shutdown_connections 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b92018a50 0x557b9201ae40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b92009370 0x557b920063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91fffb40 0x557b92005eb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 --2- 172.21.15.2:0/346422724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b91ffe5d0 0x557b92008c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 -- 172.21.15.2:0/346422724 >> 172.21.15.2:0/346422724 conn(0x557b91fc7310 msgr2=0x557b92000960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7a837fe640 0 client.25240 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 -- 172.21.15.2:0/346422724 shutdown_connections 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.849+0000 7f7aac90f740 1 -- 172.21.15.2:0/346422724 wait complete. 2024-09-12T00:53:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.850+0000 7f7aac90f740 20 client.25240 trim_cache size 0 max 16384 2024-09-12T00:53:58.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.875+0000 7f7aac90f740 1 Processor -- start 2024-09-12T00:53:58.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.875+0000 7f7aac90f740 1 -- start start 2024-09-12T00:53:58.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b920152b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b92000fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b92001500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aa8ad3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b92001500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aa8ad3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b92001500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54554/0 (socket says 172.21.15.2:54554) 2024-09-12T00:53:58.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aa3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b920152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aa8ad3640 1 -- 172.21.15.2:0/3017701063 learned_addr learned my addr 172.21.15.2:0/3017701063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:58.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b92000fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aac90f740 1 -- 172.21.15.2:0/3017701063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa41b07a0 con 0x557b92009370 2024-09-12T00:53:58.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aac90f740 1 -- 172.21.15.2:0/3017701063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa41ae070 con 0x557b91fffb40 2024-09-12T00:53:58.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.876+0000 7f7aac90f740 1 -- 172.21.15.2:0/3017701063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa41abec0 con 0x557b91ffe5d0 2024-09-12T00:53:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7aa3fff640 1 -- 172.21.15.2:0/3017701063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 msgr2=0x557b92000fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b92000fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7aa3fff640 1 -- 172.21.15.2:0/3017701063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 msgr2=0x557b92001500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b92001500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7aa3fff640 1 -- 172.21.15.2:0/3017701063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b91ffb960 con 0x557b91ffe5d0 2024-09-12T00:53:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b92000fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:53:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b920152b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a940cc7a0 tx=0x7f7a940d1700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e0524d8af8c93c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7a89ffb640 1 -- 172.21.15.2:0/3017701063 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9409b4d0 con 0x557b91ffe5d0 2024-09-12T00:53:58.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.877+0000 7f7a89ffb640 1 -- 172.21.15.2:0/3017701063 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a9409f880 con 0x557b91ffe5d0 2024-09-12T00:53:58.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.878+0000 7f7a89ffb640 1 -- 172.21.15.2:0/3017701063 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a940ccab0 con 0x557b91ffe5d0 2024-09-12T00:53:58.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.878+0000 7f7aac90f740 1 -- 172.21.15.2:0/3017701063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 msgr2=0x557b920152b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.878+0000 7f7aac90f740 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b920152b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a940cc7a0 tx=0x7f7a940d1700 comp rx=0 tx=0).stop 2024-09-12T00:53:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 -- 172.21.15.2:0/3017701063 shutdown_connections 2024-09-12T00:53:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b92001500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b92000fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 --2- 172.21.15.2:0/3017701063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b920152b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 -- 172.21.15.2:0/3017701063 >> 172.21.15.2:0/3017701063 conn(0x557b91fc7310 msgr2=0x557b92007f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 -- 172.21.15.2:0/3017701063 shutdown_connections 2024-09-12T00:53:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 -- 172.21.15.2:0/3017701063 wait complete. 2024-09-12T00:53:58.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 -- start start 2024-09-12T00:53:58.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.879+0000 7f7aac90f740 1 Processor -- start 2024-09-12T00:53:58.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.880+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b92011cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.880+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b9200cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.880+0000 7f7aac90f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.880+0000 7f7aa8ad3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa8ad3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54560/0 (socket says 172.21.15.2:54560) 2024-09-12T00:53:58.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa8ad3640 1 -- 172.21.15.2:0/1518640337 learned_addr learned my addr 172.21.15.2:0/1518640337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:53:58.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b9200cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa41ac530 con 0x557b92009370 2024-09-12T00:53:58.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa41ad9a0 con 0x557b91fffb40 2024-09-12T00:53:58.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa41acc00 con 0x557b91ffe5d0 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aac90f740 10 client.0 _ll_register_callbacks cb 0x7f7a98005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b92011cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa3fff640 1 -- 172.21.15.2:0/1518640337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 msgr2=0x557b9200cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b9200cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa3fff640 1 -- 172.21.15.2:0/1518640337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 msgr2=0x557b9200d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.881+0000 7f7aa3fff640 1 -- 172.21.15.2:0/1518640337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9200de20 con 0x557b91ffe5d0 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.882+0000 7f7aa3fff640 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b92011cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a9409b410 tx=0x7f7a9409b4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f63bf3e7db29501 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.882+0000 7f7a837fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.882+0000 7f7a837fe640 1 -- 172.21.15.2:0/1518640337 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94097b40 con 0x557b91ffe5d0 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.882+0000 7f7a837fe640 1 -- 172.21.15.2:0/1518640337 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f7a940b4260 con 0x557b91ffe5d0 2024-09-12T00:53:58.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.882+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a9409f880 con 0x557b91ffe5d0 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.882+0000 7f7a837fe640 1 -- 172.21.15.2:0/1518640337 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a94097ce0 con 0x557b91ffe5d0 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.882+0000 7f7aac90f740 10 client.25246 fetch_fsmap learned FSMap version 25 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.882+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557b92083730 con 0x557b91ffe5d0 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.883+0000 7f7a837fe640 1 -- 172.21.15.2:0/1518640337 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a940b44a0 con 0x557b91ffe5d0 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.883+0000 7f7a837fe640 1 -- 172.21.15.2:0/1518640337 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a94097220 con 0x557b91ffe5d0 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.883+0000 7f7aac90f740 10 client.25246 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.883+0000 7f7aac90f740 10 client.25246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.883+0000 7f7aac90f740 20 client.25246 populate_metadata read hostname 'smithi002' 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.883+0000 7f7aac90f740 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b92094e00 0x557b920971f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.883+0000 7f7aac90f740 4 client.25246 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.883+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7a9409f880 con 0x557b92094e00 2024-09-12T00:53:58.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.884+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b92094e00 0x557b920971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.884+0000 7f7aa37fe640 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b92094e00 0x557b920971f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be0436d115546df server_cookie=747bbe407e21bfdf in_seq=0 out_seq=0 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.884+0000 7f7a837fe640 10 client.25246 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.884+0000 7f7a837fe640 1 -- 172.21.15.2:0/1518640337 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7a9409f880 con 0x557b92094e00 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.884+0000 7f7a837fe640 10 client.25246 handle_command_reply: tid=0 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.884+0000 7f7aac90f740 1 client.25246 shutdown 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 msgr2=0x557b92011cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b92011cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a9409b410 tx=0x7f7a9409b4d0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 shutdown_connections 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b92094e00 0x557b920971f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b92009370 0x557b9200d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b91fffb40 0x557b9200cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 --2- 172.21.15.2:0/1518640337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b91ffe5d0 0x557b92011cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 >> 172.21.15.2:0/1518640337 conn(0x557b91fc7310 msgr2=0x557b92004650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:58.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7a837fe640 0 client.25246 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:53:58.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 shutdown_connections 2024-09-12T00:53:58.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 1 -- 172.21.15.2:0/1518640337 wait complete. 2024-09-12T00:53:58.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.885+0000 7f7aac90f740 20 client.25246 trim_cache size 0 max 16384 2024-09-12T00:53:58.887 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 -- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7a8c0a2e10 msgr2=0x7f7a8c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7a8c0a2e10 0x7f7a8c0a52d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009a00 tx=0x7f7a9c009560 comp rx=0 tx=0).stop 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 -- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4101dd0 msgr2=0x7f7aa4198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4101dd0 0x7f7aa4198680 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400d770 tx=0x7f7a9400dc30 comp rx=0 tx=0).stop 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 -- 172.21.15.2:0/1358501511 shutdown_connections 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7a8c0a2e10 0x7f7a8c0a52d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aa419cf50 0x7f7aa419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4106f00 0x7f7aa4198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 --2- 172.21.15.2:0/1358501511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa4101dd0 0x7f7aa4198680 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:53:58.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.886+0000 7f7aaa536640 1 -- 172.21.15.2:0/1358501511 >> 172.21.15.2:0/1358501511 conn(0x7f7aa40fd8b0 msgr2=0x7f7aa40fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:53:58.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.887+0000 7f7aaa536640 1 -- 172.21.15.2:0/1358501511 shutdown_connections 2024-09-12T00:53:58.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:53:58.887+0000 7f7aaa536640 1 -- 172.21.15.2:0/1358501511 wait complete. 2024-09-12T00:54:00.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:53:59 smithi002 ceph-mon[31210]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T00:54:00.545 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:54:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:54:00.106+0000 7f0e73091640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:54:00.545 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:54:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:54:00.106+0000 7f0e73091640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:54:00.545 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:54:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:54:00.106+0000 7f0e73091640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:54:00.545 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:54:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:54:00.106+0000 7f0e73091640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:54:00.545 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 00:54:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T00:54:00.106+0000 7f0e73091640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:54:00.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:53:59 smithi071 ceph-mon[35276]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T00:54:00.546 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:53:59 smithi167 ceph-mon[35234]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T00:54:00.635 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:54:00.635 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:01.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 -- 172.21.15.2:0/1235393365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102570 msgr2=0x7f6ac81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 --2- 172.21.15.2:0/1235393365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102570 0x7f6ac81029b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009900 tx=0x7f6abc02a480 comp rx=0 tx=0).stop 2024-09-12T00:54:01.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 -- 172.21.15.2:0/1235393365 shutdown_connections 2024-09-12T00:54:01.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 --2- 172.21.15.2:0/1235393365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac8102ef0 0x7f6ac810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 --2- 172.21.15.2:0/1235393365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102570 0x7f6ac81029b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 --2- 172.21.15.2:0/1235393365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ac8100e20 0x7f6ac8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 -- 172.21.15.2:0/1235393365 >> 172.21.15.2:0/1235393365 conn(0x7f6ac80fc7d0 msgr2=0x7f6ac80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:01.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 -- 172.21.15.2:0/1235393365 shutdown_connections 2024-09-12T00:54:01.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.655+0000 7f6acea55640 1 -- 172.21.15.2:0/1235393365 wait complete. 2024-09-12T00:54:01.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.656+0000 7f6acea55640 1 Processor -- start 2024-09-12T00:54:01.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.656+0000 7f6acea55640 1 -- start start 2024-09-12T00:54:01.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6acea55640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ac8100e20 0x7f6ac81962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6acea55640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac8102570 0x7f6ac8196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6acea55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102ef0 0x7f6ac819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6acea55640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac810fec0 con 0x7f6ac8102ef0 2024-09-12T00:54:01.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6acea55640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac810fd40 con 0x7f6ac8102570 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6ac7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ac8100e20 0x7f6ac81962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6acea55640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8110040 con 0x7f6ac8100e20 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6ac7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ac8100e20 0x7f6ac81962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:43680/0 (socket says 172.21.15.2:43680) 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6ac7fff640 1 -- 172.21.15.2:0/1848341872 learned_addr learned my addr 172.21.15.2:0/1848341872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac8102570 0x7f6ac8196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.657+0000 7f6accff2640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102ef0 0x7f6ac819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac7fff640 1 -- 172.21.15.2:0/1848341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac8102570 msgr2=0x7f6ac8196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac8102570 0x7f6ac8196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac7fff640 1 -- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102ef0 msgr2=0x7f6ac819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102ef0 0x7f6ac819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac7fff640 1 -- 172.21.15.2:0/1848341872 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac819b270 con 0x7f6ac8100e20 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6accff2640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102ef0 0x7f6ac819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac8102570 0x7f6ac8196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ac8100e20 0x7f6ac81962c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8007880 tx=0x7f6ab8007d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac57fa640 1 -- 172.21.15.2:0/1848341872 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8019030 con 0x7f6ac8100e20 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac57fa640 1 -- 172.21.15.2:0/1848341872 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ab800fe00 con 0x7f6ac8100e20 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6ac57fa640 1 -- 172.21.15.2:0/1848341872 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8004ba0 con 0x7f6ac8100e20 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6acea55640 1 -- 172.21.15.2:0/1848341872 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac819b560 con 0x7f6ac8100e20 2024-09-12T00:54:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.658+0000 7f6acea55640 1 -- 172.21.15.2:0/1848341872 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac81a2e40 con 0x7f6ac8100e20 2024-09-12T00:54:01.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ac57fa640 1 -- 172.21.15.2:0/1848341872 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 24) ==== 138116+0+0 (secure 0 0 0) 0x7f6ab801c070 con 0x7f6ac8100e20 2024-09-12T00:54:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ad0e2e740 1 Processor -- start 2024-09-12T00:54:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ad0e2e740 1 -- start start 2024-09-12T00:54:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6370 0x555919dd6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919de1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919de3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ad0e2e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555919d33280 con 0x555919dd6c90 2024-09-12T00:54:01.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ad0e2e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555919cdab10 con 0x555919dd6370 2024-09-12T00:54:01.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.662+0000 7f6ad0e2e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555919d2f240 con 0x555919de1550 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6ac77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919de3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6ac77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919de3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:43682/0 (socket says 172.21.15.2:43682) 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6ac77fe640 1 -- 172.21.15.2:0/2554209013 learned_addr learned my addr 172.21.15.2:0/2554209013 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6accff2640 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6370 0x555919dd6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919de1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6accff2640 1 -- 172.21.15.2:0/2554209013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 msgr2=0x555919de3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6accff2640 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919de3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6ac57fa640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6ab00a2f20 0x7f6ab00a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6accff2640 1 -- 172.21.15.2:0/2554209013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 msgr2=0x555919de1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6accff2640 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919de1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6accff2640 1 -- 172.21.15.2:0/2554209013 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555919ce71f0 con 0x555919dd6370 2024-09-12T00:54:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.663+0000 7f6ac57fa640 1 -- 172.21.15.2:0/1848341872 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6ab80cf830 con 0x7f6ac8100e20 2024-09-12T00:54:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.664+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919de1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.664+0000 7f6accff2640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6ab00a2f20 0x7f6ab00a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.665+0000 7f6accff2640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6ab00a2f20 0x7f6ab00a53e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d680 tx=0x7f6ac0004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.665+0000 7f6accff2640 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6370 0x555919dd6750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0005fd0 tx=0x7f6ac000d910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c7eca03be2ea00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.666+0000 7f6aae7fc640 1 -- 172.21.15.2:0/2554209013 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0037070 con 0x555919dd6370 2024-09-12T00:54:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.666+0000 7f6aae7fc640 1 -- 172.21.15.2:0/2554209013 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ac0032b10 con 0x555919dd6370 2024-09-12T00:54:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.666+0000 7f6aae7fc640 1 -- 172.21.15.2:0/2554209013 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0028b70 con 0x555919dd6370 2024-09-12T00:54:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2554209013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6370 msgr2=0x555919dd6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6370 0x555919dd6750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0005fd0 tx=0x7f6ac000d910 comp rx=0 tx=0).stop 2024-09-12T00:54:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2554209013 shutdown_connections 2024-09-12T00:54:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919de3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919de1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2554209013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6370 0x555919dd6750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2554209013 >> 172.21.15.2:0/2554209013 conn(0x555919dd2900 msgr2=0x555919dd2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2554209013 shutdown_connections 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2554209013 wait complete. 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.667+0000 7f6ad0e2e740 1 -- start start 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ad0e2e740 1 Processor -- start 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6370 0x555919dde380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919dde8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919ddee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ad0e2e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555919de41c0 con 0x555919dd6c90 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ad0e2e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555919cedf10 con 0x555919de1550 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ad0e2e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555919de4340 con 0x555919dd6370 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ad0e2e740 10 client.0 _ll_register_callbacks cb 0x555919cb6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6accff2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919ddee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6accff2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919ddee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:39122/0 (socket says 172.21.15.2:39122) 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6accff2640 1 -- 172.21.15.2:0/1428655570 learned_addr learned my addr 172.21.15.2:0/1428655570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.668+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919dde8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6370 0x555919dde380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6accff2640 1 -- 172.21.15.2:0/1428655570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6370 msgr2=0x555919dde380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6accff2640 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6370 0x555919dde380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6accff2640 1 -- 172.21.15.2:0/1428655570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 msgr2=0x555919dde8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6accff2640 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919dde8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6accff2640 1 -- 172.21.15.2:0/1428655570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555919aa46a0 con 0x555919de1550 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919dde8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6accff2640 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919ddee00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0028710 tx=0x7f6ac0028490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b02020d95c419e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6aa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1428655570 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0041020 con 0x555919de1550 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1428655570 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6ac0028870 con 0x555919de1550 2024-09-12T00:54:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.669+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1428655570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ac0032b10 con 0x555919de1550 2024-09-12T00:54:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1428655570 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ac004c050 con 0x555919de1550 2024-09-12T00:54:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6ad0e2e740 10 client.25307 fetch_fsmap learned FSMap version 25 2024-09-12T00:54:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1428655570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555919dd2090 con 0x555919de1550 2024-09-12T00:54:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1428655570 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ac0032b10 con 0x555919de1550 2024-09-12T00:54:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1428655570 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6ac003db70 con 0x555919de1550 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6ad0e2e740 10 client.25307 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6ad0e2e740 10 client.25307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6ad0e2e740 20 client.25307 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.670+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555919df9a50 0x555919dfbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.671+0000 7f6ad0e2e740 4 client.25307 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.671+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1428655570 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555919d407f0 con 0x555919df9a50 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.671+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555919df9a50 0x555919dfbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.671+0000 7f6aa77fe640 10 client.25307 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.671+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555919df9a50 0x555919dfbe40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a7536be20e5ab5c server_cookie=d00f2dc5e8d2f324 in_seq=0 out_seq=0 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.672+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1428655570 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555919d407f0 con 0x555919df9a50 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.672+0000 7f6aa77fe640 10 client.25307 handle_command_reply: tid=0 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.672+0000 7f6ad0e2e740 1 client.25307 shutdown 2024-09-12T00:54:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.672+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1428655570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 msgr2=0x555919ddee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.672+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919ddee00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0028710 tx=0x7f6ac0028490 comp rx=0 tx=0).stop 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.672+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1428655570 shutdown_connections 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555919df9a50 0x555919dfbe40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919ddee00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6c90 0x555919dde8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1428655570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6370 0x555919dde380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6aa77fe640 0 client.25307 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1428655570 >> 172.21.15.2:0/1428655570 conn(0x555919dd2900 msgr2=0x555919dd8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1428655570 shutdown_connections 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1428655570 wait complete. 2024-09-12T00:54:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.673+0000 7f6ad0e2e740 20 client.25307 trim_cache size 0 max 16384 2024-09-12T00:54:01.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.708+0000 7f6ad0e2e740 1 Processor -- start 2024-09-12T00:54:01.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.708+0000 7f6ad0e2e740 1 -- start start 2024-09-12T00:54:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dd8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ac7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dd8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ac7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dd8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54630/0 (socket says 172.21.15.2:54630) 2024-09-12T00:54:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ac7fff640 1 -- 172.21.15.2:0/2166301803 learned_addr learned my addr 172.21.15.2:0/2166301803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6c90 0x555919e013e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919e01920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2166301803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac81a5890 con 0x555919dd6370 2024-09-12T00:54:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2166301803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac81a3160 con 0x555919dd6c90 2024-09-12T00:54:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2166301803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80723c0 con 0x555919de1550 2024-09-12T00:54:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6c90 0x555919e013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.709+0000 7f6accff2640 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919e01920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6ac77fe640 1 -- 172.21.15.2:0/2166301803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 msgr2=0x555919e01920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919e01920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6ac77fe640 1 -- 172.21.15.2:0/2166301803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 msgr2=0x555919dd8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dd8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6ac77fe640 1 -- 172.21.15.2:0/2166301803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555919dd2730 con 0x555919dd6c90 2024-09-12T00:54:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dd8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6c90 0x555919e013e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6abc02aa70 tx=0x7f6abc004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61510122150065e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6aadffb640 1 -- 172.21.15.2:0/2166301803 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc035040 con 0x555919dd6c90 2024-09-12T00:54:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6aadffb640 1 -- 172.21.15.2:0/2166301803 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6abc005520 con 0x555919dd6c90 2024-09-12T00:54:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.710+0000 7f6aadffb640 1 -- 172.21.15.2:0/2166301803 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc0035f0 con 0x555919dd6c90 2024-09-12T00:54:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.711+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2166301803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6c90 msgr2=0x555919e013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.711+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6c90 0x555919e013e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6abc02aa70 tx=0x7f6abc004260 comp rx=0 tx=0).stop 2024-09-12T00:54:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.711+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2166301803 shutdown_connections 2024-09-12T00:54:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.711+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919de1550 0x555919e01920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.711+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919dd6c90 0x555919e013e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.711+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/2166301803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dd8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.711+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2166301803 >> 172.21.15.2:0/2166301803 conn(0x555919dd2900 msgr2=0x555919dd7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.712+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2166301803 shutdown_connections 2024-09-12T00:54:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.712+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/2166301803 wait complete. 2024-09-12T00:54:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.712+0000 7f6ad0e2e740 1 -- start start 2024-09-12T00:54:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.712+0000 7f6ad0e2e740 1 Processor -- start 2024-09-12T00:54:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dcb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ac7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dcb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ac7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dcb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54636/0 (socket says 172.21.15.2:54636) 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ad0e2e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6c90 0x555919dcbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ac7fff640 1 -- 172.21.15.2:0/1059604017 learned_addr learned my addr 172.21.15.2:0/1059604017 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919dcc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8072a30 con 0x555919dd6370 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8073ea0 con 0x555919de1550 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8073100 con 0x555919dd6c90 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.713+0000 7f6ad0e2e740 10 client.0 _ll_register_callbacks cb 0x7f6ac0035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6c90 0x555919dcbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6accff2640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919dcc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6ac7fff640 1 -- 172.21.15.2:0/1059604017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6c90 msgr2=0x555919dcbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6c90 0x555919dcbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6ac7fff640 1 -- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 msgr2=0x555919dcc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919dcc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6ac7fff640 1 -- 172.21.15.2:0/1059604017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555919e633c0 con 0x555919dd6370 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6c90 0x555919dcbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6accff2640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919dcc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6ac7fff640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dcb760 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8097f20 tx=0x7f6ab8005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4552acc75851143a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.714+0000 7f6aa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.715+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1059604017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8099dc0 con 0x555919dd6370 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.715+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1059604017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6ab8098130 con 0x555919dd6370 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.715+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6abc005520 con 0x555919dd6370 2024-09-12T00:54:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.715+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1059604017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ab80ba250 con 0x555919dd6370 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.715+0000 7f6ad0e2e740 10 client.15627 fetch_fsmap learned FSMap version 25 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.715+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555919e64640 con 0x555919dd6370 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.716+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1059604017 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6abc005520 con 0x555919dd6370 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.716+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1059604017 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6ab8026060 con 0x555919dd6370 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.716+0000 7f6ad0e2e740 10 client.15627 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.716+0000 7f6ad0e2e740 10 client.15627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.716+0000 7f6ad0e2e740 20 client.15627 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.716+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555919df9a50 0x555919e66b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.716+0000 7f6ad0e2e740 4 client.15627 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:54:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.716+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555919d3ad00 con 0x555919df9a50 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.717+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555919df9a50 0x555919e66b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.717+0000 7f6aa77fe640 10 client.15627 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.717+0000 7f6ac77fe640 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555919df9a50 0x555919e66b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc6be7df6edbd7b1 server_cookie=88f526108959ca4c in_seq=0 out_seq=0 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.718+0000 7f6aa77fe640 1 -- 172.21.15.2:0/1059604017 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555919d3ad00 con 0x555919df9a50 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.718+0000 7f6aa77fe640 10 client.15627 handle_command_reply: tid=0 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.718+0000 7f6ad0e2e740 1 client.15627 shutdown 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.718+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 msgr2=0x555919dcb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.718+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dcb760 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8097f20 tx=0x7f6ab8005490 comp rx=0 tx=0).stop 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 shutdown_connections 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555919df9a50 0x555919e66b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555919de1550 0x555919dcc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555919dd6c90 0x555919dcbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 1 --2- 172.21.15.2:0/1059604017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555919dd6370 0x555919dcb760 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 >> 172.21.15.2:0/1059604017 conn(0x555919dd2900 msgr2=0x555919ddd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6aa77fe640 0 client.15627 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 shutdown_connections 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 1 -- 172.21.15.2:0/1059604017 wait complete. 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.719+0000 7f6ad0e2e740 20 client.15627 trim_cache size 0 max 16384 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:54:01.720 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "6a955a3a-f15e-4b2a-b650-42ed7f9a53b7", 2024-09-12T00:54:01.721 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:54:01.721 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:54:01.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 -- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6ab00a2f20 msgr2=0x7f6ab00a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6ab00a2f20 0x7f6ab00a53e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d680 tx=0x7f6ac0004ab0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 -- 172.21.15.2:0/1848341872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ac8100e20 msgr2=0x7f6ac81962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ac8100e20 0x7f6ac81962c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8007880 tx=0x7f6ab8007d40 comp rx=0 tx=0).stop 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 -- 172.21.15.2:0/1848341872 shutdown_connections 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6ab00a2f20 0x7f6ab00a53e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ac8102ef0 0x7f6ac819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac8102570 0x7f6ac8196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 --2- 172.21.15.2:0/1848341872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ac8100e20 0x7f6ac81962c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.720+0000 7f6acea55640 1 -- 172.21.15.2:0/1848341872 >> 172.21.15.2:0/1848341872 conn(0x7f6ac80fc7d0 msgr2=0x7f6ac8105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.721+0000 7f6acea55640 1 -- 172.21.15.2:0/1848341872 shutdown_connections 2024-09-12T00:54:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:01.721+0000 7f6acea55640 1 -- 172.21.15.2:0/1848341872 wait complete. 2024-09-12T00:54:02.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:01 smithi002 ceph-mon[31210]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-12T00:54:02.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:01 smithi002 ceph-mon[31210]: mgrmap e24: x(active, since 66s), standbys: z, y 2024-09-12T00:54:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:01 smithi167 ceph-mon[35234]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-12T00:54:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:01 smithi167 ceph-mon[35234]: mgrmap e24: x(active, since 66s), standbys: z, y 2024-09-12T00:54:02.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:01 smithi071 ceph-mon[35276]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-12T00:54:02.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:01 smithi071 ceph-mon[35276]: mgrmap e24: x(active, since 66s), standbys: z, y 2024-09-12T00:54:02.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:54:02.905 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:03.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:02 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:54:03.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:02 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:03.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:02 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:54:03.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:02 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:03.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:02 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:54:03.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:02 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:03.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:02 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:54:03.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:02 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:03.343 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:02 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:54:03.343 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:02 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:03.343 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:02 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:54:03.343 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:02 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:03.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 -- 172.21.15.2:0/540570844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14881082a0 msgr2=0x7f148810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 --2- 172.21.15.2:0/540570844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14881082a0 0x7f148810ec40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1480009cd0 tx=0x7f148002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 -- 172.21.15.2:0/540570844 shutdown_connections 2024-09-12T00:54:03.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 --2- 172.21.15.2:0/540570844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14881082a0 0x7f148810ec40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 --2- 172.21.15.2:0/540570844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14881036e0 0x7f1488107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 --2- 172.21.15.2:0/540570844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1488102d30 0x7f1488103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 -- 172.21.15.2:0/540570844 >> 172.21.15.2:0/540570844 conn(0x7f14880fc7d0 msgr2=0x7f14880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 -- 172.21.15.2:0/540570844 shutdown_connections 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.485+0000 7f148c9a4640 1 -- 172.21.15.2:0/540570844 wait complete. 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.486+0000 7f148c9a4640 1 Processor -- start 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.486+0000 7f148c9a4640 1 -- start start 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148c9a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1488102d30 0x7f1488100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148c9a4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14881036e0 0x7f1488100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148c9a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14881082a0 0x7f1488101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148c9a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14881120d0 con 0x7f1488102d30 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148c9a4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1488111f50 con 0x7f14881082a0 2024-09-12T00:54:03.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148c9a4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1488112250 con 0x7f14881036e0 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1488102d30 0x7f1488100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1488102d30 0x7f1488100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54656/0 (socket says 172.21.15.2:54656) 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f148659c640 1 -- 172.21.15.2:0/4186332852 learned_addr learned my addr 172.21.15.2:0/4186332852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.487+0000 7f1486d9d640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14881082a0 0x7f1488101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.488+0000 7f148659c640 1 -- 172.21.15.2:0/4186332852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14881036e0 msgr2=0x7f1488100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.488+0000 7f148659c640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14881036e0 0x7f1488100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.488+0000 7f148659c640 1 -- 172.21.15.2:0/4186332852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14881082a0 msgr2=0x7f1488101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.488+0000 7f148659c640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14881082a0 0x7f1488101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.488+0000 7f148659c640 1 -- 172.21.15.2:0/4186332852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14881aaf20 con 0x7f1488102d30 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.488+0000 7f148659c640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1488102d30 0x7f1488100990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f147800e9f0 tx=0x7f147800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.489+0000 7f14777fe640 1 -- 172.21.15.2:0/4186332852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147800cd80 con 0x7f1488102d30 2024-09-12T00:54:03.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.490+0000 7f14777fe640 1 -- 172.21.15.2:0/4186332852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1478010910 con 0x7f1488102d30 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.490+0000 7f14777fe640 1 -- 172.21.15.2:0/4186332852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1478018990 con 0x7f1488102d30 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.490+0000 7f148c9a4640 1 -- 172.21.15.2:0/4186332852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14881ab150 con 0x7f1488102d30 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.490+0000 7f148c9a4640 1 -- 172.21.15.2:0/4186332852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881ab640 con 0x7f1488102d30 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.493+0000 7f148ed7d740 1 Processor -- start 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.493+0000 7f148ed7d740 1 -- start start 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b50027880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50027dc0 0x561b50032140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b50034a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f148ed7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b4ff8d2e0 con 0x561b500274a0 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f148ed7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561b4ff34ce0 con 0x561b50027dc0 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f148ed7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b4ff892a0 con 0x561b50032680 2024-09-12T00:54:03.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f1486d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b50027880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f1486d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b50027880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54662/0 (socket says 172.21.15.2:54662) 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f1486d9d640 1 -- 172.21.15.2:0/2786562134 learned_addr learned my addr 172.21.15.2:0/2786562134 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.494+0000 7f1485d9b640 1 --2- 172.21.15.2:0/2786562134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b50034a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.495+0000 7f1485d9b640 1 -- 172.21.15.2:0/2786562134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50027dc0 msgr2=0x561b50032140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.495+0000 7f1485d9b640 1 --2- 172.21.15.2:0/2786562134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50027dc0 0x561b50032140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.495+0000 7f1485d9b640 1 -- 172.21.15.2:0/2786562134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 msgr2=0x561b50027880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.495+0000 7f1485d9b640 1 --2- 172.21.15.2:0/2786562134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b50027880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.495+0000 7f14777fe640 1 -- 172.21.15.2:0/4186332852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138116+0+0 (secure 0 0 0) 0x7f1478010ac0 con 0x7f1488102d30 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.495+0000 7f1485d9b640 1 -- 172.21.15.2:0/2786562134 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4ff19440 con 0x561b50032680 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.496+0000 7f1485d9b640 1 --2- 172.21.15.2:0/2786562134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b50034a70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14881021e0 tx=0x7f147c009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a12f713bdec0ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.496+0000 7f1474ff9640 1 -- 172.21.15.2:0/2786562134 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c00ec80 con 0x561b50032680 2024-09-12T00:54:03.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.496+0000 7f1474ff9640 1 -- 172.21.15.2:0/2786562134 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147c00ee20 con 0x561b50032680 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.496+0000 7f1474ff9640 1 -- 172.21.15.2:0/2786562134 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c004aa0 con 0x561b50032680 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.497+0000 7f14777fe640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14700a2f20 0x7f14700a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.497+0000 7f14777fe640 1 -- 172.21.15.2:0/4186332852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f14780cfb80 con 0x7f1488102d30 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.497+0000 7f1486d9d640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14700a2f20 0x7f14700a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.497+0000 7f148ed7d740 1 -- 172.21.15.2:0/2786562134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 msgr2=0x561b50034a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.497+0000 7f148ed7d740 1 --2- 172.21.15.2:0/2786562134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b50034a70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14881021e0 tx=0x7f147c009f20 comp rx=0 tx=0).stop 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f1486d9d640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14700a2f20 0x7f14700a53e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1480009430 tx=0x7f14800098a0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f148ed7d740 1 -- 172.21.15.2:0/2786562134 shutdown_connections 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f148ed7d740 1 --2- 172.21.15.2:0/2786562134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b50034a70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f148ed7d740 1 --2- 172.21.15.2:0/2786562134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50027dc0 0x561b50032140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f148ed7d740 1 --2- 172.21.15.2:0/2786562134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b50027880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f148ed7d740 1 -- 172.21.15.2:0/2786562134 >> 172.21.15.2:0/2786562134 conn(0x561b50023a30 msgr2=0x561b50023e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f148ed7d740 1 -- 172.21.15.2:0/2786562134 shutdown_connections 2024-09-12T00:54:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f148ed7d740 1 -- 172.21.15.2:0/2786562134 wait complete. 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.498+0000 7f148ed7d740 1 -- start start 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148ed7d740 1 Processor -- start 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b500274a0 0x561b50032040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50027dc0 0x561b5002f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50032680 0x561b5002f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148ed7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b50046260 con 0x561b50027dc0 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148ed7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561b4ff48050 con 0x561b50032680 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148ed7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b500463e0 con 0x561b500274a0 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148ed7d740 10 client.0 _ll_register_callbacks cb 0x561b4ff88160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f1485d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50027dc0 0x561b5002f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f1485d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50027dc0 0x561b5002f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54674/0 (socket says 172.21.15.2:54674) 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f1485d9b640 1 -- 172.21.15.2:0/3267388070 learned_addr learned my addr 172.21.15.2:0/3267388070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:03.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f148659c640 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b500274a0 0x561b50032040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.499+0000 7f1486d9d640 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50032680 0x561b5002f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f1485d9b640 1 -- 172.21.15.2:0/3267388070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b500274a0 msgr2=0x561b50032040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f1485d9b640 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b500274a0 0x561b50032040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f1485d9b640 1 -- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50032680 msgr2=0x561b5002f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f1485d9b640 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50032680 0x561b5002f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f1485d9b640 1 -- 172.21.15.2:0/3267388070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4fcfe3c0 con 0x561b50027dc0 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f1486d9d640 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50032680 0x561b5002f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f1485d9b640 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50027dc0 0x561b5002f2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f147c0056f0 tx=0x7f147c01a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b76be111397fe83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f146dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f146dffb640 1 -- 172.21.15.2:0/3267388070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c028060 con 0x561b50027dc0 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.500+0000 7f146dffb640 1 -- 172.21.15.2:0/3267388070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f147c01a7b0 con 0x561b50027dc0 2024-09-12T00:54:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.501+0000 7f148ed7d740 1 -- 172.21.15.2:0/3267388070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f147c00ee20 con 0x561b50027dc0 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.501+0000 7f146dffb640 1 -- 172.21.15.2:0/3267388070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f147c01a2e0 con 0x561b50027dc0 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.501+0000 7f148ed7d740 10 client.15639 fetch_fsmap learned FSMap version 25 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.501+0000 7f148ed7d740 1 -- 172.21.15.2:0/3267388070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561b50051c80 con 0x561b50027dc0 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f146dffb640 1 -- 172.21.15.2:0/3267388070 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147c005400 con 0x561b50027dc0 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f146dffb640 1 -- 172.21.15.2:0/3267388070 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f147c018ca0 con 0x561b50027dc0 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f148ed7d740 10 client.15639 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f148ed7d740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f148ed7d740 20 client.15639 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f148ed7d740 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b50053030 0x561b50055420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f148ed7d740 4 client.15639 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f148ed7d740 1 -- 172.21.15.2:0/3267388070 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f147c00ee20 con 0x561b50053030 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.502+0000 7f148659c640 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b50053030 0x561b50055420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.503+0000 7f146dffb640 10 client.15639 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.503+0000 7f148659c640 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b50053030 0x561b50055420 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29d62ab6afc46a77 server_cookie=ad2b1aec9d3f8cae in_seq=0 out_seq=0 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.503+0000 7f146dffb640 1 -- 172.21.15.2:0/3267388070 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f147c00ee20 con 0x561b50053030 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.503+0000 7f146dffb640 10 client.15639 handle_command_reply: tid=0 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.503+0000 7f148ed7d740 1 client.15639 shutdown 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 -- 172.21.15.2:0/3267388070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50027dc0 msgr2=0x561b5002f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50027dc0 0x561b5002f2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f147c0056f0 tx=0x7f147c01a6c0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 -- 172.21.15.2:0/3267388070 shutdown_connections 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b50053030 0x561b50055420 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b50032680 0x561b5002f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50027dc0 0x561b5002f2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 --2- 172.21.15.2:0/3267388070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b500274a0 0x561b50032040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 -- 172.21.15.2:0/3267388070 >> 172.21.15.2:0/3267388070 conn(0x561b50023a30 msgr2=0x561b50029760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f146dffb640 0 client.15639 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 -- 172.21.15.2:0/3267388070 shutdown_connections 2024-09-12T00:54:03.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 1 -- 172.21.15.2:0/3267388070 wait complete. 2024-09-12T00:54:03.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.504+0000 7f148ed7d740 20 client.15639 trim_cache size 0 max 16384 2024-09-12T00:54:03.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.521+0000 7f148ed7d740 1 Processor -- start 2024-09-12T00:54:03.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.521+0000 7f148ed7d740 1 -- start start 2024-09-12T00:54:03.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b5002c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b5002ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b5002cfd0 0x561b50022350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148ed7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14881ae340 con 0x561b500274a0 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148ed7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f14881abc10 con 0x561b5002cfd0 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148ed7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14881a2ff0 con 0x561b50032680 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b5002c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b5002c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54678/0 (socket says 172.21.15.2:54678) 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.522+0000 7f148659c640 1 -- 172.21.15.2:0/2842656761 learned_addr learned my addr 172.21.15.2:0/2842656761 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.523+0000 7f1485d9b640 1 --2- 172.21.15.2:0/2842656761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b5002ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.523+0000 7f148659c640 1 -- 172.21.15.2:0/2842656761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 msgr2=0x561b5002ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.523+0000 7f148659c640 1 --2- 172.21.15.2:0/2842656761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b5002ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.523+0000 7f148659c640 1 -- 172.21.15.2:0/2842656761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b5002cfd0 msgr2=0x561b50022350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.523+0000 7f148659c640 1 --2- 172.21.15.2:0/2842656761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b5002cfd0 0x561b50022350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.523+0000 7f148659c640 1 -- 172.21.15.2:0/2842656761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5002d840 con 0x561b500274a0 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.524+0000 7f148659c640 1 --2- 172.21.15.2:0/2842656761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b5002c550 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f14780cd180 tx=0x7f1478009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b27b93d4d4778ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.524+0000 7f146ffff640 1 -- 172.21.15.2:0/2842656761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147809a110 con 0x561b500274a0 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.524+0000 7f146ffff640 1 -- 172.21.15.2:0/2842656761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1478098480 con 0x561b500274a0 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.524+0000 7f146ffff640 1 -- 172.21.15.2:0/2842656761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147809b4c0 con 0x561b500274a0 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.525+0000 7f148ed7d740 1 -- 172.21.15.2:0/2842656761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 msgr2=0x561b5002c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.525+0000 7f148ed7d740 1 --2- 172.21.15.2:0/2842656761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b5002c550 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f14780cd180 tx=0x7f1478009310 comp rx=0 tx=0).stop 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.525+0000 7f148ed7d740 1 -- 172.21.15.2:0/2842656761 shutdown_connections 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.525+0000 7f148ed7d740 1 --2- 172.21.15.2:0/2842656761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b5002cfd0 0x561b50022350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.525+0000 7f148ed7d740 1 --2- 172.21.15.2:0/2842656761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b50032680 0x561b5002ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.525+0000 7f148ed7d740 1 --2- 172.21.15.2:0/2842656761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b500274a0 0x561b5002c550 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.525+0000 7f148ed7d740 1 -- 172.21.15.2:0/2842656761 >> 172.21.15.2:0/2842656761 conn(0x561b50023a30 msgr2=0x561b5002e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.526+0000 7f148ed7d740 1 -- 172.21.15.2:0/2842656761 shutdown_connections 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.526+0000 7f148ed7d740 1 -- 172.21.15.2:0/2842656761 wait complete. 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.526+0000 7f148ed7d740 1 -- start start 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.527+0000 7f148ed7d740 1 Processor -- start 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.527+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b500274a0 0x561b500588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.527+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5002cfd0 0x561b50055c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f148ed7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50032680 0x561b50056230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f1485d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5002cfd0 0x561b50055c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f148659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b500274a0 0x561b500588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f148659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b500274a0 0x561b500588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:39162/0 (socket says 172.21.15.2:39162) 2024-09-12T00:54:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f1485d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5002cfd0 0x561b50055c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:43742/0 (socket says 172.21.15.2:43742) 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f1486d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50032680 0x561b50056230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f1486d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50032680 0x561b50056230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54680/0 (socket says 172.21.15.2:54680) 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f148659c640 1 -- 172.21.15.2:0/1017125614 learned_addr learned my addr 172.21.15.2:0/1017125614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14881a3660 con 0x561b50032680 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f14881a4ad0 con 0x561b500274a0 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14881a3d30 con 0x561b5002cfd0 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.528+0000 7f148ed7d740 10 client.0 _ll_register_callbacks cb 0x7f147c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.529+0000 7f1486d9d640 1 -- 172.21.15.2:0/1017125614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5002cfd0 msgr2=0x561b50055c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.529+0000 7f1486d9d640 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5002cfd0 0x561b50055c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.529+0000 7f1486d9d640 1 -- 172.21.15.2:0/1017125614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b500274a0 msgr2=0x561b500588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.529+0000 7f1486d9d640 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b500274a0 0x561b500588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.529+0000 7f1486d9d640 1 -- 172.21.15.2:0/1017125614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b50056a60 con 0x561b50032680 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.529+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1478098480 con 0x561b50032680 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.530+0000 7f1486d9d640 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50032680 0x561b50056230 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f148002aed0 tx=0x7f148002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4096d863de29ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.530+0000 7f146dffb640 10 client.15645 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.530+0000 7f146dffb640 1 -- 172.21.15.2:0/1017125614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480004040 con 0x561b50032680 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.530+0000 7f146dffb640 1 -- 172.21.15.2:0/1017125614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f14800041e0 con 0x561b50032680 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.531+0000 7f146dffb640 1 -- 172.21.15.2:0/1017125614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1480004440 con 0x561b50032680 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.531+0000 7f148ed7d740 10 client.15645 fetch_fsmap learned FSMap version 25 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.531+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=25}) -- 0x561b500bd940 con 0x561b50032680 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.532+0000 7f146dffb640 1 -- 172.21.15.2:0/1017125614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1480030070 con 0x561b50032680 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.532+0000 7f148ed7d740 10 client.15645 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.532+0000 7f148ed7d740 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.532+0000 7f148ed7d740 20 client.15645 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.532+0000 7f148ed7d740 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b500bdee0 0x561b500c0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.532+0000 7f148ed7d740 4 client.15645 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.532+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b4ff9a850 con 0x561b500bdee0 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.532+0000 7f148659c640 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b500bdee0 0x561b500c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.533+0000 7f146dffb640 10 client.15645 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.533+0000 7f148659c640 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b500bdee0 0x561b500c0300 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abbc3a20762a2c3e server_cookie=f467bd823bfa5c0f in_seq=0 out_seq=0 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.533+0000 7f146dffb640 1 -- 172.21.15.2:0/1017125614 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561b4ff9a850 con 0x561b500bdee0 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.533+0000 7f146dffb640 10 client.15645 handle_command_reply: tid=0 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.533+0000 7f148ed7d740 1 client.15645 shutdown 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.534+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50032680 msgr2=0x561b50056230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.534+0000 7f148ed7d740 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50032680 0x561b50056230 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f148002aed0 tx=0x7f148002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.534+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 shutdown_connections 2024-09-12T00:54:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.534+0000 7f148ed7d740 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b500bdee0 0x561b500c0300 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.534+0000 7f148ed7d740 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b50032680 0x561b50056230 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.534+0000 7f148ed7d740 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5002cfd0 0x561b50055c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.534+0000 7f146dffb640 0 client.15645 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.534+0000 7f148ed7d740 1 --2- 172.21.15.2:0/1017125614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b500274a0 0x561b500588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.535+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 >> 172.21.15.2:0/1017125614 conn(0x561b50023a30 msgr2=0x561b50022350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.535+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 shutdown_connections 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.535+0000 7f148ed7d740 1 -- 172.21.15.2:0/1017125614 wait complete. 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.535+0000 7f148ed7d740 20 client.15645 trim_cache size 0 max 16384 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:54:03.542 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:54:03.543 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T00:54:03.543 INFO:teuthology.orchestra.run.smithi002.stdout: "6a955a3a-f15e-4b2a-b650-42ed7f9a53b7": { 2024-09-12T00:54:03.543 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T00:54:03.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "6a955a3a-f15e-4b2a-b650-42ed7f9a53b7", 2024-09-12T00:54:03.543 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T00:54:03.543 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:03.543 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:03.543 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.537+0000 7f148c9a4640 1 -- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14700a2f20 msgr2=0x7f14700a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.537+0000 7f148c9a4640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14700a2f20 0x7f14700a53e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1480009430 tx=0x7f14800098a0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.537+0000 7f148c9a4640 1 -- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1488102d30 msgr2=0x7f1488100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.537+0000 7f148c9a4640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1488102d30 0x7f1488100990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f147800e9f0 tx=0x7f147800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.538+0000 7f148c9a4640 1 -- 172.21.15.2:0/4186332852 shutdown_connections 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.538+0000 7f148c9a4640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14700a2f20 0x7f14700a53e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.538+0000 7f148c9a4640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14881082a0 0x7f1488101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.538+0000 7f148c9a4640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14881036e0 0x7f1488100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.538+0000 7f148c9a4640 1 --2- 172.21.15.2:0/4186332852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1488102d30 0x7f1488100990 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.538+0000 7f148c9a4640 1 -- 172.21.15.2:0/4186332852 >> 172.21.15.2:0/4186332852 conn(0x7f14880fc7d0 msgr2=0x7f1488106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.538+0000 7f148c9a4640 1 -- 172.21.15.2:0/4186332852 shutdown_connections 2024-09-12T00:54:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:03.538+0000 7f148c9a4640 1 -- 172.21.15.2:0/4186332852 wait complete. 2024-09-12T00:54:03.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:54:04.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:03 smithi002 ceph-mon[31210]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:04.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:03 smithi167 ceph-mon[35234]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:04.347 INFO:tasks.cephfs.filesystem:scrub status for tag:6a955a3a-f15e-4b2a-b650-42ed7f9a53b7 - {'path': '/', 'tag': '6a955a3a-f15e-4b2a-b650-42ed7f9a53b7', 'options': 'recursive,force'} 2024-09-12T00:54:04.400 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:04.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:03 smithi071 ceph-mon[35276]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:04.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 -- 172.21.15.2:0/2525264695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50100e20 msgr2=0x7feb50101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 --2- 172.21.15.2:0/2525264695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50100e20 0x7feb50101200 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009900 tx=0x7feb4c02a480 comp rx=0 tx=0).stop 2024-09-12T00:54:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 -- 172.21.15.2:0/2525264695 shutdown_connections 2024-09-12T00:54:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 --2- 172.21.15.2:0/2525264695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb50102ef0 0x7feb5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 --2- 172.21.15.2:0/2525264695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb50102570 0x7feb501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 --2- 172.21.15.2:0/2525264695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50100e20 0x7feb50101200 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 -- 172.21.15.2:0/2525264695 >> 172.21.15.2:0/2525264695 conn(0x7feb500fc7d0 msgr2=0x7feb500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 -- 172.21.15.2:0/2525264695 shutdown_connections 2024-09-12T00:54:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.969+0000 7feb572b6640 1 -- 172.21.15.2:0/2525264695 wait complete. 2024-09-12T00:54:04.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.971+0000 7feb572b6640 1 Processor -- start 2024-09-12T00:54:04.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.971+0000 7feb572b6640 1 -- start start 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.971+0000 7feb572b6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb50100e20 0x7feb5019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.971+0000 7feb572b6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb50102570 0x7feb5019e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.971+0000 7feb572b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50102ef0 0x7feb50198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb572b6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feb50110fd0 con 0x7feb50102ef0 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb572b6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feb50110e50 con 0x7feb50102570 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb572b6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb50111150 con 0x7feb50100e20 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb55853640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50102ef0 0x7feb50198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb55052640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb50100e20 0x7feb5019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb55052640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb50100e20 0x7feb5019e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:43768/0 (socket says 172.21.15.2:43768) 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb55052640 1 -- 172.21.15.2:0/481250277 learned_addr learned my addr 172.21.15.2:0/481250277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb54851640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb50102570 0x7feb5019e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:04.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb54851640 1 -- 172.21.15.2:0/481250277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb50100e20 msgr2=0x7feb5019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb54851640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb50100e20 0x7feb5019e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb54851640 1 -- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50102ef0 msgr2=0x7feb50198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb54851640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50102ef0 0x7feb50198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb54851640 1 -- 172.21.15.2:0/481250277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb50198e20 con 0x7feb50102570 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb55052640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb50100e20 0x7feb5019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb54851640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb50102570 0x7feb5019e720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb4000e9f0 tx=0x7feb4000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb55853640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50102ef0 0x7feb50198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb467fc640 1 -- 172.21.15.2:0/481250277 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4000ccc0 con 0x7feb50102570 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.972+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb50199110 con 0x7feb50102570 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.973+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb50111730 con 0x7feb50102570 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.973+0000 7feb467fc640 1 -- 172.21.15.2:0/481250277 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb40010910 con 0x7feb50102570 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.973+0000 7feb467fc640 1 -- 172.21.15.2:0/481250277 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb400188e0 con 0x7feb50102570 2024-09-12T00:54:04.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.974+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb34005290 con 0x7feb50102570 2024-09-12T00:54:04.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.976+0000 7feb467fc640 1 -- 172.21.15.2:0/481250277 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 138116+0+0 (secure 0 0 0) 0x7feb40010ac0 con 0x7feb50102570 2024-09-12T00:54:04.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.977+0000 7feb467fc640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7feb3c0a2fa0 0x7feb3c0a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:04.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.977+0000 7feb55052640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7feb3c0a2fa0 0x7feb3c0a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:04.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.977+0000 7feb467fc640 1 -- 172.21.15.2:0/481250277 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7feb400cfa70 con 0x7feb50102570 2024-09-12T00:54:04.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.978+0000 7feb55052640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7feb3c0a2fa0 0x7feb3c0a5460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feb4c005ab0 tx=0x7feb4c000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:04.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:04.981+0000 7feb467fc640 1 -- 172.21.15.2:0/481250277 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb4009c400 con 0x7feb50102570 2024-09-12T00:54:05.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.291+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb34005850 con 0x7feb50102570 2024-09-12T00:54:05.291 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:54:05.291 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-12T00:52:56:467047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:52:55.573499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:54:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.292+0000 7feb467fc640 1 -- 172.21.15.2:0/481250277 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7feb4009bd00 con 0x7feb50102570 2024-09-12T00:54:05.292 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-12T00:54:05.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.294+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7feb3c0a2fa0 msgr2=0x7feb3c0a5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:05.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.294+0000 7feb572b6640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7feb3c0a2fa0 0x7feb3c0a5460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feb4c005ab0 tx=0x7feb4c000bc0 comp rx=0 tx=0).stop 2024-09-12T00:54:05.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.294+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb50102570 msgr2=0x7feb5019e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:05.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.294+0000 7feb572b6640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb50102570 0x7feb5019e720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb4000e9f0 tx=0x7feb4000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:54:05.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.295+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 shutdown_connections 2024-09-12T00:54:05.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.295+0000 7feb572b6640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7feb3c0a2fa0 0x7feb3c0a5460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:05.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.295+0000 7feb572b6640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb50102ef0 0x7feb50198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:05.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.295+0000 7feb572b6640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb50102570 0x7feb5019e720 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:05.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.295+0000 7feb572b6640 1 --2- 172.21.15.2:0/481250277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb50100e20 0x7feb5019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:05.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.295+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 >> 172.21.15.2:0/481250277 conn(0x7feb500fc7d0 msgr2=0x7feb500fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:05.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.295+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 shutdown_connections 2024-09-12T00:54:05.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:05.295+0000 7feb572b6640 1 -- 172.21.15.2:0/481250277 wait complete. 2024-09-12T00:54:06.008 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --set-id 5d610cbc --release --await' 2024-09-12T00:54:06.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --set-id 5d610cbc --release --await 2024-09-12T00:54:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:05 smithi002 ceph-mon[31210]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:05 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/481250277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:06.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:05 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:54:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:05 smithi167 ceph-mon[35234]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:05 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/481250277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:05 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:54:06.362 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:06.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:05 smithi071 ceph-mon[35276]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:05 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/481250277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:05 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:54:06.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 -- 172.21.15.2:0/482282597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb334102d30 msgr2=0x7fb334103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 --2- 172.21.15.2:0/482282597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb334102d30 0x7fb334103110 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb324009930 tx=0x7fb32402a420 comp rx=0 tx=0).stop 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 -- 172.21.15.2:0/482282597 shutdown_connections 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 --2- 172.21.15.2:0/482282597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3341082a0 0x7fb33410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 --2- 172.21.15.2:0/482282597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3341036e0 0x7fb334107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 --2- 172.21.15.2:0/482282597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb334102d30 0x7fb334103110 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 -- 172.21.15.2:0/482282597 >> 172.21.15.2:0/482282597 conn(0x7fb3340fc7d0 msgr2=0x7fb3340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 -- 172.21.15.2:0/482282597 shutdown_connections 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.844+0000 7fb3391d8640 1 -- 172.21.15.2:0/482282597 wait complete. 2024-09-12T00:54:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.845+0000 7fb3391d8640 1 Processor -- start 2024-09-12T00:54:06.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.845+0000 7fb3391d8640 1 -- start start 2024-09-12T00:54:06.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb3391d8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334102d30 0x7fb3341985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb3391d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3341036e0 0x7fb334198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb3391d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3341082a0 0x7fb33419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb3391d8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341120a0 con 0x7fb3341082a0 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb3391d8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb334111f20 con 0x7fb334102d30 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334102d30 0x7fb3341985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334102d30 0x7fb3341985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60540/0 (socket says 172.21.15.2:60540) 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb332d9d640 1 -- 172.21.15.2:0/1206049221 learned_addr learned my addr 172.21.15.2:0/1206049221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb33359e640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3341082a0 0x7fb33419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb33259c640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3341036e0 0x7fb334198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.846+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb334112220 con 0x7fb3341036e0 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb33259c640 1 -- 172.21.15.2:0/1206049221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334102d30 msgr2=0x7fb3341985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb33259c640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334102d30 0x7fb3341985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb33259c640 1 -- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3341082a0 msgr2=0x7fb33419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb33259c640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3341082a0 0x7fb33419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb33259c640 1 -- 172.21.15.2:0/1206049221 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33419d590 con 0x7fb3341036e0 2024-09-12T00:54:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb33259c640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3341036e0 0x7fb334198b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3340697d0 tx=0x7fb32800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb31bfff640 1 -- 172.21.15.2:0/1206049221 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32800cc40 con 0x7fb3341036e0 2024-09-12T00:54:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33419d880 con 0x7fb3341036e0 2024-09-12T00:54:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb31bfff640 1 -- 172.21.15.2:0/1206049221 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32800cde0 con 0x7fb3341036e0 2024-09-12T00:54:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3341a5160 con 0x7fb3341036e0 2024-09-12T00:54:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.847+0000 7fb31bfff640 1 -- 172.21.15.2:0/1206049221 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32801c070 con 0x7fb3341036e0 2024-09-12T00:54:06.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.850+0000 7fb33b5b1740 1 Processor -- start 2024-09-12T00:54:06.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.850+0000 7fb33b5b1740 1 -- start start 2024-09-12T00:54:06.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e379c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c980 0x5582e37a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37a7240 0x5582e37a9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5582e3701620 con 0x5582e379c980 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5582e36a8e50 con 0x5582e37a7240 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5582e36fd5e0 con 0x5582e379c060 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e379c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c980 0x5582e37a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb31bfff640 1 -- 172.21.15.2:0/1206049221 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 24) ==== 138116+0+0 (secure 0 0 0) 0x7fb328005020 con 0x7fb3341036e0 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e379c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:36480/0 (socket says 172.21.15.2:36480) 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33359e640 1 -- 172.21.15.2:0/3864136725 learned_addr learned my addr 172.21.15.2:0/3864136725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33259c640 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37a7240 0x5582e37a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33359e640 1 -- 172.21.15.2:0/3864136725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37a7240 msgr2=0x5582e37a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33359e640 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37a7240 0x5582e37a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33359e640 1 -- 172.21.15.2:0/3864136725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c980 msgr2=0x5582e37a6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33359e640 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c980 0x5582e37a6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb33359e640 1 -- 172.21.15.2:0/3864136725 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e3699d40 con 0x5582e379c060 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.851+0000 7fb332d9d640 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c980 0x5582e37a6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.852+0000 7fb33359e640 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e379c440 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009f50 tx=0x7fb32c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e40cea7a07bbf153 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.852+0000 7fb31bfff640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb31c0a2ea0 0x7fb31c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.852+0000 7fb3197fa640 1 -- 172.21.15.2:0/3864136725 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c004d20 con 0x5582e379c060 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.852+0000 7fb3197fa640 1 -- 172.21.15.2:0/3864136725 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32c004050 con 0x5582e379c060 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.852+0000 7fb3197fa640 1 -- 172.21.15.2:0/3864136725 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c005280 con 0x5582e379c060 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.852+0000 7fb332d9d640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb31c0a2ea0 0x7fb31c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.852+0000 7fb31bfff640 1 -- 172.21.15.2:0/1206049221 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb3280cf740 con 0x7fb3341036e0 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 -- 172.21.15.2:0/3864136725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 msgr2=0x5582e379c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e379c440 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009f50 tx=0x7fb32c0118d0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 -- 172.21.15.2:0/3864136725 shutdown_connections 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37a7240 0x5582e37a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c980 0x5582e37a6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/3864136725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e379c440 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 -- 172.21.15.2:0/3864136725 >> 172.21.15.2:0/3864136725 conn(0x5582e37985f0 msgr2=0x5582e37989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 -- 172.21.15.2:0/3864136725 shutdown_connections 2024-09-12T00:54:06.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.853+0000 7fb33b5b1740 1 -- 172.21.15.2:0/3864136725 wait complete. 2024-09-12T00:54:06.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb332d9d640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb31c0a2ea0 0x7fb31c0a5360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5582e3799450 tx=0x7fb324005e50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:06.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33b5b1740 1 -- start start 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33b5b1740 1 Processor -- start 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e37a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e379c980 0x5582e37a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e37a7240 0x5582e37a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5582e37a9e10 con 0x5582e37a7240 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5582e3689f10 con 0x5582e379c980 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5582e37a9f90 con 0x5582e379c060 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.854+0000 7fb33359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e37a7240 0x5582e37a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e37a7240 0x5582e37a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39088/0 (socket says 172.21.15.2:39088) 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33359e640 1 -- 172.21.15.2:0/497757479 learned_addr learned my addr 172.21.15.2:0/497757479 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33b5b1740 10 client.0 _ll_register_callbacks cb 0x5582e36addb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:06.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33259c640 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e379c980 0x5582e37a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb332d9d640 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e37a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33359e640 1 -- 172.21.15.2:0/497757479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 msgr2=0x5582e37a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33359e640 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e37a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33359e640 1 -- 172.21.15.2:0/497757479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e379c980 msgr2=0x5582e37a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33359e640 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e379c980 0x5582e37a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33359e640 1 -- 172.21.15.2:0/497757479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e3410580 con 0x5582e37a7240 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33359e640 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e37a7240 0x5582e37a4c30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009250 tx=0x7fb32c0044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eced64717708e279 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb316ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb316ff5640 1 -- 172.21.15.2:0/497757479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c029070 con 0x5582e37a7240 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb316ff5640 1 -- 172.21.15.2:0/497757479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb32c00f480 con 0x5582e37a7240 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.855+0000 7fb33b5b1740 1 -- 172.21.15.2:0/497757479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb32c004050 con 0x5582e37a7240 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb316ff5640 1 -- 172.21.15.2:0/497757479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb32c035050 con 0x5582e37a7240 2024-09-12T00:54:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb33b5b1740 10 client.15660 fetch_fsmap learned FSMap version 25 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb33b5b1740 1 -- 172.21.15.2:0/497757479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5582e34da960 con 0x5582e37a7240 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb316ff5640 1 -- 172.21.15.2:0/497757479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32c003e40 con 0x5582e37a7240 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb316ff5640 1 -- 172.21.15.2:0/497757479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb32c02e880 con 0x5582e37a7240 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb33b5b1740 10 client.15660 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb33b5b1740 10 client.15660 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb33b5b1740 20 client.15660 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5582e37b6c80 0x5582e37b9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb33b5b1740 4 client.15660 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.856+0000 7fb33b5b1740 1 -- 172.21.15.2:0/497757479 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb32c004050 con 0x5582e37b6c80 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.857+0000 7fb332d9d640 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5582e37b6c80 0x5582e37b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.857+0000 7fb332d9d640 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5582e37b6c80 0x5582e37b9070 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e64dc9b460b72866 server_cookie=d42b8cc39da22522 in_seq=0 out_seq=0 2024-09-12T00:54:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.857+0000 7fb316ff5640 10 client.15660 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:06.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb316ff5640 1 -- 172.21.15.2:0/497757479 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb32c004050 con 0x5582e37b6c80 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb316ff5640 10 client.15660 handle_command_reply: tid=0 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 client.15660 shutdown 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 -- 172.21.15.2:0/497757479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e37a7240 msgr2=0x5582e37a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e37a7240 0x5582e37a4c30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009250 tx=0x7fb32c0044b0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 -- 172.21.15.2:0/497757479 shutdown_connections 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5582e37b6c80 0x5582e37b9070 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e37a7240 0x5582e37a4c30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e379c980 0x5582e37a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/497757479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c060 0x5582e37a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 -- 172.21.15.2:0/497757479 >> 172.21.15.2:0/497757479 conn(0x5582e37985f0 msgr2=0x5582e379e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb316ff5640 0 client.15660 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.858+0000 7fb33b5b1740 1 -- 172.21.15.2:0/497757479 shutdown_connections 2024-09-12T00:54:06.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.859+0000 7fb33b5b1740 1 -- 172.21.15.2:0/497757479 wait complete. 2024-09-12T00:54:06.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.859+0000 7fb33b5b1740 20 client.15660 trim_cache size 0 max 16384 2024-09-12T00:54:06.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.884+0000 7fb33b5b1740 1 Processor -- start 2024-09-12T00:54:06.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.884+0000 7fb33b5b1740 1 -- start start 2024-09-12T00:54:06.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341ae050 con 0x5582e379c060 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341ab920 con 0x5582e37985f0 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341a9770 con 0x5582e379c980 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37be7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39090/0 (socket says 172.21.15.2:39090) 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33259c640 1 -- 172.21.15.2:0/2703048778 learned_addr learned my addr 172.21.15.2:0/2703048778 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb332d9d640 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33359e640 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33259c640 1 -- 172.21.15.2:0/2703048778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 msgr2=0x5582e37becf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33259c640 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37becf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33259c640 1 -- 172.21.15.2:0/2703048778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 msgr2=0x5582e37a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33259c640 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb33259c640 1 -- 172.21.15.2:0/2703048778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e3798090 con 0x5582e379c060 2024-09-12T00:54:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.885+0000 7fb332d9d640 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.886+0000 7fb33259c640 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37be7b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb328097e30 tx=0x7fb32800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902939af4471daa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.886+0000 7fb318ff9640 1 -- 172.21.15.2:0/2703048778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32809b9d0 con 0x5582e379c060 2024-09-12T00:54:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.886+0000 7fb318ff9640 1 -- 172.21.15.2:0/2703048778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32809fd80 con 0x5582e379c060 2024-09-12T00:54:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.886+0000 7fb318ff9640 1 -- 172.21.15.2:0/2703048778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328086310 con 0x5582e379c060 2024-09-12T00:54:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 -- 172.21.15.2:0/2703048778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 msgr2=0x5582e37be7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37be7b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb328097e30 tx=0x7fb32800cf90 comp rx=0 tx=0).stop 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 -- 172.21.15.2:0/2703048778 shutdown_connections 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37becf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37be7b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/2703048778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 -- 172.21.15.2:0/2703048778 >> 172.21.15.2:0/2703048778 conn(0x5582e37b9370 msgr2=0x5582e37a5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 -- 172.21.15.2:0/2703048778 shutdown_connections 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 -- 172.21.15.2:0/2703048778 wait complete. 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.887+0000 7fb33b5b1740 1 -- start start 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.888+0000 7fb33b5b1740 1 Processor -- start 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.888+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37ab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.888+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.888+0000 7fb33b5b1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37abba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.888+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.888+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60568/0 (socket says 172.21.15.2:60568) 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.888+0000 7fb33259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.888+0000 7fb33259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39100/0 (socket says 172.21.15.2:39100) 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341a9de0 con 0x5582e379c060 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341ab250 con 0x5582e37985f0 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33b5b1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341aa4b0 con 0x5582e379c980 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:36522/0 (socket says 172.21.15.2:36522) 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb332d9d640 1 -- 172.21.15.2:0/640745122 learned_addr learned my addr 172.21.15.2:0/640745122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33b5b1740 10 client.0 _ll_register_callbacks cb 0x7fb32c004da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33359e640 1 -- 172.21.15.2:0/640745122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 msgr2=0x5582e37ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33359e640 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33359e640 1 -- 172.21.15.2:0/640745122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 msgr2=0x5582e37ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33359e640 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb33359e640 1 -- 172.21.15.2:0/640745122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e3820980 con 0x5582e379c980 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.889+0000 7fb332d9d640 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33359e640 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37abba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb32c02edf0 tx=0x7fb32c0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53ae7106f4449d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb316ff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb316ff5640 1 -- 172.21.15.2:0/640745122 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c03e060 con 0x5582e379c980 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 1 -- 172.21.15.2:0/640745122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb32809fd80 con 0x5582e379c980 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb316ff5640 1 -- 172.21.15.2:0/640745122 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb32c02e440 con 0x5582e379c980 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb316ff5640 1 -- 172.21.15.2:0/640745122 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb32c026030 con 0x5582e379c980 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 10 client.25303 fetch_fsmap learned FSMap version 25 2024-09-12T00:54:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 1 -- 172.21.15.2:0/640745122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5582e3821c60 con 0x5582e379c980 2024-09-12T00:54:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb316ff5640 1 -- 172.21.15.2:0/640745122 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32809fd80 con 0x5582e379c980 2024-09-12T00:54:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb316ff5640 1 -- 172.21.15.2:0/640745122 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb32c0199d0 con 0x5582e379c980 2024-09-12T00:54:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 10 client.25303 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T00:54:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 10 client.25303 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:54:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 20 client.25303 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5582e37a7240 0x5582e38242d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 4 client.25303 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5d610cbc", "release": true, "await": true}] 2024-09-12T00:54:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.890+0000 7fb33b5b1740 1 -- 172.21.15.2:0/640745122 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5d610cbc", "release": true, "await": true}) -- 0x5582e370eb90 con 0x5582e37a7240 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.891+0000 7fb332d9d640 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5582e37a7240 0x5582e38242d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.891+0000 7fb332d9d640 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5582e37a7240 0x5582e38242d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e153e94f92a8d8bf server_cookie=cf25aa4b270affa6 in_seq=0 out_seq=0 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.891+0000 7fb316ff5640 10 client.25303 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.893+0000 7fb316ff5640 1 -- 172.21.15.2:0/640745122 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5582e370eb90 con 0x5582e37a7240 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb316ff5640 10 client.25303 handle_command_reply: tid=0 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 client.25303 shutdown 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 -- 172.21.15.2:0/640745122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 msgr2=0x5582e37abba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37abba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb32c02edf0 tx=0x7fb32c0047b0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 -- 172.21.15.2:0/640745122 shutdown_connections 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5582e37a7240 0x5582e38242d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb316ff5640 0 client.25303 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582e379c980 0x5582e37abba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e379c060 0x5582e37ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 --2- 172.21.15.2:0/640745122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e37985f0 0x5582e37ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 -- 172.21.15.2:0/640745122 >> 172.21.15.2:0/640745122 conn(0x5582e37b9370 msgr2=0x5582e37a6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 -- 172.21.15.2:0/640745122 shutdown_connections 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 1 -- 172.21.15.2:0/640745122 wait complete. 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.894+0000 7fb33b5b1740 20 client.25303 trim_cache size 0 max 16384 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 25, 2024-09-12T00:54:06.896 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 4, 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "5d610cbc": { 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 4, 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 144.5, 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:54:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:06.898 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb31c0a2ea0 msgr2=0x7fb31c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb31c0a2ea0 0x7fb31c0a5360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5582e3799450 tx=0x7fb324005e50 comp rx=0 tx=0).stop 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3341036e0 msgr2=0x7fb334198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3341036e0 0x7fb334198b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3340697d0 tx=0x7fb32800ee50 comp rx=0 tx=0).stop 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 shutdown_connections 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb31c0a2ea0 0x7fb31c0a5360 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3341082a0 0x7fb33419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3341036e0 0x7fb334198b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 --2- 172.21.15.2:0/1206049221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334102d30 0x7fb3341985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 >> 172.21.15.2:0/1206049221 conn(0x7fb3340fc7d0 msgr2=0x7fb334105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 shutdown_connections 2024-09-12T00:54:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:06.895+0000 7fb3391d8640 1 -- 172.21.15.2:0/1206049221 wait complete. 2024-09-12T00:54:07.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:06 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:54:07.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:06 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:54:07.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:06 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:54:07.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:06 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:54:07.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:06 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:54:07.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:06 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:54:07.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:06 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:54:07.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:06 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:54:07.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:06 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:54:07.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:06 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:54:07.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:06 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:54:07.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:06 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:54:07.776 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5d610cbc', total seconds elapsed: 28.4 2024-09-12T00:54:08.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:08 smithi002 ceph-mon[31210]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:54:08.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:08 smithi167 ceph-mon[35234]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:54:08.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:08 smithi071 ceph-mon[35276]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:54:10.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:10 smithi002 ceph-mon[31210]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:10.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:10 smithi167 ceph-mon[35234]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:10.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:10 smithi071 ceph-mon[35276]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T00:54:12.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:12 smithi002 ceph-mon[31210]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:54:12.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:12 smithi167 ceph-mon[35234]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:54:12.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:12 smithi071 ceph-mon[35276]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:54:14.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:14 smithi002 ceph-mon[31210]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:54:14.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:14 smithi167 ceph-mon[35234]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:54:14.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:14 smithi071 ceph-mon[35276]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:54:16.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:16 smithi002 ceph-mon[31210]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:54:16.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:16 smithi167 ceph-mon[35234]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:54:16.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:16 smithi071 ceph-mon[35276]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T00:54:18.265 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 94% (12208/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T00:54:18.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:18 smithi002 ceph-mon[31210]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T00:54:18.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:18 smithi167 ceph-mon[35234]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T00:54:18.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:18 smithi071 ceph-mon[35276]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T00:54:18.867 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T00:54:18.867 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:18.867 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:54:18.867 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:18.868 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T00:54:18.873 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:54:18.897 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:54:18.899 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:54:18.899 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:54:19.593 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:54:19.670 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:54:19.711 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:54:19.713 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:54:19.713 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:54:19.753 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:54:19.757 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T00:54:19.757 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:54:19.815 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-12T00:54:19.817 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-12T00:54:19.817 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-12T00:54:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:+ set -e 2024-09-12T00:54:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-12T00:54:19.882 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into 'xfstests-dev'... 2024-09-12T00:54:20.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:20 smithi002 ceph-mon[31210]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T00:54:20.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:20 smithi167 ceph-mon[35234]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T00:54:20.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:20 smithi071 ceph-mon[35276]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T00:54:22.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:22 smithi002 ceph-mon[31210]: pgmap v46: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-12T00:54:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:22 smithi167 ceph-mon[35234]: pgmap v46: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-12T00:54:22.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:22 smithi071 ceph-mon[35276]: pgmap v46: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-12T00:54:24.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:24 smithi167 ceph-mon[35234]: pgmap v47: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-09-12T00:54:24.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:24 smithi071 ceph-mon[35276]: pgmap v47: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-09-12T00:54:24.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:24 smithi002 ceph-mon[31210]: pgmap v47: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-09-12T00:54:26.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:26 smithi167 ceph-mon[35234]: pgmap v48: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-09-12T00:54:26.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:26 smithi071 ceph-mon[35276]: pgmap v48: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-09-12T00:54:26.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:26 smithi002 ceph-mon[31210]: pgmap v48: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-09-12T00:54:27.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:27 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:54:27.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:27 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:54:27.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:27 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:54:28.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:28 smithi167 ceph-mon[35234]: pgmap v49: 97 pgs: 97 active+clean; 16 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-09-12T00:54:28.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:28 smithi167 ceph-mon[35234]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T00:54:28.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:28 smithi071 ceph-mon[35276]: pgmap v49: 97 pgs: 97 active+clean; 16 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-09-12T00:54:28.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:28 smithi071 ceph-mon[35276]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T00:54:28.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:28 smithi002 ceph-mon[31210]: pgmap v49: 97 pgs: 97 active+clean; 16 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-09-12T00:54:28.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:28 smithi002 ceph-mon[31210]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T00:54:30.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:30 smithi167 ceph-mon[35234]: pgmap v50: 97 pgs: 97 active+clean; 16 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-09-12T00:54:30.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:30 smithi071 ceph-mon[35276]: pgmap v50: 97 pgs: 97 active+clean; 16 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-09-12T00:54:30.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:30 smithi002 ceph-mon[31210]: pgmap v50: 97 pgs: 97 active+clean; 16 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-09-12T00:54:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:32 smithi167 ceph-mon[35234]: pgmap v51: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-09-12T00:54:32.546 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:32 smithi002 ceph-mon[31210]: pgmap v51: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-09-12T00:54:32.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:32 smithi071 ceph-mon[35276]: pgmap v51: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-09-12T00:54:34.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:54:34.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:34 smithi167 ceph-mon[35234]: pgmap v52: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T00:54:34.611 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:34.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:34 smithi071 ceph-mon[35276]: pgmap v52: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T00:54:34.732 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:34 smithi002 ceph-mon[31210]: pgmap v52: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T00:54:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.071+0000 7fe2a6be1640 1 -- 172.21.15.2:0/1681144939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0100a80 msgr2=0x7fe2a0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.071+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/1681144939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0100a80 0x7fe2a0100ee0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009930 tx=0x7fe28c02a420 comp rx=0 tx=0).stop 2024-09-12T00:54:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 -- 172.21.15.2:0/1681144939 shutdown_connections 2024-09-12T00:54:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/1681144939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0101420 0x7fe2a010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/1681144939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0100a80 0x7fe2a0100ee0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/1681144939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2a0106a80 0x7fe2a0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 -- 172.21.15.2:0/1681144939 >> 172.21.15.2:0/1681144939 conn(0x7fe2a00fc7a0 msgr2=0x7fe2a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 -- 172.21.15.2:0/1681144939 shutdown_connections 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 -- 172.21.15.2:0/1681144939 wait complete. 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 Processor -- start 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 -- start start 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2a0100a80 0x7fe2a0197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0101420 0x7fe2a0197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0106a80 0x7fe2a0197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0110ea0 con 0x7fe2a0101420 2024-09-12T00:54:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0110d20 con 0x7fe2a0100a80 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.072+0000 7fe2a6be1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0111020 con 0x7fe2a0106a80 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0101420 0x7fe2a0197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0101420 0x7fe2a0197660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51644/0 (socket says 172.21.15.2:51644) 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 -- 172.21.15.2:0/49023866 learned_addr learned my addr 172.21.15.2:0/49023866 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe2a497d640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2a0100a80 0x7fe2a0197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe2a517e640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0106a80 0x7fe2a0197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 -- 172.21.15.2:0/49023866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0106a80 msgr2=0x7fe2a0197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0106a80 0x7fe2a0197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 -- 172.21.15.2:0/49023866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2a0100a80 msgr2=0x7fe2a0197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2a0100a80 0x7fe2a0197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 -- 172.21.15.2:0/49023866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a01a6990 con 0x7fe2a0101420 2024-09-12T00:54:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe2a517e640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0106a80 0x7fe2a0197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29ffff640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0101420 0x7fe2a0197660 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009a50 tx=0x7fe28c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29dffb640 1 -- 172.21.15.2:0/49023866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c03f030 con 0x7fe2a0101420 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe2a6be1640 1 -- 172.21.15.2:0/49023866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a01a6c20 con 0x7fe2a0101420 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29dffb640 1 -- 172.21.15.2:0/49023866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28c003ce0 con 0x7fe2a0101420 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.073+0000 7fe29dffb640 1 -- 172.21.15.2:0/49023866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c035070 con 0x7fe2a0101420 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.074+0000 7fe2a6be1640 1 -- 172.21.15.2:0/49023866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a01a7100 con 0x7fe2a0101420 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe29dffb640 1 -- 172.21.15.2:0/49023866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe28c042030 con 0x7fe2a0101420 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe2a8fba740 1 Processor -- start 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe2a8fba740 1 -- start start 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 0x55db06098880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db05ffe2e0 con 0x55db06098dc0 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55db05fa5ce0 con 0x55db060984a0 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55db05ffa2a0 con 0x55db060a3680 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.076+0000 7fe29dffb640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2900a2cf0 0x7fe2900a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51652/0 (socket says 172.21.15.2:51652) 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 -- 172.21.15.2:0/1251720255 learned_addr learned my addr 172.21.15.2:0/1251720255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a517e640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2900a2cf0 0x7fe2900a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe29dffb640 1 -- 172.21.15.2:0/49023866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe28c0efb30 con 0x7fe2a0101420 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a517e640 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 0x55db06098880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe29ffff640 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 -- 172.21.15.2:0/1251720255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 msgr2=0x55db060a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 -- 172.21.15.2:0/1251720255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 msgr2=0x55db06098880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 0x55db06098880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 -- 172.21.15.2:0/1251720255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db05f8a440 con 0x55db06098dc0 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe29ffff640 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a517e640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2900a2cf0 0x7fe2900a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2980116c0 tx=0x7fe29800a990 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe2a497d640 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a3140 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe29400cbf0 tx=0x7fe29400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b024dcbbc7ba764 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.077+0000 7fe28affd640 1 -- 172.21.15.2:0/1251720255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294010630 con 0x55db06098dc0 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe28affd640 1 -- 172.21.15.2:0/1251720255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe294010cb0 con 0x55db06098dc0 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe28affd640 1 -- 172.21.15.2:0/1251720255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29400fc40 con 0x55db06098dc0 2024-09-12T00:54:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 -- 172.21.15.2:0/1251720255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 msgr2=0x55db060a3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a3140 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe29400cbf0 tx=0x7fe29400e720 comp rx=0 tx=0).stop 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 -- 172.21.15.2:0/1251720255 shutdown_connections 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a3140 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/1251720255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 0x55db06098880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 -- 172.21.15.2:0/1251720255 >> 172.21.15.2:0/1251720255 conn(0x55db06094a30 msgr2=0x55db06094e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 -- 172.21.15.2:0/1251720255 shutdown_connections 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.078+0000 7fe2a8fba740 1 -- 172.21.15.2:0/1251720255 wait complete. 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 1 -- start start 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 1 Processor -- start 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 0x55db060a2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db060a6250 con 0x55db06098dc0 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55db05fb9050 con 0x55db060984a0 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55db060a63d0 con 0x55db060a3680 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a8fba740 10 client.0 _ll_register_callbacks cb 0x55db05ff9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51656/0 (socket says 172.21.15.2:51656) 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe29ffff640 1 -- 172.21.15.2:0/93828336 learned_addr learned my addr 172.21.15.2:0/93828336 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a497d640 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 0x55db060a2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.079+0000 7fe2a517e640 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe29ffff640 1 -- 172.21.15.2:0/93828336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 msgr2=0x55db060a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe29ffff640 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe29ffff640 1 -- 172.21.15.2:0/93828336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 msgr2=0x55db060a2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe29ffff640 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 0x55db060a2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe29ffff640 1 -- 172.21.15.2:0/93828336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db05d6f3c0 con 0x55db06098dc0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe29ffff640 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a0290 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0ed230 tx=0x7fe28c0ba4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ab9e3e4b96106c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe27ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe27ffff640 1 -- 172.21.15.2:0/93828336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c049040 con 0x55db06098dc0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe27ffff640 1 -- 172.21.15.2:0/93828336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe28c03b460 con 0x55db06098dc0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe2a8fba740 1 -- 172.21.15.2:0/93828336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe294010cb0 con 0x55db06098dc0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe27ffff640 1 -- 172.21.15.2:0/93828336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe28c0bc6a0 con 0x55db06098dc0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe2a8fba740 10 client.15678 fetch_fsmap learned FSMap version 26 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe2a8fba740 1 -- 172.21.15.2:0/93828336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55db060b1c20 con 0x55db06098dc0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe27ffff640 1 -- 172.21.15.2:0/93828336 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe294010cb0 con 0x55db06098dc0 2024-09-12T00:54:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe27ffff640 1 -- 172.21.15.2:0/93828336 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fe28c0ed450 con 0x55db06098dc0 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe2a8fba740 10 client.15678 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe2a8fba740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.080+0000 7fe2a8fba740 20 client.15678 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.081+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55db060b30d0 0x55db060b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.081+0000 7fe2a8fba740 4 client.15678 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.081+0000 7fe2a8fba740 1 -- 172.21.15.2:0/93828336 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db0600b850 con 0x55db060b30d0 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.081+0000 7fe2a497d640 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55db060b30d0 0x55db060b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.081+0000 7fe27ffff640 10 client.15678 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.081+0000 7fe2a497d640 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55db060b30d0 0x55db060b5570 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93d4b9b0968561b3 server_cookie=1109d204f350dfe in_seq=0 out_seq=0 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe27ffff640 1 -- 172.21.15.2:0/93828336 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db0600b850 con 0x55db060b30d0 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe27ffff640 10 client.15678 handle_command_reply: tid=0 2024-09-12T00:54:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 client.15678 shutdown 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 -- 172.21.15.2:0/93828336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 msgr2=0x55db060a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a0290 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0ed230 tx=0x7fe28c0ba4b0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 -- 172.21.15.2:0/93828336 shutdown_connections 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55db060b30d0 0x55db060b5570 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060a3680 0x55db060a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db060a0290 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/93828336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060984a0 0x55db060a2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe27ffff640 0 client.15678 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 -- 172.21.15.2:0/93828336 >> 172.21.15.2:0/93828336 conn(0x55db06094a30 msgr2=0x55db0609a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 -- 172.21.15.2:0/93828336 shutdown_connections 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 1 -- 172.21.15.2:0/93828336 wait complete. 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.082+0000 7fe2a8fba740 20 client.15678 trim_cache size 0 max 16384 2024-09-12T00:54:35.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a8fba740 1 Processor -- start 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a8fba740 1 -- start start 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db060af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db0609eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060a3680 0x55db060bae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01b2470 con 0x55db06098dc0 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01afd40 con 0x55db060a3680 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01adb90 con 0x55db060984a0 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db0609eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db0609eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51672/0 (socket says 172.21.15.2:51672) 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe29ffff640 1 -- 172.21.15.2:0/2644485776 learned_addr learned my addr 172.21.15.2:0/2644485776 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a497d640 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db060af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe29ffff640 1 -- 172.21.15.2:0/2644485776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 msgr2=0x55db060af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a517e640 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060a3680 0x55db060bae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe29ffff640 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db060af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe29ffff640 1 -- 172.21.15.2:0/2644485776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060a3680 msgr2=0x55db060bae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe29ffff640 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060a3680 0x55db060bae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe29ffff640 1 -- 172.21.15.2:0/2644485776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0609f240 con 0x55db06098dc0 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a497d640 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db060af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.100+0000 7fe2a517e640 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060a3680 0x55db060bae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe29ffff640 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db0609eb60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0bbf30 tx=0x7fe28c0efdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c59ea32d4ef1ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe28a7fc640 1 -- 172.21.15.2:0/2644485776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c049070 con 0x55db06098dc0 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe28a7fc640 1 -- 172.21.15.2:0/2644485776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28c0bbfa0 con 0x55db06098dc0 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe28a7fc640 1 -- 172.21.15.2:0/2644485776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0bc280 con 0x55db06098dc0 2024-09-12T00:54:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2644485776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 msgr2=0x55db0609eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db0609eb60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0bbf30 tx=0x7fe28c0efdf0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2644485776 shutdown_connections 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db060a3680 0x55db060bae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db06098dc0 0x55db0609eb60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2644485776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db060af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2644485776 >> 172.21.15.2:0/2644485776 conn(0x55db06094a30 msgr2=0x55db0609b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2644485776 shutdown_connections 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.101+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2644485776 wait complete. 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 1 -- start start 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 1 Processor -- start 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db0609d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db06098dc0 0x55db0609d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db060a3680 0x55db0609dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ae200 con 0x55db060a3680 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01af670 con 0x55db06098dc0 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ae8d0 con 0x55db060984a0 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a8fba740 10 client.0 _ll_register_callbacks cb 0x7fe28c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.102+0000 7fe2a517e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db060a3680 0x55db0609dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a517e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db060a3680 0x55db0609dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51688/0 (socket says 172.21.15.2:51688) 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a517e640 1 -- 172.21.15.2:0/2702842783 learned_addr learned my addr 172.21.15.2:0/2702842783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a497d640 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db0609d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe29ffff640 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db06098dc0 0x55db0609d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a517e640 1 -- 172.21.15.2:0/2702842783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 msgr2=0x55db0609d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a517e640 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db0609d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a517e640 1 -- 172.21.15.2:0/2702842783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db06098dc0 msgr2=0x55db0609d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a517e640 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db06098dc0 0x55db0609d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a517e640 1 -- 172.21.15.2:0/2702842783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db060a3350 con 0x55db060a3680 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a517e640 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db060a3680 0x55db0609dc50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe298015940 tx=0x7fe2980012a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd39cf85e7f4b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe27ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe27ffff640 1 -- 172.21.15.2:0/2702842783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298025070 con 0x55db060a3680 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe27ffff640 1 -- 172.21.15.2:0/2702842783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe298012b70 con 0x55db060a3680 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2702842783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe28c0bbfa0 con 0x55db060a3680 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe27ffff640 1 -- 172.21.15.2:0/2702842783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe298031050 con 0x55db060a3680 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a8fba740 10 client.15684 fetch_fsmap learned FSMap version 26 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.103+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2702842783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55db0611dde0 con 0x55db060a3680 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe27ffff640 1 -- 172.21.15.2:0/2702842783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28c0bbfa0 con 0x55db060a3680 2024-09-12T00:54:35.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe27ffff640 1 -- 172.21.15.2:0/2702842783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fe298010040 con 0x55db060a3680 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe2a8fba740 10 client.15684 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe2a8fba740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe2a8fba740 20 client.15684 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55db0611e590 0x55db061209b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe2a8fba740 4 client.15684 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2702842783 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55db06005d60 con 0x55db0611e590 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe2a497d640 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55db0611e590 0x55db061209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe2a497d640 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55db0611e590 0x55db061209b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eeacfe2f842982a server_cookie=93b08391045b9df3 in_seq=0 out_seq=0 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.104+0000 7fe27ffff640 10 client.15684 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe27ffff640 1 -- 172.21.15.2:0/2702842783 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55db06005d60 con 0x55db0611e590 2024-09-12T00:54:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe27ffff640 10 client.15684 handle_command_reply: tid=0 2024-09-12T00:54:35.128 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:54:35.128 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:54:35.128 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:54:35.128 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:54:35.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 client.15684 shutdown 2024-09-12T00:54:35.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2702842783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db060a3680 msgr2=0x55db0609dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db060a3680 0x55db0609dc50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe298015940 tx=0x7fe2980012a0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2702842783 shutdown_connections 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55db0611e590 0x55db061209b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db060a3680 0x55db0609dc50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db06098dc0 0x55db0609d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 --2- 172.21.15.2:0/2702842783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db060984a0 0x55db0609d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2702842783 >> 172.21.15.2:0/2702842783 conn(0x55db06094a30 msgr2=0x55db0609b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe27ffff640 0 client.15684 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2702842783 shutdown_connections 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 1 -- 172.21.15.2:0/2702842783 wait complete. 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.105+0000 7fe2a8fba740 20 client.15684 trim_cache size 0 max 16384 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 -- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2900a2cf0 msgr2=0x7fe2900a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2900a2cf0 0x7fe2900a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2980116c0 tx=0x7fe29800a990 comp rx=0 tx=0).stop 2024-09-12T00:54:35.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 -- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0101420 msgr2=0x7fe2a0197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0101420 0x7fe2a0197660 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009a50 tx=0x7fe28c004270 comp rx=0 tx=0).stop 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 -- 172.21.15.2:0/49023866 shutdown_connections 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2900a2cf0 0x7fe2900a51b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0106a80 0x7fe2a0197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2a0101420 0x7fe2a0197660 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 --2- 172.21.15.2:0/49023866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2a0100a80 0x7fe2a0197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 -- 172.21.15.2:0/49023866 >> 172.21.15.2:0/49023866 conn(0x7fe2a00fc7a0 msgr2=0x7fe2a00fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 -- 172.21.15.2:0/49023866 shutdown_connections 2024-09-12T00:54:35.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:35.106+0000 7fe2a6be1640 1 -- 172.21.15.2:0/49023866 wait complete. 2024-09-12T00:54:35.827 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:54:35.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:54:36.087 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:36.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:36 smithi002 ceph-mon[31210]: pgmap v53: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T00:54:36.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:36 smithi167 ceph-mon[35234]: pgmap v53: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T00:54:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 -- 172.21.15.2:0/2357626091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c102780 msgr2=0x7f046c1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 --2- 172.21.15.2:0/2357626091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c102780 0x7f046c1067d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0458009900 tx=0x7f045802a410 comp rx=0 tx=0).stop 2024-09-12T00:54:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 -- 172.21.15.2:0/2357626091 shutdown_connections 2024-09-12T00:54:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 --2- 172.21.15.2:0/2357626091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f046c106f00 0x7f046c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 --2- 172.21.15.2:0/2357626091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c102780 0x7f046c1067d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 --2- 172.21.15.2:0/2357626091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046c101dd0 0x7f046c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 -- 172.21.15.2:0/2357626091 >> 172.21.15.2:0/2357626091 conn(0x7f046c0fd8b0 msgr2=0x7f046c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 -- 172.21.15.2:0/2357626091 shutdown_connections 2024-09-12T00:54:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.576+0000 7f0472f30640 1 -- 172.21.15.2:0/2357626091 wait complete. 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.577+0000 7f0472f30640 1 Processor -- start 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.577+0000 7f0472f30640 1 -- start start 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.577+0000 7f0472f30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101dd0 0x7f046c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.577+0000 7f0472f30640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046c102780 0x7f046c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.577+0000 7f0472f30640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f046c106f00 0x7f046c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.577+0000 7f0472f30640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f046c111f60 con 0x7f046c101dd0 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.577+0000 7f0472f30640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f046c111de0 con 0x7f046c102780 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.577+0000 7f0472f30640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1120e0 con 0x7f046c106f00 2024-09-12T00:54:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101dd0 0x7f046c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101dd0 0x7f046c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42242/0 (socket says 172.21.15.2:42242) 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 -- 172.21.15.2:0/3327350909 learned_addr learned my addr 172.21.15.2:0/3327350909 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f046bfff640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046c102780 0x7f046c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f04714cd640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f046c106f00 0x7f046c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 -- 172.21.15.2:0/3327350909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f046c106f00 msgr2=0x7f046c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f046c106f00 0x7f046c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 -- 172.21.15.2:0/3327350909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046c102780 msgr2=0x7f046c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046c102780 0x7f046c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 -- 172.21.15.2:0/3327350909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c19d430 con 0x7f046c101dd0 2024-09-12T00:54:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f04714cd640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f046c106f00 0x7f046c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0470ccc640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101dd0 0x7f046c198460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f046000ea60 tx=0x7f046000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0469ffb640 1 -- 172.21.15.2:0/3327350909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046000cde0 con 0x7f046c101dd0 2024-09-12T00:54:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0469ffb640 1 -- 172.21.15.2:0/3327350909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04600035f0 con 0x7f046c101dd0 2024-09-12T00:54:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046c19d720 con 0x7f046c101dd0 2024-09-12T00:54:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.578+0000 7f0469ffb640 1 -- 172.21.15.2:0/3327350909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460010670 con 0x7f046c101dd0 2024-09-12T00:54:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.579+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046c06bc10 con 0x7f046c101dd0 2024-09-12T00:54:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.580+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046c1021b0 con 0x7f046c101dd0 2024-09-12T00:54:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.581+0000 7f0469ffb640 1 -- 172.21.15.2:0/3327350909 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f04600037a0 con 0x7f046c101dd0 2024-09-12T00:54:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.582+0000 7f0469ffb640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f045c0a2cf0 0x7f045c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.582+0000 7f0469ffb640 1 -- 172.21.15.2:0/3327350909 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f04600cf8c0 con 0x7f046c101dd0 2024-09-12T00:54:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.582+0000 7f046bfff640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f045c0a2cf0 0x7f045c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.582+0000 7f046bfff640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f045c0a2cf0 0x7f045c0a51b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0458009230 tx=0x7f04580058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.585+0000 7f0469ffb640 1 -- 172.21.15.2:0/3327350909 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f046009c520 con 0x7f046c101dd0 2024-09-12T00:54:36.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:36 smithi071 ceph-mon[35276]: pgmap v53: 97 pgs: 97 active+clean; 17 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T00:54:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.809+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f046c1997c0 con 0x7f046c101dd0 2024-09-12T00:54:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.810+0000 7f0469ffb640 1 -- 172.21.15.2:0/3327350909 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7f046c1997c0 con 0x7f046c101dd0 2024-09-12T00:54:36.810 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:54:36.810 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:54:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:54:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f045c0a2cf0 msgr2=0x7f045c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f045c0a2cf0 0x7f045c0a51b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0458009230 tx=0x7f04580058d0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101dd0 msgr2=0x7f046c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101dd0 0x7f046c198460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f046000ea60 tx=0x7f046000ef20 comp rx=0 tx=0).stop 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 shutdown_connections 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f045c0a2cf0 0x7f045c0a51b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f046c106f00 0x7f046c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046c102780 0x7f046c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 --2- 172.21.15.2:0/3327350909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101dd0 0x7f046c198460 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.812+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 >> 172.21.15.2:0/3327350909 conn(0x7f046c0fd8b0 msgr2=0x7f046c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.813+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 shutdown_connections 2024-09-12T00:54:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:36.813+0000 7f0472f30640 1 -- 172.21.15.2:0/3327350909 wait complete. 2024-09-12T00:54:37.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:37 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:54:37.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:37 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3327350909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:37.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:54:37.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:37 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:54:37.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:37 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3327350909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:37.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:37 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:54:37.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:37 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3327350909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:37.795 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:38.290 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 16% (697/4351) Updating files: 17% (740/4351) Updating files: 18% (784/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 25% (1088/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 29% (1262/4351) Updating files: 29% (1303/4351) Updating files: 30% (1306/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 36% (1567/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 44% (1915/4351) Updating files: 45% (1958/4351) Updating files: 45% (1993/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 52% (2263/4351) Updating files: 53% (2307/4351) Updating files: 54% (2350/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 57% (2481/4351) Updating files: 58% (2524/4351) Updating files: 59% (2568/4351) Updating files: 60% (2611/4351) Updating files: 60% (2649/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 64% (2809/4351) Updating files: 65% (2829/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 70% (3046/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 75% (3264/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 84% (3655/4351) Updating files: 84% (3657/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 87% (3786/4351) Updating files: 88% (3829/4351) Updating files: 89% (3873/4351) Updating files: 90% (3916/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 95% (4134/4351) Updating files: 96% (4177/4351) Updating files: 97% (4221/4351) Updating files: 97% (4252/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-12T00:54:38.296 INFO:tasks.workunit.client.0.smithi002.stderr:+ cd xfstests-dev 2024-09-12T00:54:38.296 INFO:tasks.workunit.client.0.smithi002.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-12T00:54:38.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.307+0000 7fce444bb640 1 -- 172.21.15.2:0/2298841228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1082a0 msgr2=0x7fce3c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.307+0000 7fce444bb640 1 --2- 172.21.15.2:0/2298841228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1082a0 0x7fce3c10ec40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fce34009930 tx=0x7fce3402a420 comp rx=0 tx=0).stop 2024-09-12T00:54:38.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 -- 172.21.15.2:0/2298841228 shutdown_connections 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 --2- 172.21.15.2:0/2298841228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1082a0 0x7fce3c10ec40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 --2- 172.21.15.2:0/2298841228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce3c1036e0 0x7fce3c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 --2- 172.21.15.2:0/2298841228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c102d30 0x7fce3c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 -- 172.21.15.2:0/2298841228 >> 172.21.15.2:0/2298841228 conn(0x7fce3c0fc7d0 msgr2=0x7fce3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 -- 172.21.15.2:0/2298841228 shutdown_connections 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 -- 172.21.15.2:0/2298841228 wait complete. 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 Processor -- start 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.308+0000 7fce444bb640 1 -- start start 2024-09-12T00:54:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce444bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce3c102d30 0x7fce3c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce444bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1036e0 0x7fce3c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce444bb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c1082a0 0x7fce3c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce444bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1120a0 con 0x7fce3c1036e0 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce444bb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c111f20 con 0x7fce3c1082a0 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce444bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c112220 con 0x7fce3c102d30 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1036e0 0x7fce3c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1036e0 0x7fce3c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42264/0 (socket says 172.21.15.2:42264) 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 -- 172.21.15.2:0/910717778 learned_addr learned my addr 172.21.15.2:0/910717778 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce42a58640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c1082a0 0x7fce3c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce42257640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce3c102d30 0x7fce3c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 -- 172.21.15.2:0/910717778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce3c102d30 msgr2=0x7fce3c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce3c102d30 0x7fce3c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 -- 172.21.15.2:0/910717778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c1082a0 msgr2=0x7fce3c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c1082a0 0x7fce3c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 -- 172.21.15.2:0/910717778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c1a6a00 con 0x7fce3c1036e0 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce41a56640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1036e0 0x7fce3c100ed0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00d950 tx=0x7fce2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce337fe640 1 -- 172.21.15.2:0/910717778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c017070 con 0x7fce3c1036e0 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce337fe640 1 -- 172.21.15.2:0/910717778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c009c30 con 0x7fce3c1036e0 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.309+0000 7fce337fe640 1 -- 172.21.15.2:0/910717778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0047a0 con 0x7fce3c1036e0 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.310+0000 7fce444bb640 1 -- 172.21.15.2:0/910717778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c1a6cf0 con 0x7fce3c1036e0 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.310+0000 7fce444bb640 1 -- 172.21.15.2:0/910717778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c1a7180 con 0x7fce3c1036e0 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.312+0000 7fce337fe640 1 -- 172.21.15.2:0/910717778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fce2c004020 con 0x7fce3c1036e0 2024-09-12T00:54:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.312+0000 7fce46894740 1 Processor -- start 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce46894740 1 -- start start 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce337fe640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce280a2cf0 0x7fce280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce42a58640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce280a2cf0 0x7fce280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce337fe640 1 -- 172.21.15.2:0/910717778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fce2c0cefd0 con 0x7fce3c1036e0 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce46894740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87047090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce46894740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87047a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce46894740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad87054760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce46894740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ad86fad2f0 con 0x55ad870475d0 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce46894740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ad86f54cf0 con 0x55ad87052370 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce46894740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ad86fa92b0 con 0x55ad87048b40 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce41a56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87047a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce41a56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87047a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42268/0 (socket says 172.21.15.2:42268) 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce41a56640 1 -- 172.21.15.2:0/765175821 learned_addr learned my addr 172.21.15.2:0/765175821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.313+0000 7fce42257640 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87047090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce42a58640 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad87054760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce41a56640 1 -- 172.21.15.2:0/765175821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 msgr2=0x55ad87047090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce41a56640 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87047090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce41a56640 1 -- 172.21.15.2:0/765175821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 msgr2=0x55ad87054760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce41a56640 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad87054760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce41a56640 1 -- 172.21.15.2:0/765175821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad86f393a0 con 0x55ad870475d0 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce42a58640 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad87054760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce42a58640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce280a2cf0 0x7fce280a51b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fce34006010 tx=0x7fce34005df0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce41a56640 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87047a10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fce2c097e70 tx=0x7fce2c09b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599a9d20051a2dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce30ff9640 1 -- 172.21.15.2:0/765175821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c009de0 con 0x55ad870475d0 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce30ff9640 1 -- 172.21.15.2:0/765175821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c09b4a0 con 0x55ad870475d0 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.314+0000 7fce30ff9640 1 -- 172.21.15.2:0/765175821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c097b10 con 0x55ad870475d0 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 -- 172.21.15.2:0/765175821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 msgr2=0x55ad87047a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87047a10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fce2c097e70 tx=0x7fce2c09b390 comp rx=0 tx=0).stop 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 -- 172.21.15.2:0/765175821 shutdown_connections 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad87054760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87047a10 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 --2- 172.21.15.2:0/765175821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87047090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 -- 172.21.15.2:0/765175821 >> 172.21.15.2:0/765175821 conn(0x55ad87010310 msgr2=0x55ad87043c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 -- 172.21.15.2:0/765175821 shutdown_connections 2024-09-12T00:54:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 -- 172.21.15.2:0/765175821 wait complete. 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.315+0000 7fce46894740 1 -- start start 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce46894740 1 Processor -- start 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce46894740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87051d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce46894740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce46894740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87052370 0x55ad8704f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce46894740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ad87055010 con 0x55ad870475d0 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce46894740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ad86f68060 con 0x55ad87048b40 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce46894740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ad87055190 con 0x55ad87052370 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce46894740 10 client.0 _ll_register_callbacks cb 0x55ad86cbb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42257640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87051d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42257640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87051d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42282/0 (socket says 172.21.15.2:42282) 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42257640 1 -- 172.21.15.2:0/638339389 learned_addr learned my addr 172.21.15.2:0/638339389 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce41a56640 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42a58640 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87052370 0x55ad8704f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42257640 1 -- 172.21.15.2:0/638339389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87052370 msgr2=0x55ad8704f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42257640 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87052370 0x55ad8704f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42257640 1 -- 172.21.15.2:0/638339389 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 msgr2=0x55ad8704f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42257640 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.316+0000 7fce42257640 1 -- 172.21.15.2:0/638339389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad86d1e3c0 con 0x55ad870475d0 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce42257640 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87051d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fce38011d10 tx=0x7fce3800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137177bd2f12a93a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce25ffb640 1 -- 172.21.15.2:0/638339389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3801f060 con 0x55ad870475d0 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce25ffb640 1 -- 172.21.15.2:0/638339389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fce38017070 con 0x55ad870475d0 2024-09-12T00:54:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 1 -- 172.21.15.2:0/638339389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce2c09b4a0 con 0x55ad870475d0 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce25ffb640 1 -- 172.21.15.2:0/638339389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce38003b80 con 0x55ad870475d0 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 10 client.15702 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 1 -- 172.21.15.2:0/638339389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ad87060b40 con 0x55ad870475d0 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce25ffb640 1 -- 172.21.15.2:0/638339389 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c09b4a0 con 0x55ad870475d0 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce25ffb640 1 -- 172.21.15.2:0/638339389 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fce38022400 con 0x55ad870475d0 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 10 client.15702 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 10 client.15702 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 20 client.15702 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ad87062000 0x55ad87064410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 4 client.15702 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.317+0000 7fce46894740 1 -- 172.21.15.2:0/638339389 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad86fba860 con 0x55ad87062000 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.318+0000 7fce41a56640 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ad87062000 0x55ad87064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.318+0000 7fce41a56640 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ad87062000 0x55ad87064410 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=650455536aebd2da server_cookie=1d112220ab6b2002 in_seq=0 out_seq=0 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.318+0000 7fce25ffb640 10 client.15702 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce25ffb640 1 -- 172.21.15.2:0/638339389 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad86fba860 con 0x55ad87062000 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce25ffb640 10 client.15702 handle_command_reply: tid=0 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 client.15702 shutdown 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 -- 172.21.15.2:0/638339389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 msgr2=0x55ad87051d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87051d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fce38011d10 tx=0x7fce3800f790 comp rx=0 tx=0).stop 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 -- 172.21.15.2:0/638339389 shutdown_connections 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ad87062000 0x55ad87064410 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87052370 0x55ad8704f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce25ffb640 0 client.15702 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 --2- 172.21.15.2:0/638339389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87051d80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 -- 172.21.15.2:0/638339389 >> 172.21.15.2:0/638339389 conn(0x55ad87010310 msgr2=0x55ad87049990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 -- 172.21.15.2:0/638339389 shutdown_connections 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 1 -- 172.21.15.2:0/638339389 wait complete. 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.319+0000 7fce46894740 20 client.15702 trim_cache size 0 max 16384 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.334+0000 7fce46894740 1 Processor -- start 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.334+0000 7fce46894740 1 -- start start 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.334+0000 7fce46894740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad870475d0 0x55ad8704a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.334+0000 7fce46894740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.334+0000 7fce46894740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad87052370 0x55ad87069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.334+0000 7fce46894740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1b24b0 con 0x55ad87052370 2024-09-12T00:54:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.334+0000 7fce46894740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1afd80 con 0x55ad87048b40 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.334+0000 7fce46894740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1adbd0 con 0x55ad870475d0 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce42a58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad87052370 0x55ad87069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce41a56640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce42a58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad87052370 0x55ad87069ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42286/0 (socket says 172.21.15.2:42286) 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce42a58640 1 -- 172.21.15.2:0/4068789491 learned_addr learned my addr 172.21.15.2:0/4068789491 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce42257640 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad870475d0 0x55ad8704a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce41a56640 1 -- 172.21.15.2:0/4068789491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad870475d0 msgr2=0x55ad8704a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce41a56640 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad870475d0 0x55ad8704a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce41a56640 1 -- 172.21.15.2:0/4068789491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad87052370 msgr2=0x55ad87069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce41a56640 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad87052370 0x55ad87069ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce41a56640 1 -- 172.21.15.2:0/4068789491 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad8704ffd0 con 0x55ad87048b40 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce42257640 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad870475d0 0x55ad8704a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce41a56640 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704a6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55ad87044ac0 tx=0x7fce2c09f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c2cd54f761fb2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce27fff640 1 -- 172.21.15.2:0/4068789491 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0b8070 con 0x55ad87048b40 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce27fff640 1 -- 172.21.15.2:0/4068789491 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c084050 con 0x55ad87048b40 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.335+0000 7fce27fff640 1 -- 172.21.15.2:0/4068789491 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c082030 con 0x55ad87048b40 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.336+0000 7fce46894740 1 -- 172.21.15.2:0/4068789491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 msgr2=0x55ad8704a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.336+0000 7fce46894740 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704a6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55ad87044ac0 tx=0x7fce2c09f850 comp rx=0 tx=0).stop 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.336+0000 7fce46894740 1 -- 172.21.15.2:0/4068789491 shutdown_connections 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.336+0000 7fce46894740 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad87052370 0x55ad87069ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.336+0000 7fce46894740 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87048b40 0x55ad8704a6c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.336+0000 7fce46894740 1 --2- 172.21.15.2:0/4068789491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad870475d0 0x55ad8704a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.336+0000 7fce46894740 1 -- 172.21.15.2:0/4068789491 >> 172.21.15.2:0/4068789491 conn(0x55ad87010310 msgr2=0x55ad87042d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.337+0000 7fce46894740 1 -- 172.21.15.2:0/4068789491 shutdown_connections 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.337+0000 7fce46894740 1 -- 172.21.15.2:0/4068789491 wait complete. 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.337+0000 7fce46894740 1 -- start start 2024-09-12T00:54:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.338+0000 7fce46894740 1 Processor -- start 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.338+0000 7fce46894740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87056830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.338+0000 7fce46894740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87056d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.339+0000 7fce46894740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad870cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.339+0000 7fce41a56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87056d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.339+0000 7fce41a56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87056d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:60436/0 (socket says 172.21.15.2:60436) 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.339+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1ae240 con 0x55ad870475d0 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.339+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1af6b0 con 0x55ad87052370 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.339+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1ae910 con 0x55ad87048b40 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.339+0000 7fce41a56640 1 -- 172.21.15.2:0/2675716682 learned_addr learned my addr 172.21.15.2:0/2675716682 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.339+0000 7fce42a58640 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad870cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.340+0000 7fce46894740 10 client.0 _ll_register_callbacks cb 0x7fce38009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.340+0000 7fce42a58640 1 -- 172.21.15.2:0/2675716682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 msgr2=0x55ad87056d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.340+0000 7fce42a58640 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87056d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.340+0000 7fce42a58640 1 -- 172.21.15.2:0/2675716682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 msgr2=0x55ad87056830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.340+0000 7fce42a58640 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87056830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.340+0000 7fce42a58640 1 -- 172.21.15.2:0/2675716682 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad870cc1f0 con 0x55ad87052370 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce42a58640 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad870cbcb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce34009230 tx=0x7fce3402a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9493635ade74ad40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce2c084050 con 0x55ad87052370 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce25ffb640 1 -- 172.21.15.2:0/2675716682 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34035040 con 0x55ad87052370 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce25ffb640 1 -- 172.21.15.2:0/2675716682 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fce34003d40 con 0x55ad87052370 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce25ffb640 1 -- 172.21.15.2:0/2675716682 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce3403d450 con 0x55ad87052370 2024-09-12T00:54:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 10 client.25385 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ad870cd2a0 con 0x55ad87052370 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce25ffb640 1 -- 172.21.15.2:0/2675716682 <== mon.2 v2:172.21.15.71:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fce34052020 con 0x55ad87052370 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 10 client.25385 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 10 client.25385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 20 client.25385 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ad87062000 0x55ad870d8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 4 client.25385 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.341+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad86fb4d70 con 0x55ad87062000 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.342+0000 7fce42257640 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ad87062000 0x55ad870d8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.342+0000 7fce25ffb640 10 client.25385 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.342+0000 7fce42257640 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ad87062000 0x55ad870d8290 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87d899a31b3d2901 server_cookie=7d6231957dc39ea in_seq=0 out_seq=0 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce25ffb640 1 -- 172.21.15.2:0/2675716682 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad86fb4d70 con 0x55ad87062000 2024-09-12T00:54:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce25ffb640 10 client.25385 handle_command_reply: tid=0 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 client.25385 shutdown 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 msgr2=0x55ad870cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad870cbcb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce34009230 tx=0x7fce3402a420 comp rx=0 tx=0).stop 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 shutdown_connections 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ad87062000 0x55ad870d8290 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce25ffb640 0 client.25385 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad87052370 0x55ad870cbcb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad87048b40 0x55ad87056d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 --2- 172.21.15.2:0/2675716682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad870475d0 0x55ad87056830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 >> 172.21.15.2:0/2675716682 conn(0x55ad87010310 msgr2=0x55ad87050890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.343+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 shutdown_connections 2024-09-12T00:54:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce46894740 1 -- 172.21.15.2:0/2675716682 wait complete. 2024-09-12T00:54:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce46894740 20 client.25385 trim_cache size 0 max 16384 2024-09-12T00:54:38.357 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:54:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 -- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce280a2cf0 msgr2=0x7fce280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce280a2cf0 0x7fce280a51b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fce34006010 tx=0x7fce34005df0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 -- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1036e0 msgr2=0x7fce3c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1036e0 0x7fce3c100ed0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00d950 tx=0x7fce2c00de10 comp rx=0 tx=0).stop 2024-09-12T00:54:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 -- 172.21.15.2:0/910717778 shutdown_connections 2024-09-12T00:54:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce280a2cf0 0x7fce280a51b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c1082a0 0x7fce3c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce3c1036e0 0x7fce3c100ed0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 --2- 172.21.15.2:0/910717778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce3c102d30 0x7fce3c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 -- 172.21.15.2:0/910717778 >> 172.21.15.2:0/910717778 conn(0x7fce3c0fc7d0 msgr2=0x7fce3c105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.344+0000 7fce444bb640 1 -- 172.21.15.2:0/910717778 shutdown_connections 2024-09-12T00:54:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:38.345+0000 7fce444bb640 1 -- 172.21.15.2:0/910717778 wait complete. 2024-09-12T00:54:38.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:38 smithi002 ceph-mon[31210]: pgmap v54: 97 pgs: 97 active+clean; 21 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 1.7 MiB/s wr, 36 op/s 2024-09-12T00:54:38.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:38 smithi071 ceph-mon[35276]: pgmap v54: 97 pgs: 97 active+clean; 21 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 1.7 MiB/s wr, 36 op/s 2024-09-12T00:54:38.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:38 smithi167 ceph-mon[35234]: pgmap v54: 97 pgs: 97 active+clean; 21 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 1.7 MiB/s wr, 36 op/s 2024-09-12T00:54:39.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:54:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1126474211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 msgr2=0x7fbaa0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1126474211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 0x7fbaa0106e60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fba90009930 tx=0x7fba9002a420 comp rx=0 tx=0).stop 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1126474211 shutdown_connections 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1126474211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa0101420 0x7fbaa010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1126474211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa0100a80 0x7fbaa0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1126474211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 0x7fbaa0106e60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1126474211 >> 172.21.15.2:0/1126474211 conn(0x7fbaa00fc7a0 msgr2=0x7fbaa00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1126474211 shutdown_connections 2024-09-12T00:54:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.729+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1126474211 wait complete. 2024-09-12T00:54:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fbaa5d90640 1 Processor -- start 2024-09-12T00:54:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fbaa5d90640 1 -- start start 2024-09-12T00:54:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fbaa5d90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa0100a80 0x7fbaa00fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fbaa5d90640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa0101420 0x7fbaa00fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fbaa5d90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 0x7fbaa00fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fbaa5d90640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa0110e80 con 0x7fbaa0106a80 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fbaa5d90640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa0110d00 con 0x7fbaa0101420 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fbaa5d90640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa0111000 con 0x7fbaa0100a80 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fba9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 0x7fbaa00fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fba9effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa0101420 0x7fbaa00fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fba9effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa0101420 0x7fbaa00fd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38752/0 (socket says 172.21.15.2:38752) 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fba9effd640 1 -- 172.21.15.2:0/1269157739 learned_addr learned my addr 172.21.15.2:0/1269157739 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.730+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa0100a80 0x7fbaa00fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9effd640 1 -- 172.21.15.2:0/1269157739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa0100a80 msgr2=0x7fbaa00fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9effd640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa0100a80 0x7fbaa00fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9effd640 1 -- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 msgr2=0x7fbaa00fd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9effd640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 0x7fbaa00fd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9effd640 1 -- 172.21.15.2:0/1269157739 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa01a6920 con 0x7fbaa0101420 2024-09-12T00:54:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9ffff640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 0x7fbaa00fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9effd640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa0101420 0x7fbaa00fd2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba9400e9f0 tx=0x7fba9400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9cff9640 1 -- 172.21.15.2:0/1269157739 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9400cd80 con 0x7fbaa0101420 2024-09-12T00:54:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1269157739 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa01a6c10 con 0x7fbaa0101420 2024-09-12T00:54:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9cff9640 1 -- 172.21.15.2:0/1269157739 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba94010910 con 0x7fbaa0101420 2024-09-12T00:54:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fba9cff9640 1 -- 172.21.15.2:0/1269157739 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940188f0 con 0x7fbaa0101420 2024-09-12T00:54:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.731+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1269157739 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa01a71a0 con 0x7fbaa0101420 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.733+0000 7fba9cff9640 1 -- 172.21.15.2:0/1269157739 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fba94010ac0 con 0x7fbaa0101420 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fbaa8169740 1 Processor -- start 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fbaa8169740 1 -- start start 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 0x556b736e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 0x556b736f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fbaa8169740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b7364b2f0 con 0x556b736e6b40 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fbaa8169740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556b735f2cf0 con 0x556b736f0370 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fbaa8169740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556b736472b0 con 0x556b736e55d0 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736e5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42332/0 (socket says 172.21.15.2:42332) 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9ffff640 1 -- 172.21.15.2:0/69006988 learned_addr learned my addr 172.21.15.2:0/69006988 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9effd640 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 0x556b736f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 0x556b736e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9ffff640 1 -- 172.21.15.2:0/69006988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 msgr2=0x556b736e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9ffff640 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 0x556b736e5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9ffff640 1 -- 172.21.15.2:0/69006988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 msgr2=0x556b736f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9ffff640 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 0x556b736f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.734+0000 7fba9ffff640 1 -- 172.21.15.2:0/69006988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b735d73a0 con 0x556b736e6b40 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.735+0000 7fba9cff9640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba880a2cf0 0x7fba880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.735+0000 7fba9ffff640 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736e5090 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fba98010710 tx=0x7fba98010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b42bcfa0817cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.735+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba880a2cf0 0x7fba880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.735+0000 7fba9cff9640 1 -- 172.21.15.2:0/1269157739 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba940cf8c0 con 0x7fbaa0101420 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.735+0000 7fba85ffb640 1 -- 172.21.15.2:0/69006988 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9800e8d0 con 0x556b736e6b40 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.735+0000 7fba85ffb640 1 -- 172.21.15.2:0/69006988 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba98012450 con 0x556b736e6b40 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.735+0000 7fba85ffb640 1 -- 172.21.15.2:0/69006988 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9801c650 con 0x556b736e6b40 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 -- 172.21.15.2:0/69006988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 msgr2=0x556b736e5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba880a2cf0 0x7fba880a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba90000c00 tx=0x7fba900058b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736e5090 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fba98010710 tx=0x7fba98010bd0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 -- 172.21.15.2:0/69006988 shutdown_connections 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 0x556b736f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 0x556b736e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 --2- 172.21.15.2:0/69006988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736e5090 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 -- 172.21.15.2:0/69006988 >> 172.21.15.2:0/69006988 conn(0x556b736ae310 msgr2=0x556b736e1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 -- 172.21.15.2:0/69006988 shutdown_connections 2024-09-12T00:54:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 -- 172.21.15.2:0/69006988 wait complete. 2024-09-12T00:54:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.736+0000 7fbaa8169740 1 -- start start 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fbaa8169740 1 Processor -- start 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e55d0 0x556b736efd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ed060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fbaa8169740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b736f3070 con 0x556b736e6b40 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fbaa8169740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556b73606060 con 0x556b736e55d0 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fbaa8169740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556b736f31f0 con 0x556b736f0370 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fbaa8169740 10 client.0 _ll_register_callbacks cb 0x556b733598c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e55d0 0x556b736efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ed060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42340/0 (socket says 172.21.15.2:42340) 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 -- 172.21.15.2:0/4011106171 learned_addr learned my addr 172.21.15.2:0/4011106171 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9ffff640 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 -- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 msgr2=0x556b736ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 -- 172.21.15.2:0/4011106171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e55d0 msgr2=0x556b736efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e55d0 0x556b736efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 -- 172.21.15.2:0/4011106171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b733bc3c0 con 0x556b736e6b40 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9ffff640 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba9effd640 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ed060 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fba9400e9c0 tx=0x7fba940980f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c570d40fcf2d8fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.737+0000 7fba7effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fba7effd640 1 -- 172.21.15.2:0/4011106171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9409c490 con 0x556b736e6b40 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fba7effd640 1 -- 172.21.15.2:0/4011106171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba94018b50 con 0x556b736e6b40 2024-09-12T00:54:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 1 -- 172.21.15.2:0/4011106171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba98012450 con 0x556b736e6b40 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fba7effd640 1 -- 172.21.15.2:0/4011106171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba9409bd90 con 0x556b736e6b40 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 10 client.15717 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 1 -- 172.21.15.2:0/4011106171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556b736feb50 con 0x556b736e6b40 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fba7effd640 1 -- 172.21.15.2:0/4011106171 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba98012450 con 0x556b736e6b40 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fba7effd640 1 -- 172.21.15.2:0/4011106171 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba9409b1e0 con 0x556b736e6b40 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 10 client.15717 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 10 client.15717 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 20 client.15717 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556b736fffb0 0x556b737023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 4 client.15717 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.738+0000 7fbaa8169740 1 -- 172.21.15.2:0/4011106171 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b73658860 con 0x556b736fffb0 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.739+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556b736fffb0 0x556b737023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.739+0000 7fba7effd640 10 client.15717 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:54:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.739+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556b736fffb0 0x556b737023a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99e67ccaee7e5d16 server_cookie=82be4800a9db634c in_seq=0 out_seq=0 2024-09-12T00:54:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fba7effd640 1 -- 172.21.15.2:0/4011106171 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b73658860 con 0x556b736fffb0 2024-09-12T00:54:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fba7effd640 10 client.15717 handle_command_reply: tid=0 2024-09-12T00:54:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 client.15717 shutdown 2024-09-12T00:54:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 -- 172.21.15.2:0/4011106171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 msgr2=0x556b736ed060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ed060 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fba9400e9c0 tx=0x7fba940980f0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 -- 172.21.15.2:0/4011106171 shutdown_connections 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556b736fffb0 0x556b737023a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ed060 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 --2- 172.21.15.2:0/4011106171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e55d0 0x556b736efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 -- 172.21.15.2:0/4011106171 >> 172.21.15.2:0/4011106171 conn(0x556b736ae310 msgr2=0x556b736e7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fba7effd640 0 client.15717 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 -- 172.21.15.2:0/4011106171 shutdown_connections 2024-09-12T00:54:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.740+0000 7fbaa8169740 1 -- 172.21.15.2:0/4011106171 wait complete. 2024-09-12T00:54:39.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.741+0000 7fbaa8169740 20 client.15717 trim_cache size 0 max 16384 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fbaa8169740 1 Processor -- start 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fbaa8169740 1 -- start start 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 0x556b736fc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 0x556b73707c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fbaa8169740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa01b25c0 con 0x556b736e6b40 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fbaa8169740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa01afe90 con 0x556b736f0370 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fbaa8169740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa01adce0 con 0x556b736e55d0 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fba9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fba9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ec040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42344/0 (socket says 172.21.15.2:42344) 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fba9effd640 1 -- 172.21.15.2:0/1352221450 learned_addr learned my addr 172.21.15.2:0/1352221450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.754+0000 7fba9ffff640 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 0x556b73707c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 0x556b736fc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba9effd640 1 -- 172.21.15.2:0/1352221450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 msgr2=0x556b736fc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba9effd640 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 0x556b736fc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba9effd640 1 -- 172.21.15.2:0/1352221450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 msgr2=0x556b73707c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba9effd640 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 0x556b73707c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba9effd640 1 -- 172.21.15.2:0/1352221450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b736ee190 con 0x556b736e6b40 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba9effd640 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ec040 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fba940cfd40 tx=0x7fba9401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0ed5aa9fa1a768 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba857fa640 1 -- 172.21.15.2:0/1352221450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940a4a00 con 0x556b736e6b40 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba857fa640 1 -- 172.21.15.2:0/1352221450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba94097dc0 con 0x556b736e6b40 2024-09-12T00:54:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.755+0000 7fba857fa640 1 -- 172.21.15.2:0/1352221450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94018db0 con 0x556b736e6b40 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 -- 172.21.15.2:0/1352221450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 msgr2=0x556b736ec040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ec040 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fba940cfd40 tx=0x7fba9401f000 comp rx=0 tx=0).stop 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 -- 172.21.15.2:0/1352221450 shutdown_connections 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736f0370 0x556b73707c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e6b40 0x556b736ec040 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1352221450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736e55d0 0x556b736fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 -- 172.21.15.2:0/1352221450 >> 172.21.15.2:0/1352221450 conn(0x556b736ae310 msgr2=0x556b736eb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 -- 172.21.15.2:0/1352221450 shutdown_connections 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 -- 172.21.15.2:0/1352221450 wait complete. 2024-09-12T00:54:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 -- start start 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.756+0000 7fbaa8169740 1 Processor -- start 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e55d0 0x556b736f8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e6b40 0x556b736f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fbaa8169740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736e9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fbaa8169740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa01ae350 con 0x556b736e55d0 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fbaa8169740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa01af7c0 con 0x556b736e6b40 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fbaa8169740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa01aea20 con 0x556b736f0370 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fbaa8169740 10 client.0 _ll_register_callbacks cb 0x7fba9400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e55d0 0x556b736f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e55d0 0x556b736f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42350/0 (socket says 172.21.15.2:42350) 2024-09-12T00:54:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 -- 172.21.15.2:0/1825858875 learned_addr learned my addr 172.21.15.2:0/1825858875 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9effd640 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e6b40 0x556b736f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9ffff640 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736e9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 -- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 msgr2=0x556b736e9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736e9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 -- 172.21.15.2:0/1825858875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e6b40 msgr2=0x556b736f8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e6b40 0x556b736f8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 -- 172.21.15.2:0/1825858875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b736e9d30 con 0x556b736e55d0 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9ffff640 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736e9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba9f7fe640 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e55d0 0x556b736f8660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fba9002a940 tx=0x7fba90009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3945d59bca7f5124 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba7effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba7effd640 1 -- 172.21.15.2:0/1825858875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90035040 con 0x556b736e55d0 2024-09-12T00:54:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fba7effd640 1 -- 172.21.15.2:0/1825858875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba90005040 con 0x556b736e55d0 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.757+0000 7fbaa8169740 1 -- 172.21.15.2:0/1825858875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba94097dc0 con 0x556b736e55d0 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fba7effd640 1 -- 172.21.15.2:0/1825858875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba9005f050 con 0x556b736e55d0 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fbaa8169740 10 client.15723 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fbaa8169740 1 -- 172.21.15.2:0/1825858875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556b7376a5c0 con 0x556b736e55d0 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fba7effd640 1 -- 172.21.15.2:0/1825858875 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba94097dc0 con 0x556b736e55d0 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fba7effd640 1 -- 172.21.15.2:0/1825858875 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba900035f0 con 0x556b736e55d0 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fbaa8169740 10 client.15723 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fbaa8169740 10 client.15723 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fbaa8169740 20 client.15723 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556b7376ad10 0x556b7376d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fbaa8169740 4 client.15723 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:54:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fbaa8169740 1 -- 172.21.15.2:0/1825858875 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b73652d70 con 0x556b7376ad10 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.758+0000 7fba9effd640 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556b7376ad10 0x556b7376d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fba9effd640 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556b7376ad10 0x556b7376d130 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf5252806e066c15 server_cookie=c8874c8cb34b644b in_seq=0 out_seq=0 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fba7effd640 10 client.15723 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fba7effd640 1 -- 172.21.15.2:0/1825858875 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b73652d70 con 0x556b7376ad10 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fba7effd640 10 client.15723 handle_command_reply: tid=0 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 client.15723 shutdown 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 -- 172.21.15.2:0/1825858875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e55d0 msgr2=0x556b736f8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e55d0 0x556b736f8660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fba9002a940 tx=0x7fba90009260 comp rx=0 tx=0).stop 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 -- 172.21.15.2:0/1825858875 shutdown_connections 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556b7376ad10 0x556b7376d130 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b736f0370 0x556b736e9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b736e6b40 0x556b736f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 --2- 172.21.15.2:0/1825858875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b736e55d0 0x556b736f8660 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fba7effd640 0 client.15723 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:54:39.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 -- 172.21.15.2:0/1825858875 >> 172.21.15.2:0/1825858875 conn(0x556b736ae310 msgr2=0x556b736ec150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:39.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 -- 172.21.15.2:0/1825858875 shutdown_connections 2024-09-12T00:54:39.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.759+0000 7fbaa8169740 1 -- 172.21.15.2:0/1825858875 wait complete. 2024-09-12T00:54:39.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa8169740 20 client.15723 trim_cache size 0 max 16384 2024-09-12T00:54:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:54:39.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba880a2cf0 msgr2=0x7fba880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba880a2cf0 0x7fba880a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba90000c00 tx=0x7fba900058b0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1269157739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa0101420 msgr2=0x7fbaa00fd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:39.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa0101420 0x7fbaa00fd2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba9400e9f0 tx=0x7fba9400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1269157739 shutdown_connections 2024-09-12T00:54:39.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba880a2cf0 0x7fba880a51b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa0106a80 0x7fbaa00fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa0101420 0x7fbaa00fd2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 --2- 172.21.15.2:0/1269157739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa0100a80 0x7fbaa00fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1269157739 >> 172.21.15.2:0/1269157739 conn(0x7fbaa00fc7a0 msgr2=0x7fbaa006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1269157739 shutdown_connections 2024-09-12T00:54:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:39.760+0000 7fbaa5d90640 1 -- 172.21.15.2:0/1269157739 wait complete. 2024-09-12T00:54:40.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:40 smithi071 ceph-mon[35276]: pgmap v55: 97 pgs: 97 active+clean; 21 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 513 KiB/s wr, 27 op/s 2024-09-12T00:54:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:40 smithi002 ceph-mon[31210]: pgmap v55: 97 pgs: 97 active+clean; 21 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 513 KiB/s wr, 27 op/s 2024-09-12T00:54:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:40 smithi167 ceph-mon[35234]: pgmap v55: 97 pgs: 97 active+clean; 21 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 513 KiB/s wr, 27 op/s 2024-09-12T00:54:40.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:54:41.137 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 -- 172.21.15.2:0/347459018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55701082a0 msgr2=0x7f557010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 --2- 172.21.15.2:0/347459018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55701082a0 0x7f557010ec40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5568009cd0 tx=0x7f556802a910 comp rx=0 tx=0).stop 2024-09-12T00:54:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 -- 172.21.15.2:0/347459018 shutdown_connections 2024-09-12T00:54:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 --2- 172.21.15.2:0/347459018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55701082a0 0x7f557010ec40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 --2- 172.21.15.2:0/347459018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55701036e0 0x7f5570107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 --2- 172.21.15.2:0/347459018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5570102d30 0x7f5570103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 -- 172.21.15.2:0/347459018 >> 172.21.15.2:0/347459018 conn(0x7f55700fc7d0 msgr2=0x7f55700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 -- 172.21.15.2:0/347459018 shutdown_connections 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 -- 172.21.15.2:0/347459018 wait complete. 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.588+0000 7f5575940640 1 Processor -- start 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f5575940640 1 -- start start 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f5575940640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5570102d30 0x7f5570198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f5575940640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55701036e0 0x7f5570198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f5575940640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55701082a0 0x7f557019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f5575940640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55701120e0 con 0x7f5570102d30 2024-09-12T00:54:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f5575940640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5570111f60 con 0x7f55701082a0 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f556effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5570102d30 0x7f5570198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f5575940640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5570112260 con 0x7f55701036e0 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f556effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5570102d30 0x7f5570198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42376/0 (socket says 172.21.15.2:42376) 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f556effd640 1 -- 172.21.15.2:0/955655887 learned_addr learned my addr 172.21.15.2:0/955655887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f556f7fe640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55701082a0 0x7f557019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.589+0000 7f55667fc640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55701036e0 0x7f5570198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f556effd640 1 -- 172.21.15.2:0/955655887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55701036e0 msgr2=0x7f5570198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f556effd640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55701036e0 0x7f5570198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f556effd640 1 -- 172.21.15.2:0/955655887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55701082a0 msgr2=0x7f557019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f556effd640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55701082a0 0x7f557019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f556effd640 1 -- 172.21.15.2:0/955655887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557019d5d0 con 0x7f5570102d30 2024-09-12T00:54:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f556effd640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5570102d30 0x7f5570198620 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f556000e9f0 tx=0x7f556000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f557493e640 1 -- 172.21.15.2:0/955655887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556000ccc0 con 0x7f5570102d30 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f5575940640 1 -- 172.21.15.2:0/955655887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557019d8c0 con 0x7f5570102d30 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f557493e640 1 -- 172.21.15.2:0/955655887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5560010910 con 0x7f5570102d30 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f557493e640 1 -- 172.21.15.2:0/955655887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600188a0 con 0x7f5570102d30 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.590+0000 7f5575940640 1 -- 172.21.15.2:0/955655887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55701a51a0 con 0x7f5570102d30 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.592+0000 7f557493e640 1 -- 172.21.15.2:0/955655887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f5560010ac0 con 0x7f5570102d30 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f5577d19740 1 Processor -- start 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f5577d19740 1 -- start start 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f5577d19740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a37090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f5577d19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a37a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f5577d19740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a44760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f5577d19740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557c1899d2f0 con 0x557c18a42370 2024-09-12T00:54:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f5577d19740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557c18944cf0 con 0x557c18a38b40 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f5577d19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557c189992b0 con 0x557c18a375d0 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f556f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a37090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f55667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a44760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f556f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a37090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38812/0 (socket says 172.21.15.2:38812) 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.593+0000 7f556f7fe640 1 -- 172.21.15.2:0/3011898701 learned_addr learned my addr 172.21.15.2:0/3011898701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556effd640 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a37a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f557493e640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f555c0a2cf0 0x7f555c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556f7fe640 1 -- 172.21.15.2:0/3011898701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 msgr2=0x557c18a37a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556f7fe640 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a37a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556f7fe640 1 -- 172.21.15.2:0/3011898701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 msgr2=0x557c18a44760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556f7fe640 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a44760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556f7fe640 1 -- 172.21.15.2:0/3011898701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c189293a0 con 0x557c18a38b40 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f55667fc640 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a44760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f557493e640 1 -- 172.21.15.2:0/955655887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f55600cf8f0 con 0x7f5570102d30 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556f7fe640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f555c0a2cf0 0x7f555c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556f7fe640 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a37090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5568035000 tx=0x7f5568009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=390f46cacfa51582 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f5565ffb640 1 -- 172.21.15.2:0/3011898701 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568042040 con 0x557c18a38b40 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f556f7fe640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f555c0a2cf0 0x7f555c0a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f556804d000 tx=0x7f556804e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f5565ffb640 1 -- 172.21.15.2:0/3011898701 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5568036070 con 0x557c18a38b40 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.594+0000 7f5565ffb640 1 -- 172.21.15.2:0/3011898701 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55680046a0 con 0x557c18a38b40 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 -- 172.21.15.2:0/3011898701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 msgr2=0x557c18a37090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a37090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5568035000 tx=0x7f5568009780 comp rx=0 tx=0).stop 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 -- 172.21.15.2:0/3011898701 shutdown_connections 2024-09-12T00:54:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a44760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a37a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 --2- 172.21.15.2:0/3011898701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a37090 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 -- 172.21.15.2:0/3011898701 >> 172.21.15.2:0/3011898701 conn(0x557c18a00310 msgr2=0x557c18a33c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 -- 172.21.15.2:0/3011898701 shutdown_connections 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.595+0000 7f5577d19740 1 -- 172.21.15.2:0/3011898701 wait complete. 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 1 -- start start 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 1 Processor -- start 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a41d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a3f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a3f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557c18a45070 con 0x557c18a42370 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557c18958060 con 0x557c18a38b40 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557c18a451f0 con 0x557c18a375d0 2024-09-12T00:54:41.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.596+0000 7f5577d19740 10 client.0 _ll_register_callbacks cb 0x557c186ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a3f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a3f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38828/0 (socket says 172.21.15.2:38828) 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 -- 172.21.15.2:0/2359375423 learned_addr learned my addr 172.21.15.2:0/2359375423 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f556f7fe640 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a3f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f556effd640 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a41d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 -- 172.21.15.2:0/2359375423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 msgr2=0x557c18a41d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a41d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 -- 172.21.15.2:0/2359375423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 msgr2=0x557c18a3f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a3f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 -- 172.21.15.2:0/2359375423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c1870e3c0 con 0x557c18a38b40 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f556f7fe640 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a3f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f55667fc640 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a3f040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5558011570 tx=0x7f5558011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc579ce1c69dcdb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:41.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f554effd640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:54:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f554effd640 1 -- 172.21.15.2:0/2359375423 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558013670 con 0x557c18a38b40 2024-09-12T00:54:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f554effd640 1 -- 172.21.15.2:0/2359375423 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5558013810 con 0x557c18a38b40 2024-09-12T00:54:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f5577d19740 1 -- 172.21.15.2:0/2359375423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5568036070 con 0x557c18a38b40 2024-09-12T00:54:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f554effd640 1 -- 172.21.15.2:0/2359375423 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5558013a10 con 0x557c18a38b40 2024-09-12T00:54:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f5577d19740 10 client.25415 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.597+0000 7f5577d19740 1 -- 172.21.15.2:0/2359375423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557c18a50b90 con 0x557c18a38b40 2024-09-12T00:54:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f554effd640 1 -- 172.21.15.2:0/2359375423 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5568036070 con 0x557c18a38b40 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f554effd640 1 -- 172.21.15.2:0/2359375423 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5558025400 con 0x557c18a38b40 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f5577d19740 10 client.25415 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f5577d19740 10 client.25415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f5577d19740 20 client.25415 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f5577d19740 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557c18a520f0 0x557c18a54520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f5577d19740 4 client.25415 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f5577d19740 1 -- 172.21.15.2:0/2359375423 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c189aa860 con 0x557c18a520f0 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f556effd640 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557c18a520f0 0x557c18a54520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f554effd640 10 client.25415 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.598+0000 7f556effd640 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557c18a520f0 0x557c18a54520 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4286202add3c569e server_cookie=b7c71f57049b5dd9 in_seq=0 out_seq=0 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f554effd640 1 -- 172.21.15.2:0/2359375423 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c189aa860 con 0x557c18a520f0 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f554effd640 10 client.25415 handle_command_reply: tid=0 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 client.25415 shutdown 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 -- 172.21.15.2:0/2359375423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 msgr2=0x557c18a3f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a3f040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5558011570 tx=0x7f5558011a30 comp rx=0 tx=0).stop 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 -- 172.21.15.2:0/2359375423 shutdown_connections 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557c18a520f0 0x557c18a54520 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18a3f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a3f040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 --2- 172.21.15.2:0/2359375423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a41d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f554effd640 0 client.25415 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 -- 172.21.15.2:0/2359375423 >> 172.21.15.2:0/2359375423 conn(0x557c18a00310 msgr2=0x557c18a39960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:41.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.602+0000 7f5577d19740 1 -- 172.21.15.2:0/2359375423 shutdown_connections 2024-09-12T00:54:41.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.603+0000 7f5577d19740 1 -- 172.21.15.2:0/2359375423 wait complete. 2024-09-12T00:54:41.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.603+0000 7f5577d19740 20 client.25415 trim_cache size 0 max 16384 2024-09-12T00:54:41.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.615+0000 7f5577d19740 1 Processor -- start 2024-09-12T00:54:41.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.615+0000 7f5577d19740 1 -- start start 2024-09-12T00:54:41.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f5577d19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a3d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f5577d19740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a38b40 0x557c18a3a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f5577d19740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a42370 0x557c18a3a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f5577d19740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55701b0280 con 0x557c18a38b40 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f5577d19740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55701adb50 con 0x557c18a42370 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f5577d19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55701ab9a0 con 0x557c18a375d0 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f55667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a38b40 0x557c18a3a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f55667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a38b40 0x557c18a3a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42398/0 (socket says 172.21.15.2:42398) 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f55667fc640 1 -- 172.21.15.2:0/2444630156 learned_addr learned my addr 172.21.15.2:0/2444630156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f556f7fe640 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a42370 0x557c18a3a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f556effd640 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a3d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f556effd640 1 -- 172.21.15.2:0/2444630156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a42370 msgr2=0x557c18a3a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f556effd640 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a42370 0x557c18a3a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f556effd640 1 -- 172.21.15.2:0/2444630156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a38b40 msgr2=0x557c18a3a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f556effd640 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a38b40 0x557c18a3a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f556effd640 1 -- 172.21.15.2:0/2444630156 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c18a3ffe0 con 0x557c18a375d0 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f55667fc640 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a38b40 0x557c18a3a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.616+0000 7f556effd640 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a3d910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f55600ccf90 tx=0x7f55600d1d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=372ed6a66b61fb88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f55657fa640 1 -- 172.21.15.2:0/2444630156 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600a0110 con 0x557c18a375d0 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f55657fa640 1 -- 172.21.15.2:0/2444630156 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55600a49d0 con 0x557c18a375d0 2024-09-12T00:54:41.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f55657fa640 1 -- 172.21.15.2:0/2444630156 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600cd210 con 0x557c18a375d0 2024-09-12T00:54:41.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 -- 172.21.15.2:0/2444630156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 msgr2=0x557c18a3d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a3d910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f55600ccf90 tx=0x7f55600d1d40 comp rx=0 tx=0).stop 2024-09-12T00:54:41.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 -- 172.21.15.2:0/2444630156 shutdown_connections 2024-09-12T00:54:41.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a42370 0x557c18a3a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a38b40 0x557c18a3a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 --2- 172.21.15.2:0/2444630156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a3d910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 -- 172.21.15.2:0/2444630156 >> 172.21.15.2:0/2444630156 conn(0x557c18a00310 msgr2=0x557c18a410c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 -- 172.21.15.2:0/2444630156 shutdown_connections 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.617+0000 7f5577d19740 1 -- 172.21.15.2:0/2444630156 wait complete. 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 1 -- start start 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 1 Processor -- start 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a46590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a46ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18abbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55701ac010 con 0x557c18a42370 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55701ad480 con 0x557c18a38b40 2024-09-12T00:54:41.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55701ac6e0 con 0x557c18a375d0 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f5577d19740 10 client.0 _ll_register_callbacks cb 0x7f55580095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f556effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a46590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f556f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18abbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f55667fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a46ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f556effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a46590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:60552/0 (socket says 172.21.15.2:60552) 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.618+0000 7f556effd640 1 -- 172.21.15.2:0/3683131419 learned_addr learned my addr 172.21.15.2:0/3683131419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f55667fc640 1 -- 172.21.15.2:0/3683131419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 msgr2=0x557c18a46590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f55667fc640 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a46590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f55667fc640 1 -- 172.21.15.2:0/3683131419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 msgr2=0x557c18abbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f55667fc640 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18abbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f55667fc640 1 -- 172.21.15.2:0/3683131419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c18a334f0 con 0x557c18a38b40 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f556effd640 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a46590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f556f7fe640 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18abbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f55667fc640 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a46ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5558009270 tx=0x7f5558025630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52fefb797865395a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f554effd640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f554effd640 1 -- 172.21.15.2:0/3683131419 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558025e60 con 0x557c18a38b40 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f5577d19740 1 -- 172.21.15.2:0/3683131419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55600a49d0 con 0x557c18a38b40 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f554effd640 1 -- 172.21.15.2:0/3683131419 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5558013db0 con 0x557c18a38b40 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f554effd640 1 -- 172.21.15.2:0/3683131419 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5558025ca0 con 0x557c18a38b40 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f5577d19740 10 client.25421 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f5577d19740 1 -- 172.21.15.2:0/3683131419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557c18abd280 con 0x557c18a38b40 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.619+0000 7f554effd640 1 -- 172.21.15.2:0/3683131419 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55600a49d0 con 0x557c18a38b40 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f554effd640 1 -- 172.21.15.2:0/3683131419 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f555802c070 con 0x557c18a38b40 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f5577d19740 10 client.25421 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f5577d19740 10 client.25421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f5577d19740 20 client.25421 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f5577d19740 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557c18abd930 0x557c18abfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f5577d19740 4 client.25421 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:54:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f5577d19740 1 -- 172.21.15.2:0/3683131419 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c189a4d70 con 0x557c18abd930 2024-09-12T00:54:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f556effd640 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557c18abd930 0x557c18abfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f556effd640 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557c18abd930 0x557c18abfd50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d45093fe1b092bb1 server_cookie=a5c4c67d1c760e5c in_seq=0 out_seq=0 2024-09-12T00:54:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.620+0000 7f554effd640 10 client.25421 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f554effd640 1 -- 172.21.15.2:0/3683131419 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c189a4d70 con 0x557c18abd930 2024-09-12T00:54:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f554effd640 10 client.25421 handle_command_reply: tid=0 2024-09-12T00:54:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 client.25421 shutdown 2024-09-12T00:54:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 -- 172.21.15.2:0/3683131419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 msgr2=0x557c18a46ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a46ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5558009270 tx=0x7f5558025630 comp rx=0 tx=0).stop 2024-09-12T00:54:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 -- 172.21.15.2:0/3683131419 shutdown_connections 2024-09-12T00:54:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557c18abd930 0x557c18abfd50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c18a42370 0x557c18abbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c18a38b40 0x557c18a46ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f554effd640 0 client.25421 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 --2- 172.21.15.2:0/3683131419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c18a375d0 0x557c18a46590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 -- 172.21.15.2:0/3683131419 >> 172.21.15.2:0/3683131419 conn(0x557c18a00310 msgr2=0x557c18a324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 -- 172.21.15.2:0/3683131419 shutdown_connections 2024-09-12T00:54:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 1 -- 172.21.15.2:0/3683131419 wait complete. 2024-09-12T00:54:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.624+0000 7f5577d19740 20 client.25421 trim_cache size 0 max 16384 2024-09-12T00:54:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 -- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f555c0a2cf0 msgr2=0x7f555c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f555c0a2cf0 0x7f555c0a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f556804d000 tx=0x7f556804e000 comp rx=0 tx=0).stop 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 -- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5570102d30 msgr2=0x7f5570198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5570102d30 0x7f5570198620 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f556000e9f0 tx=0x7f556000edf0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 -- 172.21.15.2:0/955655887 shutdown_connections 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f555c0a2cf0 0x7f555c0a51b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55701082a0 0x7f557019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55701036e0 0x7f5570198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 --2- 172.21.15.2:0/955655887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5570102d30 0x7f5570198620 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 -- 172.21.15.2:0/955655887 >> 172.21.15.2:0/955655887 conn(0x7f55700fc7d0 msgr2=0x7f5570106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 -- 172.21.15.2:0/955655887 shutdown_connections 2024-09-12T00:54:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:41.625+0000 7f5575940640 1 -- 172.21.15.2:0/955655887 wait complete. 2024-09-12T00:54:42.391 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:42 smithi002 ceph-mon[31210]: pgmap v56: 97 pgs: 97 active+clean; 37 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 2.1 MiB/s wr, 405 op/s 2024-09-12T00:54:42.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:42 smithi071 ceph-mon[35276]: pgmap v56: 97 pgs: 97 active+clean; 37 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 2.1 MiB/s wr, 405 op/s 2024-09-12T00:54:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:42 smithi167 ceph-mon[35234]: pgmap v56: 97 pgs: 97 active+clean; 37 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 2.1 MiB/s wr, 405 op/s 2024-09-12T00:54:43.419 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:54:43.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:54:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 -- 172.21.15.2:0/857358363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 msgr2=0x7f737810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 --2- 172.21.15.2:0/857358363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 0x7f737810d950 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7370009cd0 tx=0x7f737002a8f0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 -- 172.21.15.2:0/857358363 shutdown_connections 2024-09-12T00:54:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 --2- 172.21.15.2:0/857358363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 0x7f737810d950 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 --2- 172.21.15.2:0/857358363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7378100a80 0x7f7378100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 --2- 172.21.15.2:0/857358363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378106a80 0x7f7378106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 -- 172.21.15.2:0/857358363 >> 172.21.15.2:0/857358363 conn(0x7f73780fc7a0 msgr2=0x7f73780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 -- 172.21.15.2:0/857358363 shutdown_connections 2024-09-12T00:54:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.342+0000 7f737ca1c640 1 -- 172.21.15.2:0/857358363 wait complete. 2024-09-12T00:54:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f737ca1c640 1 Processor -- start 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f737ca1c640 1 -- start start 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f737ca1c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378100a80 0x7f7378198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f737ca1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 0x7f7378198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f737ca1c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7378106a80 0x7f737819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f737ca1c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7378111fa0 con 0x7f7378101420 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f737ca1c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7378111e20 con 0x7f7378106a80 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f737ca1c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7378112120 con 0x7f7378100a80 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f736ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 0x7f7378198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.343+0000 7f736ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 0x7f7378198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42424/0 (socket says 172.21.15.2:42424) 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736ffff640 1 -- 172.21.15.2:0/3387847276 learned_addr learned my addr 172.21.15.2:0/3387847276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f7376d9d640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7378106a80 0x7f737819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f737659c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378100a80 0x7f7378198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736ffff640 1 -- 172.21.15.2:0/3387847276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378100a80 msgr2=0x7f7378198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736ffff640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378100a80 0x7f7378198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736ffff640 1 -- 172.21.15.2:0/3387847276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7378106a80 msgr2=0x7f737819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736ffff640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7378106a80 0x7f737819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736ffff640 1 -- 172.21.15.2:0/3387847276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737819d3e0 con 0x7f7378101420 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f737659c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378100a80 0x7f7378198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736ffff640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 0x7f7378198970 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f736000e9f0 tx=0x7f736000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736f7fe640 1 -- 172.21.15.2:0/3387847276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736000cd80 con 0x7f7378101420 2024-09-12T00:54:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f737ca1c640 1 -- 172.21.15.2:0/3387847276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737819d6d0 con 0x7f7378101420 2024-09-12T00:54:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736f7fe640 1 -- 172.21.15.2:0/3387847276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7360010910 con 0x7f7378101420 2024-09-12T00:54:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f736f7fe640 1 -- 172.21.15.2:0/3387847276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360018990 con 0x7f7378101420 2024-09-12T00:54:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.344+0000 7f737ca1c640 1 -- 172.21.15.2:0/3387847276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73781a4fb0 con 0x7f7378101420 2024-09-12T00:54:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.347+0000 7f736f7fe640 1 -- 172.21.15.2:0/3387847276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f7360010ac0 con 0x7f7378101420 2024-09-12T00:54:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737edf5740 1 Processor -- start 2024-09-12T00:54:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737edf5740 1 -- start start 2024-09-12T00:54:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737edf5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e43af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737edf5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43b480 0x560b4e445800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737edf5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e448130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737edf5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b4e3a0280 con 0x560b4e445d40 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737edf5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560b4e347b10 con 0x560b4e43ab60 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737edf5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560b4e39c240 con 0x560b4e43b480 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e43af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f736ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e448130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e43af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38860/0 (socket says 172.21.15.2:38860) 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f7376d9d640 1 -- 172.21.15.2:0/1981080522 learned_addr learned my addr 172.21.15.2:0/1981080522 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.348+0000 7f737659c640 1 --2- 172.21.15.2:0/1981080522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43b480 0x560b4e445800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f7376d9d640 1 -- 172.21.15.2:0/1981080522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43b480 msgr2=0x560b4e445800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f7376d9d640 1 --2- 172.21.15.2:0/1981080522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43b480 0x560b4e445800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f7376d9d640 1 -- 172.21.15.2:0/1981080522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 msgr2=0x560b4e448130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f7376d9d640 1 --2- 172.21.15.2:0/1981080522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e448130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f7376d9d640 1 -- 172.21.15.2:0/1981080522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b4e3541f0 con 0x560b4e43ab60 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f736f7fe640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f73640a2cf0 0x7f73640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f737659c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f73640a2cf0 0x7f73640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f736f7fe640 1 -- 172.21.15.2:0/3387847276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f73600cf880 con 0x7f7378101420 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f7376d9d640 1 --2- 172.21.15.2:0/1981080522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e43af40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7370009410 tx=0x7f7370004aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1f2109dae7c1955 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f736cff9640 1 -- 172.21.15.2:0/1981080522 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73700306e0 con 0x560b4e43ab60 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f736cff9640 1 -- 172.21.15.2:0/1981080522 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7370036030 con 0x560b4e43ab60 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.349+0000 7f736cff9640 1 -- 172.21.15.2:0/1981080522 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73700043c0 con 0x560b4e43ab60 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 -- 172.21.15.2:0/1981080522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 msgr2=0x560b4e43af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737659c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f73640a2cf0 0x7f73640a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x560b4e437f50 tx=0x7f736800b550 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 --2- 172.21.15.2:0/1981080522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e43af40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7370009410 tx=0x7f7370004aa0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 -- 172.21.15.2:0/1981080522 shutdown_connections 2024-09-12T00:54:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 --2- 172.21.15.2:0/1981080522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e448130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 --2- 172.21.15.2:0/1981080522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43b480 0x560b4e445800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 --2- 172.21.15.2:0/1981080522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e43af40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 -- 172.21.15.2:0/1981080522 >> 172.21.15.2:0/1981080522 conn(0x560b4e4370f0 msgr2=0x560b4e4374d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 -- 172.21.15.2:0/1981080522 shutdown_connections 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 -- 172.21.15.2:0/1981080522 wait complete. 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.350+0000 7f737edf5740 1 -- start start 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737edf5740 1 Processor -- start 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737edf5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43ab60 0x560b4e442b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737edf5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43b480 0x560b4e4430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737edf5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e443600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737edf5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b4e44cd20 con 0x560b4e445d40 2024-09-12T00:54:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737edf5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560b4e35af10 con 0x560b4e43b480 2024-09-12T00:54:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737edf5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560b4e44cea0 con 0x560b4e43ab60 2024-09-12T00:54:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737edf5740 10 client.0 _ll_register_callbacks cb 0x560b4e323a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e443600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e443600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42446/0 (socket says 172.21.15.2:42446) 2024-09-12T00:54:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43ab60 0x560b4e442b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f7376d9d640 1 -- 172.21.15.2:0/1259461968 learned_addr learned my addr 172.21.15.2:0/1259461968 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f736ffff640 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43b480 0x560b4e4430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737659c640 1 -- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43b480 msgr2=0x560b4e4430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.351+0000 7f737659c640 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43b480 0x560b4e4430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f737659c640 1 -- 172.21.15.2:0/1259461968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 msgr2=0x560b4e443600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f737659c640 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e443600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f737659c640 1 -- 172.21.15.2:0/1259461968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b4e1116a0 con 0x560b4e43ab60 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f7376d9d640 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e443600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f736ffff640 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43b480 0x560b4e4430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f737659c640 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43ab60 0x560b4e442b80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7368010720 tx=0x7f73680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e076070147be2e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f735dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f735dffb640 1 -- 172.21.15.2:0/1259461968 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736800f990 con 0x560b4e43ab60 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f737edf5740 1 -- 172.21.15.2:0/1259461968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7370036030 con 0x560b4e43ab60 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f735dffb640 1 -- 172.21.15.2:0/1259461968 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f736800fb30 con 0x560b4e43ab60 2024-09-12T00:54:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f735dffb640 1 -- 172.21.15.2:0/1259461968 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f736800fd30 con 0x560b4e43ab60 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f737edf5740 10 client.25378 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f737edf5740 1 -- 172.21.15.2:0/1259461968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b4e4588f0 con 0x560b4e43ab60 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.352+0000 7f735dffb640 1 -- 172.21.15.2:0/1259461968 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7370036030 con 0x560b4e43ab60 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f735dffb640 1 -- 172.21.15.2:0/1259461968 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f736801f4f0 con 0x560b4e43ab60 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f737edf5740 10 client.25378 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f737edf5740 10 client.25378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f737edf5740 20 client.25378 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f737edf5740 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4e459db0 0x560b4e45c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f737edf5740 4 client.25378 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f737edf5740 1 -- 172.21.15.2:0/1259461968 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b4e3ad7f0 con 0x560b4e459db0 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f736ffff640 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4e459db0 0x560b4e45c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f736ffff640 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4e459db0 0x560b4e45c1c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e493fe4fcdf6a62 server_cookie=32d4f0f1a8d9f1bf in_seq=0 out_seq=0 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.353+0000 7f735dffb640 10 client.25378 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.355+0000 7f735dffb640 1 -- 172.21.15.2:0/1259461968 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b4e3ad7f0 con 0x560b4e459db0 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.355+0000 7f735dffb640 10 client.25378 handle_command_reply: tid=0 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.355+0000 7f737edf5740 1 client.25378 shutdown 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 -- 172.21.15.2:0/1259461968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43ab60 msgr2=0x560b4e442b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43ab60 0x560b4e442b80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7368010720 tx=0x7f73680046c0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 -- 172.21.15.2:0/1259461968 shutdown_connections 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4e459db0 0x560b4e45c1c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e445d40 0x560b4e443600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43b480 0x560b4e4430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f735dffb640 0 client.25378 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 --2- 172.21.15.2:0/1259461968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e43ab60 0x560b4e442b80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 -- 172.21.15.2:0/1259461968 >> 172.21.15.2:0/1259461968 conn(0x560b4e4370f0 msgr2=0x560b4e436270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 -- 172.21.15.2:0/1259461968 shutdown_connections 2024-09-12T00:54:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 1 -- 172.21.15.2:0/1259461968 wait complete. 2024-09-12T00:54:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.356+0000 7f737edf5740 20 client.25378 trim_cache size 0 max 16384 2024-09-12T00:54:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737edf5740 1 Processor -- start 2024-09-12T00:54:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737edf5740 1 -- start start 2024-09-12T00:54:44.373 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:44 smithi002 ceph-mon[31210]: pgmap v57: 97 pgs: 97 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.2 MiB/s wr, 444 op/s 2024-09-12T00:54:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737edf5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4449e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737edf5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e461a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737edf5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e461fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737edf5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73781ae0f0 con 0x560b4e43b480 2024-09-12T00:54:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737edf5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73781ab9c0 con 0x560b4e43ab60 2024-09-12T00:54:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737edf5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73781a9810 con 0x560b4e445d40 2024-09-12T00:54:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f736ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e461a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f736ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e461a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42452/0 (socket says 172.21.15.2:42452) 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f736ffff640 1 -- 172.21.15.2:0/1790557636 learned_addr learned my addr 172.21.15.2:0/1790557636 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.374+0000 7f737659c640 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f7376d9d640 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e461fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f736ffff640 1 -- 172.21.15.2:0/1790557636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 msgr2=0x560b4e461fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f736ffff640 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e461fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f736ffff640 1 -- 172.21.15.2:0/1790557636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 msgr2=0x560b4e4449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f736ffff640 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f736ffff640 1 -- 172.21.15.2:0/1790557636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b4e43d9d0 con 0x560b4e43b480 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f737659c640 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f7376d9d640 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e461fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f736ffff640 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e461a90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f73600981b0 tx=0x7f73600d1d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feab2387b0aab4ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f735ffff640 1 -- 172.21.15.2:0/1790557636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736009b6b0 con 0x560b4e43b480 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f735ffff640 1 -- 172.21.15.2:0/1790557636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f736009c450 con 0x560b4e43b480 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.375+0000 7f735ffff640 1 -- 172.21.15.2:0/1790557636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360018b30 con 0x560b4e43b480 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 -- 172.21.15.2:0/1790557636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 msgr2=0x560b4e461a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e461a90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f73600981b0 tx=0x7f73600d1d90 comp rx=0 tx=0).stop 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 -- 172.21.15.2:0/1790557636 shutdown_connections 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e461fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e461a90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 --2- 172.21.15.2:0/1790557636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 -- 172.21.15.2:0/1790557636 >> 172.21.15.2:0/1790557636 conn(0x560b4e4370f0 msgr2=0x560b4e4442d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 -- 172.21.15.2:0/1790557636 shutdown_connections 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 -- 172.21.15.2:0/1790557636 wait complete. 2024-09-12T00:54:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 -- start start 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.376+0000 7f737edf5740 1 Processor -- start 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737edf5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737edf5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e452630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737edf5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e449940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737edf5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73781a9e80 con 0x560b4e43b480 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737edf5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73781ab2f0 con 0x560b4e43ab60 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737edf5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73781aa550 con 0x560b4e445d40 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737edf5740 10 client.0 _ll_register_callbacks cb 0x7f73680103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38874/0 (socket says 172.21.15.2:38874) 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737659c640 1 -- 172.21.15.2:0/1405321242 learned_addr learned my addr 172.21.15.2:0/1405321242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f736ffff640 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e452630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f7376d9d640 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e449940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737659c640 1 -- 172.21.15.2:0/1405321242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 msgr2=0x560b4e449940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737659c640 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e449940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737659c640 1 -- 172.21.15.2:0/1405321242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 msgr2=0x560b4e452630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737659c640 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e452630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f737659c640 1 -- 172.21.15.2:0/1405321242 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b4e44c6a0 con 0x560b4e43ab60 2024-09-12T00:54:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.377+0000 7f7376d9d640 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e449940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f737659c640 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4520f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f736801f6a0 tx=0x7f736801f6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f262f861b5b97b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f735dffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:54:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f735dffb640 1 -- 172.21.15.2:0/1405321242 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368033070 con 0x560b4e43ab60 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f735dffb640 1 -- 172.21.15.2:0/1405321242 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f7368005040 con 0x560b4e43ab60 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f737edf5740 1 -- 172.21.15.2:0/1405321242 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f736009c450 con 0x560b4e43ab60 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f735dffb640 1 -- 172.21.15.2:0/1405321242 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7368045050 con 0x560b4e43ab60 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f737edf5740 10 client.25439 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f737edf5740 1 -- 172.21.15.2:0/1405321242 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b4e4c9640 con 0x560b4e43ab60 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f735dffb640 1 -- 172.21.15.2:0/1405321242 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f736009c450 con 0x560b4e43ab60 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f735dffb640 1 -- 172.21.15.2:0/1405321242 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7368040030 con 0x560b4e43ab60 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f737edf5740 10 client.25439 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f737edf5740 10 client.25439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.378+0000 7f737edf5740 20 client.25439 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.379+0000 7f737edf5740 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4e4c9df0 0x560b4e4cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.379+0000 7f737edf5740 4 client.25439 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:54:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.379+0000 7f737edf5740 1 -- 172.21.15.2:0/1405321242 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560b4e3a7d00 con 0x560b4e4c9df0 2024-09-12T00:54:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.379+0000 7f736ffff640 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4e4c9df0 0x560b4e4cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.379+0000 7f736ffff640 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4e4c9df0 0x560b4e4cc210 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8ff5e6227207aed server_cookie=fc255151fb6a4c7a in_seq=0 out_seq=0 2024-09-12T00:54:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.379+0000 7f735dffb640 10 client.25439 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:44.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:44 smithi071 ceph-mon[35276]: pgmap v57: 97 pgs: 97 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.2 MiB/s wr, 444 op/s 2024-09-12T00:54:44.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:44 smithi167 ceph-mon[35234]: pgmap v57: 97 pgs: 97 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.2 MiB/s wr, 444 op/s 2024-09-12T00:54:44.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f735dffb640 1 -- 172.21.15.2:0/1405321242 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560b4e3a7d00 con 0x560b4e4c9df0 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f735dffb640 10 client.25439 handle_command_reply: tid=0 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 client.25439 shutdown 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 -- 172.21.15.2:0/1405321242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 msgr2=0x560b4e4520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4520f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f736801f6a0 tx=0x7f736801f6d0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 -- 172.21.15.2:0/1405321242 shutdown_connections 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4e4c9df0 0x560b4e4cc210 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b4e445d40 0x560b4e449940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f735dffb640 0 client.25439 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b4e43b480 0x560b4e452630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 --2- 172.21.15.2:0/1405321242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b4e43ab60 0x560b4e4520f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 -- 172.21.15.2:0/1405321242 >> 172.21.15.2:0/1405321242 conn(0x560b4e4370f0 msgr2=0x560b4e436270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:44.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 -- 172.21.15.2:0/1405321242 shutdown_connections 2024-09-12T00:54:44.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.940+0000 7f737edf5740 1 -- 172.21.15.2:0/1405321242 wait complete. 2024-09-12T00:54:44.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737edf5740 20 client.25439 trim_cache size 0 max 16384 2024-09-12T00:54:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:54:44.941 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:54:44.941 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "4b39390d-70c0-4827-af24-3921356ec53b", 2024-09-12T00:54:44.942 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:54:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:54:44.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 -- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f73640a2cf0 msgr2=0x7f73640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f73640a2cf0 0x7f73640a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x560b4e437f50 tx=0x7f736800b550 comp rx=0 tx=0).stop 2024-09-12T00:54:44.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 -- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 msgr2=0x7f7378198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 0x7f7378198970 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f736000e9f0 tx=0x7f736000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 -- 172.21.15.2:0/3387847276 shutdown_connections 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f73640a2cf0 0x7f73640a51b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7378106a80 0x7f737819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7378101420 0x7f7378198970 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 --2- 172.21.15.2:0/3387847276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378100a80 0x7f7378198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.941+0000 7f737ca1c640 1 -- 172.21.15.2:0/3387847276 >> 172.21.15.2:0/3387847276 conn(0x7f73780fc7a0 msgr2=0x7f73780fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.942+0000 7f737ca1c640 1 -- 172.21.15.2:0/3387847276 shutdown_connections 2024-09-12T00:54:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:44.942+0000 7f737ca1c640 1 -- 172.21.15.2:0/3387847276 wait complete. 2024-09-12T00:54:45.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:45 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:54:45.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:45 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:45.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:45 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:54:45.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:54:45.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:45 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:54:45.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:45 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:45.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:45 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:54:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:45 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:54:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:45 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:45.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:45 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:54:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 -- 172.21.15.2:0/3776864511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424102570 msgr2=0x7fc4241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 --2- 172.21.15.2:0/3776864511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424102570 0x7fc4241029b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc418009900 tx=0x7fc41802a480 comp rx=0 tx=0).stop 2024-09-12T00:54:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 -- 172.21.15.2:0/3776864511 shutdown_connections 2024-09-12T00:54:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 --2- 172.21.15.2:0/3776864511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc424102ef0 0x7fc42410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 --2- 172.21.15.2:0/3776864511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424102570 0x7fc4241029b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 --2- 172.21.15.2:0/3776864511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc424100e20 0x7fc424101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 -- 172.21.15.2:0/3776864511 >> 172.21.15.2:0/3776864511 conn(0x7fc4240fc7d0 msgr2=0x7fc4240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 -- 172.21.15.2:0/3776864511 shutdown_connections 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.401+0000 7fc428bf9640 1 -- 172.21.15.2:0/3776864511 wait complete. 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc428bf9640 1 Processor -- start 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc428bf9640 1 -- start start 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc428bf9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424100e20 0x7fc4241985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc428bf9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc424102570 0x7fc424198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc428bf9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc424102ef0 0x7fc42419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc428bf9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc424110ff0 con 0x7fc424100e20 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc428bf9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc424110e70 con 0x7fc424102570 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc428bf9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc424111170 con 0x7fc424102ef0 2024-09-12T00:54:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc42259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424100e20 0x7fc4241985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc42259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424100e20 0x7fc4241985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34394/0 (socket says 172.21.15.2:34394) 2024-09-12T00:54:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.402+0000 7fc42259c640 1 -- 172.21.15.2:0/975656906 learned_addr learned my addr 172.21.15.2:0/975656906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc421d9b640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc424102570 0x7fc424198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc422d9d640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc424102ef0 0x7fc42419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc42259c640 1 -- 172.21.15.2:0/975656906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc424102ef0 msgr2=0x7fc42419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc42259c640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc424102ef0 0x7fc42419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc42259c640 1 -- 172.21.15.2:0/975656906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc424102570 msgr2=0x7fc424198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc42259c640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc424102570 0x7fc424198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc42259c640 1 -- 172.21.15.2:0/975656906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42419d580 con 0x7fc424100e20 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc422d9d640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc424102ef0 0x7fc42419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc42259c640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424100e20 0x7fc4241985d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc41400b4a0 tx=0x7fc41400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc4137fe640 1 -- 172.21.15.2:0/975656906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414014070 con 0x7fc424100e20 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc4137fe640 1 -- 172.21.15.2:0/975656906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc414010af0 con 0x7fc424100e20 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc428bf9640 1 -- 172.21.15.2:0/975656906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42419d870 con 0x7fc424100e20 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc4137fe640 1 -- 172.21.15.2:0/975656906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414017d10 con 0x7fc424100e20 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.403+0000 7fc428bf9640 1 -- 172.21.15.2:0/975656906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4240fcbb0 con 0x7fc424100e20 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.405+0000 7fc4137fe640 1 -- 172.21.15.2:0/975656906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc414017070 con 0x7fc424100e20 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.406+0000 7fc42afd2740 1 Processor -- start 2024-09-12T00:54:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.406+0000 7fc42afd2740 1 -- start start 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc4137fe640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc40c0a2cf0 0x7fc40c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b86813c0 0x55b5b86817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8681ce0 0x55b5b8694950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc4137fe640 1 -- 172.21.15.2:0/975656906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc4140ce760 con 0x7fc424100e20 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 0x55b5b8697280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42afd2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b5b85e72e0 con 0x55b5b86813c0 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42afd2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b5b858ece0 con 0x55b5b8694e90 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42afd2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5b85e32a0 con 0x55b5b8681ce0 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b86813c0 0x55b5b86817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b86813c0 0x55b5b86817a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34402/0 (socket says 172.21.15.2:34402) 2024-09-12T00:54:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc42259c640 1 -- 172.21.15.2:0/4220942403 learned_addr learned my addr 172.21.15.2:0/4220942403 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc422d9d640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc40c0a2cf0 0x7fc40c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.407+0000 7fc422d9d640 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 0x55b5b8697280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc421d9b640 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8681ce0 0x55b5b8694950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc42259c640 1 -- 172.21.15.2:0/4220942403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8681ce0 msgr2=0x55b5b8694950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc42259c640 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8681ce0 0x55b5b8694950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc42259c640 1 -- 172.21.15.2:0/4220942403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 msgr2=0x55b5b8697280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc42259c640 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 0x55b5b8697280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc42259c640 1 -- 172.21.15.2:0/4220942403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b8573440 con 0x55b5b86813c0 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc422d9d640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc40c0a2cf0 0x7fc40c0a51b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc41c005c40 tx=0x7fc41c009bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc42259c640 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b86813c0 0x55b5b86817a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc41409aa40 tx=0x7fc414017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0b857d96a628f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.408+0000 7fc410ff9640 1 -- 172.21.15.2:0/4220942403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41401e070 con 0x55b5b86813c0 2024-09-12T00:54:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.409+0000 7fc410ff9640 1 -- 172.21.15.2:0/4220942403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc41409f0f0 con 0x55b5b86813c0 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.409+0000 7fc410ff9640 1 -- 172.21.15.2:0/4220942403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140973b0 con 0x55b5b86813c0 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 -- 172.21.15.2:0/4220942403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b86813c0 msgr2=0x55b5b86817a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b86813c0 0x55b5b86817a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc41409aa40 tx=0x7fc414017730 comp rx=0 tx=0).stop 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 -- 172.21.15.2:0/4220942403 shutdown_connections 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 0x55b5b8697280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8681ce0 0x55b5b8694950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 --2- 172.21.15.2:0/4220942403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b86813c0 0x55b5b86817a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 -- 172.21.15.2:0/4220942403 >> 172.21.15.2:0/4220942403 conn(0x55b5b867da30 msgr2=0x55b5b867de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 -- 172.21.15.2:0/4220942403 shutdown_connections 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.410+0000 7fc42afd2740 1 -- 172.21.15.2:0/4220942403 wait complete. 2024-09-12T00:54:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.411+0000 7fc42afd2740 1 -- start start 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.411+0000 7fc42afd2740 1 Processor -- start 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.411+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b86948b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.411+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8691b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.411+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8692170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.411+0000 7fc42afd2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b5b86979a0 con 0x55b5b8681ce0 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.411+0000 7fc42afd2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b5b85a2050 con 0x55b5b86813c0 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.411+0000 7fc42afd2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5b8697b20 con 0x55b5b8694e90 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc42afd2740 10 client.0 _ll_register_callbacks cb 0x55b5b85e2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc421d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8691b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc421d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8691b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34412/0 (socket says 172.21.15.2:34412) 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc421d9b640 1 -- 172.21.15.2:0/254856533 learned_addr learned my addr 172.21.15.2:0/254856533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc42259c640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b86948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc422d9d640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8692170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc422d9d640 1 -- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 msgr2=0x55b5b86948b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc422d9d640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b86948b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc422d9d640 1 -- 172.21.15.2:0/254856533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 msgr2=0x55b5b8691b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc422d9d640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8691b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.412+0000 7fc422d9d640 1 -- 172.21.15.2:0/254856533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b83583c0 con 0x55b5b8694e90 2024-09-12T00:54:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.413+0000 7fc421d9b640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8691b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.413+0000 7fc42259c640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b86948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.413+0000 7fc422d9d640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8692170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc41c005fd0 tx=0x7fc41c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4a53f71c73e7371 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.413+0000 7fc409ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:54:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.413+0000 7fc409ffb640 1 -- 172.21.15.2:0/254856533 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c023030 con 0x55b5b8694e90 2024-09-12T00:54:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.414+0000 7fc42afd2740 1 -- 172.21.15.2:0/254856533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc41409f0f0 con 0x55b5b8694e90 2024-09-12T00:54:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.414+0000 7fc409ffb640 1 -- 172.21.15.2:0/254856533 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc41c00eae0 con 0x55b5b8694e90 2024-09-12T00:54:46.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.414+0000 7fc409ffb640 1 -- 172.21.15.2:0/254856533 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc41c02f050 con 0x55b5b8694e90 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.414+0000 7fc42afd2740 10 client.25387 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.414+0000 7fc42afd2740 1 -- 172.21.15.2:0/254856533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5b86a34c0 con 0x55b5b8694e90 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.415+0000 7fc409ffb640 1 -- 172.21.15.2:0/254856533 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc41409f0f0 con 0x55b5b8694e90 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.415+0000 7fc409ffb640 1 -- 172.21.15.2:0/254856533 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc41c004550 con 0x55b5b8694e90 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.415+0000 7fc42afd2740 10 client.25387 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.415+0000 7fc42afd2740 10 client.25387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.415+0000 7fc42afd2740 20 client.25387 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.415+0000 7fc42afd2740 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5b86a4da0 0x55b5b86a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.415+0000 7fc42afd2740 4 client.25387 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.415+0000 7fc42afd2740 1 -- 172.21.15.2:0/254856533 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5b85f4850 con 0x55b5b86a4da0 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.417+0000 7fc42259c640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5b86a4da0 0x55b5b86a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.418+0000 7fc42259c640 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5b86a4da0 0x55b5b86a7200 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd5c6b8047bf971 server_cookie=c25b0c004578cfd9 in_seq=0 out_seq=0 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.418+0000 7fc409ffb640 10 client.25387 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.421+0000 7fc409ffb640 1 -- 172.21.15.2:0/254856533 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5b85f4850 con 0x55b5b86a4da0 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.421+0000 7fc409ffb640 10 client.25387 handle_command_reply: tid=0 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.421+0000 7fc42afd2740 1 client.25387 shutdown 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.421+0000 7fc42afd2740 1 -- 172.21.15.2:0/254856533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 msgr2=0x55b5b8692170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.421+0000 7fc42afd2740 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8692170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc41c005fd0 tx=0x7fc41c004ab0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 1 -- 172.21.15.2:0/254856533 shutdown_connections 2024-09-12T00:54:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5b86a4da0 0x55b5b86a7200 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8692170 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8691b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 1 --2- 172.21.15.2:0/254856533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b86948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 1 -- 172.21.15.2:0/254856533 >> 172.21.15.2:0/254856533 conn(0x55b5b867da30 msgr2=0x55b5b867cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc409ffb640 0 client.25387 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 1 -- 172.21.15.2:0/254856533 shutdown_connections 2024-09-12T00:54:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 1 -- 172.21.15.2:0/254856533 wait complete. 2024-09-12T00:54:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.422+0000 7fc42afd2740 20 client.25387 trim_cache size 0 max 16384 2024-09-12T00:54:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.452+0000 7fc42afd2740 1 Processor -- start 2024-09-12T00:54:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.452+0000 7fc42afd2740 1 -- start start 2024-09-12T00:54:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b86813c0 0x55b5b86a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8693ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 0x55b5b86acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc42afd2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241ae120 con 0x55b5b8681ce0 2024-09-12T00:54:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc42afd2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241ab9f0 con 0x55b5b8694e90 2024-09-12T00:54:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc42afd2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241a9840 con 0x55b5b86813c0 2024-09-12T00:54:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8693ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8693ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34416/0 (socket says 172.21.15.2:34416) 2024-09-12T00:54:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 -- 172.21.15.2:0/3096106352 learned_addr learned my addr 172.21.15.2:0/3096106352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc422d9d640 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 0x55b5b86acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc42259c640 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b86813c0 0x55b5b86a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 -- 172.21.15.2:0/3096106352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b86813c0 msgr2=0x55b5b86a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b86813c0 0x55b5b86a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 -- 172.21.15.2:0/3096106352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 msgr2=0x55b5b86acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 0x55b5b86acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 -- 172.21.15.2:0/3096106352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b8697b10 con 0x55b5b8681ce0 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc421d9b640 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8693ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc418009230 tx=0x7fc418004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf648ef0684139 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.453+0000 7fc40bfff640 1 -- 172.21.15.2:0/3096106352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418035040 con 0x55b5b8681ce0 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc40bfff640 1 -- 172.21.15.2:0/3096106352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4180046c0 con 0x55b5b8681ce0 2024-09-12T00:54:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc40bfff640 1 -- 172.21.15.2:0/3096106352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418003850 con 0x55b5b8681ce0 2024-09-12T00:54:46.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 -- 172.21.15.2:0/3096106352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 msgr2=0x55b5b8693ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8693ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc418009230 tx=0x7fc418004310 comp rx=0 tx=0).stop 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 -- 172.21.15.2:0/3096106352 shutdown_connections 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b8694e90 0x55b5b86acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b8693ad0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3096106352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b86813c0 0x55b5b86a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 -- 172.21.15.2:0/3096106352 >> 172.21.15.2:0/3096106352 conn(0x55b5b867da30 msgr2=0x55b5b86933c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 -- 172.21.15.2:0/3096106352 shutdown_connections 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.454+0000 7fc42afd2740 1 -- 172.21.15.2:0/3096106352 wait complete. 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 1 -- start start 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 1 Processor -- start 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b869d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b86987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8698d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241a9eb0 con 0x55b5b8681ce0 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241ab320 con 0x55b5b86813c0 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241aa580 con 0x55b5b8694e90 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42afd2740 10 client.0 _ll_register_callbacks cb 0x7fc41c0119d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc42259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b869d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc421d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b86987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc421d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b86987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34428/0 (socket says 172.21.15.2:34428) 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc421d9b640 1 -- 172.21.15.2:0/3357298203 learned_addr learned my addr 172.21.15.2:0/3357298203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.455+0000 7fc422d9d640 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8698d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc421d9b640 1 -- 172.21.15.2:0/3357298203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 msgr2=0x55b5b8698d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc421d9b640 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8698d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc421d9b640 1 -- 172.21.15.2:0/3357298203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 msgr2=0x55b5b869d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc421d9b640 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b869d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc421d9b640 1 -- 172.21.15.2:0/3357298203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b8699520 con 0x55b5b8681ce0 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc421d9b640 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b86987e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc418000c00 tx=0x7fc418004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9fda373ce29c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc409ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc409ffb640 1 -- 172.21.15.2:0/3357298203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418035040 con 0x55b5b8681ce0 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc409ffb640 1 -- 172.21.15.2:0/3357298203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc418005510 con 0x55b5b8681ce0 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc42afd2740 1 -- 172.21.15.2:0/3357298203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4180046c0 con 0x55b5b8681ce0 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc409ffb640 1 -- 172.21.15.2:0/3357298203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc418031540 con 0x55b5b8681ce0 2024-09-12T00:54:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc42afd2740 10 client.15777 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc42afd2740 1 -- 172.21.15.2:0/3357298203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5b870fa60 con 0x55b5b8681ce0 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.456+0000 7fc409ffb640 1 -- 172.21.15.2:0/3357298203 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4180046c0 con 0x55b5b8681ce0 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc409ffb640 1 -- 172.21.15.2:0/3357298203 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc418044020 con 0x55b5b8681ce0 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc42afd2740 10 client.15777 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc42afd2740 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc42afd2740 20 client.15777 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5b8710200 0x55b5b8712620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc42afd2740 4 client.15777 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc42afd2740 1 -- 172.21.15.2:0/3357298203 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b5b85eed60 con 0x55b5b8710200 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc42259c640 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5b8710200 0x55b5b8712620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc42259c640 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5b8710200 0x55b5b8712620 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed4b22180a679b6 server_cookie=75aeb9dd6d9fd37c in_seq=0 out_seq=0 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.457+0000 7fc409ffb640 10 client.15777 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc409ffb640 1 -- 172.21.15.2:0/3357298203 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55b5b85eed60 con 0x55b5b8710200 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc409ffb640 10 client.15777 handle_command_reply: tid=0 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 client.15777 shutdown 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 -- 172.21.15.2:0/3357298203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 msgr2=0x55b5b86987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b86987e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc418000c00 tx=0x7fc418004ee0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 -- 172.21.15.2:0/3357298203 shutdown_connections 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b5b8710200 0x55b5b8712620 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b8694e90 0x55b5b8698d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b5b8681ce0 0x55b5b86987e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 --2- 172.21.15.2:0/3357298203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5b86813c0 0x55b5b869d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 -- 172.21.15.2:0/3357298203 >> 172.21.15.2:0/3357298203 conn(0x55b5b867da30 msgr2=0x55b5b868d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc409ffb640 0 client.15777 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.459+0000 7fc42afd2740 1 -- 172.21.15.2:0/3357298203 shutdown_connections 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc42afd2740 1 -- 172.21.15.2:0/3357298203 wait complete. 2024-09-12T00:54:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc42afd2740 20 client.15777 trim_cache size 0 max 16384 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "scrub active (257 inodes in the stack)", 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout: "4b39390d-70c0-4827-af24-3921356ec53b": { 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "4b39390d-70c0-4827-af24-3921356ec53b", 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:54:46.464 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:54:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 -- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc40c0a2cf0 msgr2=0x7fc40c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc40c0a2cf0 0x7fc40c0a51b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc41c005c40 tx=0x7fc41c009bc0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 -- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424100e20 msgr2=0x7fc4241985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424100e20 0x7fc4241985d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc41400b4a0 tx=0x7fc41400b960 comp rx=0 tx=0).stop 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 -- 172.21.15.2:0/975656906 shutdown_connections 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc40c0a2cf0 0x7fc40c0a51b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc424102ef0 0x7fc42419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc424102570 0x7fc424198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 --2- 172.21.15.2:0/975656906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424100e20 0x7fc4241985d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.460+0000 7fc428bf9640 1 -- 172.21.15.2:0/975656906 >> 172.21.15.2:0/975656906 conn(0x7fc4240fc7d0 msgr2=0x7fc42406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.461+0000 7fc428bf9640 1 -- 172.21.15.2:0/975656906 shutdown_connections 2024-09-12T00:54:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:46.461+0000 7fc428bf9640 1 -- 172.21.15.2:0/975656906 wait complete. 2024-09-12T00:54:46.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:46 smithi071 ceph-mon[35276]: pgmap v58: 97 pgs: 97 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.2 MiB/s wr, 444 op/s 2024-09-12T00:54:46.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:46 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:54:46.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:46 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:46.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:46 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:54:46.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:46 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:46 smithi002 ceph-mon[31210]: pgmap v58: 97 pgs: 97 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.2 MiB/s wr, 444 op/s 2024-09-12T00:54:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:46 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:54:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:46 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:46 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:54:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:46 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:46 smithi167 ceph-mon[35234]: pgmap v58: 97 pgs: 97 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.2 MiB/s wr, 444 op/s 2024-09-12T00:54:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:46 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:54:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:46 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:46 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:54:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:46 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:47.411 INFO:tasks.cephfs.filesystem:scrub status for tag:4b39390d-70c0-4827-af24-3921356ec53b - {'path': '/', 'tag': '4b39390d-70c0-4827-af24-3921356ec53b', 'options': 'recursive,force'} 2024-09-12T00:54:47.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:47 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:54:47.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:47 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:47.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:47 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:54:47.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:47 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:47.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:47 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:54:47.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:47 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-12T00:54:48.419 INFO:tasks.workunit.client.0.smithi002.stderr:+ make -j4 2024-09-12T00:54:48.427 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize -cfi 2024-09-12T00:54:48.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:48 smithi071 ceph-mon[35276]: pgmap v59: 97 pgs: 97 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 573 op/s 2024-09-12T00:54:48.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:48 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:54:48.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:48 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:48.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:48 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:54:48.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:48 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:48.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:48 smithi002 ceph-mon[31210]: pgmap v59: 97 pgs: 97 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 573 op/s 2024-09-12T00:54:48.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:48 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:54:48.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:48 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:48.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:48 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:54:48.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:48 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:48.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:48 smithi167 ceph-mon[35234]: pgmap v59: 97 pgs: 97 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 573 op/s 2024-09-12T00:54:48.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:48 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:54:48.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:48 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:48.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:48 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:54:48.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:48 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:48.848 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-12T00:54:48.848 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file './config.guess' 2024-09-12T00:54:48.853 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file './config.sub' 2024-09-12T00:54:48.858 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file './install-sh' 2024-09-12T00:54:48.863 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file './ltmain.sh' 2024-09-12T00:54:48.887 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-12T00:54:48.887 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-12T00:54:48.899 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-12T00:54:48.900 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-12T00:54:48.905 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-12T00:54:48.911 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-12T00:54:48.918 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-12T00:54:48.919 INFO:tasks.workunit.client.0.smithi002.stdout:cp include/install-sh . 2024-09-12T00:54:48.929 INFO:tasks.workunit.client.0.smithi002.stdout:aclocal -I m4 2024-09-12T00:54:49.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:49 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:54:49.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:49 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:49.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:49 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:49.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:49 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:54:49.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:49 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:49.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:49 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:49.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:49 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:54:49.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:49 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:49.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:49 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:54:50.047 INFO:tasks.workunit.client.0.smithi002.stdout:autoheader 2024-09-12T00:54:50.379 INFO:tasks.workunit.client.0.smithi002.stdout:autoconf 2024-09-12T00:54:50.564 INFO:tasks.workunit.client.0.smithi002.stdout:./configure \ 2024-09-12T00:54:50.565 INFO:tasks.workunit.client.0.smithi002.stdout: --libexecdir=/usr/lib \ 2024-09-12T00:54:50.565 INFO:tasks.workunit.client.0.smithi002.stdout: --exec_prefix=/var/lib 2024-09-12T00:54:50.687 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:50 smithi167 ceph-mon[35234]: pgmap v60: 97 pgs: 97 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 552 op/s 2024-09-12T00:54:50.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:50 smithi071 ceph-mon[35276]: pgmap v60: 97 pgs: 97 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 552 op/s 2024-09-12T00:54:50.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:50 smithi002 ceph-mon[31210]: pgmap v60: 97 pgs: 97 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 552 op/s 2024-09-12T00:54:50.804 INFO:tasks.workunit.client.0.smithi002.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-12T00:54:50.805 INFO:tasks.workunit.client.0.smithi002.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-12T00:54:50.806 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to print strings... printf 2024-09-12T00:54:50.806 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc... gcc 2024-09-12T00:54:50.921 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether the C compiler works... yes 2024-09-12T00:54:50.921 INFO:tasks.workunit.client.0.smithi002.stdout:checking for C compiler default output file name... a.out 2024-09-12T00:54:51.007 INFO:tasks.workunit.client.0.smithi002.stdout:checking for suffix of executables... 2024-09-12T00:54:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether we are cross compiling... no 2024-09-12T00:54:51.179 INFO:tasks.workunit.client.0.smithi002.stdout:checking for suffix of object files... o 2024-09-12T00:54:51.217 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T00:54:51.243 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether gcc accepts -g... yes 2024-09-12T00:54:51.550 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-12T00:54:51.554 INFO:tasks.workunit.client.0.smithi002.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-12T00:54:51.559 INFO:tasks.workunit.client.0.smithi002.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-12T00:54:51.560 INFO:tasks.workunit.client.0.smithi002.stdout:checking for egrep... /usr/bin/grep -E 2024-09-12T00:54:51.561 INFO:tasks.workunit.client.0.smithi002.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-12T00:54:51.565 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-12T00:54:51.566 INFO:tasks.workunit.client.0.smithi002.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-12T00:54:51.648 INFO:tasks.workunit.client.0.smithi002.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-12T00:54:52.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:52 smithi071 ceph-mon[35276]: pgmap v61: 97 pgs: 97 active+clean; 55 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 630 op/s 2024-09-12T00:54:52.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:52 smithi002 ceph-mon[31210]: pgmap v61: 97 pgs: 97 active+clean; 55 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 630 op/s 2024-09-12T00:54:52.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:52 smithi167 ceph-mon[35234]: pgmap v61: 97 pgs: 97 active+clean; 55 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 630 op/s 2024-09-12T00:54:53.277 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-12T00:54:53.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:54:53.496 INFO:tasks.workunit.client.0.smithi002.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-12T00:54:53.496 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether ln -s works... yes 2024-09-12T00:54:53.507 INFO:tasks.workunit.client.0.smithi002.stdout:checking the maximum length of command line arguments... 1572864 2024-09-12T00:54:53.510 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-12T00:54:53.510 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-12T00:54:53.511 INFO:tasks.workunit.client.0.smithi002.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-12T00:54:53.511 INFO:tasks.workunit.client.0.smithi002.stdout:checking for objdump... objdump 2024-09-12T00:54:53.512 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to recognize dependent libraries... pass_all 2024-09-12T00:54:53.512 INFO:tasks.workunit.client.0.smithi002.stdout:checking for dlltool... no 2024-09-12T00:54:53.512 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-12T00:54:53.512 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ar... ar 2024-09-12T00:54:53.556 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:53.592 INFO:tasks.workunit.client.0.smithi002.stdout:checking for archiver @FILE support... @ 2024-09-12T00:54:53.592 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strip... strip 2024-09-12T00:54:53.592 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ranlib... ranlib 2024-09-12T00:54:53.592 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gawk... gawk 2024-09-12T00:54:53.692 INFO:tasks.workunit.client.0.smithi002.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-12T00:54:53.693 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sysroot... no 2024-09-12T00:54:53.704 INFO:tasks.workunit.client.0.smithi002.stdout:checking for a working dd... /usr/bin/dd 2024-09-12T00:54:53.714 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-12T00:54:53.746 INFO:tasks.workunit.client.0.smithi002.stdout:checking for mt... no 2024-09-12T00:54:53.757 INFO:tasks.workunit.client.0.smithi002.stdout:checking if : is a manifest tool... no 2024-09-12T00:54:53.862 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T00:54:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc49dd9b640 1 -- 172.21.15.2:0/3659383600 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494031940 con 0x7fc4a0102570 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 -- 172.21.15.2:0/3659383600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0102570 msgr2=0x7fc4a01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/3659383600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0102570 0x7fc4a01029b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc494009900 tx=0x7fc49402a480 comp rx=0 tx=0).stop 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 -- 172.21.15.2:0/3659383600 shutdown_connections 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/3659383600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4a0102ef0 0x7fc4a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/3659383600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0102570 0x7fc4a01029b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/3659383600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0100e20 0x7fc4a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 -- 172.21.15.2:0/3659383600 >> 172.21.15.2:0/3659383600 conn(0x7fc4a00fc7d0 msgr2=0x7fc4a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 -- 172.21.15.2:0/3659383600 shutdown_connections 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.001+0000 7fc4a50f2640 1 -- 172.21.15.2:0/3659383600 wait complete. 2024-09-12T00:54:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.002+0000 7fc4a50f2640 1 Processor -- start 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.002+0000 7fc4a50f2640 1 -- start start 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc4a50f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0100e20 0x7fc4a00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc4a50f2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4a0102570 0x7fc4a00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc4a50f2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0102ef0 0x7fc4a00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc4a50f2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0110f50 con 0x7fc4a0100e20 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc4a50f2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0110dd0 con 0x7fc4a0102570 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc4a50f2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01110d0 con 0x7fc4a0102ef0 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0100e20 0x7fc4a00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0100e20 0x7fc4a00fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34456/0 (socket says 172.21.15.2:34456) 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49ed9d640 1 -- 172.21.15.2:0/1769490744 learned_addr learned my addr 172.21.15.2:0/1769490744 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49e59c640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4a0102570 0x7fc4a00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49f59e640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0102ef0 0x7fc4a00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49ed9d640 1 -- 172.21.15.2:0/1769490744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0102ef0 msgr2=0x7fc4a00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49ed9d640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0102ef0 0x7fc4a00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49ed9d640 1 -- 172.21.15.2:0/1769490744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4a0102570 msgr2=0x7fc4a00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49ed9d640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4a0102570 0x7fc4a00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.003+0000 7fc49ed9d640 1 -- 172.21.15.2:0/1769490744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a01a6a60 con 0x7fc4a0100e20 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.004+0000 7fc49ed9d640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0100e20 0x7fc4a00fcc80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c890 tx=0x7fc49000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.004+0000 7fc487fff640 1 -- 172.21.15.2:0/1769490744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490004220 con 0x7fc4a0100e20 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.004+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a01a6d50 con 0x7fc4a0100e20 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.004+0000 7fc487fff640 1 -- 172.21.15.2:0/1769490744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4900043c0 con 0x7fc4a0100e20 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.004+0000 7fc487fff640 1 -- 172.21.15.2:0/1769490744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490004a00 con 0x7fc4a0100e20 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.004+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a01a7200 con 0x7fc4a0100e20 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.005+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a0101200 con 0x7fc4a0100e20 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.006+0000 7fc487fff640 1 -- 172.21.15.2:0/1769490744 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc4900079b0 con 0x7fc4a0100e20 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.007+0000 7fc487fff640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4880a2cf0 0x7fc4880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.007+0000 7fc487fff640 1 -- 172.21.15.2:0/1769490744 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc4900cf560 con 0x7fc4a0100e20 2024-09-12T00:54:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.007+0000 7fc49e59c640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4880a2cf0 0x7fc4880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.008+0000 7fc49e59c640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4880a2cf0 0x7fc4880a51b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc494009230 tx=0x7fc4940058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.011+0000 7fc487fff640 1 -- 172.21.15.2:0/1769490744 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc490014030 con 0x7fc4a0100e20 2024-09-12T00:54:54.065 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ANSI C header files... yes 2024-09-12T00:54:54.098 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/types.h... yes 2024-09-12T00:54:54.135 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/stat.h... yes 2024-09-12T00:54:54.173 INFO:tasks.workunit.client.0.smithi002.stdout:checking for stdlib.h... yes 2024-09-12T00:54:54.214 INFO:tasks.workunit.client.0.smithi002.stdout:checking for string.h... yes 2024-09-12T00:54:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.230+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4a00fe1b0 con 0x7fc4a0100e20 2024-09-12T00:54:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.231+0000 7fc487fff640 1 -- 172.21.15.2:0/1769490744 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7fc49009c130 con 0x7fc4a0100e20 2024-09-12T00:54:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:54:54.230 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:54:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:54:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4880a2cf0 msgr2=0x7fc4880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4880a2cf0 0x7fc4880a51b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc494009230 tx=0x7fc4940058d0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0100e20 msgr2=0x7fc4a00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0100e20 0x7fc4a00fcc80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c890 tx=0x7fc49000cd50 comp rx=0 tx=0).stop 2024-09-12T00:54:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 shutdown_connections 2024-09-12T00:54:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4880a2cf0 0x7fc4880a51b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0102ef0 0x7fc4a00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4a0102570 0x7fc4a00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 --2- 172.21.15.2:0/1769490744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4a0100e20 0x7fc4a00fcc80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.233+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 >> 172.21.15.2:0/1769490744 conn(0x7fc4a00fc7d0 msgr2=0x7fc4a006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.234+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 shutdown_connections 2024-09-12T00:54:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:54.234+0000 7fc4a50f2640 1 -- 172.21.15.2:0/1769490744 wait complete. 2024-09-12T00:54:54.273 INFO:tasks.workunit.client.0.smithi002.stdout:checking for memory.h... yes 2024-09-12T00:54:54.315 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strings.h... yes 2024-09-12T00:54:54.360 INFO:tasks.workunit.client.0.smithi002.stdout:checking for inttypes.h... yes 2024-09-12T00:54:54.400 INFO:tasks.workunit.client.0.smithi002.stdout:checking for stdint.h... yes 2024-09-12T00:54:54.442 INFO:tasks.workunit.client.0.smithi002.stdout:checking for unistd.h... yes 2024-09-12T00:54:54.516 INFO:tasks.workunit.client.0.smithi002.stdout:checking for dlfcn.h... yes 2024-09-12T00:54:54.522 INFO:tasks.workunit.client.0.smithi002.stdout:checking for objdir... .libs 2024-09-12T00:54:54.640 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-12T00:54:54.640 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-12T00:54:54.684 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-12T00:54:54.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:54 smithi071 ceph-mon[35276]: pgmap v62: 97 pgs: 97 active+clean; 56 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 264 op/s 2024-09-12T00:54:54.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:54 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1769490744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:54.733 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:54 smithi002 ceph-mon[31210]: pgmap v62: 97 pgs: 97 active+clean; 56 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 264 op/s 2024-09-12T00:54:54.733 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:54 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1769490744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:54.771 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc static flag -static works... no 2024-09-12T00:54:54.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:54 smithi167 ceph-mon[35234]: pgmap v62: 97 pgs: 97 active+clean; 56 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 264 op/s 2024-09-12T00:54:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:54 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1769490744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:54:54.839 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc supports -c -o file.o... yes 2024-09-12T00:54:54.839 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-12T00:54:54.845 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-12T00:54:54.929 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether -lc should be explicitly linked in... no 2024-09-12T00:54:54.992 INFO:tasks.workunit.client.0.smithi002.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-12T00:54:54.992 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to hardcode library paths into programs... immediate 2024-09-12T00:54:54.994 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether stripping libraries is possible... yes 2024-09-12T00:54:54.994 INFO:tasks.workunit.client.0.smithi002.stdout:checking if libtool supports shared libraries... yes 2024-09-12T00:54:54.994 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether to build shared libraries... yes 2024-09-12T00:54:54.994 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether to build static libraries... yes 2024-09-12T00:54:55.000 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc... (cached) gcc 2024-09-12T00:54:55.039 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-12T00:54:55.039 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-12T00:54:55.039 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-12T00:54:55.039 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gmake... /usr/bin/gmake 2024-09-12T00:54:55.040 INFO:tasks.workunit.client.0.smithi002.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-12T00:54:55.040 INFO:tasks.workunit.client.0.smithi002.stdout:checking for tar... /bin/tar 2024-09-12T00:54:55.041 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gzip... /bin/gzip 2024-09-12T00:54:55.080 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether gcc -MM is supported... yes 2024-09-12T00:54:55.080 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sort... /bin/sort 2024-09-12T00:54:55.080 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether ln -s works... yes 2024-09-12T00:54:55.080 INFO:tasks.workunit.client.0.smithi002.stdout:checking for rpm... /bin/rpm 2024-09-12T00:54:55.084 INFO:tasks.workunit.client.0.smithi002.stdout:checking for rpmbuild... no 2024-09-12T00:54:55.140 INFO:tasks.workunit.client.0.smithi002.stdout:checking assert.h usability... yes 2024-09-12T00:54:55.146 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-12T00:54:55.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-12T00:54:55.156 INFO:tasks.workunit.client.0.smithi002.stdout:checking assert.h presence... yes 2024-09-12T00:54:55.156 INFO:tasks.workunit.client.0.smithi002.stdout:checking for assert.h... yes 2024-09-12T00:54:55.207 INFO:tasks.workunit.client.0.smithi002.stdout:checking bstring.h usability... no 2024-09-12T00:54:55.234 INFO:tasks.workunit.client.0.smithi002.stdout:checking bstring.h presence... no 2024-09-12T00:54:55.234 INFO:tasks.workunit.client.0.smithi002.stdout:checking for bstring.h... no 2024-09-12T00:54:55.272 INFO:tasks.workunit.client.0.smithi002.stdout:checking libgen.h usability... yes 2024-09-12T00:54:55.288 INFO:tasks.workunit.client.0.smithi002.stdout:checking libgen.h presence... yes 2024-09-12T00:54:55.288 INFO:tasks.workunit.client.0.smithi002.stdout:checking for libgen.h... yes 2024-09-12T00:54:55.340 INFO:tasks.workunit.client.0.smithi002.stdout:checking dirent.h usability... yes 2024-09-12T00:54:55.358 INFO:tasks.workunit.client.0.smithi002.stdout:checking dirent.h presence... yes 2024-09-12T00:54:55.358 INFO:tasks.workunit.client.0.smithi002.stdout:checking for dirent.h... yes 2024-09-12T00:54:55.405 INFO:tasks.workunit.client.0.smithi002.stdout:checking errno.h usability... yes 2024-09-12T00:54:55.410 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:54:55.421 INFO:tasks.workunit.client.0.smithi002.stdout:checking errno.h presence... yes 2024-09-12T00:54:55.421 INFO:tasks.workunit.client.0.smithi002.stdout:checking for errno.h... yes 2024-09-12T00:54:55.483 INFO:tasks.workunit.client.0.smithi002.stdout:checking malloc.h usability... yes 2024-09-12T00:54:55.502 INFO:tasks.workunit.client.0.smithi002.stdout:checking malloc.h presence... yes 2024-09-12T00:54:55.502 INFO:tasks.workunit.client.0.smithi002.stdout:checking for malloc.h... yes 2024-09-12T00:54:55.576 INFO:tasks.workunit.client.0.smithi002.stdout:checking uuid.h usability... no 2024-09-12T00:54:55.604 INFO:tasks.workunit.client.0.smithi002.stdout:checking uuid.h presence... no 2024-09-12T00:54:55.605 INFO:tasks.workunit.client.0.smithi002.stdout:checking for uuid.h... no 2024-09-12T00:54:55.659 INFO:tasks.workunit.client.0.smithi002.stdout:checking uuid/uuid.h usability... yes 2024-09-12T00:54:55.677 INFO:tasks.workunit.client.0.smithi002.stdout:checking uuid/uuid.h presence... yes 2024-09-12T00:54:55.677 INFO:tasks.workunit.client.0.smithi002.stdout:checking for uuid/uuid.h... yes 2024-09-12T00:54:55.735 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/uuid.h usability... no 2024-09-12T00:54:55.762 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/uuid.h presence... no 2024-09-12T00:54:55.762 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/uuid.h... no 2024-09-12T00:54:55.820 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/file.h usability... yes 2024-09-12T00:54:55.836 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/file.h presence... yes 2024-09-12T00:54:55.837 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/file.h... yes 2024-09-12T00:54:55.886 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fcntl.h usability... yes 2024-09-12T00:54:55.902 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fcntl.h presence... yes 2024-09-12T00:54:55.902 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/fcntl.h... yes 2024-09-12T00:54:55.970 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/syssgi.h usability... no 2024-09-12T00:54:55.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 -- 172.21.15.2:0/2652890704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101240 msgr2=0x7f3714101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:55.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 --2- 172.21.15.2:0/2652890704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101240 0x7f3714101680 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3704009900 tx=0x7f370402a410 comp rx=0 tx=0).stop 2024-09-12T00:54:55.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 -- 172.21.15.2:0/2652890704 shutdown_connections 2024-09-12T00:54:55.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 --2- 172.21.15.2:0/2652890704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3714101bc0 0x7f371410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 --2- 172.21.15.2:0/2652890704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101240 0x7f3714101680 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 --2- 172.21.15.2:0/2652890704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3714105a90 0x7f3714105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 -- 172.21.15.2:0/2652890704 >> 172.21.15.2:0/2652890704 conn(0x7f3714077210 msgr2=0x7f37140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 -- 172.21.15.2:0/2652890704 shutdown_connections 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.945+0000 7f371b8a7640 1 -- 172.21.15.2:0/2652890704 wait complete. 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f371b8a7640 1 Processor -- start 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f371b8a7640 1 -- start start 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f371b8a7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3714101240 0x7f3714197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f371b8a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101bc0 0x7f37141979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f371b8a7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3714105a90 0x7f371419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f371b8a7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3714110fb0 con 0x7f3714101bc0 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f371b8a7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3714110e30 con 0x7f3714101240 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f371b8a7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3714111130 con 0x7f3714105a90 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3718e42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101bc0 0x7f37141979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3718e42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101bc0 0x7f37141979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44408/0 (socket says 172.21.15.2:44408) 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3718e42640 1 -- 172.21.15.2:0/3458515098 learned_addr learned my addr 172.21.15.2:0/3458515098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3719643640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3714101240 0x7f3714197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3719e44640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3714105a90 0x7f371419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3718e42640 1 -- 172.21.15.2:0/3458515098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3714105a90 msgr2=0x7f371419bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3718e42640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3714105a90 0x7f371419bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3718e42640 1 -- 172.21.15.2:0/3458515098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3714101240 msgr2=0x7f3714197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:55.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3718e42640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3714101240 0x7f3714197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.946+0000 7f3718e42640 1 -- 172.21.15.2:0/3458515098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371419c420 con 0x7f3714101bc0 2024-09-12T00:54:55.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.947+0000 7f3719e44640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3714105a90 0x7f371419bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:55.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.947+0000 7f3718e42640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101bc0 0x7f37141979b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3704006010 tx=0x7f3704003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:55.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.947+0000 7f370a7fc640 1 -- 172.21.15.2:0/3458515098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370403f070 con 0x7f3714101bc0 2024-09-12T00:54:55.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.947+0000 7f370a7fc640 1 -- 172.21.15.2:0/3458515098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3704031c30 con 0x7f3714101bc0 2024-09-12T00:54:55.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.947+0000 7f371b8a7640 1 -- 172.21.15.2:0/3458515098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371419c6b0 con 0x7f3714101bc0 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.947+0000 7f370a7fc640 1 -- 172.21.15.2:0/3458515098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704035030 con 0x7f3714101bc0 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.947+0000 7f371b8a7640 1 -- 172.21.15.2:0/3458515098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37141a3ff0 con 0x7f3714101bc0 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.949+0000 7f370a7fc640 1 -- 172.21.15.2:0/3458515098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f3704042070 con 0x7f3714101bc0 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f371dc80740 1 Processor -- start 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f371dc80740 1 -- start start 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f371dc80740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b312a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f371dc80740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b31f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f371dc80740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b31fb50 0x55b70b321f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f371dc80740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b70b2782a0 con 0x55b70b312f80 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f371dc80740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b70b21fb10 con 0x55b70b312660 2024-09-12T00:54:55.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f371dc80740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b70b274260 con 0x55b70b31fb50 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719643640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b31f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719e44640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b312a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719643640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b31f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44418/0 (socket says 172.21.15.2:44418) 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719643640 1 -- 172.21.15.2:0/4009454155 learned_addr learned my addr 172.21.15.2:0/4009454155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f370a7fc640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37000a2cf0 0x7f37000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3718e42640 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b31fb50 0x55b70b321f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719e44640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37000a2cf0 0x7f37000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f370a7fc640 1 -- 172.21.15.2:0/3458515098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f37040efc60 con 0x7f3714101bc0 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719643640 1 -- 172.21.15.2:0/4009454155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b31fb50 msgr2=0x55b70b321f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719643640 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b31fb50 0x55b70b321f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719643640 1 -- 172.21.15.2:0/4009454155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 msgr2=0x55b70b312a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:55.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719643640 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b312a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.950+0000 7f3719643640 1 -- 172.21.15.2:0/4009454155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70afe9b90 con 0x55b70b312f80 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.951+0000 7f3718e42640 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b31fb50 0x55b70b321f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.951+0000 7f3719e44640 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b312a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.951+0000 7f3719643640 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b31f610 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3710009a70 tx=0x7f3710009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f786dc599245ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.951+0000 7f3719e44640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37000a2cf0 0x7f37000a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f370c005fd0 tx=0x7f370c004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.951+0000 7f36ff7fe640 1 -- 172.21.15.2:0/4009454155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710017070 con 0x55b70b312f80 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.951+0000 7f36ff7fe640 1 -- 172.21.15.2:0/4009454155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3710013470 con 0x55b70b312f80 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.951+0000 7f36ff7fe640 1 -- 172.21.15.2:0/4009454155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710012630 con 0x55b70b312f80 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 -- 172.21.15.2:0/4009454155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 msgr2=0x55b70b31f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b31f610 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3710009a70 tx=0x7f3710009f30 comp rx=0 tx=0).stop 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 -- 172.21.15.2:0/4009454155 shutdown_connections 2024-09-12T00:54:55.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b31fb50 0x55b70b321f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b31f610 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 --2- 172.21.15.2:0/4009454155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b312a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 -- 172.21.15.2:0/4009454155 >> 172.21.15.2:0/4009454155 conn(0x55b70b30ecf0 msgr2=0x55b70b30f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 -- 172.21.15.2:0/4009454155 shutdown_connections 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 -- 172.21.15.2:0/4009454155 wait complete. 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 -- start start 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.952+0000 7f371dc80740 1 Processor -- start 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f371dc80740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f371dc80740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 0x55b70b31cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f371dc80740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b31fb50 0x55b70b31d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f371dc80740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b70b322780 con 0x55b70b31fb50 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f371dc80740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b70b2006e0 con 0x55b70b312660 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f371dc80740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b70b322900 con 0x55b70b312f80 2024-09-12T00:54:55.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f371dc80740 10 client.0 _ll_register_callbacks cb 0x55b70b224a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b31fb50 0x55b70b31d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b31fb50 0x55b70b31d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44422/0 (socket says 172.21.15.2:44422) 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 -- 172.21.15.2:0/3275566567 learned_addr learned my addr 172.21.15.2:0/3275566567 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719643640 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 -- 172.21.15.2:0/3275566567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 msgr2=0x55b70b31cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 0x55b70b31cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 -- 172.21.15.2:0/3275566567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 msgr2=0x55b70b31ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 -- 172.21.15.2:0/3275566567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b70b32bd00 con 0x55b70b31fb50 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f3719e44640 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b31fb50 0x55b70b31d500 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f370c012d10 tx=0x7f370c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07b28e3e988ee10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.953+0000 7f36fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:54:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f36fcff9640 1 -- 172.21.15.2:0/3275566567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c01a070 con 0x55b70b31fb50 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f36fcff9640 1 -- 172.21.15.2:0/3275566567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f370c004d20 con 0x55b70b31fb50 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 1 -- 172.21.15.2:0/3275566567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3710013470 con 0x55b70b31fb50 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f36fcff9640 1 -- 172.21.15.2:0/3275566567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f370c005020 con 0x55b70b31fb50 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 10 client.15795 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 1 -- 172.21.15.2:0/3275566567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b70b32e660 con 0x55b70b31fb50 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f36fcff9640 1 -- 172.21.15.2:0/3275566567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3710013470 con 0x55b70b31fb50 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f36fcff9640 1 -- 172.21.15.2:0/3275566567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f370c00f040 con 0x55b70b31fb50 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 10 client.15795 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 10 client.15795 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 20 client.15795 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b70b32fb10 0x55b70b331fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 4 client.15795 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:54:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.954+0000 7f371dc80740 1 -- 172.21.15.2:0/3275566567 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b70b2859d0 con 0x55b70b32fb10 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.955+0000 7f3719643640 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b70b32fb10 0x55b70b331fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.955+0000 7f3719643640 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b70b32fb10 0x55b70b331fb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b3308fcba989d7 server_cookie=5e09f8fdc94d5a7b in_seq=0 out_seq=0 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.955+0000 7f36fcff9640 10 client.15795 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f36fcff9640 1 -- 172.21.15.2:0/3275566567 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b70b2859d0 con 0x55b70b32fb10 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f36fcff9640 10 client.15795 handle_command_reply: tid=0 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 client.15795 shutdown 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 -- 172.21.15.2:0/3275566567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b31fb50 msgr2=0x55b70b31d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b31fb50 0x55b70b31d500 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f370c012d10 tx=0x7f370c004a40 comp rx=0 tx=0).stop 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 -- 172.21.15.2:0/3275566567 shutdown_connections 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b70b32fb10 0x55b70b331fb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b31fb50 0x55b70b31d500 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 0x55b70b31cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f36fcff9640 0 client.15795 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 --2- 172.21.15.2:0/3275566567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 -- 172.21.15.2:0/3275566567 >> 172.21.15.2:0/3275566567 conn(0x55b70b30ecf0 msgr2=0x55b70b314a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 -- 172.21.15.2:0/3275566567 shutdown_connections 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 1 -- 172.21.15.2:0/3275566567 wait complete. 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.956+0000 7f371dc80740 20 client.15795 trim_cache size 0 max 16384 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.973+0000 7f371dc80740 1 Processor -- start 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.973+0000 7f371dc80740 1 -- start start 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.973+0000 7f371dc80740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b30ecf0 0x55b70b3148a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.973+0000 7f371dc80740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.973+0000 7f371dc80740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 0x55b70b337880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.973+0000 7f371dc80740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37141ae0e0 con 0x55b70b30ecf0 2024-09-12T00:54:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.973+0000 7f371dc80740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37141ab9b0 con 0x55b70b312660 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.973+0000 7f371dc80740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f37141a9800 con 0x55b70b312f80 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3719643640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b30ecf0 0x55b70b3148a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:36294/0 (socket says 172.21.15.2:36294) 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3719643640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b30ecf0 0x55b70b3148a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44430/0 (socket says 172.21.15.2:44430) 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 -- 172.21.15.2:0/1922500510 learned_addr learned my addr 172.21.15.2:0/1922500510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3719e44640 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 0x55b70b337880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 -- 172.21.15.2:0/1922500510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 msgr2=0x55b70b337880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 0x55b70b337880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 -- 172.21.15.2:0/1922500510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b30ecf0 msgr2=0x55b70b3148a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b30ecf0 0x55b70b3148a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 -- 172.21.15.2:0/1922500510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70b30eb20 con 0x55b70b312660 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3719643640 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b30ecf0 0x55b70b3148a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f3718e42640 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31b350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3704000c00 tx=0x7f370403b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b36313af91b106 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f36feffd640 1 -- 172.21.15.2:0/1922500510 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704049040 con 0x55b70b312660 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f36feffd640 1 -- 172.21.15.2:0/1922500510 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37040bc830 con 0x55b70b312660 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.974+0000 7f36feffd640 1 -- 172.21.15.2:0/1922500510 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37040ba4c0 con 0x55b70b312660 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 -- 172.21.15.2:0/1922500510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 msgr2=0x55b70b31b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31b350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3704000c00 tx=0x7f370403b890 comp rx=0 tx=0).stop 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 -- 172.21.15.2:0/1922500510 shutdown_connections 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312f80 0x55b70b337880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b312660 0x55b70b31b350 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 --2- 172.21.15.2:0/1922500510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b30ecf0 0x55b70b3148a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 -- 172.21.15.2:0/1922500510 >> 172.21.15.2:0/1922500510 conn(0x55b70b318470 msgr2=0x55b70b31eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:54:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 -- 172.21.15.2:0/1922500510 shutdown_connections 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.975+0000 7f371dc80740 1 -- 172.21.15.2:0/1922500510 wait complete. 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 1 -- start start 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 1 Processor -- start 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b30ecf0 0x55b70b3280e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312660 0x55b70b324420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b324960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37141a9e70 con 0x55b70b312f80 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37141ab2e0 con 0x55b70b30ecf0 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f37141aa540 con 0x55b70b312660 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f371dc80740 10 client.0 _ll_register_callbacks cb 0x7f370c0145c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f3719643640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b30ecf0 0x55b70b3280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f3719e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b324960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f3719643640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b30ecf0 0x55b70b3280e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:36302/0 (socket says 172.21.15.2:36302) 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f3719643640 1 -- 172.21.15.2:0/2124781413 learned_addr learned my addr 172.21.15.2:0/2124781413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.976+0000 7f3718e42640 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312660 0x55b70b324420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f3719643640 1 -- 172.21.15.2:0/2124781413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312660 msgr2=0x55b70b324420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f3719643640 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312660 0x55b70b324420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f3719643640 1 -- 172.21.15.2:0/2124781413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 msgr2=0x55b70b324960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f3719643640 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b324960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f3719643640 1 -- 172.21.15.2:0/2124781413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b70b30f980 con 0x55b70b30ecf0 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f3718e42640 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312660 0x55b70b324420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f3719643640 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b30ecf0 0x55b70b3280e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3710009a70 tx=0x7f3710013f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8fca7e242f54082 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f36fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f36fcff9640 1 -- 172.21.15.2:0/2124781413 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710017040 con 0x55b70b30ecf0 2024-09-12T00:54:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f36fcff9640 1 -- 172.21.15.2:0/2124781413 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f371000ed50 con 0x55b70b30ecf0 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f371dc80740 1 -- 172.21.15.2:0/2124781413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37040bc830 con 0x55b70b30ecf0 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f36fcff9640 1 -- 172.21.15.2:0/2124781413 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3710035050 con 0x55b70b30ecf0 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f371dc80740 10 client.25481 fetch_fsmap learned FSMap version 27 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f371dc80740 1 -- 172.21.15.2:0/2124781413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b70b30a260 con 0x55b70b30ecf0 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.977+0000 7f36fcff9640 1 -- 172.21.15.2:0/2124781413 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37040bc830 con 0x55b70b30ecf0 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f36fcff9640 1 -- 172.21.15.2:0/2124781413 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3710006050 con 0x55b70b30ecf0 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f371dc80740 10 client.25481 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f371dc80740 10 client.25481 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f371dc80740 20 client.25481 populate_metadata read hostname 'smithi002' 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f371dc80740 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b70b31fb50 0x55b70b39d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f371dc80740 4 client.25481 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-12T00:54:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f371dc80740 1 -- 172.21.15.2:0/2124781413 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x55b70b27fd20 con 0x55b70b31fb50 2024-09-12T00:54:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f3718e42640 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b70b31fb50 0x55b70b39d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:54:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f36fcff9640 10 client.25481 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:54:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:54:55.978+0000 7f3718e42640 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b70b31fb50 0x55b70b39d7d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ca0d3c992fcfce server_cookie=bd2944e5cc326bb5 in_seq=0 out_seq=0 2024-09-12T00:54:56.007 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/syssgi.h presence... no 2024-09-12T00:54:56.007 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/syssgi.h... no 2024-09-12T00:54:56.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:56 smithi071 ceph-mon[35276]: pgmap v63: 97 pgs: 97 active+clean; 56 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-09-12T00:54:56.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:56 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:54:56.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:56 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:54:56.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:56 smithi002 ceph-mon[31210]: pgmap v63: 97 pgs: 97 active+clean; 56 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-09-12T00:54:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:56 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:54:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:56 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:54:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:56 smithi167 ceph-mon[35234]: pgmap v63: 97 pgs: 97 active+clean; 56 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-09-12T00:54:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:56 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:54:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:56 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:54:57.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:57 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:54:57.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:57 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:54:57.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:57 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:54:58.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:54:58 smithi071 ceph-mon[35276]: pgmap v64: 97 pgs: 97 active+clean; 57 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 229 op/s 2024-09-12T00:54:58.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:54:58 smithi002 ceph-mon[31210]: pgmap v64: 97 pgs: 97 active+clean; 57 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 229 op/s 2024-09-12T00:54:58.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:54:58 smithi167 ceph-mon[35234]: pgmap v64: 97 pgs: 97 active+clean; 57 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 229 op/s 2024-09-12T00:55:00.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:00 smithi071 ceph-mon[35276]: pgmap v65: 97 pgs: 97 active+clean; 57 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 598 KiB/s wr, 100 op/s 2024-09-12T00:55:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:00 smithi002 ceph-mon[31210]: pgmap v65: 97 pgs: 97 active+clean; 57 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 598 KiB/s wr, 100 op/s 2024-09-12T00:55:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:00 smithi167 ceph-mon[35234]: pgmap v65: 97 pgs: 97 active+clean; 57 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 598 KiB/s wr, 100 op/s 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f36fcff9640 1 -- 172.21.15.2:0/2124781413 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b70b27fd20 con 0x55b70b31fb50 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f36fcff9640 10 client.25481 handle_command_reply: tid=0 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 client.25481 shutdown 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 -- 172.21.15.2:0/2124781413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b30ecf0 msgr2=0x55b70b3280e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b30ecf0 0x55b70b3280e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3710009a70 tx=0x7f3710013f90 comp rx=0 tx=0).stop 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 -- 172.21.15.2:0/2124781413 shutdown_connections 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b70b31fb50 0x55b70b39d7d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b70b312f80 0x55b70b324960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b70b312660 0x55b70b324420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f36fcff9640 0 client.25481 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 --2- 172.21.15.2:0/2124781413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b70b30ecf0 0x55b70b3280e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 -- 172.21.15.2:0/2124781413 >> 172.21.15.2:0/2124781413 conn(0x55b70b318470 msgr2=0x55b70b31ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 -- 172.21.15.2:0/2124781413 shutdown_connections 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 1 -- 172.21.15.2:0/2124781413 wait complete. 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.353+0000 7f371dc80740 20 client.25481 trim_cache size 0 max 16384 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 27, 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 6, 2024-09-12T00:55:01.354 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "5582156a": { 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 6, 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 133.4, 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:55:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:55:01.356 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:55:01.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:01.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:01.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:01.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:01.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:01.356 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 -- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37000a2cf0 msgr2=0x7f37000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37000a2cf0 0x7f37000a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f370c005fd0 tx=0x7f370c004ab0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 -- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101bc0 msgr2=0x7f37141979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101bc0 0x7f37141979b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3704006010 tx=0x7f3704003c10 comp rx=0 tx=0).stop 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 -- 172.21.15.2:0/3458515098 shutdown_connections 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37000a2cf0 0x7f37000a51b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3714105a90 0x7f371419bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3714101bc0 0x7f37141979b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 --2- 172.21.15.2:0/3458515098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3714101240 0x7f3714197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 -- 172.21.15.2:0/3458515098 >> 172.21.15.2:0/3458515098 conn(0x7f3714077210 msgr2=0x7f3714103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 -- 172.21.15.2:0/3458515098 shutdown_connections 2024-09-12T00:55:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:01.354+0000 7f371b8a7640 1 -- 172.21.15.2:0/3458515098 wait complete. 2024-09-12T00:55:01.995 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5582156a', quiesce took 8.7 seconds. Will release after: 4.700000000000001 2024-09-12T00:55:02.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:02 smithi071 ceph-mon[35276]: pgmap v66: 97 pgs: 97 active+clean; 70 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 438 op/s 2024-09-12T00:55:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:02 smithi002 ceph-mon[31210]: pgmap v66: 97 pgs: 97 active+clean; 70 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 438 op/s 2024-09-12T00:55:02.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:02 smithi167 ceph-mon[35234]: pgmap v66: 97 pgs: 97 active+clean; 70 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 438 op/s 2024-09-12T00:55:04.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:04 smithi071 ceph-mon[35276]: pgmap v67: 97 pgs: 97 active+clean; 71 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 1.6 MiB/s wr, 403 op/s 2024-09-12T00:55:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:04 smithi002 ceph-mon[31210]: pgmap v67: 97 pgs: 97 active+clean; 71 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 1.6 MiB/s wr, 403 op/s 2024-09-12T00:55:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:04 smithi167 ceph-mon[35234]: pgmap v67: 97 pgs: 97 active+clean; 71 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 1.6 MiB/s wr, 403 op/s 2024-09-12T00:55:06.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:06 smithi071 ceph-mon[35276]: pgmap v68: 97 pgs: 97 active+clean; 71 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.5 MiB/s wr, 392 op/s 2024-09-12T00:55:06.693 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:06 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:55:06.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:06 smithi002 ceph-mon[31210]: pgmap v68: 97 pgs: 97 active+clean; 71 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.5 MiB/s wr, 392 op/s 2024-09-12T00:55:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:06 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:55:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:06 smithi167 ceph-mon[35234]: pgmap v68: 97 pgs: 97 active+clean; 71 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.5 MiB/s wr, 392 op/s 2024-09-12T00:55:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:06 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:55:06.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:55:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 -- 172.21.15.2:0/3130959294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c100e20 msgr2=0x7fdc9c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 --2- 172.21.15.2:0/3130959294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c100e20 0x7fdc9c101200 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009900 tx=0x7fdc8c02a480 comp rx=0 tx=0).stop 2024-09-12T00:55:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 -- 172.21.15.2:0/3130959294 shutdown_connections 2024-09-12T00:55:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 --2- 172.21.15.2:0/3130959294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc9c102ef0 0x7fdc9c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 --2- 172.21.15.2:0/3130959294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc9c102570 0x7fdc9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 --2- 172.21.15.2:0/3130959294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c100e20 0x7fdc9c101200 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 -- 172.21.15.2:0/3130959294 >> 172.21.15.2:0/3130959294 conn(0x7fdc9c0fc7d0 msgr2=0x7fdc9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 -- 172.21.15.2:0/3130959294 shutdown_connections 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 -- 172.21.15.2:0/3130959294 wait complete. 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.709+0000 7fdca174b640 1 Processor -- start 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdca174b640 1 -- start start 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdca174b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc9c100e20 0x7fdc9c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdca174b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc9c102570 0x7fdc9c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdca174b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c102ef0 0x7fdc9c1a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdca174b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c110fc0 con 0x7fdc9c102ef0 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdca174b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c110e40 con 0x7fdc9c100e20 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdca174b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c111140 con 0x7fdc9c102570 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c102ef0 0x7fdc9c1a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c102ef0 0x7fdc9c1a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48108/0 (socket says 172.21.15.2:48108) 2024-09-12T00:55:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9b7fe640 1 -- 172.21.15.2:0/3363712180 learned_addr learned my addr 172.21.15.2:0/3363712180 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9a7fc640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc9c102570 0x7fdc9c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9affd640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc9c100e20 0x7fdc9c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9b7fe640 1 -- 172.21.15.2:0/3363712180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc9c102570 msgr2=0x7fdc9c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9b7fe640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc9c102570 0x7fdc9c1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9b7fe640 1 -- 172.21.15.2:0/3363712180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc9c100e20 msgr2=0x7fdc9c1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9b7fe640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc9c100e20 0x7fdc9c1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9b7fe640 1 -- 172.21.15.2:0/3363712180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c1a4960 con 0x7fdc9c102ef0 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.710+0000 7fdc9a7fc640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc9c102570 0x7fdc9c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.711+0000 7fdc9b7fe640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c102ef0 0x7fdc9c1a4420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400eb10 tx=0x7fdc9400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.711+0000 7fdc93fff640 1 -- 172.21.15.2:0/3363712180 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94004b20 con 0x7fdc9c102ef0 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.711+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c1a4b30 con 0x7fdc9c102ef0 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.711+0000 7fdc93fff640 1 -- 172.21.15.2:0/3363712180 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc94004cc0 con 0x7fdc9c102ef0 2024-09-12T00:55:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.711+0000 7fdc93fff640 1 -- 172.21.15.2:0/3363712180 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94010760 con 0x7fdc9c102ef0 2024-09-12T00:55:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.711+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c1a5040 con 0x7fdc9c102ef0 2024-09-12T00:55:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.712+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9c101200 con 0x7fdc9c102ef0 2024-09-12T00:55:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.713+0000 7fdc93fff640 1 -- 172.21.15.2:0/3363712180 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fdc94005000 con 0x7fdc9c102ef0 2024-09-12T00:55:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.714+0000 7fdc93fff640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdc880a2cf0 0x7fdc880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.714+0000 7fdc9affd640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdc880a2cf0 0x7fdc880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.714+0000 7fdc93fff640 1 -- 172.21.15.2:0/3363712180 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fdc940d0060 con 0x7fdc9c102ef0 2024-09-12T00:55:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.714+0000 7fdc9affd640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdc880a2cf0 0x7fdc880a51b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c005ab0 tx=0x7fdc8c005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.717+0000 7fdc93fff640 1 -- 172.21.15.2:0/3363712180 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc9409cbd0 con 0x7fdc9c102ef0 2024-09-12T00:55:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.931+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc9c06a560 con 0x7fdc9c102ef0 2024-09-12T00:55:07.931 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.931 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.931 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.931 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.931 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.931 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.932 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:55:07.932 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:55:07.932 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.931+0000 7fdc93fff640 1 -- 172.21.15.2:0/3363712180 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7fdc9c06a560 con 0x7fdc9c102ef0 2024-09-12T00:55:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:55:07.933 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:55:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdc880a2cf0 msgr2=0x7fdc880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdc880a2cf0 0x7fdc880a51b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c005ab0 tx=0x7fdc8c005a20 comp rx=0 tx=0).stop 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c102ef0 msgr2=0x7fdc9c1a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c102ef0 0x7fdc9c1a4420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400eb10 tx=0x7fdc9400c2d0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 shutdown_connections 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdc880a2cf0 0x7fdc880a51b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c102ef0 0x7fdc9c1a4420 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc9c102570 0x7fdc9c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 --2- 172.21.15.2:0/3363712180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc9c100e20 0x7fdc9c1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 >> 172.21.15.2:0/3363712180 conn(0x7fdc9c0fc7d0 msgr2=0x7fdc9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 shutdown_connections 2024-09-12T00:55:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:07.934+0000 7fdca174b640 1 -- 172.21.15.2:0/3363712180 wait complete. 2024-09-12T00:55:07.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:55:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:55:07.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:55:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:55:08.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:55:08.687 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --set-id 5582156a --release --await' 2024-09-12T00:55:08.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --set-id 5582156a --release --await 2024-09-12T00:55:08.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:08 smithi071 ceph-mon[35276]: pgmap v69: 97 pgs: 97 active+clean; 74 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 399 op/s 2024-09-12T00:55:08.944 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:08 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3363712180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:08.954 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:08.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:08 smithi002 ceph-mon[31210]: pgmap v69: 97 pgs: 97 active+clean; 74 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 399 op/s 2024-09-12T00:55:08.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:08 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3363712180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:08 smithi167 ceph-mon[35234]: pgmap v69: 97 pgs: 97 active+clean; 74 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 399 op/s 2024-09-12T00:55:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:08 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3363712180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.426+0000 7f38a0cef640 1 -- 172.21.15.2:0/763790030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c101de0 msgr2=0x7f389c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.426+0000 7f38a0cef640 1 --2- 172.21.15.2:0/763790030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c101de0 0x7f389c1021c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f388c009900 tx=0x7f388c02a410 comp rx=0 tx=0).stop 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 -- 172.21.15.2:0/763790030 shutdown_connections 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 --2- 172.21.15.2:0/763790030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c106f10 0x7f389c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 --2- 172.21.15.2:0/763790030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f389c102790 0x7f389c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 --2- 172.21.15.2:0/763790030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c101de0 0x7f389c1021c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 -- 172.21.15.2:0/763790030 >> 172.21.15.2:0/763790030 conn(0x7f389c0fd8c0 msgr2=0x7f389c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 -- 172.21.15.2:0/763790030 shutdown_connections 2024-09-12T00:55:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 -- 172.21.15.2:0/763790030 wait complete. 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 Processor -- start 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.427+0000 7f38a0cef640 1 -- start start 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f38a0cef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c101de0 0x7f389c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f38a0cef640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f389c102790 0x7f389c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f38a0cef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c106f10 0x7f389c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f38a0cef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f389c112000 con 0x7f389c106f10 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f38a0cef640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f389c111e80 con 0x7f389c102790 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f38a0cef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f389c112180 con 0x7f389c101de0 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c106f10 0x7f389c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c106f10 0x7f389c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48134/0 (socket says 172.21.15.2:48134) 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 -- 172.21.15.2:0/2535154653 learned_addr learned my addr 172.21.15.2:0/2535154653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f3899d9b640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f389c102790 0x7f389c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389a59c640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c101de0 0x7f389c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 -- 172.21.15.2:0/2535154653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c101de0 msgr2=0x7f389c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c101de0 0x7f389c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 -- 172.21.15.2:0/2535154653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f389c102790 msgr2=0x7f389c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f389c102790 0x7f389c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 -- 172.21.15.2:0/2535154653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c1a6950 con 0x7f389c106f10 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389a59c640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c101de0 0x7f389c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:55:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f3899d9b640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f389c102790 0x7f389c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:55:09.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.428+0000 7f389ad9d640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c106f10 0x7f389c074f70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f389400eaa0 tx=0x7f389400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:09.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.429+0000 7f388b7fe640 1 -- 172.21.15.2:0/2535154653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389400cdb0 con 0x7f389c106f10 2024-09-12T00:55:09.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.429+0000 7f38a0cef640 1 -- 172.21.15.2:0/2535154653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c1a6c40 con 0x7f389c106f10 2024-09-12T00:55:09.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.429+0000 7f388b7fe640 1 -- 172.21.15.2:0/2535154653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3894005020 con 0x7f389c106f10 2024-09-12T00:55:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.429+0000 7f388b7fe640 1 -- 172.21.15.2:0/2535154653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38940116d0 con 0x7f389c106f10 2024-09-12T00:55:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.429+0000 7f38a0cef640 1 -- 172.21.15.2:0/2535154653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c1a71d0 con 0x7f389c106f10 2024-09-12T00:55:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.431+0000 7f388b7fe640 1 -- 172.21.15.2:0/2535154653 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f38940054d0 con 0x7f389c106f10 2024-09-12T00:55:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.431+0000 7f38a30c8740 1 Processor -- start 2024-09-12T00:55:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.431+0000 7f38a30c8740 1 -- start start 2024-09-12T00:55:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.431+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e2d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f38a30c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fe9e228620 con 0x55fe9e2c3980 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f38a30c8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fe9e1cfe50 con 0x55fe9e2ce240 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f38a30c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fe9e2245e0 con 0x55fe9e2c3060 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f3899d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48146/0 (socket says 172.21.15.2:48146) 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 -- 172.21.15.2:0/2292823120 learned_addr learned my addr 172.21.15.2:0/2292823120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f3899d9b640 1 --2- 172.21.15.2:0/2292823120 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e2d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 -- 172.21.15.2:0/2292823120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 msgr2=0x55fe9e2c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 --2- 172.21.15.2:0/2292823120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f388b7fe640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38840a2d70 0x7f38840a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 -- 172.21.15.2:0/2292823120 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 msgr2=0x55fe9e2d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 --2- 172.21.15.2:0/2292823120 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e2d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 -- 172.21.15.2:0/2292823120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe9e1c0d40 con 0x55fe9e2c3980 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389ad9d640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38840a2d70 0x7f38840a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f388b7fe640 1 -- 172.21.15.2:0/2535154653 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f38940cf6f0 con 0x7f389c106f10 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.432+0000 7f389a59c640 1 --2- 172.21.15.2:0/2292823120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cdd00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f388c006010 tx=0x7f388c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a659d8781215b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.433+0000 7f3888ff9640 1 -- 172.21.15.2:0/2292823120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c03f070 con 0x55fe9e2c3980 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.433+0000 7f3888ff9640 1 -- 172.21.15.2:0/2292823120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c005520 con 0x55fe9e2c3980 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.433+0000 7f3888ff9640 1 -- 172.21.15.2:0/2292823120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c035030 con 0x55fe9e2c3980 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.433+0000 7f38a30c8740 1 -- 172.21.15.2:0/2292823120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 msgr2=0x55fe9e2cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.433+0000 7f389ad9d640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38840a2d70 0x7f38840a5230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38940ccea0 tx=0x7f389406aaf0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.433+0000 7f38a30c8740 1 --2- 172.21.15.2:0/2292823120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cdd00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f388c006010 tx=0x7f388c004170 comp rx=0 tx=0).stop 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 -- 172.21.15.2:0/2292823120 shutdown_connections 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 --2- 172.21.15.2:0/2292823120 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e2d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 --2- 172.21.15.2:0/2292823120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cdd00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 --2- 172.21.15.2:0/2292823120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 -- 172.21.15.2:0/2292823120 >> 172.21.15.2:0/2292823120 conn(0x55fe9e2bf5f0 msgr2=0x55fe9e2bf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 -- 172.21.15.2:0/2292823120 shutdown_connections 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 -- 172.21.15.2:0/2292823120 wait complete. 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 -- start start 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 Processor -- start 2024-09-12T00:55:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2ce240 0x55fe9e2cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fe9e2d0e10 con 0x55fe9e2ce240 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fe9e1b0f10 con 0x55fe9e2c3980 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fe9e2d0f90 con 0x55fe9e2c3060 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f38a30c8740 10 client.0 _ll_register_callbacks cb 0x55fe9e1d4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.434+0000 7f3899d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2ce240 0x55fe9e2cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2ce240 0x55fe9e2cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48152/0 (socket says 172.21.15.2:48152) 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 -- 172.21.15.2:0/1648769464 learned_addr learned my addr 172.21.15.2:0/1648769464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f389a59c640 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 -- 172.21.15.2:0/1648769464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 msgr2=0x55fe9e2cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 -- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2c3980 msgr2=0x55fe9e2cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 -- 172.21.15.2:0/1648769464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe9df37580 con 0x55fe9e2ce240 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f389a59c640 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3899d9b640 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2ce240 0x55fe9e2cbb40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3890017f80 tx=0x7f38900047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded2686b1444a6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3881ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3881ffb640 1 -- 172.21.15.2:0/1648769464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389001f070 con 0x55fe9e2ce240 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3881ffb640 1 -- 172.21.15.2:0/1648769464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f38900166a0 con 0x55fe9e2ce240 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f38a30c8740 1 -- 172.21.15.2:0/1648769464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f388c005520 con 0x55fe9e2ce240 2024-09-12T00:55:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f3881ffb640 1 -- 172.21.15.2:0/1648769464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38900059c0 con 0x55fe9e2ce240 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f38a30c8740 10 client.15819 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.435+0000 7f38a30c8740 1 -- 172.21.15.2:0/1648769464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fe9e001960 con 0x55fe9e2ce240 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f3881ffb640 1 -- 172.21.15.2:0/1648769464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c005520 con 0x55fe9e2ce240 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f3881ffb640 1 -- 172.21.15.2:0/1648769464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3890022020 con 0x55fe9e2ce240 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f38a30c8740 10 client.15819 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f38a30c8740 10 client.15819 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f38a30c8740 20 client.15819 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fe9e2dde10 0x55fe9e2e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f38a30c8740 4 client.15819 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f38a30c8740 1 -- 172.21.15.2:0/1648769464 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe9e235b90 con 0x55fe9e2dde10 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.436+0000 7f389a59c640 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fe9e2dde10 0x55fe9e2e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.437+0000 7f389a59c640 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fe9e2dde10 0x55fe9e2e02a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15e117d60243bdf4 server_cookie=247d067a0674f5fe in_seq=0 out_seq=0 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.437+0000 7f3881ffb640 10 client.15819 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.437+0000 7f3881ffb640 1 -- 172.21.15.2:0/1648769464 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe9e235b90 con 0x55fe9e2dde10 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.437+0000 7f3881ffb640 10 client.15819 handle_command_reply: tid=0 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.437+0000 7f38a30c8740 1 client.15819 shutdown 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.437+0000 7f38a30c8740 1 -- 172.21.15.2:0/1648769464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2ce240 msgr2=0x55fe9e2cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.437+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2ce240 0x55fe9e2cbb40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3890017f80 tx=0x7f38900047d0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.437+0000 7f38a30c8740 1 -- 172.21.15.2:0/1648769464 shutdown_connections 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fe9e2dde10 0x55fe9e2e02a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2ce240 0x55fe9e2cbb40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2c3980 0x55fe9e2cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1648769464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f3881ffb640 0 client.15819 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:09.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f38a30c8740 1 -- 172.21.15.2:0/1648769464 >> 172.21.15.2:0/1648769464 conn(0x55fe9e2bf5f0 msgr2=0x55fe9e2c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:09.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f38a30c8740 1 -- 172.21.15.2:0/1648769464 shutdown_connections 2024-09-12T00:55:09.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f38a30c8740 1 -- 172.21.15.2:0/1648769464 wait complete. 2024-09-12T00:55:09.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.438+0000 7f38a30c8740 20 client.15819 trim_cache size 0 max 16384 2024-09-12T00:55:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f38a30c8740 1 Processor -- start 2024-09-12T00:55:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f38a30c8740 1 -- start start 2024-09-12T00:55:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2be640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e2e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f38a30c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f389c1b2570 con 0x55fe9e2c3980 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f38a30c8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f389c1afe40 con 0x55fe9e2ce240 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f38a30c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f389c1adc90 con 0x55fe9e2c3060 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2be640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48164/0 (socket says 172.21.15.2:48164) 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 -- 172.21.15.2:0/1202250675 learned_addr learned my addr 172.21.15.2:0/1202250675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 -- 172.21.15.2:0/1202250675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 msgr2=0x55fe9e2c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 --2- 172.21.15.2:0/1202250675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 -- 172.21.15.2:0/1202250675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 msgr2=0x55fe9e2e5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 --2- 172.21.15.2:0/1202250675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e2e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 -- 172.21.15.2:0/1202250675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe9e2bf090 con 0x55fe9e2c3980 2024-09-12T00:55:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.455+0000 7f389a59c640 1 --2- 172.21.15.2:0/1202250675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2be640 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f388c004b00 tx=0x7f388c004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff8b1b8e0d769b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f3883fff640 1 -- 172.21.15.2:0/1202250675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c053070 con 0x55fe9e2c3980 2024-09-12T00:55:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f3883fff640 1 -- 172.21.15.2:0/1202250675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c031a90 con 0x55fe9e2c3980 2024-09-12T00:55:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f3883fff640 1 -- 172.21.15.2:0/1202250675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c03f040 con 0x55fe9e2c3980 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 -- 172.21.15.2:0/1202250675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 msgr2=0x55fe9e2be640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1202250675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2be640 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f388c004b00 tx=0x7f388c004b30 comp rx=0 tx=0).stop 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 -- 172.21.15.2:0/1202250675 shutdown_connections 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1202250675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e2e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1202250675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2be640 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 --2- 172.21.15.2:0/1202250675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 -- 172.21.15.2:0/1202250675 >> 172.21.15.2:0/1202250675 conn(0x55fe9e2bf5f0 msgr2=0x55fe9e2bdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 -- 172.21.15.2:0/1202250675 shutdown_connections 2024-09-12T00:55:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.456+0000 7f38a30c8740 1 -- 172.21.15.2:0/1202250675 wait complete. 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 1 -- start start 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 1 Processor -- start 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e347b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f389c1ae300 con 0x55fe9e2c3980 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f389c1af770 con 0x55fe9e2ce240 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f389c1ae9d0 con 0x55fe9e2c3060 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f38a30c8740 10 client.0 _ll_register_callbacks cb 0x7f3890017de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f389a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f389a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2d2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48170/0 (socket says 172.21.15.2:48170) 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f389a59c640 1 -- 172.21.15.2:0/3955929621 learned_addr learned my addr 172.21.15.2:0/3955929621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f3899d9b640 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f3899d9b640 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e347b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f389a59c640 1 -- 172.21.15.2:0/3955929621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 msgr2=0x55fe9e2d2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f389a59c640 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2d2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f389a59c640 1 -- 172.21.15.2:0/3955929621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 msgr2=0x55fe9e347b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f389a59c640 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e347b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.457+0000 7f389a59c640 1 -- 172.21.15.2:0/3955929621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe9e3480c0 con 0x55fe9e2c3980 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f389a59c640 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2d2bd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f388c02a930 tx=0x7f388c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29967ce10767e9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f3881ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f3881ffb640 1 -- 172.21.15.2:0/3955929621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c03f070 con 0x55fe9e2c3980 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f3881ffb640 1 -- 172.21.15.2:0/3955929621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f388c0042f0 con 0x55fe9e2c3980 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 1 -- 172.21.15.2:0/3955929621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f388c031a90 con 0x55fe9e2c3980 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f3881ffb640 1 -- 172.21.15.2:0/3955929621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f388c053040 con 0x55fe9e2c3980 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 10 client.15825 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 1 -- 172.21.15.2:0/3955929621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fe9e3493d0 con 0x55fe9e2c3980 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f3881ffb640 1 -- 172.21.15.2:0/3955929621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c031a90 con 0x55fe9e2c3980 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f3881ffb640 1 -- 172.21.15.2:0/3955929621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f388c004cf0 con 0x55fe9e2c3980 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 10 client.15825 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 10 client.15825 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 20 client.15825 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fe9e3495a0 0x55fe9e34b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 4 client.15825 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5582156a", "release": true, "await": true}] 2024-09-12T00:55:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.458+0000 7f38a30c8740 1 -- 172.21.15.2:0/3955929621 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5582156a", "release": true, "await": true}) -- 0x55fe9e2300a0 con 0x55fe9e3495a0 2024-09-12T00:55:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.459+0000 7f3899d9b640 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fe9e3495a0 0x55fe9e34b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.459+0000 7f3881ffb640 10 client.15825 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.459+0000 7f3899d9b640 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fe9e3495a0 0x55fe9e34b990 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf4f29624f122f66 server_cookie=bd4432409b72231 in_seq=0 out_seq=0 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f3881ffb640 1 -- 172.21.15.2:0/3955929621 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55fe9e2300a0 con 0x55fe9e3495a0 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f3881ffb640 10 client.15825 handle_command_reply: tid=0 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 client.15825 shutdown 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 -- 172.21.15.2:0/3955929621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 msgr2=0x55fe9e2d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2d2bd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f388c02a930 tx=0x7f388c000bc0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 -- 172.21.15.2:0/3955929621 shutdown_connections 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fe9e3495a0 0x55fe9e34b990 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe9e2ce240 0x55fe9e347b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe9e2c3980 0x55fe9e2d2bd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 --2- 172.21.15.2:0/3955929621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe9e2c3060 0x55fe9e2d2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 -- 172.21.15.2:0/3955929621 >> 172.21.15.2:0/3955929621 conn(0x55fe9e2bf5f0 msgr2=0x55fe9e2cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:09.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f3881ffb640 0 client.15825 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:09.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 -- 172.21.15.2:0/3955929621 shutdown_connections 2024-09-12T00:55:09.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 1 -- 172.21.15.2:0/3955929621 wait complete. 2024-09-12T00:55:09.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a30c8740 20 client.15825 trim_cache size 0 max 16384 2024-09-12T00:55:09.646 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:55:09.646 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 27, 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 8, 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "5582156a": { 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 8, 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:55:09.647 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 133.4, 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:09.648 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:09.649 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:55:09.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a0cef640 1 -- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38840a2d70 msgr2=0x7f38840a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.645+0000 7f38a0cef640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38840a2d70 0x7f38840a5230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38940ccea0 tx=0x7f389406aaf0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 -- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c106f10 msgr2=0x7f389c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c106f10 0x7f389c074f70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f389400eaa0 tx=0x7f389400ef60 comp rx=0 tx=0).stop 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 -- 172.21.15.2:0/2535154653 shutdown_connections 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38840a2d70 0x7f38840a5230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f389c106f10 0x7f389c074f70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f389c102790 0x7f389c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 --2- 172.21.15.2:0/2535154653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c101de0 0x7f389c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 -- 172.21.15.2:0/2535154653 >> 172.21.15.2:0/2535154653 conn(0x7f389c0fd8c0 msgr2=0x7f389c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 -- 172.21.15.2:0/2535154653 shutdown_connections 2024-09-12T00:55:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:09.646+0000 7f38a0cef640 1 -- 172.21.15.2:0/2535154653 wait complete. 2024-09-12T00:55:09.964 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/param.h usability... yes 2024-09-12T00:55:09.988 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/param.h presence... yes 2024-09-12T00:55:09.988 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/param.h... yes 2024-09-12T00:55:10.003 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/stat.h... (cached) yes 2024-09-12T00:55:10.062 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/statvfs.h usability... yes 2024-09-12T00:55:10.078 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/statvfs.h presence... yes 2024-09-12T00:55:10.079 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/statvfs.h... yes 2024-09-12T00:55:10.124 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/time.h usability... yes 2024-09-12T00:55:10.141 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/time.h presence... yes 2024-09-12T00:55:10.141 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/time.h... yes 2024-09-12T00:55:10.192 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/ioctl.h usability... yes 2024-09-12T00:55:10.212 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/ioctl.h presence... yes 2024-09-12T00:55:10.212 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/ioctl.h... yes 2024-09-12T00:55:10.272 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/wait.h usability... yes 2024-09-12T00:55:10.290 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/wait.h presence... yes 2024-09-12T00:55:10.290 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/wait.h... yes 2024-09-12T00:55:10.304 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/types.h... (cached) yes 2024-09-12T00:55:10.309 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strings.h... (cached) yes 2024-09-12T00:55:10.375 INFO:tasks.workunit.client.0.smithi002.stdout:checking err.h usability... yes 2024-09-12T00:55:10.396 INFO:tasks.workunit.client.0.smithi002.stdout:checking err.h presence... yes 2024-09-12T00:55:10.396 INFO:tasks.workunit.client.0.smithi002.stdout:checking for err.h... yes 2024-09-12T00:55:10.465 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/falloc.h usability... yes 2024-09-12T00:55:10.481 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/falloc.h presence... yes 2024-09-12T00:55:10.481 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/falloc.h... yes 2024-09-12T00:55:10.507 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5582156a', total seconds elapsed: 17.2 2024-09-12T00:55:10.530 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-12T00:55:10.558 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-12T00:55:10.558 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-12T00:55:10.604 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-12T00:55:10.633 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-12T00:55:10.633 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfs/platform_defs.h usability... no 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfs/platform_defs.h presence... no 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/platform_defs.h... no 2024-09-12T00:55:10.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:10 smithi002 ceph-mon[31210]: pgmap v70: 97 pgs: 97 active+clean; 74 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.6 MiB/s wr, 388 op/s 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi002.stdout:checking btrfs/ioctl.h usability... no 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi002.stdout:checking btrfs/ioctl.h presence... no 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi002.stdout:checking for btrfs/ioctl.h... no 2024-09-12T00:55:10.849 INFO:tasks.workunit.client.0.smithi002.stdout:checking cifs/ioctl.h usability... no 2024-09-12T00:55:10.878 INFO:tasks.workunit.client.0.smithi002.stdout:checking cifs/ioctl.h presence... no 2024-09-12T00:55:10.878 INFO:tasks.workunit.client.0.smithi002.stdout:checking for cifs/ioctl.h... no 2024-09-12T00:55:10.927 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/mman.h usability... yes 2024-09-12T00:55:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:10 smithi071 ceph-mon[35276]: pgmap v70: 97 pgs: 97 active+clean; 74 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.6 MiB/s wr, 388 op/s 2024-09-12T00:55:10.949 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/mman.h presence... yes 2024-09-12T00:55:10.949 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/mman.h... yes 2024-09-12T00:55:11.003 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/ext4.h usability... no 2024-09-12T00:55:11.036 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/ext4.h presence... no 2024-09-12T00:55:11.036 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/ext4.h... no 2024-09-12T00:55:11.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:10 smithi167 ceph-mon[35234]: pgmap v70: 97 pgs: 97 active+clean; 74 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.6 MiB/s wr, 388 op/s 2024-09-12T00:55:11.066 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/xfs_log_format.h... no 2024-09-12T00:55:11.125 INFO:tasks.workunit.client.0.smithi002.stdout:checking for uuid_compare... no 2024-09-12T00:55:11.174 INFO:tasks.workunit.client.0.smithi002.stdout:checking for uuid_compare in -luuid... yes 2024-09-12T00:55:11.280 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/xfs.h... yes 2024-09-12T00:55:11.314 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/libxfs.h... no 2024-09-12T00:55:11.343 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-12T00:55:11.382 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/xqm.h... yes 2024-09-12T00:55:11.436 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-12T00:55:11.472 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfs/handle.h usability... yes 2024-09-12T00:55:11.488 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfs/handle.h presence... yes 2024-09-12T00:55:11.488 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/handle.h... yes 2024-09-12T00:55:11.534 INFO:tasks.workunit.client.0.smithi002.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-12T00:55:11.575 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/acl.h usability... yes 2024-09-12T00:55:11.593 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/acl.h presence... yes 2024-09-12T00:55:11.593 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/acl.h... yes 2024-09-12T00:55:11.636 INFO:tasks.workunit.client.0.smithi002.stdout:checking acl/libacl.h usability... yes 2024-09-12T00:55:11.655 INFO:tasks.workunit.client.0.smithi002.stdout:checking acl/libacl.h presence... yes 2024-09-12T00:55:11.655 INFO:tasks.workunit.client.0.smithi002.stdout:checking for acl/libacl.h... yes 2024-09-12T00:55:11.696 INFO:tasks.workunit.client.0.smithi002.stdout:checking for acl_init in -lacl... yes 2024-09-12T00:55:11.763 INFO:tasks.workunit.client.0.smithi002.stdout:checking gdbm-ndbm.h usability... no 2024-09-12T00:55:11.796 INFO:tasks.workunit.client.0.smithi002.stdout:checking gdbm-ndbm.h presence... no 2024-09-12T00:55:11.796 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gdbm-ndbm.h... no 2024-09-12T00:55:11.834 INFO:tasks.workunit.client.0.smithi002.stdout:checking gdbm/ndbm.h usability... no 2024-09-12T00:55:11.871 INFO:tasks.workunit.client.0.smithi002.stdout:checking gdbm/ndbm.h presence... no 2024-09-12T00:55:11.871 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gdbm/ndbm.h... no 2024-09-12T00:55:11.903 INFO:tasks.workunit.client.0.smithi002.stdout:checking ndbm.h usability... no 2024-09-12T00:55:11.939 INFO:tasks.workunit.client.0.smithi002.stdout:checking ndbm.h presence... no 2024-09-12T00:55:11.940 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ndbm.h... no 2024-09-12T00:55:11.966 INFO:tasks.workunit.client.0.smithi002.stdout:checking libaio.h usability... yes 2024-09-12T00:55:11.984 INFO:tasks.workunit.client.0.smithi002.stdout:checking libaio.h presence... yes 2024-09-12T00:55:11.984 INFO:tasks.workunit.client.0.smithi002.stdout:checking for libaio.h... yes 2024-09-12T00:55:12.029 INFO:tasks.workunit.client.0.smithi002.stdout:checking liburing.h usability... no 2024-09-12T00:55:12.058 INFO:tasks.workunit.client.0.smithi002.stdout:checking liburing.h presence... no 2024-09-12T00:55:12.059 INFO:tasks.workunit.client.0.smithi002.stdout:checking for liburing.h... no 2024-09-12T00:55:12.098 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/capability.h usability... no 2024-09-12T00:55:12.133 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/capability.h presence... no 2024-09-12T00:55:12.133 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/capability.h... no 2024-09-12T00:55:12.169 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/fiemap.h usability... yes 2024-09-12T00:55:12.188 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/fiemap.h presence... yes 2024-09-12T00:55:12.188 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/fiemap.h... yes 2024-09-12T00:55:12.227 INFO:tasks.workunit.client.0.smithi002.stdout:checking for fallocate... yes 2024-09-12T00:55:12.281 INFO:tasks.workunit.client.0.smithi002.stdout:checking for open_by_handle_at... yes 2024-09-12T00:55:12.319 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/fs.h usability... yes 2024-09-12T00:55:12.335 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/fs.h presence... yes 2024-09-12T00:55:12.335 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/fs.h... yes 2024-09-12T00:55:12.391 INFO:tasks.workunit.client.0.smithi002.stdout:checking btrfsutil.h usability... no 2024-09-12T00:55:12.419 INFO:tasks.workunit.client.0.smithi002.stdout:checking btrfsutil.h presence... no 2024-09-12T00:55:12.419 INFO:tasks.workunit.client.0.smithi002.stdout:checking for btrfsutil.h... no 2024-09-12T00:55:12.469 INFO:tasks.workunit.client.0.smithi002.stdout:checking for copy_file_range... yes 2024-09-12T00:55:12.513 INFO:tasks.workunit.client.0.smithi002.stdout:checking for SEEK_DATA... yes 2024-09-12T00:55:12.571 INFO:tasks.workunit.client.0.smithi002.stdout:checking for BMV_OF_SHARED... yes 2024-09-12T00:55:12.624 INFO:tasks.workunit.client.0.smithi002.stdout:checking for nftw... yes 2024-09-12T00:55:12.681 INFO:tasks.workunit.client.0.smithi002.stdout:checking for RLIMIT_NOFILE... yes 2024-09-12T00:55:12.728 INFO:tasks.workunit.client.0.smithi002.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-12T00:55:12.791 INFO:tasks.workunit.client.0.smithi002.stdout:checking for FICLONE... yes 2024-09-12T00:55:12.838 INFO:tasks.workunit.client.0.smithi002.stdout:checking for renameat2... yes 2024-09-12T00:55:12.880 INFO:tasks.workunit.client.0.smithi002.stdout:checking for reallocarray... yes 2024-09-12T00:55:12.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:12 smithi071 ceph-mon[35276]: pgmap v71: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-09-12T00:55:12.945 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct mount_attr... yes 2024-09-12T00:55:12.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:12 smithi002 ceph-mon[31210]: pgmap v71: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-09-12T00:55:13.012 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-12T00:55:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:12 smithi167 ceph-mon[35234]: pgmap v71: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-09-12T00:55:13.074 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-12T00:55:13.208 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-12T00:55:13.266 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-12T00:55:13.325 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-12T00:55:13.382 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-12T00:55:13.443 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-12T00:55:13.484 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/btrfs.h usability... yes 2024-09-12T00:55:13.500 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/btrfs.h presence... yes 2024-09-12T00:55:13.500 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/btrfs.h... yes 2024-09-12T00:55:13.552 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-12T00:55:13.569 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-12T00:55:13.569 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/btrfs_tree.h... yes 2024-09-12T00:55:13.617 INFO:tasks.workunit.client.0.smithi002.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-12T00:55:13.648 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-12T00:55:13.668 INFO:tasks.workunit.client.0.smithi002.stdout:configure: creating ./config.status 2024-09-12T00:55:14.016 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: creating include/builddefs 2024-09-12T00:55:14.032 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: creating include/config.h 2024-09-12T00:55:14.045 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: executing libtool commands 2024-09-12T00:55:14.137 INFO:tasks.workunit.client.0.smithi002.stdout:Building include 2024-09-12T00:55:14.137 INFO:tasks.workunit.client.0.smithi002.stdout:Building lib 2024-09-12T00:55:14.137 INFO:tasks.workunit.client.0.smithi002.stdout:Building tests 2024-09-12T00:55:14.145 INFO:tasks.workunit.client.0.smithi002.stdout:Building btrfs 2024-09-12T00:55:14.145 INFO:tasks.workunit.client.0.smithi002.stdout:Building ceph 2024-09-12T00:55:14.145 INFO:tasks.workunit.client.0.smithi002.stdout:Building cifs 2024-09-12T00:55:14.152 INFO:tasks.workunit.client.0.smithi002.stdout: [LTDEP] 2024-09-12T00:55:14.155 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-12T00:55:14.155 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-12T00:55:14.176 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-12T00:55:14.177 INFO:tasks.workunit.client.0.smithi002.stdout:Building ext4 2024-09-12T00:55:14.183 INFO:tasks.workunit.client.0.smithi002.stdout:Building f2fs 2024-09-12T00:55:14.191 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-12T00:55:14.201 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-12T00:55:14.216 INFO:tasks.workunit.client.0.smithi002.stdout:Building generic 2024-09-12T00:55:14.366 INFO:tasks.workunit.client.0.smithi002.stdout:Building nfs 2024-09-12T00:55:14.367 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-12T00:55:14.374 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-12T00:55:14.389 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dataascii.lo 2024-09-12T00:55:14.394 INFO:tasks.workunit.client.0.smithi002.stdout:Building ocfs2 2024-09-12T00:55:14.402 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-12T00:55:14.421 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] databin.lo 2024-09-12T00:55:14.555 INFO:tasks.workunit.client.0.smithi002.stdout:Building overlay 2024-09-12T00:55:14.565 INFO:tasks.workunit.client.0.smithi002.stdout:Building perf 2024-09-12T00:55:14.573 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-12T00:55:14.574 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-12T00:55:14.593 INFO:tasks.workunit.client.0.smithi002.stdout:Building selftest 2024-09-12T00:55:14.601 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-12T00:55:14.621 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] datapid.lo 2024-09-12T00:55:14.624 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] file_lock.lo 2024-09-12T00:55:14.729 INFO:tasks.workunit.client.0.smithi002.stdout:Building shared 2024-09-12T00:55:14.737 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-12T00:55:14.762 INFO:tasks.workunit.client.0.smithi002.stdout:Building tmpfs 2024-09-12T00:55:14.765 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] forker.lo 2024-09-12T00:55:14.769 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-12T00:55:14.793 INFO:tasks.workunit.client.0.smithi002.stdout:Building udf 2024-09-12T00:55:14.801 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-12T00:55:14.817 INFO:tasks.workunit.client.0.smithi002.stdout:Building xfs 2024-09-12T00:55:14.829 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] pattern.lo 2024-09-12T00:55:14.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:14 smithi071 ceph-mon[35276]: pgmap v72: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 415 KiB/s wr, 56 op/s 2024-09-12T00:55:14.968 INFO:tasks.workunit.client.0.smithi002.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-12T00:55:14.971 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] open_flags.lo 2024-09-12T00:55:14.989 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] random_range.lo 2024-09-12T00:55:14.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:14 smithi002 ceph-mon[31210]: pgmap v72: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 415 KiB/s wr, 56 op/s 2024-09-12T00:55:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:14 smithi167 ceph-mon[35234]: pgmap v72: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 415 KiB/s wr, 56 op/s 2024-09-12T00:55:15.157 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] string_to_tokens.lo 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] str_to_bytes.lo 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] tlibio.lo 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] write_log.lo 2024-09-12T00:55:15.459 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] random.lo 2024-09-12T00:55:15.623 INFO:tasks.workunit.client.0.smithi002.stdout: [LD] 2024-09-12T00:55:15.745 INFO:tasks.workunit.client.0.smithi002.stdout:Building ltp 2024-09-12T00:55:15.746 INFO:tasks.workunit.client.0.smithi002.stdout:Building src 2024-09-12T00:55:15.746 INFO:tasks.workunit.client.0.smithi002.stdout:Building m4 2024-09-12T00:55:15.751 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-09-12T00:55:15.753 INFO:tasks.workunit.client.0.smithi002.stdout:Building common 2024-09-12T00:55:15.767 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-09-12T00:55:15.982 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] doio 2024-09-12T00:55:15.982 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fsstress 2024-09-12T00:55:15.982 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fsx 2024-09-12T00:55:16.744 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] growfiles 2024-09-12T00:55:16.813 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] iogen 2024-09-12T00:55:16.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:16 smithi002 ceph-mon[31210]: pgmap v73: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 292 KiB/s wr, 14 op/s 2024-09-12T00:55:17.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:16 smithi167 ceph-mon[35234]: pgmap v73: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 292 KiB/s wr, 14 op/s 2024-09-12T00:55:17.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:16 smithi071 ceph-mon[35276]: pgmap v73: 97 pgs: 97 active+clean; 74 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 292 KiB/s wr, 14 op/s 2024-09-12T00:55:17.209 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-stress 2024-09-12T00:55:17.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:55:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:18.026 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-09-12T00:55:18.026 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-09-12T00:55:18.027 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-09-12T00:55:18.028 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-09-12T00:55:18.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 -- 172.21.15.2:0/4265418238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0810e4d0 msgr2=0x7f1f081108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 --2- 172.21.15.2:0/4265418238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0810e4d0 0x7f1f081108e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009ca0 tx=0x7f1f0002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 -- 172.21.15.2:0/4265418238 shutdown_connections 2024-09-12T00:55:18.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 --2- 172.21.15.2:0/4265418238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0810e4d0 0x7f1f081108e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 --2- 172.21.15.2:0/4265418238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08101360 0x7f1f0810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 --2- 172.21.15.2:0/4265418238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f081009b0 0x7f1f08100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 -- 172.21.15.2:0/4265418238 >> 172.21.15.2:0/4265418238 conn(0x7f1f080fc7d0 msgr2=0x7f1f080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 -- 172.21.15.2:0/4265418238 shutdown_connections 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.188+0000 7f1f0f909640 1 -- 172.21.15.2:0/4265418238 wait complete. 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0f909640 1 Processor -- start 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0f909640 1 -- start start 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0f909640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f081009b0 0x7f1f0819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0f909640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f08101360 0x7f1f0819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0f909640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f0810e4d0 0x7f1f0819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0f909640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08114200 con 0x7f1f081009b0 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0f909640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08114080 con 0x7f1f08101360 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0f909640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08114380 con 0x7f1f0810e4d0 2024-09-12T00:55:18.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0d6a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f081009b0 0x7f1f0819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0d6a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f081009b0 0x7f1f0819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43730/0 (socket says 172.21.15.2:43730) 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.189+0000 7f1f0d6a5640 1 -- 172.21.15.2:0/2047189841 learned_addr learned my addr 172.21.15.2:0/2047189841 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f0810e4d0 0x7f1f0819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f08101360 0x7f1f0819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0d6a5640 1 -- 172.21.15.2:0/2047189841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f0810e4d0 msgr2=0x7f1f0819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0d6a5640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f0810e4d0 0x7f1f0819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0d6a5640 1 -- 172.21.15.2:0/2047189841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f08101360 msgr2=0x7f1f0819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0d6a5640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f08101360 0x7f1f0819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0d6a5640 1 -- 172.21.15.2:0/2047189841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0819f650 con 0x7f1f081009b0 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f08101360 0x7f1f0819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0d6a5640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f081009b0 0x7f1f0819a6a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400d950 tx=0x7f1f0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1efe7fc640 1 -- 172.21.15.2:0/2047189841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04017070 con 0x7f1f081009b0 2024-09-12T00:55:18.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0f909640 1 -- 172.21.15.2:0/2047189841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0819f940 con 0x7f1f081009b0 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1efe7fc640 1 -- 172.21.15.2:0/2047189841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f04009c30 con 0x7f1f081009b0 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1f0f909640 1 -- 172.21.15.2:0/2047189841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f081a7220 con 0x7f1f081009b0 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.190+0000 7f1efe7fc640 1 -- 172.21.15.2:0/2047189841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04020060 con 0x7f1f081009b0 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.193+0000 7f1f11ce2740 1 Processor -- start 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.193+0000 7f1f11ce2740 1 -- start start 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.193+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2705c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.193+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2705cdc0 0x55ec27067140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.193+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec27067680 0x55ec27069a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.193+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ec26fc22e0 con 0x55ec2705c4a0 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.193+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ec26f69ce0 con 0x55ec27067680 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.193+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec26fbe2a0 con 0x55ec2705cdc0 2024-09-12T00:55:18.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2705c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2705c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43732/0 (socket says 172.21.15.2:43732) 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 -- 172.21.15.2:0/990792342 learned_addr learned my addr 172.21.15.2:0/990792342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1efe7fc640 1 -- 172.21.15.2:0/2047189841 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f1f040109d0 con 0x7f1f081009b0 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/990792342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec27067680 0x55ec27069a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 -- 172.21.15.2:0/990792342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2705cdc0 msgr2=0x55ec27067140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/990792342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2705cdc0 0x55ec27067140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 -- 172.21.15.2:0/990792342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec27067680 msgr2=0x55ec27069a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/990792342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec27067680 0x55ec27069a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 -- 172.21.15.2:0/990792342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec26f4e440 con 0x55ec2705c4a0 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/990792342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2705c880 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f00004af0 tx=0x7f1f000098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09954c822b82fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.194+0000 7f1ef37fe640 1 -- 172.21.15.2:0/990792342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00003970 con 0x55ec2705c4a0 2024-09-12T00:55:18.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.195+0000 7f1ef37fe640 1 -- 172.21.15.2:0/990792342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f00036040 con 0x55ec2705c4a0 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.195+0000 7f1ef37fe640 1 -- 172.21.15.2:0/990792342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f000043a0 con 0x55ec2705c4a0 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.195+0000 7f1efe7fc640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1ef40a2cf0 0x7f1ef40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.195+0000 7f1f0d6a5640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1ef40a2cf0 0x7f1ef40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.195+0000 7f1efe7fc640 1 -- 172.21.15.2:0/2047189841 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f1f040cf160 con 0x7f1f081009b0 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.195+0000 7f1f11ce2740 1 -- 172.21.15.2:0/990792342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 msgr2=0x55ec2705c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.195+0000 7f1f0d6a5640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1ef40a2cf0 0x7f1ef40a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ec27059890 tx=0x7f1f04022f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.195+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/990792342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2705c880 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f00004af0 tx=0x7f1f000098b0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 -- 172.21.15.2:0/990792342 shutdown_connections 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/990792342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec27067680 0x55ec27069a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/990792342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2705cdc0 0x55ec27067140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/990792342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2705c880 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 -- 172.21.15.2:0/990792342 >> 172.21.15.2:0/990792342 conn(0x55ec27058a30 msgr2=0x55ec27058e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 -- 172.21.15.2:0/990792342 shutdown_connections 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 -- 172.21.15.2:0/990792342 wait complete. 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 -- start start 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 Processor -- start 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec27067030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.196+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec270642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec27064880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ec2706a0d0 con 0x55ec2705c4a0 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ec26f7d050 con 0x55ec2705cdc0 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec2706a250 con 0x55ec27067680 2024-09-12T00:55:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f11ce2740 10 client.0 _ll_register_callbacks cb 0x55ec26fbd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec27067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec27067030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43748/0 (socket says 172.21.15.2:43748) 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 -- 172.21.15.2:0/2634548069 learned_addr learned my addr 172.21.15.2:0/2634548069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec27064880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec270642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 -- 172.21.15.2:0/2634548069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 msgr2=0x55ec27064880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec27064880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 -- 172.21.15.2:0/2634548069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 msgr2=0x55ec270642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec270642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 -- 172.21.15.2:0/2634548069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec26d333c0 con 0x55ec2705c4a0 2024-09-12T00:55:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec27067030 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1f0002a900 tx=0x7f1f00031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783dfeb7fb458cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1ef0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.197+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2634548069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00056060 con 0x55ec2705c4a0 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2634548069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f1f00004120 con 0x55ec2705c4a0 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2634548069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f00036040 con 0x55ec2705c4a0 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2634548069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f0004a040 con 0x55ec2705c4a0 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 10 client.15837 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2634548069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ec2706a0d0 con 0x55ec2705c4a0 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2634548069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f00036040 con 0x55ec2705c4a0 2024-09-12T00:55:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2634548069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1f00050070 con 0x55ec2705c4a0 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 10 client.15837 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 20 client.15837 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ec27076c60 0x55ec27079050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 4 client.15837 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2634548069 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec26fcf850 con 0x55ec27076c60 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.198+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ec27076c60 0x55ec27079050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.199+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ec27076c60 0x55ec27079050 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9e97eccd96801b server_cookie=9c111bb85e23d876 in_seq=0 out_seq=0 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.199+0000 7f1ef0ff9640 10 client.15837 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2634548069 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec26fcf850 con 0x55ec27076c60 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1ef0ff9640 10 client.15837 handle_command_reply: tid=0 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 client.15837 shutdown 2024-09-12T00:55:18.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2634548069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 msgr2=0x55ec27067030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec27067030 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1f0002a900 tx=0x7f1f00031a50 comp rx=0 tx=0).stop 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2634548069 shutdown_connections 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ec27076c60 0x55ec27079050 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1ef0ff9640 0 client.15837 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec27064880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec270642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2634548069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec27067030 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2634548069 >> 172.21.15.2:0/2634548069 conn(0x55ec27058a30 msgr2=0x55ec2705e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:18.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2634548069 shutdown_connections 2024-09-12T00:55:18.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2634548069 wait complete. 2024-09-12T00:55:18.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.200+0000 7f1f11ce2740 20 client.15837 trim_cache size 0 max 16384 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.218+0000 7f1f11ce2740 1 Processor -- start 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.218+0000 7f1f11ce2740 1 -- start start 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2707e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2707edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec27061540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081b2390 con 0x55ec2705c4a0 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081afc60 con 0x55ec2705cdc0 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081adab0 con 0x55ec27067680 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0cea4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2707edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0cea4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2707edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:37432/0 (socket says 172.21.15.2:37432) 2024-09-12T00:55:18.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0cea4640 1 -- 172.21.15.2:0/2059424815 learned_addr learned my addr 172.21.15.2:0/2059424815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0cea4640 1 -- 172.21.15.2:0/2059424815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 msgr2=0x55ec27061540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec27061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0cea4640 1 -- 172.21.15.2:0/2059424815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 msgr2=0x55ec2707e8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2707e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2707e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.219+0000 7f1f0cea4640 1 -- 172.21.15.2:0/2059424815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec27063290 con 0x55ec2705cdc0 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.220+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2707e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.220+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2707edf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8005d80 tx=0x7f1ef80119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1b6b9ea1ff7e33e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.220+0000 7f1ef2ffd640 1 -- 172.21.15.2:0/2059424815 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8020020 con 0x55ec2705cdc0 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.220+0000 7f1ef2ffd640 1 -- 172.21.15.2:0/2059424815 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ef801cb50 con 0x55ec2705cdc0 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.220+0000 7f1ef2ffd640 1 -- 172.21.15.2:0/2059424815 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8010e70 con 0x55ec2705cdc0 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2059424815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 msgr2=0x55ec2707edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2707edf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8005d80 tx=0x7f1ef80119d0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2059424815 shutdown_connections 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec27061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2707edf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2059424815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2707e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2059424815 >> 172.21.15.2:0/2059424815 conn(0x55ec27058a30 msgr2=0x55ec27066360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2059424815 shutdown_connections 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2059424815 wait complete. 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 -- start start 2024-09-12T00:55:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.221+0000 7f1f11ce2740 1 Processor -- start 2024-09-12T00:55:18.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2706d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2706de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f11ce2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec270e0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081ae120 con 0x55ec2705c4a0 2024-09-12T00:55:18.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081af590 con 0x55ec2705cdc0 2024-09-12T00:55:18.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f11ce2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081ae7f0 con 0x55ec27067680 2024-09-12T00:55:18.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f11ce2740 10 client.0 _ll_register_callbacks cb 0x7f1ef800b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2706d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2706d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43762/0 (socket says 172.21.15.2:43762) 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 -- 172.21.15.2:0/2879538845 learned_addr learned my addr 172.21.15.2:0/2879538845 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2706de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 -- 172.21.15.2:0/2879538845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 msgr2=0x55ec270e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec270e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 -- 172.21.15.2:0/2879538845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 msgr2=0x55ec2706de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2706de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 -- 172.21.15.2:0/2879538845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec270e0dd0 con 0x55ec2705c4a0 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1f0dea6640 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2706d8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1f00006010 tx=0x7f1f00009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40cd2d31b9ab676 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.222+0000 7f1ef0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2879538845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0003f070 con 0x55ec2705c4a0 2024-09-12T00:55:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2879538845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f1f0002fa20 con 0x55ec2705c4a0 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2879538845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ef801cb50 con 0x55ec2705c4a0 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2879538845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f00068050 con 0x55ec2705c4a0 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 10 client.15840 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2879538845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ec270e1fd0 con 0x55ec2705c4a0 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2879538845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ef801cb50 con 0x55ec2705c4a0 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2879538845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1f00060020 con 0x55ec2705c4a0 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 10 client.15840 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 20 client.15840 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ec27076c60 0x55ec270e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 4 client.15840 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2879538845 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec26fc9d60 con 0x55ec27076c60 2024-09-12T00:55:18.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.223+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ec27076c60 0x55ec270e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.224+0000 7f1f0cea4640 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ec27076c60 0x55ec270e46d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e9bfc632b404d80 server_cookie=52739a5c7d694f69 in_seq=0 out_seq=0 2024-09-12T00:55:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.224+0000 7f1ef0ff9640 10 client.15840 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.227+0000 7f1ef0ff9640 1 -- 172.21.15.2:0/2879538845 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ec26fc9d60 con 0x55ec27076c60 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.227+0000 7f1ef0ff9640 10 client.15840 handle_command_reply: tid=0 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.227+0000 7f1f11ce2740 1 client.15840 shutdown 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.227+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2879538845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 msgr2=0x55ec2706d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.227+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2706d8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1f00006010 tx=0x7f1f00009360 comp rx=0 tx=0).stop 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2879538845 shutdown_connections 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ec27076c60 0x55ec270e46d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec27067680 0x55ec270e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ec2705cdc0 0x55ec2706de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1f11ce2740 1 --2- 172.21.15.2:0/2879538845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec2705c4a0 0x55ec2706d8f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2879538845 >> 172.21.15.2:0/2879538845 conn(0x55ec27058a30 msgr2=0x55ec27057370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1ef0ff9640 0 client.15840 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2879538845 shutdown_connections 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.228+0000 7f1f11ce2740 1 -- 172.21.15.2:0/2879538845 wait complete. 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.229+0000 7f1f11ce2740 20 client.15840 trim_cache size 0 max 16384 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:55:18.230 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:55:18.231 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:55:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.229+0000 7f1f0f909640 1 -- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1ef40a2cf0 msgr2=0x7f1ef40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.229+0000 7f1f0f909640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1ef40a2cf0 0x7f1ef40a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ec27059890 tx=0x7f1f04022f90 comp rx=0 tx=0).stop 2024-09-12T00:55:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.229+0000 7f1f0f909640 1 -- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f081009b0 msgr2=0x7f1f0819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.229+0000 7f1f0f909640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f081009b0 0x7f1f0819a6a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400d950 tx=0x7f1f0400de10 comp rx=0 tx=0).stop 2024-09-12T00:55:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.230+0000 7f1f0f909640 1 -- 172.21.15.2:0/2047189841 shutdown_connections 2024-09-12T00:55:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.230+0000 7f1f0f909640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1ef40a2cf0 0x7f1ef40a51b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.230+0000 7f1f0f909640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f0810e4d0 0x7f1f0819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.230+0000 7f1f0f909640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f08101360 0x7f1f0819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.230+0000 7f1f0f909640 1 --2- 172.21.15.2:0/2047189841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f081009b0 0x7f1f0819a6a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.230+0000 7f1f0f909640 1 -- 172.21.15.2:0/2047189841 >> 172.21.15.2:0/2047189841 conn(0x7f1f080fc7d0 msgr2=0x7f1f080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.230+0000 7f1f0f909640 1 -- 172.21.15.2:0/2047189841 shutdown_connections 2024-09-12T00:55:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:18.230+0000 7f1f0f909640 1 -- 172.21.15.2:0/2047189841 wait complete. 2024-09-12T00:55:18.309 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dirstress 2024-09-12T00:55:18.309 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fill 2024-09-12T00:55:18.310 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fill2 2024-09-12T00:55:18.310 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] getpagesize 2024-09-12T00:55:18.465 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] holes 2024-09-12T00:55:18.476 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] lstat64 2024-09-12T00:55:18.556 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] nametest 2024-09-12T00:55:18.577 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] permname 2024-09-12T00:55:18.660 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] randholes 2024-09-12T00:55:18.698 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] runas 2024-09-12T00:55:18.773 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] truncfile 2024-09-12T00:55:18.840 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] usemem 2024-09-12T00:55:18.883 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] mmapcat 2024-09-12T00:55:18.934 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] append_reader 2024-09-12T00:55:18.955 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] append_writer 2024-09-12T00:55:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:18 smithi002 ceph-mon[31210]: pgmap v74: 97 pgs: 97 active+clean; 77 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 525 KiB/s wr, 366 op/s 2024-09-12T00:55:19.008 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dirperf 2024-09-12T00:55:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:18 smithi167 ceph-mon[35234]: pgmap v74: 97 pgs: 97 active+clean; 77 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 525 KiB/s wr, 366 op/s 2024-09-12T00:55:19.038 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] metaperf 2024-09-12T00:55:19.097 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] devzero 2024-09-12T00:55:19.124 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] feature 2024-09-12T00:55:19.185 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:55:19.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:55:19.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:18 smithi071 ceph-mon[35276]: pgmap v74: 97 pgs: 97 active+clean; 77 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 525 KiB/s wr, 366 op/s 2024-09-12T00:55:19.250 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] alloc 2024-09-12T00:55:19.284 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fault 2024-09-12T00:55:19.370 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fstest 2024-09-12T00:55:19.403 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_access_root 2024-09-12T00:55:19.459 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] godown 2024-09-12T00:55:19.488 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] resvtest 2024-09-12T00:55:19.549 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:19.593 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] writemod 2024-09-12T00:55:19.657 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] writev_on_pagefault 2024-09-12T00:55:19.669 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] makeextents 2024-09-12T00:55:19.697 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] itrash 2024-09-12T00:55:19.752 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] rename 2024-09-12T00:55:19.821 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] multi_open_unlink 2024-09-12T00:55:19.856 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] unwritten_sync 2024-09-12T00:55:19.856 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] genhashnames 2024-09-12T00:55:19.894 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_holes 2024-09-12T00:55:20.001 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_writev 2024-09-12T00:55:20.054 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_truncate_cmtime 2024-09-12T00:55:20.065 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dirhash_collide 2024-09-12T00:55:20.067 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_rename_overwrite 2024-09-12T00:55:20.154 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] holetest 2024-09-12T00:55:20.235 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] af_unix 2024-09-12T00:55:20.235 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_truncate_self 2024-09-12T00:55:20.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/284101034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100aa0 msgr2=0x7f2bd410ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/284101034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100aa0 0x7f2bd410ea20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009ca0 tx=0x7f2bcc02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/284101034 shutdown_connections 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/284101034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100aa0 0x7f2bd410ea20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/284101034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bd4100100 0x7f2bd4100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/284101034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bd4106b80 0x7f2bd4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/284101034 >> 172.21.15.2:0/284101034 conn(0x7f2bd4077230 msgr2=0x7f2bd40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/284101034 shutdown_connections 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.226+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/284101034 wait complete. 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.227+0000 7f2bd9ee8640 1 Processor -- start 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.227+0000 7f2bd9ee8640 1 -- start start 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.227+0000 7f2bd9ee8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100100 0x7f2bd4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.227+0000 7f2bd9ee8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bd4100aa0 0x7f2bd41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.227+0000 7f2bd9ee8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bd4106b80 0x7f2bd419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100100 0x7f2bd4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd9ee8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4112050 con 0x7f2bd4100100 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd9ee8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4111ed0 con 0x7f2bd4106b80 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd9ee8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41121d0 con 0x7f2bd4100aa0 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100100 0x7f2bd4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43780/0 (socket says 172.21.15.2:43780) 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 -- 172.21.15.2:0/1665285252 learned_addr learned my addr 172.21.15.2:0/1665285252 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd3fff640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bd4106b80 0x7f2bd419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd2ffd640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bd4100aa0 0x7f2bd41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 -- 172.21.15.2:0/1665285252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bd4100aa0 msgr2=0x7f2bd41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bd4100aa0 0x7f2bd41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 -- 172.21.15.2:0/1665285252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bd4106b80 msgr2=0x7f2bd419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bd4106b80 0x7f2bd419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 -- 172.21.15.2:0/1665285252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd419d440 con 0x7f2bd4100100 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd3fff640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bd4106b80 0x7f2bd419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.228+0000 7f2bd37fe640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100100 0x7f2bd4198490 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400e9f0 tx=0x7f2bc400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.229+0000 7f2bd0ff9640 1 -- 172.21.15.2:0/1665285252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc400cd80 con 0x7f2bd4100100 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.229+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd419d730 con 0x7f2bd4100100 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.229+0000 7f2bd0ff9640 1 -- 172.21.15.2:0/1665285252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bc4010910 con 0x7f2bd4100100 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.229+0000 7f2bd0ff9640 1 -- 172.21.15.2:0/1665285252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc40188f0 con 0x7f2bd4100100 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.229+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd4101210 con 0x7f2bd4100100 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.230+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd4100560 con 0x7f2bd4100100 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.232+0000 7f2bd0ff9640 1 -- 172.21.15.2:0/1665285252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f2bc4010ac0 con 0x7f2bd4100100 2024-09-12T00:55:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.233+0000 7f2bd0ff9640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2bbc0a2cf0 0x7f2bbc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.233+0000 7f2bd0ff9640 1 -- 172.21.15.2:0/1665285252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2bc40cf810 con 0x7f2bd4100100 2024-09-12T00:55:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.233+0000 7f2bd2ffd640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2bbc0a2cf0 0x7f2bbc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.234+0000 7f2bd2ffd640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2bbc0a2cf0 0x7f2bbc0a51b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40ff780 tx=0x7f2bc8005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.238+0000 7f2bd0ff9640 1 -- 172.21.15.2:0/1665285252 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2bc409bd90 con 0x7f2bd4100100 2024-09-12T00:55:20.315 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_stale_pmd 2024-09-12T00:55:20.390 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_cow_race 2024-09-12T00:55:20.410 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_fallocate 2024-09-12T00:55:20.433 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fsync-err 2024-09-12T00:55:20.507 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_write_ro 2024-09-12T00:55:20.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.526+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bd4101530 con 0x7f2bd4100100 2024-09-12T00:55:20.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.527+0000 7f2bd0ff9640 1 -- 172.21.15.2:0/1665285252 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7f2bc40a0090 con 0x7f2bd4100100 2024-09-12T00:55:20.526 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:55:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:55:20.527 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2bbc0a2cf0 msgr2=0x7f2bbc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2bbc0a2cf0 0x7f2bbc0a51b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40ff780 tx=0x7f2bc8005f90 comp rx=0 tx=0).stop 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100100 msgr2=0x7f2bd4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100100 0x7f2bd4198490 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400e9f0 tx=0x7f2bc400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 shutdown_connections 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2bbc0a2cf0 0x7f2bbc0a51b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bd4106b80 0x7f2bd419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bd4100aa0 0x7f2bd41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 --2- 172.21.15.2:0/1665285252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100100 0x7f2bd4198490 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 >> 172.21.15.2:0/1665285252 conn(0x7f2bd4077230 msgr2=0x7f2bd4104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 shutdown_connections 2024-09-12T00:55:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:20.530+0000 7f2bd9ee8640 1 -- 172.21.15.2:0/1665285252 wait complete. 2024-09-12T00:55:20.582 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-12T00:55:20.585 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-12T00:55:20.646 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_ofd_locks 2024-09-12T00:55:20.672 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_collision 2024-09-12T00:55:20.750 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] mmap-write-concurrent 2024-09-12T00:55:20.773 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_get_file_time 2024-09-12T00:55:20.854 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_create_short_dirs 2024-09-12T00:55:20.900 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_create_long_dirs 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_enospc 2024-09-12T00:55:20.943 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_writev_overlap 2024-09-12T00:55:20.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:20 smithi002 ceph-mon[31210]: pgmap v75: 97 pgs: 97 active+clean; 77 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 302 KiB/s wr, 359 op/s 2024-09-12T00:55:20.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:20 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1665285252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:21.032 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] checkpoint_journal 2024-09-12T00:55:21.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:20 smithi167 ceph-mon[35234]: pgmap v75: 97 pgs: 97 active+clean; 77 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 302 KiB/s wr, 359 op/s 2024-09-12T00:55:21.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:20 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1665285252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:21.075 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] mmap-rw-fault 2024-09-12T00:55:21.120 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] allocstale 2024-09-12T00:55:21.151 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_cow_memory_failure 2024-09-12T00:55:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:20 smithi071 ceph-mon[35276]: pgmap v75: 97 pgs: 97 active+clean; 77 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 302 KiB/s wr, 359 op/s 2024-09-12T00:55:21.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:20 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1665285252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:21.216 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fake-dump-rootino 2024-09-12T00:55:21.267 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dio-buf-fault 2024-09-12T00:55:21.306 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] rewinddir-test 2024-09-12T00:55:21.326 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] readdir-while-renames 2024-09-12T00:55:21.377 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] xfsctl 2024-09-12T00:55:21.447 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] bstat 2024-09-12T00:55:21.475 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mtab 2024-09-12T00:55:21.510 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] getdevicesize 2024-09-12T00:55:21.573 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] preallo_rw_pattern_reader 2024-09-12T00:55:21.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:55:21.665 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] preallo_rw_pattern_writer 2024-09-12T00:55:21.675 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] ftrunc 2024-09-12T00:55:21.676 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] trunc 2024-09-12T00:55:21.760 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fs_perms 2024-09-12T00:55:21.842 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] testx 2024-09-12T00:55:21.852 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] looptest 2024-09-12T00:55:21.858 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] locktest 2024-09-12T00:55:21.968 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] unwritten_mmap 2024-09-12T00:55:21.993 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] bulkstat_unlink_test 2024-09-12T00:55:21.995 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:22.085 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] deduperace 2024-09-12T00:55:22.157 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] bulkstat_unlink_test_modified 2024-09-12T00:55:22.203 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_dir_offset 2024-09-12T00:55:22.203 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_futimens 2024-09-12T00:55:22.298 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_immutable 2024-09-12T00:55:22.357 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] stale_handle 2024-09-12T00:55:22.357 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] pwrite_mmap_blocked 2024-09-12T00:55:22.374 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_dir_offset2 2024-09-12T00:55:22.520 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] seek_sanity_test 2024-09-12T00:55:22.546 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] seek_copy_test 2024-09-12T00:55:22.584 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_readdir_1 2024-09-12T00:55:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/1913991455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 msgr2=0x7f0aac106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/1913991455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 0x7f0aac106f60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009900 tx=0x7f0a9c02a3f0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/1913991455 shutdown_connections 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/1913991455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aac100aa0 0x7f0aac10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/1913991455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aac100100 0x7f0aac100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/1913991455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 0x7f0aac106f60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/1913991455 >> 172.21.15.2:0/1913991455 conn(0x7f0aac077230 msgr2=0x7f0aac0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/1913991455 shutdown_connections 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.630+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/1913991455 wait complete. 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.631+0000 7f0ab1f1b640 1 Processor -- start 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.631+0000 7f0ab1f1b640 1 -- start start 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0ab1f1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aac100100 0x7f0aac1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0ab1f1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aac100aa0 0x7f0aac198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0ab1f1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 0x7f0aac19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0ab1f1b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac112050 con 0x7f0aac106b80 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0ab1f1b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac111ed0 con 0x7f0aac100aa0 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0ab1f1b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1121d0 con 0x7f0aac100100 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 0x7f0aac19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 0x7f0aac19cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43794/0 (socket says 172.21.15.2:43794) 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0aabfff640 1 -- 172.21.15.2:0/977837203 learned_addr learned my addr 172.21.15.2:0/977837203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.632+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aac100100 0x7f0aac1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.633+0000 7f0aaaffd640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aac100aa0 0x7f0aac198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.633+0000 7f0aab7fe640 1 -- 172.21.15.2:0/977837203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aac100aa0 msgr2=0x7f0aac198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.633+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aac100aa0 0x7f0aac198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.633+0000 7f0aab7fe640 1 -- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 msgr2=0x7f0aac19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.633+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 0x7f0aac19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.633+0000 7f0aab7fe640 1 -- 172.21.15.2:0/977837203 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac19d580 con 0x7f0aac100100 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.633+0000 7f0aabfff640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 0x7f0aac19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.633+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aac100100 0x7f0aac1985d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c000c00 tx=0x7f0a9c032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.634+0000 7f0aa8ff9640 1 -- 172.21.15.2:0/977837203 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c03f030 con 0x7f0aac100100 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.634+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/977837203 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac19d810 con 0x7f0aac100100 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.634+0000 7f0aa8ff9640 1 -- 172.21.15.2:0/977837203 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a9c003ad0 con 0x7f0aac100100 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.634+0000 7f0aa8ff9640 1 -- 172.21.15.2:0/977837203 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c035070 con 0x7f0aac100100 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.634+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/977837203 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac101210 con 0x7f0aac100100 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.637+0000 7f0aa8ff9640 1 -- 172.21.15.2:0/977837203 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f0a9c042030 con 0x7f0aac100100 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.638+0000 7f0ab42f4740 1 Processor -- start 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.638+0000 7f0ab42f4740 1 -- start start 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.638+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b81796090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.638+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b81796a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.638+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b817a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.638+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b816fc2f0 con 0x564b81797b40 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.638+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564b816a3cf0 con 0x564b817a1370 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.638+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564b816f82b0 con 0x564b817965d0 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b81796090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b81796090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43802/0 (socket says 172.21.15.2:43802) 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 -- 172.21.15.2:0/3985325554 learned_addr learned my addr 172.21.15.2:0/3985325554 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b81796a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aa8ff9640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0a940a2df0 0x7f0a940a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0a940a2df0 0x7f0a940a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aa8ff9640 1 -- 172.21.15.2:0/977837203 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f0a9c0efbf0 con 0x7f0aac100100 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 -- 172.21.15.2:0/3985325554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 msgr2=0x564b81796a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:22.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aaaffd640 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b817a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b81796a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 -- 172.21.15.2:0/3985325554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 msgr2=0x564b817a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b817a3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 -- 172.21.15.2:0/3985325554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b816883a0 con 0x564b81797b40 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b81796a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aaaffd640 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b817a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.639+0000 7f0aabfff640 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b81796090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4013eb0 tx=0x7f0aa400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecde8ef45b94b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.640+0000 7f0a91ffb640 1 -- 172.21.15.2:0/3985325554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa401e420 con 0x564b81797b40 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.640+0000 7f0a91ffb640 1 -- 172.21.15.2:0/3985325554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aa401eaa0 con 0x564b81797b40 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.640+0000 7f0a91ffb640 1 -- 172.21.15.2:0/3985325554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4026700 con 0x564b81797b40 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.640+0000 7f0aabfff640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0a940a2df0 0x7f0a940a52b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4023000 tx=0x7f0aa4020030 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 -- 172.21.15.2:0/3985325554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 msgr2=0x564b81796090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b81796090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4013eb0 tx=0x7f0aa400f730 comp rx=0 tx=0).stop 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 -- 172.21.15.2:0/3985325554 shutdown_connections 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b817a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b81796a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/3985325554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b81796090 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 -- 172.21.15.2:0/3985325554 >> 172.21.15.2:0/3985325554 conn(0x564b8175f310 msgr2=0x564b81792c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 -- 172.21.15.2:0/3985325554 shutdown_connections 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.641+0000 7f0ab42f4740 1 -- 172.21.15.2:0/3985325554 wait complete. 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.642+0000 7f0ab42f4740 1 -- start start 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.642+0000 7f0ab42f4740 1 Processor -- start 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.642+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b8179e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b817a4070 con 0x564b817a1370 2024-09-12T00:55:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564b816b7060 con 0x564b81797b40 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564b817a41f0 con 0x564b817965d0 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b8179e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b8179e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43818/0 (socket says 172.21.15.2:43818) 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aabfff640 1 -- 172.21.15.2:0/1417819224 learned_addr learned my addr 172.21.15.2:0/1417819224 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0ab42f4740 10 client.0 _ll_register_callbacks cb 0x564b8140a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aaaffd640 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aabfff640 1 -- 172.21.15.2:0/1417819224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 msgr2=0x564b817a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aabfff640 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aabfff640 1 -- 172.21.15.2:0/1417819224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 msgr2=0x564b8179e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aabfff640 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.643+0000 7f0aabfff640 1 -- 172.21.15.2:0/1417819224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8146d3c0 con 0x564b817a1370 2024-09-12T00:55:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.644+0000 7f0aabfff640 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b8179e600 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009680 tx=0x7f0aa401df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da6c251e7a481c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.644+0000 7f0a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.644+0000 7f0a8affd640 1 -- 172.21.15.2:0/1417819224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa401ec50 con 0x564b817a1370 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.644+0000 7f0ab42f4740 1 -- 172.21.15.2:0/1417819224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa401eaa0 con 0x564b817a1370 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.644+0000 7f0a8affd640 1 -- 172.21.15.2:0/1417819224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f0aa4026500 con 0x564b817a1370 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.644+0000 7f0a8affd640 1 -- 172.21.15.2:0/1417819224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0aa401edf0 con 0x564b817a1370 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.644+0000 7f0ab42f4740 10 client.15858 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.644+0000 7f0ab42f4740 1 -- 172.21.15.2:0/1417819224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b817afad0 con 0x564b817a1370 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.645+0000 7f0a8affd640 1 -- 172.21.15.2:0/1417819224 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aa4026700 con 0x564b817a1370 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.645+0000 7f0a8affd640 1 -- 172.21.15.2:0/1417819224 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0aa400f040 con 0x564b817a1370 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.645+0000 7f0ab42f4740 10 client.15858 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.645+0000 7f0ab42f4740 10 client.15858 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.645+0000 7f0ab42f4740 20 client.15858 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.645+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x564b817b0ee0 0x564b817b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.645+0000 7f0ab42f4740 4 client.15858 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:55:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.645+0000 7f0ab42f4740 1 -- 172.21.15.2:0/1417819224 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0aa401eaa0 con 0x564b817b0ee0 2024-09-12T00:55:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.646+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x564b817b0ee0 0x564b817b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.646+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x564b817b0ee0 0x564b817b32d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d2410a450f11af1a server_cookie=d3aecbba22ca7b63 in_seq=0 out_seq=0 2024-09-12T00:55:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.646+0000 7f0a8affd640 10 client.15858 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.647+0000 7f0a8affd640 1 -- 172.21.15.2:0/1417819224 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0aa401eaa0 con 0x564b817b0ee0 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.647+0000 7f0a8affd640 10 client.15858 handle_command_reply: tid=0 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.647+0000 7f0ab42f4740 1 client.15858 shutdown 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.647+0000 7f0ab42f4740 1 -- 172.21.15.2:0/1417819224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 msgr2=0x564b8179e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.647+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b8179e600 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009680 tx=0x7f0aa401df90 comp rx=0 tx=0).stop 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.648+0000 7f0ab42f4740 1 -- 172.21.15.2:0/1417819224 shutdown_connections 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.648+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x564b817b0ee0 0x564b817b32d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.648+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b8179e600 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.648+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.648+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/1417819224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.648+0000 7f0ab42f4740 1 -- 172.21.15.2:0/1417819224 >> 172.21.15.2:0/1417819224 conn(0x564b8175f310 msgr2=0x564b81798960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.648+0000 7f0a8affd640 0 client.15858 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:55:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.650+0000 7f0ab42f4740 1 -- 172.21.15.2:0/1417819224 shutdown_connections 2024-09-12T00:55:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.650+0000 7f0ab42f4740 1 -- 172.21.15.2:0/1417819224 wait complete. 2024-09-12T00:55:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.650+0000 7f0ab42f4740 20 client.15858 trim_cache size 0 max 16384 2024-09-12T00:55:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.676+0000 7f0ab42f4740 1 Processor -- start 2024-09-12T00:55:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.676+0000 7f0ab42f4740 1 -- start start 2024-09-12T00:55:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.676+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.676+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.676+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b81799120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aaaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aaaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:37492/0 (socket says 172.21.15.2:37492) 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817ad310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:53734/0 (socket says 172.21.15.2:53734) 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b81799120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b81799120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43822/0 (socket says 172.21.15.2:43822) 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aaaffd640 1 -- 172.21.15.2:0/115150958 learned_addr learned my addr 172.21.15.2:0/115150958 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0ab42f4740 1 -- 172.21.15.2:0/115150958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1b24d0 con 0x564b817a1370 2024-09-12T00:55:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0ab42f4740 1 -- 172.21.15.2:0/115150958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1afda0 con 0x564b81797b40 2024-09-12T00:55:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0ab42f4740 1 -- 172.21.15.2:0/115150958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1adbf0 con 0x564b817965d0 2024-09-12T00:55:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aab7fe640 1 -- 172.21.15.2:0/115150958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 msgr2=0x564b8179cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/115150958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aab7fe640 1 -- 172.21.15.2:0/115150958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 msgr2=0x564b81799120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/115150958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b81799120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aab7fe640 1 -- 172.21.15.2:0/115150958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b81792ed0 con 0x564b817965d0 2024-09-12T00:55:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.677+0000 7f0aabfff640 1 --2- 172.21.15.2:0/115150958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b81799120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.678+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/115150958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817ad310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0ed290 tx=0x7f0a9c0c0040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69588a794275a647 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.678+0000 7f0a917fa640 1 -- 172.21.15.2:0/115150958 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c049040 con 0x564b817965d0 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.678+0000 7f0a917fa640 1 -- 172.21.15.2:0/115150958 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a9c0c0410 con 0x564b817965d0 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.678+0000 7f0a917fa640 1 -- 172.21.15.2:0/115150958 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c003c80 con 0x564b817965d0 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.679+0000 7f0ab42f4740 1 -- 172.21.15.2:0/115150958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 msgr2=0x564b817ad310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.679+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/115150958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817ad310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0ed290 tx=0x7f0a9c0c0040 comp rx=0 tx=0).stop 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.679+0000 7f0ab42f4740 1 -- 172.21.15.2:0/115150958 shutdown_connections 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.679+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/115150958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b817a1370 0x564b81799120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.679+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/115150958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b81797b40 0x564b8179cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.679+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/115150958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817ad310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.679+0000 7f0ab42f4740 1 -- 172.21.15.2:0/115150958 >> 172.21.15.2:0/115150958 conn(0x564b8175f310 msgr2=0x564b8179c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.679+0000 7f0ab42f4740 1 -- 172.21.15.2:0/115150958 shutdown_connections 2024-09-12T00:55:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.680+0000 7f0ab42f4740 1 -- 172.21.15.2:0/115150958 wait complete. 2024-09-12T00:55:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.680+0000 7f0ab42f4740 1 -- start start 2024-09-12T00:55:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.681+0000 7f0ab42f4740 1 Processor -- start 2024-09-12T00:55:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.681+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.681+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b817a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.681+0000 7f0ab42f4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b81822300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1ae260 con 0x564b81797b40 2024-09-12T00:55:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1af6d0 con 0x564b817a1370 2024-09-12T00:55:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0ab42f4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1ae930 con 0x564b817965d0 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0ab42f4740 10 client.0 _ll_register_callbacks cb 0x7f0a9c0bbee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aaaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b817a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aaaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b817a4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43836/0 (socket says 172.21.15.2:43836) 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aaaffd640 1 -- 172.21.15.2:0/449782069 learned_addr learned my addr 172.21.15.2:0/449782069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aabfff640 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b81822300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aabfff640 1 -- 172.21.15.2:0/449782069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 msgr2=0x564b817a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aabfff640 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aabfff640 1 -- 172.21.15.2:0/449782069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 msgr2=0x564b817a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aabfff640 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b817a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aabfff640 1 -- 172.21.15.2:0/449782069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b81822940 con 0x564b817a1370 2024-09-12T00:55:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.682+0000 7f0aaaffd640 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b817a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.683+0000 7f0aabfff640 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b81822300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4013870 tx=0x7f0aa4013ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfc5e127f16e0396 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.683+0000 7f0a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.683+0000 7f0a8affd640 1 -- 172.21.15.2:0/449782069 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa401ea40 con 0x564b817a1370 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.683+0000 7f0a8affd640 1 -- 172.21.15.2:0/449782069 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f0aa401ebe0 con 0x564b817a1370 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.683+0000 7f0ab42f4740 1 -- 172.21.15.2:0/449782069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a9c0c0410 con 0x564b817a1370 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.684+0000 7f0a8affd640 1 -- 172.21.15.2:0/449782069 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0aa401e420 con 0x564b817a1370 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.684+0000 7f0ab42f4740 10 client.25529 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.684+0000 7f0ab42f4740 1 -- 172.21.15.2:0/449782069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b81823c00 con 0x564b817a1370 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.684+0000 7f0a8affd640 1 -- 172.21.15.2:0/449782069 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aa401e5c0 con 0x564b817a1370 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.684+0000 7f0a8affd640 1 -- 172.21.15.2:0/449782069 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0aa4026a20 con 0x564b817a1370 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.684+0000 7f0ab42f4740 10 client.25529 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.684+0000 7f0ab42f4740 10 client.25529 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:55:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.685+0000 7f0ab42f4740 20 client.25529 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.685+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x564b818243a0 0x564b818267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.685+0000 7f0ab42f4740 4 client.25529 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:55:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.685+0000 7f0ab42f4740 1 -- 172.21.15.2:0/449782069 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0a9c0c0410 con 0x564b818243a0 2024-09-12T00:55:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.685+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x564b818243a0 0x564b818267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.685+0000 7f0a8affd640 10 client.25529 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:55:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.685+0000 7f0aab7fe640 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x564b818243a0 0x564b818267c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b0f5dfa8f89ad80 server_cookie=9ebf149c2aca791e in_seq=0 out_seq=0 2024-09-12T00:55:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0a8affd640 1 -- 172.21.15.2:0/449782069 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0a9c0c0410 con 0x564b818243a0 2024-09-12T00:55:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0a8affd640 10 client.25529 handle_command_reply: tid=0 2024-09-12T00:55:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 client.25529 shutdown 2024-09-12T00:55:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 -- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 msgr2=0x564b81822300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b81822300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4013870 tx=0x7f0aa4013ad0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 -- 172.21.15.2:0/449782069 shutdown_connections 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x564b818243a0 0x564b818267c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b817a1370 0x564b81822300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b81797b40 0x564b817a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 --2- 172.21.15.2:0/449782069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b817965d0 0x564b817a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 -- 172.21.15.2:0/449782069 >> 172.21.15.2:0/449782069 conn(0x564b8175f310 msgr2=0x564b8179d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0a8affd640 0 client.25529 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 -- 172.21.15.2:0/449782069 shutdown_connections 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.686+0000 7f0ab42f4740 1 -- 172.21.15.2:0/449782069 wait complete. 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.687+0000 7f0ab42f4740 20 client.25529 trim_cache size 0 max 16384 2024-09-12T00:55:22.687 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:55:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.687+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0a940a2df0 msgr2=0x7f0a940a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.687+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0a940a2df0 0x7f0a940a52b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4023000 tx=0x7f0aa4020030 comp rx=0 tx=0).stop 2024-09-12T00:55:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.687+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/977837203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aac100100 msgr2=0x7f0aac1985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.687+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aac100100 0x7f0aac1985d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c000c00 tx=0x7f0a9c032b20 comp rx=0 tx=0).stop 2024-09-12T00:55:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.688+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/977837203 shutdown_connections 2024-09-12T00:55:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.688+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0a940a2df0 0x7f0a940a52b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.688+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aac106b80 0x7f0aac19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.688+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0aac100aa0 0x7f0aac198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.688+0000 7f0ab1f1b640 1 --2- 172.21.15.2:0/977837203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aac100100 0x7f0aac1985d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.688+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/977837203 >> 172.21.15.2:0/977837203 conn(0x7f0aac077230 msgr2=0x7f0aac104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.688+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/977837203 shutdown_connections 2024-09-12T00:55:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:22.688+0000 7f0ab1f1b640 1 -- 172.21.15.2:0/977837203 wait complete. 2024-09-12T00:55:22.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:22 smithi002 ceph-mon[31210]: pgmap v76: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 691 KiB/s wr, 441 op/s 2024-09-12T00:55:22.746 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_readdir_2 2024-09-12T00:55:22.746 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fsync-tester 2024-09-12T00:55:22.891 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] nsexec 2024-09-12T00:55:23.011 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] cloner 2024-09-12T00:55:23.033 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] renameat2 2024-09-12T00:55:23.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:22 smithi167 ceph-mon[35234]: pgmap v76: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 691 KiB/s wr, 441 op/s 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_getcwd 2024-09-12T00:55:23.084 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] e4compact 2024-09-12T00:55:23.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:22 smithi071 ceph-mon[35276]: pgmap v76: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 691 KiB/s wr, 441 op/s 2024-09-12T00:55:23.204 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] test-nextquota 2024-09-12T00:55:23.205 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] punch-alternating 2024-09-12T00:55:23.241 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-12T00:55:23.331 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] listxattr 2024-09-12T00:55:23.379 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dio-interleaved 2024-09-12T00:55:23.379 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_dir_type 2024-09-12T00:55:23.410 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dio-invalidate-cache 2024-09-12T00:55:23.493 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] stat_test 2024-09-12T00:55:23.532 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_encrypted_d_revalidate 2024-09-12T00:55:23.553 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] attr_replace_test 2024-09-12T00:55:23.650 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] swapon 2024-09-12T00:55:23.719 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] mkswap 2024-09-12T00:55:23.719 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_attr_corruption 2024-09-12T00:55:23.815 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_open_tmpfiles 2024-09-12T00:55:23.834 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fscrypt-crypt-util 2024-09-12T00:55:23.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:55:23.904 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] bulkstat_null_ocount 2024-09-12T00:55:23.907 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] splice-test 2024-09-12T00:55:24.007 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] chprojid_fail 2024-09-12T00:55:24.077 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] detached_mounts_propagation 2024-09-12T00:55:24.126 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] ext4_resize 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_readdir_3 2024-09-12T00:55:24.233 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:24.318 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] splice2pipe 2024-09-12T00:55:24.319 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] uuid_ioctl 2024-09-12T00:55:24.428 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-12T00:55:24.479 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fiemap-fault 2024-09-12T00:55:24.503 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fiemap-tester 2024-09-12T00:55:24.625 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_stripealign 2024-09-12T00:55:24.640 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] open_by_handle 2024-09-12T00:55:24.645 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_mmap_dio 2024-09-12T00:55:24.800 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] xfsfind 2024-09-12T00:55:24.813 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] t_reflink_read_race 2024-09-12T00:55:24.819 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fssum 2024-09-12T00:55:24.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:24 smithi002 ceph-mon[31210]: pgmap v77: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 715 KiB/s wr, 449 op/s 2024-09-12T00:55:24.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 -- 172.21.15.2:0/1395796176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620106a70 msgr2=0x7fe620106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 --2- 172.21.15.2:0/1395796176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620106a70 0x7fe620106e50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe610009930 tx=0x7fe61002a420 comp rx=0 tx=0).stop 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 -- 172.21.15.2:0/1395796176 shutdown_connections 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 --2- 172.21.15.2:0/1395796176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe620101410 0x7fe62010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 --2- 172.21.15.2:0/1395796176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe620100a70 0x7fe620100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 --2- 172.21.15.2:0/1395796176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620106a70 0x7fe620106e50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 -- 172.21.15.2:0/1395796176 >> 172.21.15.2:0/1395796176 conn(0x7fe6200fc7d0 msgr2=0x7fe6200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 -- 172.21.15.2:0/1395796176 shutdown_connections 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.900+0000 7fe624eb0640 1 -- 172.21.15.2:0/1395796176 wait complete. 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.901+0000 7fe624eb0640 1 Processor -- start 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.901+0000 7fe624eb0640 1 -- start start 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe624eb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620100a70 0x7fe6201a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe624eb0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe620101410 0x7fe6201a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe624eb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe620106a70 0x7fe62010caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe624eb0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe620111f80 con 0x7fe620100a70 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe61e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620100a70 0x7fe6201a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe624eb0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe620111e00 con 0x7fe620101410 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe61e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620100a70 0x7fe6201a3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43842/0 (socket says 172.21.15.2:43842) 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe61e59c640 1 -- 172.21.15.2:0/3664897309 learned_addr learned my addr 172.21.15.2:0/3664897309 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe620101410 0x7fe6201a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe620112100 con 0x7fe620106a70 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.902+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe620106a70 0x7fe62010caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.903+0000 7fe61dd9b640 1 -- 172.21.15.2:0/3664897309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe620106a70 msgr2=0x7fe62010caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.903+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe620106a70 0x7fe62010caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.903+0000 7fe61dd9b640 1 -- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620100a70 msgr2=0x7fe6201a3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.903+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620100a70 0x7fe6201a3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.903+0000 7fe61dd9b640 1 -- 172.21.15.2:0/3664897309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62010d240 con 0x7fe620101410 2024-09-12T00:55:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.903+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe620106a70 0x7fe62010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.904+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe620101410 0x7fe6201a3bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe61400e9f0 tx=0x7fe61400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.904+0000 7fe60f7fe640 1 -- 172.21.15.2:0/3664897309 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61400ccc0 con 0x7fe620101410 2024-09-12T00:55:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.904+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62010d530 con 0x7fe620101410 2024-09-12T00:55:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.904+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6201ab5b0 con 0x7fe620101410 2024-09-12T00:55:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.904+0000 7fe60f7fe640 1 -- 172.21.15.2:0/3664897309 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe614010910 con 0x7fe620101410 2024-09-12T00:55:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.904+0000 7fe60f7fe640 1 -- 172.21.15.2:0/3664897309 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614018960 con 0x7fe620101410 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.907+0000 7fe60f7fe640 1 -- 172.21.15.2:0/3664897309 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe614018b00 con 0x7fe620101410 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.908+0000 7fe627289740 1 Processor -- start 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.908+0000 7fe627289740 1 -- start start 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.908+0000 7fe627289740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd07b40 0x56475dd06090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe627289740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd06a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe627289740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd11370 0x56475dd13760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe627289740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56475dc6c2f0 con 0x56475dd07b40 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe627289740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56475dc13cf0 con 0x56475dd11370 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe627289740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56475dc682b0 con 0x56475dd065d0 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe60f7fe640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe6080a2d70 0x7fe6080a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe61ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd07b40 0x56475dd06090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe61ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd07b40 0x56475dd06090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43848/0 (socket says 172.21.15.2:43848) 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe61ed9d640 1 -- 172.21.15.2:0/953692924 learned_addr learned my addr 172.21.15.2:0/953692924 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe6080a2d70 0x7fe6080a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.909+0000 7fe60f7fe640 1 -- 172.21.15.2:0/3664897309 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe6140cf840 con 0x7fe620101410 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.910+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd11370 0x56475dd13760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.910+0000 7fe61e59c640 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd06a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.910+0000 7fe61ed9d640 1 -- 172.21.15.2:0/953692924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 msgr2=0x56475dd06a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.910+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd06a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.910+0000 7fe61ed9d640 1 -- 172.21.15.2:0/953692924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd11370 msgr2=0x56475dd13760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.910+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd11370 0x56475dd13760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.910+0000 7fe61ed9d640 1 -- 172.21.15.2:0/953692924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475dbf83a0 con 0x56475dd07b40 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.911+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe6080a2d70 0x7fe6080a5230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6180092f0 tx=0x7fe618012640 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.911+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd07b40 0x56475dd06090 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe618014fd0 tx=0x7fe61801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28eeb25bfa72f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.911+0000 7fe60cff9640 1 -- 172.21.15.2:0/953692924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618023070 con 0x56475dd07b40 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.911+0000 7fe60cff9640 1 -- 172.21.15.2:0/953692924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe61801fb20 con 0x56475dd07b40 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.912+0000 7fe60cff9640 1 -- 172.21.15.2:0/953692924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618027900 con 0x56475dd07b40 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.912+0000 7fe627289740 1 -- 172.21.15.2:0/953692924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd07b40 msgr2=0x56475dd06090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.912+0000 7fe627289740 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd07b40 0x56475dd06090 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe618014fd0 tx=0x7fe61801c000 comp rx=0 tx=0).stop 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.912+0000 7fe627289740 1 -- 172.21.15.2:0/953692924 shutdown_connections 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.912+0000 7fe627289740 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd11370 0x56475dd13760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.912+0000 7fe627289740 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd06a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.912+0000 7fe627289740 1 --2- 172.21.15.2:0/953692924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd07b40 0x56475dd06090 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.912+0000 7fe627289740 1 -- 172.21.15.2:0/953692924 >> 172.21.15.2:0/953692924 conn(0x56475dccf310 msgr2=0x56475dd02c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.913+0000 7fe627289740 1 -- 172.21.15.2:0/953692924 shutdown_connections 2024-09-12T00:55:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.913+0000 7fe627289740 1 -- 172.21.15.2:0/953692924 wait complete. 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.914+0000 7fe627289740 1 -- start start 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.914+0000 7fe627289740 1 Processor -- start 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.914+0000 7fe627289740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd10c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.914+0000 7fe627289740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd0df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.914+0000 7fe627289740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd0e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.914+0000 7fe627289740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56475dd14050 con 0x56475dd11370 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.914+0000 7fe627289740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56475dc27060 con 0x56475dd07b40 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.914+0000 7fe627289740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56475dd141d0 con 0x56475dd065d0 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe627289740 10 client.0 _ll_register_callbacks cb 0x56475d97a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd0e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd10c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd0e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43862/0 (socket says 172.21.15.2:43862) 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61ed9d640 1 -- 172.21.15.2:0/3822657272 learned_addr learned my addr 172.21.15.2:0/3822657272 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd0df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61ed9d640 1 -- 172.21.15.2:0/3822657272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 msgr2=0x56475dd10c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd10c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61ed9d640 1 -- 172.21.15.2:0/3822657272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 msgr2=0x56475dd0df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd0df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.915+0000 7fe61ed9d640 1 -- 172.21.15.2:0/3822657272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475d9dd3c0 con 0x56475dd11370 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.916+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd0e440 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe618029040 tx=0x7fe61801ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fe50213e87160e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.916+0000 7fe605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.916+0000 7fe605ffb640 1 -- 172.21.15.2:0/3822657272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618035030 con 0x56475dd11370 2024-09-12T00:55:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.916+0000 7fe605ffb640 1 -- 172.21.15.2:0/3822657272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe618012c70 con 0x56475dd11370 2024-09-12T00:55:24.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.916+0000 7fe627289740 1 -- 172.21.15.2:0/3822657272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe61801fb20 con 0x56475dd11370 2024-09-12T00:55:24.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.917+0000 7fe605ffb640 1 -- 172.21.15.2:0/3822657272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe618023040 con 0x56475dd11370 2024-09-12T00:55:24.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.917+0000 7fe627289740 10 client.15876 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:24.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.917+0000 7fe627289740 1 -- 172.21.15.2:0/3822657272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56475dd1fa80 con 0x56475dd11370 2024-09-12T00:55:24.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.917+0000 7fe605ffb640 1 -- 172.21.15.2:0/3822657272 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe61801fb20 con 0x56475dd11370 2024-09-12T00:55:24.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.917+0000 7fe605ffb640 1 -- 172.21.15.2:0/3822657272 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe61800f040 con 0x56475dd11370 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.917+0000 7fe627289740 10 client.15876 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.917+0000 7fe627289740 10 client.15876 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.918+0000 7fe627289740 20 client.15876 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.918+0000 7fe627289740 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56475dd20e30 0x56475dd23220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.918+0000 7fe627289740 4 client.15876 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.918+0000 7fe627289740 1 -- 172.21.15.2:0/3822657272 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56475dc79860 con 0x56475dd20e30 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.918+0000 7fe61e59c640 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56475dd20e30 0x56475dd23220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.919+0000 7fe605ffb640 10 client.15876 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.919+0000 7fe61e59c640 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56475dd20e30 0x56475dd23220 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a294f03135f9351f server_cookie=85a962f8d09e19fa in_seq=0 out_seq=0 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.919+0000 7fe605ffb640 1 -- 172.21.15.2:0/3822657272 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56475dc79860 con 0x56475dd20e30 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.919+0000 7fe605ffb640 10 client.15876 handle_command_reply: tid=0 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.919+0000 7fe627289740 1 client.15876 shutdown 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 -- 172.21.15.2:0/3822657272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 msgr2=0x56475dd0e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd0e440 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe618029040 tx=0x7fe61801ff00 comp rx=0 tx=0).stop 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 -- 172.21.15.2:0/3822657272 shutdown_connections 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56475dd20e30 0x56475dd23220 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd0e440 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd0df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 --2- 172.21.15.2:0/3822657272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd10c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 -- 172.21.15.2:0/3822657272 >> 172.21.15.2:0/3822657272 conn(0x56475dccf310 msgr2=0x56475dd08930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe605ffb640 0 client.15876 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 -- 172.21.15.2:0/3822657272 shutdown_connections 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 1 -- 172.21.15.2:0/3822657272 wait complete. 2024-09-12T00:55:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.920+0000 7fe627289740 20 client.15876 trim_cache size 0 max 16384 2024-09-12T00:55:24.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.942+0000 7fe627289740 1 Processor -- start 2024-09-12T00:55:24.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.942+0000 7fe627289740 1 -- start start 2024-09-12T00:55:24.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.943+0000 7fe627289740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd065d0 0x56475dd0c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.943+0000 7fe627289740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd07b40 0x56475dd09120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.943+0000 7fe61e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd065d0 0x56475dd0c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.943+0000 7fe61e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd065d0 0x56475dd0c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:37540/0 (socket says 172.21.15.2:37540) 2024-09-12T00:55:24.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.943+0000 7fe61dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd07b40 0x56475dd09120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.943+0000 7fe61dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd07b40 0x56475dd09120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:53778/0 (socket says 172.21.15.2:53778) 2024-09-12T00:55:24.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.943+0000 7fe627289740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd09660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe61e59c640 1 -- 172.21.15.2:0/2043206541 learned_addr learned my addr 172.21.15.2:0/2043206541 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe627289740 1 -- 172.21.15.2:0/2043206541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b6960 con 0x56475dd11370 2024-09-12T00:55:24.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/2043206541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd09660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe627289740 1 -- 172.21.15.2:0/2043206541 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b4230 con 0x56475dd065d0 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe627289740 1 -- 172.21.15.2:0/2043206541 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b2080 con 0x56475dd07b40 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe61ed9d640 1 -- 172.21.15.2:0/2043206541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd07b40 msgr2=0x56475dd09120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/2043206541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd07b40 0x56475dd09120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe61ed9d640 1 -- 172.21.15.2:0/2043206541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd065d0 msgr2=0x56475dd0c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/2043206541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd065d0 0x56475dd0c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.944+0000 7fe61ed9d640 1 -- 172.21.15.2:0/2043206541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475dd13cf0 con 0x56475dd11370 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.945+0000 7fe61ed9d640 1 --2- 172.21.15.2:0/2043206541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd09660 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe618027fd0 tx=0x7fe618000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a8ecccac03cba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.945+0000 7fe607fff640 1 -- 172.21.15.2:0/2043206541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618035030 con 0x56475dd11370 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.945+0000 7fe607fff640 1 -- 172.21.15.2:0/2043206541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6180315c0 con 0x56475dd11370 2024-09-12T00:55:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.945+0000 7fe607fff640 1 -- 172.21.15.2:0/2043206541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618027400 con 0x56475dd11370 2024-09-12T00:55:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.946+0000 7fe627289740 1 -- 172.21.15.2:0/2043206541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 msgr2=0x56475dd09660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.946+0000 7fe627289740 1 --2- 172.21.15.2:0/2043206541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd09660 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe618027fd0 tx=0x7fe618000f40 comp rx=0 tx=0).stop 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.946+0000 7fe627289740 1 -- 172.21.15.2:0/2043206541 shutdown_connections 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.946+0000 7fe627289740 1 --2- 172.21.15.2:0/2043206541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd09660 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.946+0000 7fe627289740 1 --2- 172.21.15.2:0/2043206541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd07b40 0x56475dd09120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.946+0000 7fe627289740 1 --2- 172.21.15.2:0/2043206541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd065d0 0x56475dd0c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.946+0000 7fe627289740 1 -- 172.21.15.2:0/2043206541 >> 172.21.15.2:0/2043206541 conn(0x56475dccf310 msgr2=0x56475dd0ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.946+0000 7fe627289740 1 -- 172.21.15.2:0/2043206541 shutdown_connections 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.947+0000 7fe627289740 1 -- 172.21.15.2:0/2043206541 wait complete. 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.947+0000 7fe627289740 1 -- start start 2024-09-12T00:55:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.947+0000 7fe627289740 1 Processor -- start 2024-09-12T00:55:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.947+0000 7fe627289740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd153a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe627289740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd158e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe627289740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd15e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe627289740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b26f0 con 0x56475dd11370 2024-09-12T00:55:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe627289740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b3b60 con 0x56475dd07b40 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe627289740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b2dc0 con 0x56475dd065d0 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe627289740 10 client.0 _ll_register_callbacks cb 0x7fe614097900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd15e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd15e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43884/0 (socket says 172.21.15.2:43884) 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61ed9d640 1 -- 172.21.15.2:0/527227834 learned_addr learned my addr 172.21.15.2:0/527227834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61e59c640 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61dd9b640 1 -- 172.21.15.2:0/527227834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 msgr2=0x56475dd153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61dd9b640 1 -- 172.21.15.2:0/527227834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 msgr2=0x56475dd15e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd15e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.948+0000 7fe61dd9b640 1 -- 172.21.15.2:0/527227834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475dd02510 con 0x56475dd07b40 2024-09-12T00:55:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.949+0000 7fe61dd9b640 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd158e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe6140ccee0 tx=0x7fe61401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b777f13969462cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:24.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.949+0000 7fe605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:55:24.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.949+0000 7fe605ffb640 1 -- 172.21.15.2:0/527227834 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6140b8020 con 0x56475dd07b40 2024-09-12T00:55:24.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.949+0000 7fe605ffb640 1 -- 172.21.15.2:0/527227834 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe6140983d0 con 0x56475dd07b40 2024-09-12T00:55:24.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.949+0000 7fe627289740 1 -- 172.21.15.2:0/527227834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6180315c0 con 0x56475dd07b40 2024-09-12T00:55:24.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.949+0000 7fe605ffb640 1 -- 172.21.15.2:0/527227834 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6140a0060 con 0x56475dd07b40 2024-09-12T00:55:24.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.949+0000 7fe627289740 10 client.25547 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:24.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.949+0000 7fe627289740 1 -- 172.21.15.2:0/527227834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56475dd8bab0 con 0x56475dd07b40 2024-09-12T00:55:24.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe605ffb640 1 -- 172.21.15.2:0/527227834 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6180315c0 con 0x56475dd07b40 2024-09-12T00:55:24.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe605ffb640 1 -- 172.21.15.2:0/527227834 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe6140a4b70 con 0x56475dd07b40 2024-09-12T00:55:24.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe627289740 10 client.25547 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:24.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe627289740 10 client.25547 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe627289740 20 client.25547 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe627289740 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56475dd8c230 0x56475dd8e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe627289740 4 client.25547 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe627289740 1 -- 172.21.15.2:0/527227834 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56475dd0e7d0 con 0x56475dd8c230 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.950+0000 7fe61e59c640 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56475dd8c230 0x56475dd8e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.951+0000 7fe61e59c640 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56475dd8c230 0x56475dd8e650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ef5ced47be65166 server_cookie=2390e8356eb7ecc in_seq=0 out_seq=0 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.951+0000 7fe605ffb640 10 client.25547 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.951+0000 7fe605ffb640 1 -- 172.21.15.2:0/527227834 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56475dd0e7d0 con 0x56475dd8c230 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.951+0000 7fe605ffb640 10 client.25547 handle_command_reply: tid=0 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.951+0000 7fe627289740 1 client.25547 shutdown 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.951+0000 7fe627289740 1 -- 172.21.15.2:0/527227834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 msgr2=0x56475dd158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.951+0000 7fe627289740 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd158e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe6140ccee0 tx=0x7fe61401a040 comp rx=0 tx=0).stop 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 1 -- 172.21.15.2:0/527227834 shutdown_connections 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x56475dd8c230 0x56475dd8e650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56475dd11370 0x56475dd15e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dd07b40 0x56475dd158e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 1 --2- 172.21.15.2:0/527227834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56475dd065d0 0x56475dd153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 1 -- 172.21.15.2:0/527227834 >> 172.21.15.2:0/527227834 conn(0x56475dccf310 msgr2=0x56475dd014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe605ffb640 0 client.25547 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 1 -- 172.21.15.2:0/527227834 shutdown_connections 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 1 -- 172.21.15.2:0/527227834 wait complete. 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.952+0000 7fe627289740 20 client.25547 trim_cache size 0 max 16384 2024-09-12T00:55:24.953 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:55:24.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe6080a2d70 msgr2=0x7fe6080a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe6080a2d70 0x7fe6080a5230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6180092f0 tx=0x7fe618012640 comp rx=0 tx=0).stop 2024-09-12T00:55:24.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe620101410 msgr2=0x7fe6201a3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:24.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe620101410 0x7fe6201a3bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe61400e9f0 tx=0x7fe61400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 shutdown_connections 2024-09-12T00:55:24.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe6080a2d70 0x7fe6080a5230 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe620106a70 0x7fe62010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe620101410 0x7fe6201a3bc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 --2- 172.21.15.2:0/3664897309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe620100a70 0x7fe6201a3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:24.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 >> 172.21.15.2:0/3664897309 conn(0x7fe6200fc7d0 msgr2=0x7fe6200fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:24.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 shutdown_connections 2024-09-12T00:55:24.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:24.953+0000 7fe624eb0640 1 -- 172.21.15.2:0/3664897309 wait complete. 2024-09-12T00:55:24.955 INFO:tasks.workunit.client.0.smithi002.stdout:Building log-writes 2024-09-12T00:55:24.958 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] replay-log 2024-09-12T00:55:25.033 INFO:tasks.workunit.client.0.smithi002.stdout:Building perf 2024-09-12T00:55:25.034 INFO:tasks.workunit.client.0.smithi002.stdout:Building aio-dio-regress 2024-09-12T00:55:25.036 INFO:tasks.workunit.client.0.smithi002.stdout:Building vfs 2024-09-12T00:55:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:24 smithi167 ceph-mon[35234]: pgmap v77: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 715 KiB/s wr, 449 op/s 2024-09-12T00:55:25.040 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aiocp 2024-09-12T00:55:25.042 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] vfstest 2024-09-12T00:55:25.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:24 smithi071 ceph-mon[35276]: pgmap v77: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 715 KiB/s wr, 449 op/s 2024-09-12T00:55:25.297 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-12T00:55:25.339 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-append-write-read-race 2024-09-12T00:55:25.399 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-cow-race 2024-09-12T00:55:25.478 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-cycle-write 2024-09-12T00:55:25.532 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-eof-race 2024-09-12T00:55:25.559 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-extend-stat 2024-09-12T00:55:25.680 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-fcntl-race 2024-09-12T00:55:25.727 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] mount-idmapped 2024-09-12T00:55:25.727 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-hole-filling-race 2024-09-12T00:55:25.858 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-invalidate-failure 2024-09-12T00:55:25.892 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-invalidate-readahead 2024-09-12T00:55:26.018 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aiodio_sparse2 2024-09-12T00:55:26.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:55:26.071 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-subblock-eof-read 2024-09-12T00:55:26.266 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-dio-write-verify 2024-09-12T00:55:26.271 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-12T00:55:26.288 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-12T00:55:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:26.423 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] aio-last-ref-held-by-io 2024-09-12T00:55:26.862 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:26 smithi002 ceph-mon[31210]: pgmap v78: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 647 KiB/s wr, 445 op/s 2024-09-12T00:55:26.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/1788419460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8102d30 msgr2=0x7fc2b8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/1788419460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8102d30 0x7fc2b8103110 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009930 tx=0x7fc2a802a420 comp rx=0 tx=0).stop 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/1788419460 shutdown_connections 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/1788419460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b81082a0 0x7fc2b810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/1788419460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2b81036e0 0x7fc2b8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/1788419460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8102d30 0x7fc2b8103110 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/1788419460 >> 172.21.15.2:0/1788419460 conn(0x7fc2b80fc7d0 msgr2=0x7fc2b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/1788419460 shutdown_connections 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.949+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/1788419460 wait complete. 2024-09-12T00:55:26.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2bdd8e640 1 Processor -- start 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2bdd8e640 1 -- start start 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2bdd8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8102d30 0x7fc2b8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2bdd8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b81036e0 0x7fc2b8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2bdd8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2b81082a0 0x7fc2b8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2bdd8e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81120a0 con 0x7fc2b81036e0 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2bdd8e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b8111f20 con 0x7fc2b81082a0 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2bdd8e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b8112220 con 0x7fc2b8102d30 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b81036e0 0x7fc2b8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b81036e0 0x7fc2b8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53520/0 (socket says 172.21.15.2:53520) 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2affff640 1 -- 172.21.15.2:0/3253739951 learned_addr learned my addr 172.21.15.2:0/3253739951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8102d30 0x7fc2b8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.950+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2b81082a0 0x7fc2b8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2affff640 1 -- 172.21.15.2:0/3253739951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8102d30 msgr2=0x7fc2b8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2affff640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8102d30 0x7fc2b8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2affff640 1 -- 172.21.15.2:0/3253739951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2b81082a0 msgr2=0x7fc2b8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2affff640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2b81082a0 0x7fc2b8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2affff640 1 -- 172.21.15.2:0/3253739951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b81a69e0 con 0x7fc2b81036e0 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2affff640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b81036e0 0x7fc2b8100ed0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000d740 tx=0x7fc2a000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2b57fa640 1 -- 172.21.15.2:0/3253739951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0017070 con 0x7fc2b81036e0 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2b57fa640 1 -- 172.21.15.2:0/3253739951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a000de50 con 0x7fc2b81036e0 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/3253739951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b81a6cd0 con 0x7fc2b81036e0 2024-09-12T00:55:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2b57fa640 1 -- 172.21.15.2:0/3253739951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000f6b0 con 0x7fc2b81036e0 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.951+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/3253739951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b81a7200 con 0x7fc2b81036e0 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.953+0000 7fc2b57fa640 1 -- 172.21.15.2:0/3253739951 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc2a001a070 con 0x7fc2b81036e0 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2c0167740 1 Processor -- start 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2c0167740 1 -- start start 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303718090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 0x559303718a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303723370 0x559303725760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2c0167740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55930367e2f0 con 0x559303719b40 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2c0167740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559303625cf0 con 0x5593037185d0 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2c0167740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55930367a2b0 con 0x559303723370 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2b57fa640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2a40a2d70 0x7fc2a40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303718090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303718090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53528/0 (socket says 172.21.15.2:53528) 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2b7fff640 1 -- 172.21.15.2:0/1227394270 learned_addr learned my addr 172.21.15.2:0/1227394270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2a40a2d70 0x7fc2a40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 0x559303718a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.954+0000 7fc2b57fa640 1 -- 172.21.15.2:0/3253739951 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc2a00ced80 con 0x7fc2b81036e0 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2affff640 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303723370 0x559303725760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2b7fff640 1 -- 172.21.15.2:0/1227394270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303723370 msgr2=0x559303725760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303723370 0x559303725760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2b7fff640 1 -- 172.21.15.2:0/1227394270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 msgr2=0x559303718a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 0x559303718a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2b7fff640 1 -- 172.21.15.2:0/1227394270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55930360a3a0 con 0x559303719b40 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303718090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0014e80 tx=0x7fc2b00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bdc38097e6f74d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2a40a2d70 0x7fc2a40a5230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0011cb0 tx=0x7fc2b0016000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2adffb640 1 -- 172.21.15.2:0/1227394270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000cd60 con 0x559303719b40 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2adffb640 1 -- 172.21.15.2:0/1227394270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b0007c60 con 0x559303719b40 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.955+0000 7fc2adffb640 1 -- 172.21.15.2:0/1227394270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0005850 con 0x559303719b40 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 -- 172.21.15.2:0/1227394270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 msgr2=0x559303718090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303718090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0014e80 tx=0x7fc2b00117b0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 -- 172.21.15.2:0/1227394270 shutdown_connections 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303723370 0x559303725760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 0x559303718a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1227394270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303718090 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 -- 172.21.15.2:0/1227394270 >> 172.21.15.2:0/1227394270 conn(0x5593036e1310 msgr2=0x559303714c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 -- 172.21.15.2:0/1227394270 shutdown_connections 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 -- 172.21.15.2:0/1227394270 wait complete. 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.956+0000 7fc2c0167740 1 -- start start 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2c0167740 1 Processor -- start 2024-09-12T00:55:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 0x559303722d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x559303720020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303723370 0x559303720610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2c0167740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559303726010 con 0x559303723370 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2c0167740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559303639060 con 0x5593037185d0 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2c0167740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559303726190 con 0x559303719b40 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2c0167740 10 client.0 _ll_register_callbacks cb 0x55930338c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303723370 0x559303720610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303723370 0x559303720610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53532/0 (socket says 172.21.15.2:53532) 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2b7fff640 1 -- 172.21.15.2:0/2288489565 learned_addr learned my addr 172.21.15.2:0/2288489565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 0x559303722d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.957+0000 7fc2affff640 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x559303720020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2b7fff640 1 -- 172.21.15.2:0/2288489565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 msgr2=0x559303720020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x559303720020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2b7fff640 1 -- 172.21.15.2:0/2288489565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 msgr2=0x559303722d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 0x559303722d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2b7fff640 1 -- 172.21.15.2:0/2288489565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593033ef3c0 con 0x559303723370 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303723370 0x559303720610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0014680 tx=0x7fc2b000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24875d5253e29878 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc296ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc296ffd640 1 -- 172.21.15.2:0/2288489565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b002e070 con 0x559303723370 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc296ffd640 1 -- 172.21.15.2:0/2288489565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc2b0003970 con 0x559303723370 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2c0167740 1 -- 172.21.15.2:0/2288489565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b0007c60 con 0x559303723370 2024-09-12T00:55:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc296ffd640 1 -- 172.21.15.2:0/2288489565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc2b0003b70 con 0x559303723370 2024-09-12T00:55:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2c0167740 10 client.15894 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.958+0000 7fc2c0167740 1 -- 172.21.15.2:0/2288489565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559303731ab0 con 0x559303723370 2024-09-12T00:55:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc296ffd640 1 -- 172.21.15.2:0/2288489565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b0007c60 con 0x559303723370 2024-09-12T00:55:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc296ffd640 1 -- 172.21.15.2:0/2288489565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc2b003ab80 con 0x559303723370 2024-09-12T00:55:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc2c0167740 10 client.15894 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc2c0167740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:55:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc2c0167740 20 client.15894 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc2c0167740 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559303732f70 0x559303735360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc2c0167740 4 client.15894 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:55:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc2c0167740 1 -- 172.21.15.2:0/2288489565 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55930368b860 con 0x559303732f70 2024-09-12T00:55:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.959+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559303732f70 0x559303735360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.960+0000 7fc296ffd640 10 client.15894 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.960+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559303732f70 0x559303735360 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=425a9fee0e0a4f75 server_cookie=578fdc7ced6b138c in_seq=0 out_seq=0 2024-09-12T00:55:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.960+0000 7fc296ffd640 1 -- 172.21.15.2:0/2288489565 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55930368b860 con 0x559303732f70 2024-09-12T00:55:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.960+0000 7fc296ffd640 10 client.15894 handle_command_reply: tid=0 2024-09-12T00:55:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 client.15894 shutdown 2024-09-12T00:55:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 -- 172.21.15.2:0/2288489565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303723370 msgr2=0x559303720610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303723370 0x559303720610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0014680 tx=0x7fc2b000cd60 comp rx=0 tx=0).stop 2024-09-12T00:55:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 -- 172.21.15.2:0/2288489565 shutdown_connections 2024-09-12T00:55:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559303732f70 0x559303735360 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303723370 0x559303720610 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x559303720020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc296ffd640 0 client.15894 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 --2- 172.21.15.2:0/2288489565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593037185d0 0x559303722d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 -- 172.21.15.2:0/2288489565 >> 172.21.15.2:0/2288489565 conn(0x5593036e1310 msgr2=0x55930371a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 -- 172.21.15.2:0/2288489565 shutdown_connections 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 1 -- 172.21.15.2:0/2288489565 wait complete. 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.961+0000 7fc2c0167740 20 client.15894 trim_cache size 0 max 16384 2024-09-12T00:55:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2c0167740 1 Processor -- start 2024-09-12T00:55:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2c0167740 1 -- start start 2024-09-12T00:55:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593037185d0 0x55930372f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x55930373a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 0x55930373af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2c0167740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81b2440 con 0x5593037185d0 2024-09-12T00:55:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2c0167740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81afd10 con 0x559303723370 2024-09-12T00:55:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2c0167740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81adb60 con 0x559303719b40 2024-09-12T00:55:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593037185d0 0x55930372f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593037185d0 0x55930372f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53548/0 (socket says 172.21.15.2:53548) 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2b77fe640 1 -- 172.21.15.2:0/1220123990 learned_addr learned my addr 172.21.15.2:0/1220123990 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.989+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 0x55930373af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2b77fe640 1 -- 172.21.15.2:0/1220123990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 msgr2=0x55930373a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2affff640 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x55930373a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x55930373a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2b77fe640 1 -- 172.21.15.2:0/1220123990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 msgr2=0x55930373af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 0x55930373af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2b77fe640 1 -- 172.21.15.2:0/1220123990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593037230a0 con 0x5593037185d0 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2affff640 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x55930373a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593037185d0 0x55930372f2b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009900 tx=0x7fc2a8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38722346b9333f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2ad7fa640 1 -- 172.21.15.2:0/1220123990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a804d030 con 0x5593037185d0 2024-09-12T00:55:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2ad7fa640 1 -- 172.21.15.2:0/1220123990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a8031a10 con 0x5593037185d0 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.990+0000 7fc2ad7fa640 1 -- 172.21.15.2:0/1220123990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8035040 con 0x5593037185d0 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 -- 172.21.15.2:0/1220123990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593037185d0 msgr2=0x55930372f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593037185d0 0x55930372f2b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009900 tx=0x7fc2a8005c00 comp rx=0 tx=0).stop 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 -- 172.21.15.2:0/1220123990 shutdown_connections 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 0x55930373af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559303719b40 0x55930373a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1220123990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593037185d0 0x55930372f2b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 -- 172.21.15.2:0/1220123990 >> 172.21.15.2:0/1220123990 conn(0x5593036e1310 msgr2=0x55930371f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 -- 172.21.15.2:0/1220123990 shutdown_connections 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 -- 172.21.15.2:0/1220123990 wait complete. 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 -- start start 2024-09-12T00:55:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.991+0000 7fc2c0167740 1 Processor -- start 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593037185d0 0x55930372bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303726e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2c0167740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 0x5593037273c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2c0167740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81ae1d0 con 0x559303719b40 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2c0167740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81af640 con 0x559303723370 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2c0167740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81ae8a0 con 0x5593037185d0 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2c0167740 10 client.0 _ll_register_callbacks cb 0x7fc2b0014c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303726e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303726e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53564/0 (socket says 172.21.15.2:53564) 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 -- 172.21.15.2:0/1629876333 learned_addr learned my addr 172.21.15.2:0/1629876333 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593037185d0 0x55930372bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2b7fff640 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 0x5593037273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 -- 172.21.15.2:0/1629876333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593037185d0 msgr2=0x55930372bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593037185d0 0x55930372bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 -- 172.21.15.2:0/1629876333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 msgr2=0x5593037273c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 0x5593037273c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 -- 172.21.15.2:0/1629876333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559303727bf0 con 0x559303719b40 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.992+0000 7fc2affff640 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303726e80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0097cd0 tx=0x7fc2a0099be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93a00fd3949d38f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc296ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc296ffd640 1 -- 172.21.15.2:0/1629876333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0021040 con 0x559303719b40 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc296ffd640 1 -- 172.21.15.2:0/1629876333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc2a0099e30 con 0x559303719b40 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 1 -- 172.21.15.2:0/1629876333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2a8031a10 con 0x559303719b40 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc296ffd640 1 -- 172.21.15.2:0/1629876333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc2a0098950 con 0x559303719b40 2024-09-12T00:55:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 10 client.15900 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 1 -- 172.21.15.2:0/1629876333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55930379d920 con 0x559303719b40 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc296ffd640 1 -- 172.21.15.2:0/1629876333 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a8031a10 con 0x559303719b40 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc296ffd640 1 -- 172.21.15.2:0/1629876333 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc2a00ccbd0 con 0x559303719b40 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 10 client.15900 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 20 client.15900 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55930379e0f0 0x5593037a0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 4 client.15900 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.993+0000 7fc2c0167740 1 -- 172.21.15.2:0/1629876333 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559303685d70 con 0x55930379e0f0 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55930379e0f0 0x5593037a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2b77fe640 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55930379e0f0 0x5593037a0510 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5d4bd0ccc3fc8ff server_cookie=6209c6eed7a1393f in_seq=0 out_seq=0 2024-09-12T00:55:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc296ffd640 10 client.15900 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc296ffd640 1 -- 172.21.15.2:0/1629876333 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559303685d70 con 0x55930379e0f0 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc296ffd640 10 client.15900 handle_command_reply: tid=0 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 client.15900 shutdown 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 -- 172.21.15.2:0/1629876333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 msgr2=0x559303726e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303726e80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0097cd0 tx=0x7fc2a0099be0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 -- 172.21.15.2:0/1629876333 shutdown_connections 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55930379e0f0 0x5593037a0510 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559303723370 0x5593037273c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559303719b40 0x559303726e80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc296ffd640 0 client.15900 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 --2- 172.21.15.2:0/1629876333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593037185d0 0x55930372bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.994+0000 7fc2c0167740 1 -- 172.21.15.2:0/1629876333 >> 172.21.15.2:0/1629876333 conn(0x5593036e1310 msgr2=0x559303721880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:27.017 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:55:27.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2c0167740 1 -- 172.21.15.2:0/1629876333 shutdown_connections 2024-09-12T00:55:27.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2c0167740 1 -- 172.21.15.2:0/1629876333 wait complete. 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2c0167740 20 client.15900 trim_cache size 0 max 16384 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2a40a2d70 msgr2=0x7fc2a40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2a40a2d70 0x7fc2a40a5230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0011cb0 tx=0x7fc2b0016000 comp rx=0 tx=0).stop 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b81036e0 msgr2=0x7fc2b8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b81036e0 0x7fc2b8100ed0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000d740 tx=0x7fc2a000dc00 comp rx=0 tx=0).stop 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/3253739951 shutdown_connections 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2a40a2d70 0x7fc2a40a5230 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2b81082a0 0x7fc2b8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b81036e0 0x7fc2b8100ed0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 --2- 172.21.15.2:0/3253739951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8102d30 0x7fc2b8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/3253739951 >> 172.21.15.2:0/3253739951 conn(0x7fc2b80fc7d0 msgr2=0x7fc2b8105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:27.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/3253739951 shutdown_connections 2024-09-12T00:55:27.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:26.995+0000 7fc2bdd8e640 1 -- 172.21.15.2:0/3253739951 wait complete. 2024-09-12T00:55:27.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:26 smithi167 ceph-mon[35234]: pgmap v78: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 647 KiB/s wr, 445 op/s 2024-09-12T00:55:27.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:26 smithi071 ceph-mon[35276]: pgmap v78: 97 pgs: 97 active+clean; 80 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 647 KiB/s wr, 445 op/s 2024-09-12T00:55:27.269 INFO:tasks.workunit.client.0.smithi002.stderr:+ cd .. 2024-09-12T00:55:27.269 INFO:tasks.workunit.client.0.smithi002.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-12T00:55:27.271 INFO:tasks.workunit.client.0.smithi002.stderr:+ OPTIONS=-z 2024-09-12T00:55:27.271 INFO:tasks.workunit.client.0.smithi002.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-12T00:55:27.271 INFO:tasks.workunit.client.0.smithi002.stdout:Seed set to 1 2024-09-12T00:55:27.298 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-12T00:55:27.298 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-12T00:55:27.301 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-12T00:55:27.301 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-12T00:55:27.301 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support clone range, disabling! 2024-09-12T00:55:27.305 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-12T00:55:27.308 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support exchange range, disabling! 2024-09-12T00:55:27.308 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero size read 2024-09-12T00:55:27.308 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero size read 2024-09-12T00:55:27.308 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x81d54 2024-09-12T00:55:27.315 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xb86d7 2024-09-12T00:55:27.323 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xe627e 2024-09-12T00:55:27.364 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0xf3194 2024-09-12T00:55:27.388 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xf3ceb 2024-09-12T00:55:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0xf47e4 2024-09-12T00:55:27.486 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xfaccc 2024-09-12T00:55:27.867 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xfe423 2024-09-12T00:55:28.853 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:55:28.854 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:55:28.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:28 smithi002 ceph-mon[31210]: pgmap v79: 97 pgs: 97 active+clean; 80 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 673 KiB/s wr, 453 op/s 2024-09-12T00:55:29.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:28 smithi167 ceph-mon[35234]: pgmap v79: 97 pgs: 97 active+clean; 80 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 673 KiB/s wr, 453 op/s 2024-09-12T00:55:29.123 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:29.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:28 smithi071 ceph-mon[35276]: pgmap v79: 97 pgs: 97 active+clean; 80 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 673 KiB/s wr, 453 op/s 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 -- 172.21.15.2:0/3056304660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101082a0 msgr2=0x7fba1010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 --2- 172.21.15.2:0/3056304660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101082a0 0x7fba1010ec40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fba08009cd0 tx=0x7fba0802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 -- 172.21.15.2:0/3056304660 shutdown_connections 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 --2- 172.21.15.2:0/3056304660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101082a0 0x7fba1010ec40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 --2- 172.21.15.2:0/3056304660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba101036e0 0x7fba10107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 --2- 172.21.15.2:0/3056304660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba10102d30 0x7fba10103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 -- 172.21.15.2:0/3056304660 >> 172.21.15.2:0/3056304660 conn(0x7fba100fc7d0 msgr2=0x7fba100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 -- 172.21.15.2:0/3056304660 shutdown_connections 2024-09-12T00:55:29.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.609+0000 7fba165a1640 1 -- 172.21.15.2:0/3056304660 wait complete. 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.610+0000 7fba165a1640 1 Processor -- start 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.610+0000 7fba165a1640 1 -- start start 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.610+0000 7fba165a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba10102d30 0x7fba10100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.610+0000 7fba165a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101036e0 0x7fba10100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.610+0000 7fba165a1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba101082a0 0x7fba10101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba165a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba101120a0 con 0x7fba101036e0 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba165a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba10111f20 con 0x7fba10102d30 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba165a1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba10112220 con 0x7fba101082a0 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba10102d30 0x7fba10100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101036e0 0x7fba10100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba10102d30 0x7fba10100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:46730/0 (socket says 172.21.15.2:46730) 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba0ffff640 1 -- 172.21.15.2:0/2220117862 learned_addr learned my addr 172.21.15.2:0/2220117862 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:29.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba14b3e640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba101082a0 0x7fba10101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba14b3e640 1 -- 172.21.15.2:0/2220117862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba10102d30 msgr2=0x7fba10100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba14b3e640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba10102d30 0x7fba10100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba14b3e640 1 -- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101036e0 msgr2=0x7fba10100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba14b3e640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101036e0 0x7fba10100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba14b3e640 1 -- 172.21.15.2:0/2220117862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba101a6a30 con 0x7fba101082a0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba0ffff640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba10102d30 0x7fba10100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba14b3e640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba101082a0 0x7fba10101410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba0802ae00 tx=0x7fba08031df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.611+0000 7fba0d7fa640 1 -- 172.21.15.2:0/2220117862 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08003d80 con 0x7fba101082a0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.612+0000 7fba165a1640 1 -- 172.21.15.2:0/2220117862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba101a6cc0 con 0x7fba101082a0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.612+0000 7fba0d7fa640 1 -- 172.21.15.2:0/2220117862 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba08004520 con 0x7fba101082a0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.612+0000 7fba0d7fa640 1 -- 172.21.15.2:0/2220117862 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08030d00 con 0x7fba101082a0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.612+0000 7fba165a1640 1 -- 172.21.15.2:0/2220117862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba101a7200 con 0x7fba101082a0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.614+0000 7fba0d7fa640 1 -- 172.21.15.2:0/2220117862 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fba080046d0 con 0x7fba101082a0 2024-09-12T00:55:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.614+0000 7fba1897a740 1 Processor -- start 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.614+0000 7fba1897a740 1 -- start start 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.614+0000 7fba1897a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d5df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.614+0000 7fba1897a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d68800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba1897a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d6b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba1897a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca38cc3280 con 0x55ca38d5e480 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba1897a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca38c6ab10 con 0x55ca38d5db60 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba1897a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca38cbf240 con 0x55ca38d68d40 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d68800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d5df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d68800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53594/0 (socket says 172.21.15.2:53594) 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0ffff640 1 -- 172.21.15.2:0/857684905 learned_addr learned my addr 172.21.15.2:0/857684905 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d6b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0d7fa640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb9f80a2cf0 0x7fb9f80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0f7fe640 1 -- 172.21.15.2:0/857684905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 msgr2=0x55ca38d6b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d6b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0f7fe640 1 -- 172.21.15.2:0/857684905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 msgr2=0x55ca38d68800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d68800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0f7fe640 1 -- 172.21.15.2:0/857684905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca38c771f0 con 0x55ca38d5db60 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0ffff640 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d68800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba14b3e640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb9f80a2cf0 0x7fb9f80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0d7fa640 1 -- 172.21.15.2:0/2220117862 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba080f02e0 con 0x7fba101082a0 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.615+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d5df40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba10102420 tx=0x7fba04004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b79f406411fe9272 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.616+0000 7fb9f67fc640 1 -- 172.21.15.2:0/857684905 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04011050 con 0x55ca38d5db60 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.616+0000 7fb9f67fc640 1 -- 172.21.15.2:0/857684905 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba040111f0 con 0x55ca38d5db60 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.616+0000 7fb9f67fc640 1 -- 172.21.15.2:0/857684905 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04010430 con 0x55ca38d5db60 2024-09-12T00:55:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 -- 172.21.15.2:0/857684905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 msgr2=0x55ca38d5df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d5df40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba10102420 tx=0x7fba04004730 comp rx=0 tx=0).stop 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba14b3e640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb9f80a2cf0 0x7fb9f80a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba080bc7f0 tx=0x7fba080a7040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 -- 172.21.15.2:0/857684905 shutdown_connections 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d6b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d68800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 --2- 172.21.15.2:0/857684905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d5df40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 -- 172.21.15.2:0/857684905 >> 172.21.15.2:0/857684905 conn(0x55ca38d5a0f0 msgr2=0x55ca38d5a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 -- 172.21.15.2:0/857684905 shutdown_connections 2024-09-12T00:55:29.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.617+0000 7fba1897a740 1 -- 172.21.15.2:0/857684905 wait complete. 2024-09-12T00:55:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 1 -- start start 2024-09-12T00:55:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 1 Processor -- start 2024-09-12T00:55:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d65c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d66140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d68d40 0x55ca38d66680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca38d6b910 con 0x55ca38d68d40 2024-09-12T00:55:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca38c7df10 con 0x55ca38d5db60 2024-09-12T00:55:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca38d6ba90 con 0x55ca38d5e480 2024-09-12T00:55:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba1897a740 10 client.0 _ll_register_callbacks cb 0x55ca38c46a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d65c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d65c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:46760/0 (socket says 172.21.15.2:46760) 2024-09-12T00:55:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba0f7fe640 1 -- 172.21.15.2:0/3592059234 learned_addr learned my addr 172.21.15.2:0/3592059234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d66140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.618+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d68d40 0x55ca38d66680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fba0ffff640 1 -- 172.21.15.2:0/3592059234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 msgr2=0x55ca38d65c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fba0ffff640 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d65c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fba0ffff640 1 -- 172.21.15.2:0/3592059234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d68d40 msgr2=0x55ca38d66680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fba0ffff640 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d68d40 0x55ca38d66680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fba0ffff640 1 -- 172.21.15.2:0/3592059234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca38a346a0 con 0x55ca38d5e480 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fba0ffff640 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d66140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fba00012cf0 tx=0x7fba0000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8fabc92e6fd1a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fb9ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3592059234 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba000120d0 con 0x55ca38d5e480 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3592059234 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba00005020 con 0x55ca38d5e480 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.619+0000 7fba1897a740 1 -- 172.21.15.2:0/3592059234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba040111f0 con 0x55ca38d5e480 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3592059234 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba00012270 con 0x55ca38d5e480 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba1897a740 10 client.25495 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba1897a740 1 -- 172.21.15.2:0/3592059234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ca38d775b0 con 0x55ca38d5e480 2024-09-12T00:55:29.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3592059234 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba040111f0 con 0x55ca38d5e480 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3592059234 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba0001c630 con 0x55ca38d5e480 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba1897a740 10 client.25495 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba1897a740 10 client.25495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba1897a740 20 client.25495 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba1897a740 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca38d78f40 0x55ca38d7b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba1897a740 4 client.25495 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba1897a740 1 -- 172.21.15.2:0/3592059234 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca38cd07f0 con 0x55ca38d78f40 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.620+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca38d78f40 0x55ca38d7b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.621+0000 7fb9ef7fe640 10 client.25495 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:29.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.621+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca38d78f40 0x55ca38d7b360 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af4ce9d107f7447 server_cookie=cc4e91d5c359ca45 in_seq=0 out_seq=0 2024-09-12T00:55:29.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.621+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3592059234 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca38cd07f0 con 0x55ca38d78f40 2024-09-12T00:55:29.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.621+0000 7fb9ef7fe640 10 client.25495 handle_command_reply: tid=0 2024-09-12T00:55:29.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.621+0000 7fba1897a740 1 client.25495 shutdown 2024-09-12T00:55:29.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 -- 172.21.15.2:0/3592059234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 msgr2=0x55ca38d66140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d66140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fba00012cf0 tx=0x7fba0000f790 comp rx=0 tx=0).stop 2024-09-12T00:55:29.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 -- 172.21.15.2:0/3592059234 shutdown_connections 2024-09-12T00:55:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca38d78f40 0x55ca38d7b360 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d68d40 0x55ca38d66680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d66140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 --2- 172.21.15.2:0/3592059234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d65c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 -- 172.21.15.2:0/3592059234 >> 172.21.15.2:0/3592059234 conn(0x55ca38d5a0f0 msgr2=0x55ca38d59270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fb9ef7fe640 0 client.25495 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 -- 172.21.15.2:0/3592059234 shutdown_connections 2024-09-12T00:55:29.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 1 -- 172.21.15.2:0/3592059234 wait complete. 2024-09-12T00:55:29.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.622+0000 7fba1897a740 20 client.25495 trim_cache size 0 max 16384 2024-09-12T00:55:29.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba1897a740 1 Processor -- start 2024-09-12T00:55:29.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba1897a740 1 -- start start 2024-09-12T00:55:29.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba1897a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba1897a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d80c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba1897a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d81140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba1897a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba101b2470 con 0x55ca38d5e480 2024-09-12T00:55:29.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba1897a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba101afd40 con 0x55ca38d5db60 2024-09-12T00:55:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba1897a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba101adb90 con 0x55ca38d68d40 2024-09-12T00:55:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.640+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d80c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d81140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d80c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53614/0 (socket says 172.21.15.2:53614) 2024-09-12T00:55:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0ffff640 1 -- 172.21.15.2:0/3709872822 learned_addr learned my addr 172.21.15.2:0/3709872822 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3709872822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0f7fe640 1 -- 172.21.15.2:0/3709872822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 msgr2=0x55ca38d664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3709872822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0f7fe640 1 -- 172.21.15.2:0/3709872822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 msgr2=0x55ca38d80c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3709872822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d80c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0f7fe640 1 -- 172.21.15.2:0/3709872822 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca38d55830 con 0x55ca38d68d40 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3709872822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d81140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba040097c0 tx=0x7fba04005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b78dc3729b5633 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fb9f5ffb640 1 -- 172.21.15.2:0/3709872822 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04004290 con 0x55ca38d68d40 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fb9f5ffb640 1 -- 172.21.15.2:0/3709872822 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba04035070 con 0x55ca38d68d40 2024-09-12T00:55:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.641+0000 7fb9f5ffb640 1 -- 172.21.15.2:0/3709872822 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba040316c0 con 0x55ca38d68d40 2024-09-12T00:55:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 -- 172.21.15.2:0/3709872822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 msgr2=0x55ca38d81140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 --2- 172.21.15.2:0/3709872822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d81140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba040097c0 tx=0x7fba04005f90 comp rx=0 tx=0).stop 2024-09-12T00:55:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 -- 172.21.15.2:0/3709872822 shutdown_connections 2024-09-12T00:55:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 --2- 172.21.15.2:0/3709872822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d68d40 0x55ca38d81140 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 --2- 172.21.15.2:0/3709872822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5e480 0x55ca38d80c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 --2- 172.21.15.2:0/3709872822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d5db60 0x55ca38d664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 -- 172.21.15.2:0/3709872822 >> 172.21.15.2:0/3709872822 conn(0x55ca38d5a0f0 msgr2=0x55ca38d64cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 -- 172.21.15.2:0/3709872822 shutdown_connections 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.642+0000 7fba1897a740 1 -- 172.21.15.2:0/3709872822 wait complete. 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 1 -- start start 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 1 Processor -- start 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5db60 0x55ca38d6be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d6c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d68d40 0x55ca38de1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba101ae200 con 0x55ca38d5db60 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba101af670 con 0x55ca38d68d40 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba101ae8d0 con 0x55ca38d5e480 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba1897a740 10 client.0 _ll_register_callbacks cb 0x7fba00009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5db60 0x55ca38d6be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5db60 0x55ca38d6be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53618/0 (socket says 172.21.15.2:53618) 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba0f7fe640 1 -- 172.21.15.2:0/3861299182 learned_addr learned my addr 172.21.15.2:0/3861299182 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba0ffff640 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d6c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.643+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d68d40 0x55ca38de1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba0f7fe640 1 -- 172.21.15.2:0/3861299182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 msgr2=0x55ca38d6c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d6c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba0f7fe640 1 -- 172.21.15.2:0/3861299182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d68d40 msgr2=0x55ca38de1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d68d40 0x55ca38de1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba0f7fe640 1 -- 172.21.15.2:0/3861299182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca38de2100 con 0x55ca38d5db60 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5db60 0x55ca38d6be00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fba04009a10 tx=0x7fba04003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81858bc24720fc7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fb9ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3861299182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba040037f0 con 0x55ca38d5db60 2024-09-12T00:55:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3861299182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba04003990 con 0x55ca38d5db60 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba1897a740 1 -- 172.21.15.2:0/3861299182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba04035070 con 0x55ca38d5db60 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3861299182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba04003b90 con 0x55ca38d5db60 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba1897a740 10 client.15918 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.644+0000 7fba1897a740 1 -- 172.21.15.2:0/3861299182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ca38de3230 con 0x55ca38d5db60 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3861299182 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba04035070 con 0x55ca38d5db60 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3861299182 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba0404a070 con 0x55ca38d5db60 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fba1897a740 10 client.15918 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fba1897a740 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fba1897a740 20 client.15918 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fba1897a740 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca38de3700 0x55ca38de5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fba1897a740 4 client.15918 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fba1897a740 1 -- 172.21.15.2:0/3861299182 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ca38ccad00 con 0x55ca38de3700 2024-09-12T00:55:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fba0ffff640 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca38de3700 0x55ca38de5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fba0ffff640 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca38de3700 0x55ca38de5af0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f0d90b4aaf9374c server_cookie=462a09d1cb2e59a0 in_seq=0 out_seq=0 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.645+0000 7fb9ef7fe640 10 client.15918 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.646+0000 7fb9ef7fe640 1 -- 172.21.15.2:0/3861299182 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ca38ccad00 con 0x55ca38de3700 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.646+0000 7fb9ef7fe640 10 client.15918 handle_command_reply: tid=0 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.646+0000 7fba1897a740 1 client.15918 shutdown 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 -- 172.21.15.2:0/3861299182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5db60 msgr2=0x55ca38d6be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5db60 0x55ca38d6be00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fba04009a10 tx=0x7fba04003ed0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 -- 172.21.15.2:0/3861299182 shutdown_connections 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca38de3700 0x55ca38de5af0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca38d68d40 0x55ca38de1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca38d5e480 0x55ca38d6c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 --2- 172.21.15.2:0/3861299182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca38d5db60 0x55ca38d6be00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 -- 172.21.15.2:0/3861299182 >> 172.21.15.2:0/3861299182 conn(0x55ca38d5a0f0 msgr2=0x55ca38d664e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fb9ef7fe640 0 client.15918 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 -- 172.21.15.2:0/3861299182 shutdown_connections 2024-09-12T00:55:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 1 -- 172.21.15.2:0/3861299182 wait complete. 2024-09-12T00:55:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba1897a740 20 client.15918 trim_cache size 0 max 16384 2024-09-12T00:55:29.653 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:55:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:55:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "0c86a692-e741-4b87-87f8-c645b0a08d60", 2024-09-12T00:55:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:55:29.653 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:55:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba165a1640 1 -- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb9f80a2cf0 msgr2=0x7fb9f80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba165a1640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb9f80a2cf0 0x7fb9f80a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba080bc7f0 tx=0x7fba080a7040 comp rx=0 tx=0).stop 2024-09-12T00:55:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba165a1640 1 -- 172.21.15.2:0/2220117862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba101082a0 msgr2=0x7fba10101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.647+0000 7fba165a1640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba101082a0 0x7fba10101410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba0802ae00 tx=0x7fba08031df0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.648+0000 7fba165a1640 1 -- 172.21.15.2:0/2220117862 shutdown_connections 2024-09-12T00:55:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.648+0000 7fba165a1640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb9f80a2cf0 0x7fb9f80a51b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.648+0000 7fba165a1640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba101082a0 0x7fba10101410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.648+0000 7fba165a1640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101036e0 0x7fba10100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.648+0000 7fba165a1640 1 --2- 172.21.15.2:0/2220117862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba10102d30 0x7fba10100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.648+0000 7fba165a1640 1 -- 172.21.15.2:0/2220117862 >> 172.21.15.2:0/2220117862 conn(0x7fba100fc7d0 msgr2=0x7fba10105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.648+0000 7fba165a1640 1 -- 172.21.15.2:0/2220117862 shutdown_connections 2024-09-12T00:55:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:29.648+0000 7fba165a1640 1 -- 172.21.15.2:0/2220117862 wait complete. 2024-09-12T00:55:30.147 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xfe492 2024-09-12T00:55:30.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:55:30.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:30.926 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: pgmap v80: 97 pgs: 97 active+clean; 80 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 440 KiB/s wr, 100 op/s 2024-09-12T00:55:30.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:55:30.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:30.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:55:30.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:55:30.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:30.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:55:30.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:30.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:55:30.928 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:30.928 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:55:30.928 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:30.928 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:55:30.928 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:30 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: pgmap v80: 97 pgs: 97 active+clean; 80 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 440 KiB/s wr, 100 op/s 2024-09-12T00:55:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:55:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:55:31.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:55:31.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:55:31.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:55:31.039 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.039 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:55:31.039 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.039 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:55:31.039 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:30 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: pgmap v80: 97 pgs: 97 active+clean; 80 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 440 KiB/s wr, 100 op/s 2024-09-12T00:55:31.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:55:31.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:30 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.323+0000 7f6dbd57a640 1 -- 172.21.15.2:0/3065817898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6db8102570 msgr2=0x7f6db81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.323+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/3065817898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6db8102570 0x7f6db81029b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009890 tx=0x7f6da002a410 comp rx=0 tx=0).stop 2024-09-12T00:55:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 -- 172.21.15.2:0/3065817898 shutdown_connections 2024-09-12T00:55:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/3065817898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102ef0 0x7f6db810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/3065817898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6db8102570 0x7f6db81029b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/3065817898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6db8100e20 0x7f6db8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 -- 172.21.15.2:0/3065817898 >> 172.21.15.2:0/3065817898 conn(0x7f6db80fc7d0 msgr2=0x7f6db80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 -- 172.21.15.2:0/3065817898 shutdown_connections 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 -- 172.21.15.2:0/3065817898 wait complete. 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 Processor -- start 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.324+0000 7f6dbd57a640 1 -- start start 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6dbd57a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8100e20 0x7f6db8199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6dbd57a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6db8102570 0x7f6db81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6dbd57a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6db8102ef0 0x7f6db81a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6dbd57a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8110f80 con 0x7f6db8100e20 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6dbd57a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8110e00 con 0x7f6db8102570 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6dbd57a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8111100 con 0x7f6db8102ef0 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8100e20 0x7f6db8199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8100e20 0x7f6db8199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53632/0 (socket says 172.21.15.2:53632) 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1144687711 learned_addr learned my addr 172.21.15.2:0/1144687711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6daffff640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6db8102570 0x7f6db81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db77fe640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6db8102ef0 0x7f6db81a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1144687711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6db8102ef0 msgr2=0x7f6db81a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6db8102ef0 0x7f6db81a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1144687711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6db8102570 msgr2=0x7f6db81998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6db8102570 0x7f6db81998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1144687711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db81a4950 con 0x7f6db8100e20 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.325+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8100e20 0x7f6db8199390 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6da800ebc0 tx=0x7f6da800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.326+0000 7f6db4ff9640 1 -- 172.21.15.2:0/1144687711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8010630 con 0x7f6db8100e20 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.326+0000 7f6db4ff9640 1 -- 172.21.15.2:0/1144687711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da8010cb0 con 0x7f6db8100e20 2024-09-12T00:55:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.326+0000 7f6dbd57a640 1 -- 172.21.15.2:0/1144687711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db81a4b20 con 0x7f6db8100e20 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.326+0000 7f6db4ff9640 1 -- 172.21.15.2:0/1144687711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8018bd0 con 0x7f6db8100e20 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.326+0000 7f6dbd57a640 1 -- 172.21.15.2:0/1144687711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db81a5030 con 0x7f6db8100e20 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.328+0000 7f6db4ff9640 1 -- 172.21.15.2:0/1144687711 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f6da80107d0 con 0x7f6db8100e20 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6dbf953740 1 Processor -- start 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6dbf953740 1 -- start start 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d227880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d232140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6db4ff9640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6da40a2cf0 0x7f6da40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d234a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6dbf953740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56057d18d2e0 con 0x56057d227dc0 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6dbf953740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56057d134ce0 con 0x56057d2274a0 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6dbf953740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56057d1892a0 con 0x56057d232680 2024-09-12T00:55:31.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d232140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d227880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d232140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53638/0 (socket says 172.21.15.2:53638) 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1117211645 learned_addr learned my addr 172.21.15.2:0/1117211645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6daffff640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6da40a2cf0 0x7f6da40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6db77fe640 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d234a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.329+0000 7f6db4ff9640 1 -- 172.21.15.2:0/1144687711 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6da80cfac0 con 0x7f6db8100e20 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6db77fe640 1 -- 172.21.15.2:0/1117211645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 msgr2=0x56057d234a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6db77fe640 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d234a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6db77fe640 1 -- 172.21.15.2:0/1117211645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 msgr2=0x56057d232140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6db77fe640 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d232140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6db77fe640 1 -- 172.21.15.2:0/1117211645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057d119440 con 0x56057d2274a0 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d232140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6daffff640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6da40a2cf0 0x7f6da40a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6da00095f0 tx=0x7f6da0005dc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6db77fe640 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d227880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009fd0 tx=0x7f6db0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be95f53053d38234 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6dad7fa640 1 -- 172.21.15.2:0/1117211645 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0013c60 con 0x56057d2274a0 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6dad7fa640 1 -- 172.21.15.2:0/1117211645 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6db0013e00 con 0x56057d2274a0 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.330+0000 7f6dad7fa640 1 -- 172.21.15.2:0/1117211645 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db00035f0 con 0x56057d2274a0 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 -- 172.21.15.2:0/1117211645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 msgr2=0x56057d227880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d227880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009fd0 tx=0x7f6db0004730 comp rx=0 tx=0).stop 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 -- 172.21.15.2:0/1117211645 shutdown_connections 2024-09-12T00:55:31.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d234a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d232140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1117211645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d227880 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 -- 172.21.15.2:0/1117211645 >> 172.21.15.2:0/1117211645 conn(0x56057d223a30 msgr2=0x56057d223e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 -- 172.21.15.2:0/1117211645 shutdown_connections 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 -- 172.21.15.2:0/1117211645 wait complete. 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 -- start start 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.331+0000 7f6dbf953740 1 Processor -- start 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d232000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d22f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d22f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6dbf953740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56057d235250 con 0x56057d227dc0 2024-09-12T00:55:31.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6dbf953740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56057d148050 con 0x56057d2274a0 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6dbf953740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56057d2353d0 con 0x56057d232680 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6dbf953740 10 client.0 _ll_register_callbacks cb 0x56057d188160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6daffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d22f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d232000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d232000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:46810/0 (socket says 172.21.15.2:46810) 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 -- 172.21.15.2:0/2581793902 learned_addr learned my addr 172.21.15.2:0/2581793902 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6daffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d22f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53648/0 (socket says 172.21.15.2:53648) 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db77fe640 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d22f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 -- 172.21.15.2:0/2581793902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 msgr2=0x56057d22f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d22f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 -- 172.21.15.2:0/2581793902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 msgr2=0x56057d22f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d22f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 -- 172.21.15.2:0/2581793902 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057cefe3c0 con 0x56057d2274a0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d232000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6da8098a10 tx=0x7f6da8009a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7deecee31ae801af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.332+0000 7f6d9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/2581793902 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da807ae60 con 0x56057d2274a0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/2581793902 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6da80c5e70 con 0x56057d2274a0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 1 -- 172.21.15.2:0/2581793902 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db0013e00 con 0x56057d2274a0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/2581793902 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6da8010e60 con 0x56057d2274a0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 10 client.25595 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 1 -- 172.21.15.2:0/2581793902 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56057d240c40 con 0x56057d2274a0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/2581793902 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6db0013e00 con 0x56057d2274a0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/2581793902 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6da80a4770 con 0x56057d2274a0 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 10 client.25595 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 10 client.25595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:55:31.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 20 client.25595 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56057d2420a0 0x56057d2444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 4 client.25595 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6dbf953740 1 -- 172.21.15.2:0/2581793902 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56057d19a850 con 0x56057d2420a0 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.333+0000 7f6daffff640 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56057d2420a0 0x56057d2444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.334+0000 7f6d9e7fc640 10 client.25595 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.334+0000 7f6daffff640 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56057d2420a0 0x56057d2444d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a12e11f5aa8483fc server_cookie=371247fe4621089 in_seq=0 out_seq=0 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/2581793902 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56057d19a850 con 0x56057d2420a0 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6d9e7fc640 10 client.25595 handle_command_reply: tid=0 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 client.25595 shutdown 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 -- 172.21.15.2:0/2581793902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 msgr2=0x56057d232000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d232000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6da8098a10 tx=0x7f6da8009a40 comp rx=0 tx=0).stop 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 -- 172.21.15.2:0/2581793902 shutdown_connections 2024-09-12T00:55:31.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56057d2420a0 0x56057d2444d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d22f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d22f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6d9e7fc640 0 client.25595 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:31.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 --2- 172.21.15.2:0/2581793902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d2274a0 0x56057d232000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 -- 172.21.15.2:0/2581793902 >> 172.21.15.2:0/2581793902 conn(0x56057d223a30 msgr2=0x56057d229760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:31.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 -- 172.21.15.2:0/2581793902 shutdown_connections 2024-09-12T00:55:31.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 1 -- 172.21.15.2:0/2581793902 wait complete. 2024-09-12T00:55:31.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.335+0000 7f6dbf953740 20 client.25595 trim_cache size 0 max 16384 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.355+0000 7f6dbf953740 1 Processor -- start 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.355+0000 7f6dbf953740 1 -- start start 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.355+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d2274a0 0x56057d249da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.355+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d24a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d232680 0x56057d22c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6dbf953740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81b03b0 con 0x56057d227dc0 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6dbf953740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81adc80 con 0x56057d232680 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6dbf953740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81abad0 con 0x56057d2274a0 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6daffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d24a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d2274a0 0x56057d249da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d2274a0 0x56057d249da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:47848/0 (socket says 172.21.15.2:47848) 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6daffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d24a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53662/0 (socket says 172.21.15.2:53662) 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1397306194 learned_addr learned my addr 172.21.15.2:0/1397306194 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db77fe640 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d232680 0x56057d22c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1397306194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d232680 msgr2=0x56057d22c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d232680 0x56057d22c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1397306194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 msgr2=0x56057d24a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d24a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1397306194 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057d2234d0 con 0x56057d2274a0 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6daffff640 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d24a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d2274a0 0x56057d249da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6da809a2f0 tx=0x7f6da809a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb87b5eea77b1bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.356+0000 7f6dacff9640 1 -- 172.21.15.2:0/1397306194 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8026040 con 0x56057d2274a0 2024-09-12T00:55:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dacff9640 1 -- 172.21.15.2:0/1397306194 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da809b490 con 0x56057d2274a0 2024-09-12T00:55:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dacff9640 1 -- 172.21.15.2:0/1397306194 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8096bb0 con 0x56057d2274a0 2024-09-12T00:55:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 -- 172.21.15.2:0/1397306194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d2274a0 msgr2=0x56057d249da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d2274a0 0x56057d249da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6da809a2f0 tx=0x7f6da809a550 comp rx=0 tx=0).stop 2024-09-12T00:55:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 -- 172.21.15.2:0/1397306194 shutdown_connections 2024-09-12T00:55:31.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d232680 0x56057d22c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d227dc0 0x56057d24a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1397306194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d2274a0 0x56057d249da0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 -- 172.21.15.2:0/1397306194 >> 172.21.15.2:0/1397306194 conn(0x56057d223a30 msgr2=0x56057d222b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:31.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 -- 172.21.15.2:0/1397306194 shutdown_connections 2024-09-12T00:55:31.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.357+0000 7f6dbf953740 1 -- 172.21.15.2:0/1397306194 wait complete. 2024-09-12T00:55:31.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 1 -- start start 2024-09-12T00:55:31.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 1 Processor -- start 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d2274a0 0x56057d238320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d227dc0 0x56057d238860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d238da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81ac140 con 0x56057d2274a0 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81ad5b0 con 0x56057d227dc0 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81ac810 con 0x56057d232680 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6dbf953740 10 client.0 _ll_register_callbacks cb 0x7f6da80bc0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d2274a0 0x56057d238320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d2274a0 0x56057d238320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53674/0 (socket says 172.21.15.2:53674) 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1311741126 learned_addr learned my addr 172.21.15.2:0/1311741126 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.358+0000 7f6daffff640 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d227dc0 0x56057d238860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6db77fe640 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d238da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1311741126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 msgr2=0x56057d238da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d238da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1311741126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d227dc0 msgr2=0x56057d238860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d227dc0 0x56057d238860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6db6ffd640 1 -- 172.21.15.2:0/1311741126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057d2abd80 con 0x56057d2274a0 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6db6ffd640 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d2274a0 0x56057d238320 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6da8098a10 tx=0x7f6da8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d99f7beb8496ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6d9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/1311741126 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da809bb80 con 0x56057d2274a0 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/1311741126 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6da8097d90 con 0x56057d2274a0 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6dbf953740 1 -- 172.21.15.2:0/1311741126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da809b490 con 0x56057d2274a0 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/1311741126 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6da80cc020 con 0x56057d2274a0 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6dbf953740 10 client.15936 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:31.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.359+0000 7f6dbf953740 1 -- 172.21.15.2:0/1311741126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56057d2acff0 con 0x56057d2274a0 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/1311741126 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da809b490 con 0x56057d2274a0 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/1311741126 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6da80a14d0 con 0x56057d2274a0 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6dbf953740 10 client.15936 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6dbf953740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6dbf953740 20 client.15936 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56057d2ad520 0x56057d2af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6dbf953740 4 client.15936 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6dbf953740 1 -- 172.21.15.2:0/1311741126 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56057d194d60 con 0x56057d2ad520 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.360+0000 7f6daffff640 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56057d2ad520 0x56057d2af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6daffff640 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56057d2ad520 0x56057d2af940 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2ad2fd4c58c970a server_cookie=8987bc43b6954ea0 in_seq=0 out_seq=0 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6d9e7fc640 10 client.15936 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6d9e7fc640 1 -- 172.21.15.2:0/1311741126 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56057d194d60 con 0x56057d2ad520 2024-09-12T00:55:31.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6d9e7fc640 10 client.15936 handle_command_reply: tid=0 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 client.15936 shutdown 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 -- 172.21.15.2:0/1311741126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d2274a0 msgr2=0x56057d238320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d2274a0 0x56057d238320 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6da8098a10 tx=0x7f6da8000f40 comp rx=0 tx=0).stop 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 -- 172.21.15.2:0/1311741126 shutdown_connections 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56057d2ad520 0x56057d2af940 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56057d232680 0x56057d238da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56057d227dc0 0x56057d238860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 --2- 172.21.15.2:0/1311741126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56057d2274a0 0x56057d238320 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 -- 172.21.15.2:0/1311741126 >> 172.21.15.2:0/1311741126 conn(0x56057d223a30 msgr2=0x56057d230b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6d9e7fc640 0 client.15936 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 -- 172.21.15.2:0/1311741126 shutdown_connections 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 1 -- 172.21.15.2:0/1311741126 wait complete. 2024-09-12T00:55:31.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.361+0000 7f6dbf953740 20 client.15936 trim_cache size 0 max 16384 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout: "0c86a692-e741-4b87-87f8-c645b0a08d60": { 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "0c86a692-e741-4b87-87f8-c645b0a08d60", 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:31.366 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:55:31.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 -- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6da40a2cf0 msgr2=0x7f6da40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6da40a2cf0 0x7f6da40a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6da00095f0 tx=0x7f6da0005dc0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 -- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8100e20 msgr2=0x7f6db8199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:31.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8100e20 0x7f6db8199390 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6da800ebc0 tx=0x7f6da800c6a0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 -- 172.21.15.2:0/1144687711 shutdown_connections 2024-09-12T00:55:31.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6da40a2cf0 0x7f6da40a51b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6db8102ef0 0x7f6db81a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6db8102570 0x7f6db81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 --2- 172.21.15.2:0/1144687711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8100e20 0x7f6db8199390 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:31.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 -- 172.21.15.2:0/1144687711 >> 172.21.15.2:0/1144687711 conn(0x7f6db80fc7d0 msgr2=0x7f6db81048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:31.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 -- 172.21.15.2:0/1144687711 shutdown_connections 2024-09-12T00:55:31.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:31.362+0000 7f6dbd57a640 1 -- 172.21.15.2:0/1144687711 wait complete. 2024-09-12T00:55:31.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:31 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:32.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:31 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:32.045 INFO:tasks.cephfs.filesystem:scrub status for tag:0c86a692-e741-4b87-87f8-c645b0a08d60 - {'path': '/', 'tag': '0c86a692-e741-4b87-87f8-c645b0a08d60', 'options': 'recursive,force'} 2024-09-12T00:55:32.057 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xff038 2024-09-12T00:55:32.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:31 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:55:32.860 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0xffcac 2024-09-12T00:55:32.972 INFO:tasks.workunit.client.0.smithi002.stdout:10000 copy from 0x2d237 to 0x30552, (0x331b bytes) at 0x82aed 2024-09-12T00:55:32.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:32 smithi002 ceph-mon[31210]: pgmap v81: 97 pgs: 97 active+clean; 83 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 351 op/s 2024-09-12T00:55:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:32 smithi167 ceph-mon[35234]: pgmap v81: 97 pgs: 97 active+clean; 83 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 351 op/s 2024-09-12T00:55:33.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:32 smithi071 ceph-mon[35276]: pgmap v81: 97 pgs: 97 active+clean; 83 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 351 op/s 2024-09-12T00:55:34.993 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:34 smithi071 ceph-mon[35276]: pgmap v82: 97 pgs: 97 active+clean; 83 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 269 op/s 2024-09-12T00:55:34.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:34 smithi002 ceph-mon[31210]: pgmap v82: 97 pgs: 97 active+clean; 83 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 269 op/s 2024-09-12T00:55:35.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:34 smithi167 ceph-mon[35234]: pgmap v82: 97 pgs: 97 active+clean; 83 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 269 op/s 2024-09-12T00:55:35.393 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.7 2024-09-12T00:55:35.394 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:55:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 -- 172.21.15.2:0/1578681964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 msgr2=0x7f61e010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/1578681964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 0x7f61e010ea90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009ca0 tx=0x7f61d802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 -- 172.21.15.2:0/1578681964 shutdown_connections 2024-09-12T00:55:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/1578681964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 0x7f61e010ea90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/1578681964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e0102790 0x7f61e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/1578681964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e0101de0 0x7f61e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 -- 172.21.15.2:0/1578681964 >> 172.21.15.2:0/1578681964 conn(0x7f61e00fd8e0 msgr2=0x7f61e00ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 -- 172.21.15.2:0/1578681964 shutdown_connections 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.192+0000 7f61e7d9e640 1 -- 172.21.15.2:0/1578681964 wait complete. 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e7d9e640 1 Processor -- start 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e7d9e640 1 -- start start 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e7d9e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e0101de0 0x7f61e01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e7d9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e0102790 0x7f61e0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e7d9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 0x7f61e019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e7d9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0111f70 con 0x7f61e0106f10 2024-09-12T00:55:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e7d9e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0111df0 con 0x7f61e0101de0 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e7d9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61e01120f0 con 0x7f61e0102790 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e633b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 0x7f61e019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e5b3a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e0101de0 0x7f61e01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e633b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 0x7f61e019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49182/0 (socket says 172.21.15.2:49182) 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e633b640 1 -- 172.21.15.2:0/3833026134 learned_addr learned my addr 172.21.15.2:0/3833026134 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.193+0000 7f61e5339640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e0102790 0x7f61e0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61e5b3a640 1 -- 172.21.15.2:0/3833026134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e0102790 msgr2=0x7f61e0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61e5b3a640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e0102790 0x7f61e0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61e5b3a640 1 -- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 msgr2=0x7f61e019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61e5b3a640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 0x7f61e019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61e5b3a640 1 -- 172.21.15.2:0/3833026134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e019d3a0 con 0x7f61e0101de0 2024-09-12T00:55:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61e5b3a640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e0101de0 0x7f61e01983f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9f0 tx=0x7f61dc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61d6ffd640 1 -- 172.21.15.2:0/3833026134 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00ccc0 con 0x7f61e0101de0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61d6ffd640 1 -- 172.21.15.2:0/3833026134 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61dc010910 con 0x7f61e0101de0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e019d690 con 0x7f61e0101de0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61d6ffd640 1 -- 172.21.15.2:0/3833026134 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc018960 con 0x7f61e0101de0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.194+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e01a4f70 con 0x7f61e0101de0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.195+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e01021c0 con 0x7f61e0101de0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.197+0000 7f61d6ffd640 1 -- 172.21.15.2:0/3833026134 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f61dc010ac0 con 0x7f61e0101de0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.197+0000 7f61d6ffd640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f61cc0a2cf0 0x7f61cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.197+0000 7f61e5339640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f61cc0a2cf0 0x7f61cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.197+0000 7f61d6ffd640 1 -- 172.21.15.2:0/3833026134 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f61dc0cfb30 con 0x7f61e0101de0 2024-09-12T00:55:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.198+0000 7f61e5339640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f61cc0a2cf0 0x7f61cc0a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61d00095f0 tx=0x7f61d0005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.201+0000 7f61d6ffd640 1 -- 172.21.15.2:0/3833026134 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61dc09c0b0 con 0x7f61e0101de0 2024-09-12T00:55:36.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.437+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61e0199750 con 0x7f61e0101de0 2024-09-12T00:55:36.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.438+0000 7f61d6ffd640 1 -- 172.21.15.2:0/3833026134 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7f61dc0a03b0 con 0x7f61e0101de0 2024-09-12T00:55:36.437 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:55:36.437 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:55:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f61cc0a2cf0 msgr2=0x7f61cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f61cc0a2cf0 0x7f61cc0a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61d00095f0 tx=0x7f61d0005f90 comp rx=0 tx=0).stop 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e0101de0 msgr2=0x7f61e01983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e0101de0 0x7f61e01983f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9f0 tx=0x7f61dc00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 shutdown_connections 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f61cc0a2cf0 0x7f61cc0a51b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61e0106f10 0x7f61e019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e0102790 0x7f61e0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 --2- 172.21.15.2:0/3833026134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e0101de0 0x7f61e01983f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:36.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 >> 172.21.15.2:0/3833026134 conn(0x7f61e00fd8e0 msgr2=0x7f61e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:36.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 shutdown_connections 2024-09-12T00:55:36.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:36.441+0000 7f61e7d9e640 1 -- 172.21.15.2:0/3833026134 wait complete. 2024-09-12T00:55:36.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:36 smithi002 ceph-mon[31210]: pgmap v83: 97 pgs: 97 active+clean; 83 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-09-12T00:55:36.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:36 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:55:36.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:36 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:55:36.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:36 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3833026134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:37.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:36 smithi167 ceph-mon[35234]: pgmap v83: 97 pgs: 97 active+clean; 83 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-09-12T00:55:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:36 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:55:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:36 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:55:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:36 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3833026134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:37.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:36 smithi071 ceph-mon[35276]: pgmap v83: 97 pgs: 97 active+clean; 83 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-09-12T00:55:37.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:36 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:55:37.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:36 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:55:37.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:36 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3833026134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:55:37.231 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0' 2024-09-12T00:55:37.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0 2024-09-12T00:55:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:55:37.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:37 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 -- 172.21.15.2:0/1667611056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 msgr2=0x7f89e4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 --2- 172.21.15.2:0/1667611056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 0x7f89e4101200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009900 tx=0x7f89e002a480 comp rx=0 tx=0).stop 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 -- 172.21.15.2:0/1667611056 shutdown_connections 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 --2- 172.21.15.2:0/1667611056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102ef0 0x7f89e410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 --2- 172.21.15.2:0/1667611056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89e4102570 0x7f89e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 --2- 172.21.15.2:0/1667611056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 0x7f89e4101200 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 -- 172.21.15.2:0/1667611056 >> 172.21.15.2:0/1667611056 conn(0x7f89e40fc7d0 msgr2=0x7f89e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 -- 172.21.15.2:0/1667611056 shutdown_connections 2024-09-12T00:55:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.005+0000 7f89eb748640 1 -- 172.21.15.2:0/1667611056 wait complete. 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89eb748640 1 Processor -- start 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89eb748640 1 -- start start 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89eb748640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 0x7f89e4198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89eb748640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102570 0x7f89e4198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89eb748640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89e4102ef0 0x7f89e419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89eb748640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4110f80 con 0x7f89e4100e20 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89eb748640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4110e00 con 0x7f89e4102570 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89eb748640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4111100 con 0x7f89e4102ef0 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89e94e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 0x7f89e4198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89e94e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 0x7f89e4198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49196/0 (socket says 172.21.15.2:49196) 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.006+0000 7f89e94e4640 1 -- 172.21.15.2:0/1474043706 learned_addr learned my addr 172.21.15.2:0/1474043706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89e4102ef0 0x7f89e419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102570 0x7f89e4198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89e94e4640 1 -- 172.21.15.2:0/1474043706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89e4102ef0 msgr2=0x7f89e419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89e94e4640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89e4102ef0 0x7f89e419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89e94e4640 1 -- 172.21.15.2:0/1474043706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102570 msgr2=0x7f89e4198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89e94e4640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102570 0x7f89e4198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89e94e4640 1 -- 172.21.15.2:0/1474043706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e419d4f0 con 0x7f89e4100e20 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89e94e4640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 0x7f89e4198540 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006010 tx=0x7f89e0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89da7fc640 1 -- 172.21.15.2:0/1474043706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e003f070 con 0x7f89e4100e20 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89da7fc640 1 -- 172.21.15.2:0/1474043706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89e0031c30 con 0x7f89e4100e20 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89eb748640 1 -- 172.21.15.2:0/1474043706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e419d780 con 0x7f89e4100e20 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.007+0000 7f89da7fc640 1 -- 172.21.15.2:0/1474043706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0035030 con 0x7f89e4100e20 2024-09-12T00:55:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.008+0000 7f89eb748640 1 -- 172.21.15.2:0/1474043706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e41a50c0 con 0x7f89e4100e20 2024-09-12T00:55:38.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.010+0000 7f89da7fc640 1 -- 172.21.15.2:0/1474043706 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f89e0042070 con 0x7f89e4100e20 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89edb21740 1 Processor -- start 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89edb21740 1 -- start start 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89edb21740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06c9db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89edb21740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89edb21740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06ca8940 0x55cb06caad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89edb21740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cb06c032a0 con 0x55cb06ca8940 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89edb21740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cb06baab10 con 0x55cb06c9e080 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89edb21740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cb06bff260 con 0x55cb06c9d760 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e94e4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e94e4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:59998/0 (socket says 172.21.15.2:59998) 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e94e4640 1 -- 172.21.15.2:0/2955909348 learned_addr learned my addr 172.21.15.2:0/2955909348 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06ca8940 0x55cb06caad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06c9db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e9ce5640 1 -- 172.21.15.2:0/2955909348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 msgr2=0x55cb06ca8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e9ce5640 1 -- 172.21.15.2:0/2955909348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06ca8940 msgr2=0x55cb06caad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06ca8940 0x55cb06caad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.011+0000 7f89e9ce5640 1 -- 172.21.15.2:0/2955909348 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb06974b90 con 0x55cb06c9d760 2024-09-12T00:55:38.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.012+0000 7f89da7fc640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f89d00a2cf0 0x7f89d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.012+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06c9db40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009f10 tx=0x7f89dc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a147030bf52400a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.012+0000 7f89e94e4640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f89d00a2cf0 0x7f89d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.012+0000 7f89da7fc640 1 -- 172.21.15.2:0/1474043706 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f89e00ef900 con 0x7f89e4100e20 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.012+0000 7f89cf7fe640 1 -- 172.21.15.2:0/2955909348 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc004d20 con 0x55cb06c9d760 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.012+0000 7f89cf7fe640 1 -- 172.21.15.2:0/2955909348 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89dc004030 con 0x55cb06c9d760 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.012+0000 7f89cf7fe640 1 -- 172.21.15.2:0/2955909348 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc005260 con 0x55cb06c9d760 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 -- 172.21.15.2:0/2955909348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 msgr2=0x55cb06c9db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89e94e4640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f89d00a2cf0 0x7f89d00a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f89e00b8230 tx=0x7f89e00f5550 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06c9db40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009f10 tx=0x7f89dc011810 comp rx=0 tx=0).stop 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 -- 172.21.15.2:0/2955909348 shutdown_connections 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06ca8940 0x55cb06caad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 --2- 172.21.15.2:0/2955909348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06c9db40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 -- 172.21.15.2:0/2955909348 >> 172.21.15.2:0/2955909348 conn(0x55cb06c99cf0 msgr2=0x55cb06c9a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 -- 172.21.15.2:0/2955909348 shutdown_connections 2024-09-12T00:55:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 -- 172.21.15.2:0/2955909348 wait complete. 2024-09-12T00:55:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.013+0000 7f89edb21740 1 -- start start 2024-09-12T00:55:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89edb21740 1 Processor -- start 2024-09-12T00:55:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89edb21740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06ca57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89edb21740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89edb21740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06ca8940 0x55cb06ca6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89edb21740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cb06cab510 con 0x55cb06c9d760 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89edb21740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cb06b8b6e0 con 0x55cb06c9e080 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89edb21740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cb06cab690 con 0x55cb06ca8940 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89edb21740 10 client.0 _ll_register_callbacks cb 0x55cb06bafa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89e9ce5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06ca57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89e9ce5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06ca57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49202/0 (socket says 172.21.15.2:49202) 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89e9ce5640 1 -- 172.21.15.2:0/397639768 learned_addr learned my addr 172.21.15.2:0/397639768 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.014+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06ca8940 0x55cb06ca6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89e8ce3640 1 -- 172.21.15.2:0/397639768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06ca8940 msgr2=0x55cb06ca6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06ca8940 0x55cb06ca6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89e8ce3640 1 -- 172.21.15.2:0/397639768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 msgr2=0x55cb06ca57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06ca57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89e8ce3640 1 -- 172.21.15.2:0/397639768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb06cb49b0 con 0x55cb06c9e080 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06ca8940 0x55cb06ca6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca5d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f89e40fff40 tx=0x7f89d4016f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04bba4f563d9d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89ccff9640 1 -- 172.21.15.2:0/397639768 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d400fd70 con 0x55cb06c9e080 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89edb21740 1 -- 172.21.15.2:0/397639768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89dc004030 con 0x55cb06c9e080 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89ccff9640 1 -- 172.21.15.2:0/397639768 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f89d40160d0 con 0x55cb06c9e080 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89ccff9640 1 -- 172.21.15.2:0/397639768 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f89d40162d0 con 0x55cb06c9e080 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89edb21740 10 client.25619 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.015+0000 7f89edb21740 1 -- 172.21.15.2:0/397639768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cb06cb7380 con 0x55cb06c9e080 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89ccff9640 1 -- 172.21.15.2:0/397639768 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89dc004030 con 0x55cb06c9e080 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89ccff9640 1 -- 172.21.15.2:0/397639768 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f89d40204b0 con 0x55cb06c9e080 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89edb21740 10 client.25619 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89edb21740 10 client.25619 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89edb21740 20 client.25619 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89edb21740 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cb06cb88e0 0x55cb06cbad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89edb21740 4 client.25619 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89edb21740 1 -- 172.21.15.2:0/397639768 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb06c109d0 con 0x55cb06cb88e0 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cb06cb88e0 0x55cb06cbad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89ccff9640 10 client.25619 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.016+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cb06cb88e0 0x55cb06cbad30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de37f3755dc4f4e5 server_cookie=a53a7326abd4b34d in_seq=0 out_seq=0 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89ccff9640 1 -- 172.21.15.2:0/397639768 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb06c109d0 con 0x55cb06cb88e0 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89ccff9640 10 client.25619 handle_command_reply: tid=0 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 client.25619 shutdown 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 -- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 msgr2=0x55cb06ca5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca5d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f89e40fff40 tx=0x7f89d4016f70 comp rx=0 tx=0).stop 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 -- 172.21.15.2:0/397639768 shutdown_connections 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cb06cb88e0 0x55cb06cbad30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06ca8940 0x55cb06ca6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06c9e080 0x55cb06ca5d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 --2- 172.21.15.2:0/397639768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06ca57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89edb21740 1 -- 172.21.15.2:0/397639768 >> 172.21.15.2:0/397639768 conn(0x55cb06c99cf0 msgr2=0x55cb06c98e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.017+0000 7f89ccff9640 0 client.25619 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.018+0000 7f89edb21740 1 -- 172.21.15.2:0/397639768 shutdown_connections 2024-09-12T00:55:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.018+0000 7f89edb21740 1 -- 172.21.15.2:0/397639768 wait complete. 2024-09-12T00:55:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.018+0000 7f89edb21740 20 client.25619 trim_cache size 0 max 16384 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89edb21740 1 Processor -- start 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89edb21740 1 -- start start 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89edb21740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06ca01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89edb21740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9e080 0x55cb06cc0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89edb21740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cc0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89edb21740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41ae0c0 con 0x55cb06c9e080 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89edb21740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41ab990 con 0x55cb06ca8940 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89edb21740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41a9800 con 0x55cb06c9d760 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89e9ce5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06ca01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89e8ce3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9e080 0x55cb06cc0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89e9ce5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06ca01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:57438/0 (socket says 172.21.15.2:57438) 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89e9ce5640 1 -- 172.21.15.2:0/2564802171 learned_addr learned my addr 172.21.15.2:0/2564802171 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cc0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89e9ce5640 1 -- 172.21.15.2:0/2564802171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 msgr2=0x55cb06cc0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.036+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cc0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.037+0000 7f89e9ce5640 1 -- 172.21.15.2:0/2564802171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9e080 msgr2=0x55cb06cc0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.037+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9e080 0x55cb06cc0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.037+0000 7f89e9ce5640 1 -- 172.21.15.2:0/2564802171 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb06c9deb0 con 0x55cb06c9d760 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.037+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9e080 0x55cb06cc0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.037+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06ca01c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0047e0 tx=0x7f89dc003fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de08f272c2aa627c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.037+0000 7f89ceffd640 1 -- 172.21.15.2:0/2564802171 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc01e040 con 0x55cb06c9d760 2024-09-12T00:55:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.037+0000 7f89ceffd640 1 -- 172.21.15.2:0/2564802171 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89dc004da0 con 0x55cb06c9d760 2024-09-12T00:55:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.037+0000 7f89ceffd640 1 -- 172.21.15.2:0/2564802171 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc005720 con 0x55cb06c9d760 2024-09-12T00:55:38.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:37 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 -- 172.21.15.2:0/2564802171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 msgr2=0x55cb06ca01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06ca01c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0047e0 tx=0x7f89dc003fc0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 -- 172.21.15.2:0/2564802171 shutdown_connections 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cc0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9e080 0x55cb06cc0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 --2- 172.21.15.2:0/2564802171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9d760 0x55cb06ca01c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 -- 172.21.15.2:0/2564802171 >> 172.21.15.2:0/2564802171 conn(0x55cb06c99cf0 msgr2=0x55cb06ca7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 -- 172.21.15.2:0/2564802171 shutdown_connections 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 -- 172.21.15.2:0/2564802171 wait complete. 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 -- start start 2024-09-12T00:55:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.038+0000 7f89edb21740 1 Processor -- start 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89edb21740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06cb0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89edb21740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9e080 0x55cb06cb10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89edb21740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89edb21740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41a9e50 con 0x55cb06c9d760 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89edb21740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41ab2c0 con 0x55cb06ca8940 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89edb21740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41aa520 con 0x55cb06c9e080 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89edb21740 10 client.0 _ll_register_callbacks cb 0x7f89d4009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e9ce5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06cb0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e9ce5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06cb0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49210/0 (socket says 172.21.15.2:49210) 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e9ce5640 1 -- 172.21.15.2:0/2590941591 learned_addr learned my addr 172.21.15.2:0/2590941591 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9e080 0x55cb06cb10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e8ce3640 1 -- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 msgr2=0x55cb06cad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e8ce3640 1 -- 172.21.15.2:0/2590941591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 msgr2=0x55cb06cb0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:55:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06cb0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e8ce3640 1 -- 172.21.15.2:0/2590941591 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb06cae1a0 con 0x55cb06c9e080 2024-09-12T00:55:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.039+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:55:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89e8ce3640 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9e080 0x55cb06cb10d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f89d4020a90 tx=0x7f89d4005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=936367ecf8ecb43c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:55:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:55:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89ccff9640 1 -- 172.21.15.2:0/2590941591 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4016680 con 0x55cb06c9e080 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89ccff9640 1 -- 172.21.15.2:0/2590941591 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f89d4020420 con 0x55cb06c9e080 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89edb21740 1 -- 172.21.15.2:0/2590941591 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89dc004da0 con 0x55cb06c9e080 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89ccff9640 1 -- 172.21.15.2:0/2590941591 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f89d4020640 con 0x55cb06c9e080 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89edb21740 10 client.25540 fetch_fsmap learned FSMap version 27 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89edb21740 1 -- 172.21.15.2:0/2590941591 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cb06d241e0 con 0x55cb06c9e080 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89ccff9640 1 -- 172.21.15.2:0/2590941591 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89dc004da0 con 0x55cb06c9e080 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.040+0000 7f89ccff9640 1 -- 172.21.15.2:0/2590941591 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f89d40035f0 con 0x55cb06c9e080 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89edb21740 10 client.25540 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89edb21740 10 client.25540 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89edb21740 20 client.25540 populate_metadata read hostname 'smithi002' 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89edb21740 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cb06d249e0 0x55cb06d26e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89edb21740 4 client.25540 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}] 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89edb21740 1 -- 172.21.15.2:0/2590941591 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}) -- 0x55cb06c0ad20 con 0x55cb06d249e0 2024-09-12T00:55:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cb06d249e0 0x55cb06d26e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:55:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89ccff9640 10 client.25540 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:38.041+0000 7f89e9ce5640 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cb06d249e0 0x55cb06d26e00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e576b376148ea9 server_cookie=54269c141508b6b2 in_seq=0 out_seq=0 2024-09-12T00:55:38.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:37 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:55:38.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:38 smithi002 ceph-mon[31210]: pgmap v84: 97 pgs: 97 active+clean; 87 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.8 MiB/s wr, 598 op/s 2024-09-12T00:55:39.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:38 smithi167 ceph-mon[35234]: pgmap v84: 97 pgs: 97 active+clean; 87 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.8 MiB/s wr, 598 op/s 2024-09-12T00:55:39.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:38 smithi071 ceph-mon[35276]: pgmap v84: 97 pgs: 97 active+clean; 87 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.8 MiB/s wr, 598 op/s 2024-09-12T00:55:39.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89ccff9640 1 -- 172.21.15.2:0/2590941591 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55cb06c0ad20 con 0x55cb06d249e0 2024-09-12T00:55:39.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89ccff9640 10 client.25540 handle_command_reply: tid=0 2024-09-12T00:55:39.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 client.25540 shutdown 2024-09-12T00:55:39.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 -- 172.21.15.2:0/2590941591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9e080 msgr2=0x55cb06cb10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9e080 0x55cb06cb10d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f89d4020a90 tx=0x7f89d4005c50 comp rx=0 tx=0).stop 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 -- 172.21.15.2:0/2590941591 shutdown_connections 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cb06d249e0 0x55cb06d26e00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb06ca8940 0x55cb06cad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb06c9e080 0x55cb06cb10d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 --2- 172.21.15.2:0/2590941591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb06c9d760 0x55cb06cb0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89ccff9640 0 client.25540 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 -- 172.21.15.2:0/2590941591 >> 172.21.15.2:0/2590941591 conn(0x55cb06c99cf0 msgr2=0x55cb06c98650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 -- 172.21.15.2:0/2590941591 shutdown_connections 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 1 -- 172.21.15.2:0/2590941591 wait complete. 2024-09-12T00:55:39.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.943+0000 7f89edb21740 20 client.25540 trim_cache size 0 max 16384 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 27, 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 10, 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "fb5e7c9c": { 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 10, 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:55:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 144.7, 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:55:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:55:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 -- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f89d00a2cf0 msgr2=0x7f89d00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f89d00a2cf0 0x7f89d00a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f89e00b8230 tx=0x7f89e00f5550 comp rx=0 tx=0).stop 2024-09-12T00:55:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 -- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 msgr2=0x7f89e4198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:55:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 0x7f89e4198540 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006010 tx=0x7f89e0003c10 comp rx=0 tx=0).stop 2024-09-12T00:55:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 -- 172.21.15.2:0/1474043706 shutdown_connections 2024-09-12T00:55:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f89d00a2cf0 0x7f89d00a51b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89e4102ef0 0x7f89e419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:39.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102570 0x7f89e4198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:39.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 --2- 172.21.15.2:0/1474043706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4100e20 0x7f89e4198540 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:55:39.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 -- 172.21.15.2:0/1474043706 >> 172.21.15.2:0/1474043706 conn(0x7f89e40fc7d0 msgr2=0x7f89e406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:55:39.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 -- 172.21.15.2:0/1474043706 shutdown_connections 2024-09-12T00:55:39.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:55:39.944+0000 7f89eb748640 1 -- 172.21.15.2:0/1474043706 wait complete. 2024-09-12T00:55:40.694 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fb5e7c9c', quiesce took 5.3 seconds. Will release after: 19.4 2024-09-12T00:55:40.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:40 smithi002 ceph-mon[31210]: pgmap v85: 97 pgs: 97 active+clean; 87 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 591 op/s 2024-09-12T00:55:41.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:40 smithi167 ceph-mon[35234]: pgmap v85: 97 pgs: 97 active+clean; 87 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 591 op/s 2024-09-12T00:55:41.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:40 smithi071 ceph-mon[35276]: pgmap v85: 97 pgs: 97 active+clean; 87 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 591 op/s 2024-09-12T00:55:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:42 smithi002 ceph-mon[31210]: pgmap v86: 97 pgs: 97 active+clean; 94 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 761 op/s 2024-09-12T00:55:43.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:42 smithi167 ceph-mon[35234]: pgmap v86: 97 pgs: 97 active+clean; 94 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 761 op/s 2024-09-12T00:55:43.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:42 smithi071 ceph-mon[35276]: pgmap v86: 97 pgs: 97 active+clean; 94 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 761 op/s 2024-09-12T00:55:44.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:44 smithi002 ceph-mon[31210]: pgmap v87: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2024-09-12T00:55:45.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:44 smithi167 ceph-mon[35234]: pgmap v87: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2024-09-12T00:55:45.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:44 smithi071 ceph-mon[35276]: pgmap v87: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2024-09-12T00:55:46.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:46 smithi002 ceph-mon[31210]: pgmap v88: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2024-09-12T00:55:47.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:46 smithi167 ceph-mon[35234]: pgmap v88: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2024-09-12T00:55:47.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:46 smithi071 ceph-mon[35276]: pgmap v88: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2024-09-12T00:55:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:48 smithi002 ceph-mon[31210]: pgmap v89: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 516 op/s 2024-09-12T00:55:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:48 smithi167 ceph-mon[35234]: pgmap v89: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 516 op/s 2024-09-12T00:55:49.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:48 smithi071 ceph-mon[35276]: pgmap v89: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 516 op/s 2024-09-12T00:55:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:50 smithi002 ceph-mon[31210]: pgmap v90: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-09-12T00:55:51.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:50 smithi167 ceph-mon[35234]: pgmap v90: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-09-12T00:55:51.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:50 smithi071 ceph-mon[35276]: pgmap v90: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-09-12T00:55:52.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:52 smithi002 ceph-mon[31210]: pgmap v91: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-12T00:55:53.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:52 smithi167 ceph-mon[35234]: pgmap v91: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-12T00:55:53.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:52 smithi071 ceph-mon[35276]: pgmap v91: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-12T00:55:54.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:53 smithi167 ceph-mon[35234]: pgmap v92: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 73 KiB/s wr, 9 op/s 2024-09-12T00:55:54.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:53 smithi071 ceph-mon[35276]: pgmap v92: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 73 KiB/s wr, 9 op/s 2024-09-12T00:55:54.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:53 smithi002 ceph-mon[31210]: pgmap v92: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 73 KiB/s wr, 9 op/s 2024-09-12T00:55:56.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:55 smithi002 ceph-mon[31210]: pgmap v93: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-12T00:55:56.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:55 smithi167 ceph-mon[35234]: pgmap v93: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-12T00:55:56.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:55 smithi071 ceph-mon[35276]: pgmap v93: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-12T00:55:58.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:57 smithi002 ceph-mon[31210]: pgmap v94: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-12T00:55:58.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:57 smithi167 ceph-mon[35234]: pgmap v94: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-12T00:55:58.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:57 smithi071 ceph-mon[35276]: pgmap v94: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-12T00:56:00.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:56:00.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:55:59 smithi002 ceph-mon[31210]: pgmap v95: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-12T00:56:00.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:55:59 smithi167 ceph-mon[35234]: pgmap v95: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-12T00:56:00.382 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:00.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:55:59 smithi071 ceph-mon[35276]: pgmap v95: 97 pgs: 97 active+clean; 95 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-12T00:56:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 -- 172.21.15.2:0/49235214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c101420 msgr2=0x7f390c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 --2- 172.21.15.2:0/49235214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c101420 0x7f390c10d950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3904009cd0 tx=0x7f390402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 -- 172.21.15.2:0/49235214 shutdown_connections 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 --2- 172.21.15.2:0/49235214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c101420 0x7f390c10d950 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 --2- 172.21.15.2:0/49235214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c100a80 0x7f390c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 --2- 172.21.15.2:0/49235214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390c106a80 0x7f390c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 -- 172.21.15.2:0/49235214 >> 172.21.15.2:0/49235214 conn(0x7f390c0fc7a0 msgr2=0x7f390c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 -- 172.21.15.2:0/49235214 shutdown_connections 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.104+0000 7f39119c9640 1 -- 172.21.15.2:0/49235214 wait complete. 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f39119c9640 1 Processor -- start 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f39119c9640 1 -- start start 2024-09-12T00:56:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f39119c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c100a80 0x7f390c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f39119c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390c101420 0x7f390c199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f39119c9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c106a80 0x7f390c1a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f39119c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f390c110e80 con 0x7f390c100a80 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f39119c9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f390c110d00 con 0x7f390c106a80 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f39119c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f390c111000 con 0x7f390c101420 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.105+0000 7f390affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c100a80 0x7f390c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c100a80 0x7f390c199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40084/0 (socket says 172.21.15.2:40084) 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390affd640 1 -- 172.21.15.2:0/2489657037 learned_addr learned my addr 172.21.15.2:0/2489657037 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390a7fc640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390c101420 0x7f390c199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390b7fe640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c106a80 0x7f390c1a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390affd640 1 -- 172.21.15.2:0/2489657037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390c101420 msgr2=0x7f390c199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390affd640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390c101420 0x7f390c199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390affd640 1 -- 172.21.15.2:0/2489657037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c106a80 msgr2=0x7f390c1a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390affd640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c106a80 0x7f390c1a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390affd640 1 -- 172.21.15.2:0/2489657037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c1a4800 con 0x7f390c100a80 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390a7fc640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390c101420 0x7f390c199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390b7fe640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c106a80 0x7f390c1a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f390affd640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c100a80 0x7f390c199240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00d950 tx=0x7f38fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f39109c7640 1 -- 172.21.15.2:0/2489657037 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc017030 con 0x7f390c100a80 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f39109c7640 1 -- 172.21.15.2:0/2489657037 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38fc004020 con 0x7f390c100a80 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c1a49d0 con 0x7f390c100a80 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f39109c7640 1 -- 172.21.15.2:0/2489657037 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0047a0 con 0x7f390c100a80 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.106+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c1a4f10 con 0x7f390c100a80 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.107+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c100ee0 con 0x7f390c100a80 2024-09-12T00:56:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.108+0000 7f39109c7640 1 -- 172.21.15.2:0/2489657037 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f38fc0041d0 con 0x7f390c100a80 2024-09-12T00:56:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.109+0000 7f39109c7640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38f40a2cf0 0x7f38f40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.109+0000 7f390a7fc640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38f40a2cf0 0x7f38f40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.109+0000 7f39109c7640 1 -- 172.21.15.2:0/2489657037 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f38fc0cef20 con 0x7f390c100a80 2024-09-12T00:56:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.110+0000 7f390a7fc640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38f40a2cf0 0x7f38f40a51b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f390c06b320 tx=0x7f390000b5f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.113+0000 7f39109c7640 1 -- 172.21.15.2:0/2489657037 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38fc09baf0 con 0x7f390c100a80 2024-09-12T00:56:01.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.325+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f390c06adc0 con 0x7f390c100a80 2024-09-12T00:56:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.326+0000 7f39109c7640 1 -- 172.21.15.2:0/2489657037 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7f38fc09b3f0 con 0x7f390c100a80 2024-09-12T00:56:01.326 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:56:01.328 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:56:01.328 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38f40a2cf0 msgr2=0x7f38f40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38f40a2cf0 0x7f38f40a51b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f390c06b320 tx=0x7f390000b5f0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c100a80 msgr2=0x7f390c199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c100a80 0x7f390c199240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00d950 tx=0x7f38fc00de10 comp rx=0 tx=0).stop 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 shutdown_connections 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f38f40a2cf0 0x7f38f40a51b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c106a80 0x7f390c1a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390c101420 0x7f390c199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 --2- 172.21.15.2:0/2489657037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c100a80 0x7f390c199240 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.328+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 >> 172.21.15.2:0/2489657037 conn(0x7f390c0fc7a0 msgr2=0x7f390c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.329+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 shutdown_connections 2024-09-12T00:56:01.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:01.329+0000 7f39119c9640 1 -- 172.21.15.2:0/2489657037 wait complete. 2024-09-12T00:56:02.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:56:02.139 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --set-id fb5e7c9c --release --await' 2024-09-12T00:56:02.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --set-id fb5e7c9c --release --await 2024-09-12T00:56:02.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:01 smithi002 ceph-mon[31210]: pgmap v96: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 KiB/s wr, 25 op/s 2024-09-12T00:56:02.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:01 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2489657037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:02.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:01 smithi167 ceph-mon[35234]: pgmap v96: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 KiB/s wr, 25 op/s 2024-09-12T00:56:02.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:01 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2489657037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:02.336 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:02.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:01 smithi071 ceph-mon[35276]: pgmap v96: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 KiB/s wr, 25 op/s 2024-09-12T00:56:02.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:01 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2489657037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 -- 172.21.15.2:0/2835794916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88106a80 msgr2=0x7fba88106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/2835794916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88106a80 0x7fba88106e60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fba84009930 tx=0x7fba8402a420 comp rx=0 tx=0).stop 2024-09-12T00:56:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 -- 172.21.15.2:0/2835794916 shutdown_connections 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/2835794916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba88101420 0x7fba8810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/2835794916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba88100a80 0x7fba88100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/2835794916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88106a80 0x7fba88106e60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 -- 172.21.15.2:0/2835794916 >> 172.21.15.2:0/2835794916 conn(0x7fba880fc7a0 msgr2=0x7fba880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 -- 172.21.15.2:0/2835794916 shutdown_connections 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.803+0000 7fba8ee6c640 1 -- 172.21.15.2:0/2835794916 wait complete. 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 Processor -- start 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 -- start start 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba88100a80 0x7fba88198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88101420 0x7fba88198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba88106a80 0x7fba8819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba88110e80 con 0x7fba88101420 2024-09-12T00:56:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba88110d00 con 0x7fba88100a80 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba88111000 con 0x7fba88106a80 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88101420 0x7fba88198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88101420 0x7fba88198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40098/0 (socket says 172.21.15.2:40098) 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 -- 172.21.15.2:0/3970992239 learned_addr learned my addr 172.21.15.2:0/3970992239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8cc08640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba88100a80 0x7fba88198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8d409640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba88106a80 0x7fba8819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 -- 172.21.15.2:0/3970992239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba88106a80 msgr2=0x7fba8819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba88106a80 0x7fba8819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 -- 172.21.15.2:0/3970992239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba88100a80 msgr2=0x7fba88198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba88100a80 0x7fba88198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 -- 172.21.15.2:0/3970992239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8819d3c0 con 0x7fba88101420 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8cc08640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba88100a80 0x7fba88198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7ffff640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88101420 0x7fba88198950 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fba7800d950 tx=0x7fba7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7dffb640 1 -- 172.21.15.2:0/3970992239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78017070 con 0x7fba88101420 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7dffb640 1 -- 172.21.15.2:0/3970992239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba78009c30 con 0x7fba88101420 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 -- 172.21.15.2:0/3970992239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8819d6b0 con 0x7fba88101420 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba7dffb640 1 -- 172.21.15.2:0/3970992239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7800f6b0 con 0x7fba88101420 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.805+0000 7fba8ee6c640 1 -- 172.21.15.2:0/3970992239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba881a4f90 con 0x7fba88101420 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.807+0000 7fba7dffb640 1 -- 172.21.15.2:0/3970992239 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fba780109d0 con 0x7fba88101420 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba91245740 1 Processor -- start 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba91245740 1 -- start start 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba7dffb640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba700a2cf0 0x7fba700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba91245740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5d4a0 0x55dc74f5d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba91245740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f68140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba91245740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f6aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba91245740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dc74ec32e0 con 0x55dc74f5d4a0 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba91245740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dc74e6ace0 con 0x55dc74f5ddc0 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba91245740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dc74ebf2a0 con 0x55dc74f68680 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba8cc08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5d4a0 0x55dc74f5d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba8cc08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5d4a0 0x55dc74f5d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40112/0 (socket says 172.21.15.2:40112) 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba7dffb640 1 -- 172.21.15.2:0/3970992239 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba780cf140 con 0x7fba88101420 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba8cc08640 1 -- 172.21.15.2:0/211842458 learned_addr learned my addr 172.21.15.2:0/211842458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.808+0000 7fba8d409640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba700a2cf0 0x7fba700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba7ffff640 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f68140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8d409640 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f6aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8cc08640 1 -- 172.21.15.2:0/211842458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 msgr2=0x55dc74f6aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8cc08640 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f6aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8cc08640 1 -- 172.21.15.2:0/211842458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 msgr2=0x55dc74f68140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8cc08640 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f68140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8cc08640 1 -- 172.21.15.2:0/211842458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc74e4f440 con 0x55dc74f5d4a0 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8d409640 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f6aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba7ffff640 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f68140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8cc08640 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5d4a0 0x55dc74f5d880 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fba84009930 tx=0x7fba84032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdbd24bd22b7624 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba8d409640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba700a2cf0 0x7fba700a51b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55dc74f5adb0 tx=0x7fba8000a790 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba6effd640 1 -- 172.21.15.2:0/211842458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8403f070 con 0x55dc74f5d4a0 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba6effd640 1 -- 172.21.15.2:0/211842458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba840317b0 con 0x55dc74f5d4a0 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.809+0000 7fba6effd640 1 -- 172.21.15.2:0/211842458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84035070 con 0x55dc74f5d4a0 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 -- 172.21.15.2:0/211842458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5d4a0 msgr2=0x55dc74f5d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5d4a0 0x55dc74f5d880 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fba84009930 tx=0x7fba84032d60 comp rx=0 tx=0).stop 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 -- 172.21.15.2:0/211842458 shutdown_connections 2024-09-12T00:56:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f6aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f68140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 --2- 172.21.15.2:0/211842458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5d4a0 0x55dc74f5d880 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 -- 172.21.15.2:0/211842458 >> 172.21.15.2:0/211842458 conn(0x55dc74f59a30 msgr2=0x55dc74f59e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 -- 172.21.15.2:0/211842458 shutdown_connections 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 -- 172.21.15.2:0/211842458 wait complete. 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 -- start start 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.810+0000 7fba91245740 1 Processor -- start 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba91245740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba91245740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba91245740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f65710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba91245740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dc74f6b250 con 0x55dc74f68680 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba91245740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dc74e7e050 con 0x55dc74f5ddc0 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba91245740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dc74f6b3d0 con 0x55dc74f5d4a0 2024-09-12T00:56:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba91245740 10 client.0 _ll_register_callbacks cb 0x55dc74ebe160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f65710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f65710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40126/0 (socket says 172.21.15.2:40126) 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 -- 172.21.15.2:0/4147284625 learned_addr learned my addr 172.21.15.2:0/4147284625 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8cc08640 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba7ffff640 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 -- 172.21.15.2:0/4147284625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5d4a0 msgr2=0x55dc74f67f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 -- 172.21.15.2:0/4147284625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 msgr2=0x55dc74f651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 -- 172.21.15.2:0/4147284625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc74c343c0 con 0x55dc74f68680 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8cc08640 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba8d409640 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f65710 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fba80012e50 tx=0x7fba80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197c01b3d2b7f5d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba67fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.811+0000 7fba67fff640 1 -- 172.21.15.2:0/4147284625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80024020 con 0x55dc74f68680 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba67fff640 1 -- 172.21.15.2:0/4147284625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba80020440 con 0x55dc74f68680 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 1 -- 172.21.15.2:0/4147284625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba840317b0 con 0x55dc74f68680 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba67fff640 1 -- 172.21.15.2:0/4147284625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba8002f050 con 0x55dc74f68680 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 10 client.15978 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 1 -- 172.21.15.2:0/4147284625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dc74f7af50 con 0x55dc74f68680 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba67fff640 1 -- 172.21.15.2:0/4147284625 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba840317b0 con 0x55dc74f68680 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba67fff640 1 -- 172.21.15.2:0/4147284625 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba8001f660 con 0x55dc74f68680 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 10 client.15978 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 20 client.15978 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dc74f7c460 0x55dc74f7e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 4 client.15978 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba91245740 1 -- 172.21.15.2:0/4147284625 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc74ed0850 con 0x55dc74f7c460 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.812+0000 7fba8cc08640 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dc74f7c460 0x55dc74f7e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.813+0000 7fba8cc08640 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dc74f7c460 0x55dc74f7e900 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a02396fb808f08a7 server_cookie=98e8cc87d3f71fb4 in_seq=0 out_seq=0 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.813+0000 7fba67fff640 10 client.15978 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.813+0000 7fba67fff640 1 -- 172.21.15.2:0/4147284625 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc74ed0850 con 0x55dc74f7c460 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba67fff640 10 client.15978 handle_command_reply: tid=0 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 client.15978 shutdown 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 -- 172.21.15.2:0/4147284625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 msgr2=0x55dc74f65710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f65710 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fba80012e50 tx=0x7fba80004a40 comp rx=0 tx=0).stop 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 -- 172.21.15.2:0/4147284625 shutdown_connections 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dc74f7c460 0x55dc74f7e900 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f65710 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5ddc0 0x55dc74f651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba67fff640 0 client.15978 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 --2- 172.21.15.2:0/4147284625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 -- 172.21.15.2:0/4147284625 >> 172.21.15.2:0/4147284625 conn(0x55dc74f59a30 msgr2=0x55dc74f58b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 -- 172.21.15.2:0/4147284625 shutdown_connections 2024-09-12T00:56:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 1 -- 172.21.15.2:0/4147284625 wait complete. 2024-09-12T00:56:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.814+0000 7fba91245740 20 client.15978 trim_cache size 0 max 16384 2024-09-12T00:56:02.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba91245740 1 Processor -- start 2024-09-12T00:56:02.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba91245740 1 -- start start 2024-09-12T00:56:02.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba91245740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba91245740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5ddc0 0x55dc74f841d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba91245740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f84710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba91245740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba881ae000 con 0x55dc74f5ddc0 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba91245740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba881ab8d0 con 0x55dc74f5d4a0 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba91245740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba881a9720 con 0x55dc74f68680 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5ddc0 0x55dc74f841d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5ddc0 0x55dc74f841d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40132/0 (socket says 172.21.15.2:40132) 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba7ffff640 1 -- 172.21.15.2:0/2493392368 learned_addr learned my addr 172.21.15.2:0/2493392368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.832+0000 7fba8cc08640 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba8d409640 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f84710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba7ffff640 1 -- 172.21.15.2:0/2493392368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 msgr2=0x55dc74f84710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba7ffff640 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f84710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba7ffff640 1 -- 172.21.15.2:0/2493392368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 msgr2=0x55dc74f67140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba7ffff640 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba7ffff640 1 -- 172.21.15.2:0/2493392368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc74f65d10 con 0x55dc74f5ddc0 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba7ffff640 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5ddc0 0x55dc74f841d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba780058c0 tx=0x7fba78010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686692402a7eb9d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba6e7fc640 1 -- 172.21.15.2:0/2493392368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78020040 con 0x55dc74f5ddc0 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba6e7fc640 1 -- 172.21.15.2:0/2493392368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba7809fa60 con 0x55dc74f5ddc0 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.833+0000 7fba6e7fc640 1 -- 172.21.15.2:0/2493392368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78097d20 con 0x55dc74f5ddc0 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 -- 172.21.15.2:0/2493392368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5ddc0 msgr2=0x55dc74f841d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5ddc0 0x55dc74f841d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba780058c0 tx=0x7fba78010d70 comp rx=0 tx=0).stop 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 -- 172.21.15.2:0/2493392368 shutdown_connections 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f68680 0x55dc74f84710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f5ddc0 0x55dc74f841d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 --2- 172.21.15.2:0/2493392368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f67140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 -- 172.21.15.2:0/2493392368 >> 172.21.15.2:0/2493392368 conn(0x55dc74f59a30 msgr2=0x55dc74f66a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 -- 172.21.15.2:0/2493392368 shutdown_connections 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.834+0000 7fba91245740 1 -- 172.21.15.2:0/2493392368 wait complete. 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 1 -- start start 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 1 Processor -- start 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f74e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5ddc0 0x55dc74f75360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f72410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba881a9d90 con 0x55dc74f68680 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba881ab200 con 0x55dc74f5d4a0 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba881aa460 con 0x55dc74f5ddc0 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba91245740 10 client.0 _ll_register_callbacks cb 0x7fba8000a4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba8d409640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f72410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba8d409640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f72410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40136/0 (socket says 172.21.15.2:40136) 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba8d409640 1 -- 172.21.15.2:0/2774633921 learned_addr learned my addr 172.21.15.2:0/2774633921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba8cc08640 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f74e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.835+0000 7fba7ffff640 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5ddc0 0x55dc74f75360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba8cc08640 1 -- 172.21.15.2:0/2774633921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5ddc0 msgr2=0x55dc74f75360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba8cc08640 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5ddc0 0x55dc74f75360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba8cc08640 1 -- 172.21.15.2:0/2774633921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 msgr2=0x55dc74f72410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba8cc08640 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f72410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba8cc08640 1 -- 172.21.15.2:0/2774633921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc74f72c40 con 0x55dc74f5d4a0 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba8cc08640 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f74e20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba84006010 tx=0x7fba84031510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55a84085dba89732 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba67fff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba67fff640 1 -- 172.21.15.2:0/2774633921 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8403f040 con 0x55dc74f5d4a0 2024-09-12T00:56:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba67fff640 1 -- 172.21.15.2:0/2774633921 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fba84004040 con 0x55dc74f5d4a0 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.836+0000 7fba91245740 1 -- 172.21.15.2:0/2774633921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba7809fa60 con 0x55dc74f5d4a0 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba67fff640 1 -- 172.21.15.2:0/2774633921 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba8405b050 con 0x55dc74f5d4a0 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba91245740 10 client.25643 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba91245740 1 -- 172.21.15.2:0/2774633921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dc74fe6e00 con 0x55dc74f5d4a0 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba67fff640 1 -- 172.21.15.2:0/2774633921 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba7809fa60 con 0x55dc74f5d4a0 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba67fff640 1 -- 172.21.15.2:0/2774633921 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba8404c450 con 0x55dc74f5d4a0 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba91245740 10 client.25643 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba91245740 10 client.25643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba91245740 20 client.25643 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba91245740 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dc74fe7190 0x55dc74fe9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba91245740 4 client.25643 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba91245740 1 -- 172.21.15.2:0/2774633921 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc74ecad60 con 0x55dc74fe7190 2024-09-12T00:56:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.837+0000 7fba7ffff640 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dc74fe7190 0x55dc74fe9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba67fff640 10 client.25643 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba7ffff640 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dc74fe7190 0x55dc74fe9580 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e445ae612463c753 server_cookie=b0cd04018452af7a in_seq=0 out_seq=0 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba67fff640 1 -- 172.21.15.2:0/2774633921 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dc74ecad60 con 0x55dc74fe7190 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba67fff640 10 client.25643 handle_command_reply: tid=0 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 client.25643 shutdown 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 -- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 msgr2=0x55dc74f74e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f74e20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba84006010 tx=0x7fba84031510 comp rx=0 tx=0).stop 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 -- 172.21.15.2:0/2774633921 shutdown_connections 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dc74fe7190 0x55dc74fe9580 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc74f68680 0x55dc74f72410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba67fff640 0 client.25643 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc74f5ddc0 0x55dc74f75360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 --2- 172.21.15.2:0/2774633921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dc74f5d4a0 0x55dc74f74e20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.838+0000 7fba91245740 1 -- 172.21.15.2:0/2774633921 >> 172.21.15.2:0/2774633921 conn(0x55dc74f59a30 msgr2=0x55dc74f67250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.839+0000 7fba91245740 1 -- 172.21.15.2:0/2774633921 shutdown_connections 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.839+0000 7fba91245740 1 -- 172.21.15.2:0/2774633921 wait complete. 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.839+0000 7fba91245740 20 client.25643 trim_cache size 0 max 16384 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:56:02.849 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:56:02.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 -- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba700a2cf0 msgr2=0x7fba700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba700a2cf0 0x7fba700a51b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55dc74f5adb0 tx=0x7fba8000a790 comp rx=0 tx=0).stop 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 -- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88101420 msgr2=0x7fba88198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88101420 0x7fba88198950 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fba7800d950 tx=0x7fba7800de10 comp rx=0 tx=0).stop 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 -- 172.21.15.2:0/3970992239 shutdown_connections 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fba700a2cf0 0x7fba700a51b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba88106a80 0x7fba8819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba88101420 0x7fba88198950 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 --2- 172.21.15.2:0/3970992239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba88100a80 0x7fba88198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 -- 172.21.15.2:0/3970992239 >> 172.21.15.2:0/3970992239 conn(0x7fba880fc7a0 msgr2=0x7fba8806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 -- 172.21.15.2:0/3970992239 shutdown_connections 2024-09-12T00:56:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:02.840+0000 7fba8ee6c640 1 -- 172.21.15.2:0/3970992239 wait complete. 2024-09-12T00:56:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:03.604 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:56:03.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:56:04.135 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:03 smithi002 ceph-mon[31210]: pgmap v97: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:56:04.243 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:03 smithi071 ceph-mon[35276]: pgmap v97: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 -- 172.21.15.2:0/195964051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102790 msgr2=0x7fe3a81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 --2- 172.21.15.2:0/195964051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102790 0x7fe3a81067e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe398009900 tx=0x7fe39802a410 comp rx=0 tx=0).stop 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 -- 172.21.15.2:0/195964051 shutdown_connections 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 --2- 172.21.15.2:0/195964051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a8106f10 0x7fe3a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 --2- 172.21.15.2:0/195964051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102790 0x7fe3a81067e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 --2- 172.21.15.2:0/195964051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a8101de0 0x7fe3a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 -- 172.21.15.2:0/195964051 >> 172.21.15.2:0/195964051 conn(0x7fe3a80fd8c0 msgr2=0x7fe3a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 -- 172.21.15.2:0/195964051 shutdown_connections 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.226+0000 7fe3affd2640 1 -- 172.21.15.2:0/195964051 wait complete. 2024-09-12T00:56:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.227+0000 7fe3affd2640 1 Processor -- start 2024-09-12T00:56:04.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.227+0000 7fe3affd2640 1 -- start start 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.227+0000 7fe3affd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8101de0 0x7fe3a81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3affd2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a8102790 0x7fe3a8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3affd2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a8106f10 0x7fe3a819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3affd2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8111f70 con 0x7fe3a8101de0 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3affd2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8111df0 con 0x7fe3a8102790 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3affd2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81120f0 con 0x7fe3a8106f10 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8101de0 0x7fe3a81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8101de0 0x7fe3a81983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40148/0 (socket says 172.21.15.2:40148) 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 -- 172.21.15.2:0/823105313 learned_addr learned my addr 172.21.15.2:0/823105313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a8106f10 0x7fe3a819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 -- 172.21.15.2:0/823105313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a8106f10 msgr2=0x7fe3a819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a8106f10 0x7fe3a819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 -- 172.21.15.2:0/823105313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a8102790 msgr2=0x7fe3a8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a8102790 0x7fe3a8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 -- 172.21.15.2:0/823105313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a819d3a0 con 0x7fe3a8101de0 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a8106f10 0x7fe3a819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3add6e640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8101de0 0x7fe3a81983f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400d950 tx=0x7fe3a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe39effd640 1 -- 172.21.15.2:0/823105313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4017070 con 0x7fe3a8101de0 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe39effd640 1 -- 172.21.15.2:0/823105313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3a4009c30 con 0x7fe3a8101de0 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3affd2640 1 -- 172.21.15.2:0/823105313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a819d690 con 0x7fe3a8101de0 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe39effd640 1 -- 172.21.15.2:0/823105313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400f6b0 con 0x7fe3a8101de0 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.228+0000 7fe3affd2640 1 -- 172.21.15.2:0/823105313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a81a4f70 con 0x7fe3a8101de0 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.231+0000 7fe39effd640 1 -- 172.21.15.2:0/823105313 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe3a40109d0 con 0x7fe3a8101de0 2024-09-12T00:56:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.231+0000 7fe3b23ab740 1 Processor -- start 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.231+0000 7fe3b23ab740 1 -- start start 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 0x5615d6ad1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1980 0x5615d6adbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6ade630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5615d6a36620 con 0x5615d6ad1980 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5615d69dde50 con 0x5615d6adc240 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5615d6a325e0 con 0x5615d6ad1060 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe39effd640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3940a2cf0 0x7fe3940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1980 0x5615d6adbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1980 0x5615d6adbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40154/0 (socket says 172.21.15.2:40154) 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 -- 172.21.15.2:0/2955905200 learned_addr learned my addr 172.21.15.2:0/2955905200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3940a2cf0 0x7fe3940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6ade630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 0x5615d6ad1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe39effd640 1 -- 172.21.15.2:0/823105313 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe3a40cf140 con 0x7fe3a8101de0 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 -- 172.21.15.2:0/2955905200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 msgr2=0x5615d6ad1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 0x5615d6ad1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 -- 172.21.15.2:0/2955905200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 msgr2=0x5615d6ade630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6ade630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 -- 172.21.15.2:0/2955905200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615d69ced40 con 0x5615d6ad1980 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3add6e640 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1980 0x5615d6adbd00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4010fd0 tx=0x7fe3a400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f666325e0554780d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.232+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3940a2cf0 0x7fe3940a51b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0007fd0 tx=0x7fe3a0007d00 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe393fff640 1 -- 172.21.15.2:0/2955905200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4020070 con 0x5615d6ad1980 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe393fff640 1 -- 172.21.15.2:0/2955905200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3a4009de0 con 0x5615d6ad1980 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe393fff640 1 -- 172.21.15.2:0/2955905200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4097d20 con 0x5615d6ad1980 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2955905200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1980 msgr2=0x5615d6adbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1980 0x5615d6adbd00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4010fd0 tx=0x7fe3a400bf60 comp rx=0 tx=0).stop 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2955905200 shutdown_connections 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6ade630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1980 0x5615d6adbd00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2955905200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 0x5615d6ad1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.233+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2955905200 >> 172.21.15.2:0/2955905200 conn(0x5615d6acd5f0 msgr2=0x5615d6acd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.234+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2955905200 shutdown_connections 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.234+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2955905200 wait complete. 2024-09-12T00:56:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.234+0000 7fe3b23ab740 1 -- start start 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.234+0000 7fe3b23ab740 1 Processor -- start 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6ad9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6ad9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6ad9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5615d6adee10 con 0x5615d6ad1060 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5615d69bef10 con 0x5615d6adc240 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5615d6adef90 con 0x5615d6ad1980 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3b23ab740 10 client.0 _ll_register_callbacks cb 0x5615d69e2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6ad9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6ad9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40166/0 (socket says 172.21.15.2:40166) 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 -- 172.21.15.2:0/3773468433 learned_addr learned my addr 172.21.15.2:0/3773468433 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6ad9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6ad9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 -- 172.21.15.2:0/3773468433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 msgr2=0x5615d6ad9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6ad9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 -- 172.21.15.2:0/3773468433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 msgr2=0x5615d6ad9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6ad9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 -- 172.21.15.2:0/3773468433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615d6745580 con 0x5615d6ad1060 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3add6e640 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6ad9110 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40a3df0 tx=0x7fe3a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08a5b3314acdc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3917fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3917fa640 1 -- 172.21.15.2:0/3773468433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4020040 con 0x5615d6ad1060 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3917fa640 1 -- 172.21.15.2:0/3773468433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe3a40afbd0 con 0x5615d6ad1060 2024-09-12T00:56:04.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.235+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3773468433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3a4009de0 con 0x5615d6ad1060 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3917fa640 1 -- 172.21.15.2:0/3773468433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe3a409b6b0 con 0x5615d6ad1060 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3b23ab740 10 client.15996 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3773468433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5615d680f960 con 0x5615d6ad1060 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3917fa640 1 -- 172.21.15.2:0/3773468433 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3a4009de0 con 0x5615d6ad1060 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3917fa640 1 -- 172.21.15.2:0/3773468433 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe3a40bb030 con 0x5615d6ad1060 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3b23ab740 10 client.15996 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3b23ab740 10 client.15996 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3b23ab740 20 client.15996 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5615d6aebc20 0x5615d6aee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3b23ab740 4 client.15996 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3773468433 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615d6a43b90 con 0x5615d6aebc20 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.236+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5615d6aebc20 0x5615d6aee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.237+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5615d6aebc20 0x5615d6aee010 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca3f47c75809361d server_cookie=d2021182c39280c6 in_seq=0 out_seq=0 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.237+0000 7fe3917fa640 10 client.15996 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3917fa640 1 -- 172.21.15.2:0/3773468433 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615d6a43b90 con 0x5615d6aebc20 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3917fa640 10 client.15996 handle_command_reply: tid=0 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 client.15996 shutdown 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3773468433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 msgr2=0x5615d6ad9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6ad9110 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40a3df0 tx=0x7fe3a4000bc0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3773468433 shutdown_connections 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5615d6aebc20 0x5615d6aee010 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6ad9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6ad9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3917fa640 0 client.15996 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3773468433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6ad9110 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3773468433 >> 172.21.15.2:0/3773468433 conn(0x5615d6acd5f0 msgr2=0x5615d6ad32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3773468433 shutdown_connections 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3773468433 wait complete. 2024-09-12T00:56:04.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.238+0000 7fe3b23ab740 20 client.15996 trim_cache size 0 max 16384 2024-09-12T00:56:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3b23ab740 1 Processor -- start 2024-09-12T00:56:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3b23ab740 1 -- start start 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 0x5615d6adb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6ad1980 0x5615d6ad6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6adc240 0x5615d6ad68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81b03a0 con 0x5615d6adc240 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81adc70 con 0x5615d6ad1980 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81abac0 con 0x5615d6ad1060 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.256+0000 7fe3ae56f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6adc240 0x5615d6ad68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ae56f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6adc240 0x5615d6ad68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40176/0 (socket says 172.21.15.2:40176) 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ae56f640 1 -- 172.21.15.2:0/3861376634 learned_addr learned my addr 172.21.15.2:0/3861376634 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6ad1980 0x5615d6ad6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3add6e640 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 0x5615d6adb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ae56f640 1 -- 172.21.15.2:0/3861376634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 msgr2=0x5615d6adb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 0x5615d6adb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ae56f640 1 -- 172.21.15.2:0/3861376634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6ad1980 msgr2=0x5615d6ad6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6ad1980 0x5615d6ad6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ae56f640 1 -- 172.21.15.2:0/3861376634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615d6ad17b0 con 0x5615d6adc240 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6adc240 0x5615d6ad68b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0013700 tx=0x7fe3a0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6af317bd52ab69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3937fe640 1 -- 172.21.15.2:0/3861376634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00132b0 con 0x5615d6adc240 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3937fe640 1 -- 172.21.15.2:0/3861376634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3a0011940 con 0x5615d6adc240 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.257+0000 7fe3937fe640 1 -- 172.21.15.2:0/3861376634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0029a60 con 0x5615d6adc240 2024-09-12T00:56:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3861376634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6adc240 msgr2=0x5615d6ad68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6adc240 0x5615d6ad68b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0013700 tx=0x7fe3a0004ab0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3861376634 shutdown_connections 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6adc240 0x5615d6ad68b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6ad1980 0x5615d6ad6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/3861376634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1060 0x5615d6adb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3861376634 >> 172.21.15.2:0/3861376634 conn(0x5615d6acd5f0 msgr2=0x5615d6ada970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3861376634 shutdown_connections 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.258+0000 7fe3b23ab740 1 -- 172.21.15.2:0/3861376634 wait complete. 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 1 -- start start 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 1 Processor -- start 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6af1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6aefd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6af0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81ac130 con 0x5615d6ad1060 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81ad5a0 con 0x5615d6adc240 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81ac800 con 0x5615d6ad1980 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3b23ab740 10 client.0 _ll_register_callbacks cb 0x7fe3a409b530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3add6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6af1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3add6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6af1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40186/0 (socket says 172.21.15.2:40186) 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.259+0000 7fe3add6e640 1 -- 172.21.15.2:0/2825794417 learned_addr learned my addr 172.21.15.2:0/2825794417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6aefd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6af0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3add6e640 1 -- 172.21.15.2:0/2825794417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 msgr2=0x5615d6aefd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3add6e640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6aefd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3add6e640 1 -- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 msgr2=0x5615d6af0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3add6e640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6af0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3add6e640 1 -- 172.21.15.2:0/2825794417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615d6b56570 con 0x5615d6ad1060 2024-09-12T00:56:04.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6aefd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:04.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3ae56f640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6af0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:56:04.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3add6e640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6af1950 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4010fd0 tx=0x7fe3a4097290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6b60880972e17c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:04.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3917fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:04.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3917fa640 1 -- 172.21.15.2:0/2825794417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4020040 con 0x5615d6ad1060 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3917fa640 1 -- 172.21.15.2:0/2825794417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe3a4097610 con 0x5615d6ad1060 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2825794417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3a0011940 con 0x5615d6ad1060 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3917fa640 1 -- 172.21.15.2:0/2825794417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe3a409b010 con 0x5615d6ad1060 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3b23ab740 10 client.16002 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2825794417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5615d6b57790 con 0x5615d6ad1060 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.260+0000 7fe3917fa640 1 -- 172.21.15.2:0/2825794417 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3a0011940 con 0x5615d6ad1060 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3917fa640 1 -- 172.21.15.2:0/2825794417 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe3a40bb050 con 0x5615d6ad1060 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3b23ab740 10 client.16002 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3b23ab740 10 client.16002 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3b23ab740 20 client.16002 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5615d6b57dd0 0x5615d6b5a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3b23ab740 4 client.16002 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fb5e7c9c", "release": true, "await": true}] 2024-09-12T00:56:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2825794417 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fb5e7c9c", "release": true, "await": true}) -- 0x5615d6a3e0a0 con 0x5615d6b57dd0 2024-09-12T00:56:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5615d6b57dd0 0x5615d6b5a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3ad56d640 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5615d6b57dd0 0x5615d6b5a1f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dda7e9197ed4e1b9 server_cookie=ce6f23f48b89e66a in_seq=0 out_seq=0 2024-09-12T00:56:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.261+0000 7fe3917fa640 10 client.16002 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:04.286 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:04.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:03 smithi167 ceph-mon[35234]: pgmap v97: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:56:04.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3917fa640 1 -- 172.21.15.2:0/2825794417 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5615d6a3e0a0 con 0x5615d6b57dd0 2024-09-12T00:56:04.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3917fa640 10 client.16002 handle_command_reply: tid=0 2024-09-12T00:56:04.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 client.16002 shutdown 2024-09-12T00:56:04.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2825794417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 msgr2=0x5615d6af1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6af1950 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4010fd0 tx=0x7fe3a4097290 comp rx=0 tx=0).stop 2024-09-12T00:56:04.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2825794417 shutdown_connections 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5615d6b57dd0 0x5615d6b5a1f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615d6adc240 0x5615d6af0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5615d6ad1980 0x5615d6aefd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 --2- 172.21.15.2:0/2825794417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615d6ad1060 0x5615d6af1950 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3917fa640 0 client.16002 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2825794417 >> 172.21.15.2:0/2825794417 conn(0x5615d6acd5f0 msgr2=0x5615d6adb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2825794417 shutdown_connections 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 1 -- 172.21.15.2:0/2825794417 wait complete. 2024-09-12T00:56:04.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.450+0000 7fe3b23ab740 20 client.16002 trim_cache size 0 max 16384 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 27, 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 12, 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "fb5e7c9c": { 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 12, 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:56:04.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 144.7, 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:04.452 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:04.453 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:04.453 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:04.453 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:04.453 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:56:04.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 -- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3940a2cf0 msgr2=0x7fe3940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3940a2cf0 0x7fe3940a51b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0007fd0 tx=0x7fe3a0007d00 comp rx=0 tx=0).stop 2024-09-12T00:56:04.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 -- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8101de0 msgr2=0x7fe3a81983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:04.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8101de0 0x7fe3a81983f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400d950 tx=0x7fe3a400de10 comp rx=0 tx=0).stop 2024-09-12T00:56:04.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 -- 172.21.15.2:0/823105313 shutdown_connections 2024-09-12T00:56:04.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3940a2cf0 0x7fe3940a51b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a8106f10 0x7fe3a819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a8102790 0x7fe3a8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 --2- 172.21.15.2:0/823105313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8101de0 0x7fe3a81983f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:04.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 -- 172.21.15.2:0/823105313 >> 172.21.15.2:0/823105313 conn(0x7fe3a80fd8c0 msgr2=0x7fe3a80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:04.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 -- 172.21.15.2:0/823105313 shutdown_connections 2024-09-12T00:56:04.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:04.451+0000 7fe3affd2640 1 -- 172.21.15.2:0/823105313 wait complete. 2024-09-12T00:56:05.357 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fb5e7c9c', total seconds elapsed: 30.0 2024-09-12T00:56:05.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 -- 172.21.15.2:0/1551937846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 msgr2=0x7fe724103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:05.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 --2- 172.21.15.2:0/1551937846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 0x7fe724103110 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe714009930 tx=0x7fe71402a420 comp rx=0 tx=0).stop 2024-09-12T00:56:05.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 -- 172.21.15.2:0/1551937846 shutdown_connections 2024-09-12T00:56:05.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 --2- 172.21.15.2:0/1551937846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7241082a0 0x7fe72410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 --2- 172.21.15.2:0/1551937846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7241036e0 0x7fe724107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 --2- 172.21.15.2:0/1551937846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 0x7fe724103110 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 -- 172.21.15.2:0/1551937846 >> 172.21.15.2:0/1551937846 conn(0x7fe7240fc7d0 msgr2=0x7fe7240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:05.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 -- 172.21.15.2:0/1551937846 shutdown_connections 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.570+0000 7fe7289a4640 1 -- 172.21.15.2:0/1551937846 wait complete. 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe7289a4640 1 Processor -- start 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe7289a4640 1 -- start start 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe7289a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 0x7fe7241985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe7289a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7241036e0 0x7fe724198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe7289a4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7241082a0 0x7fe72419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe7289a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7241120a0 con 0x7fe724102d30 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe7289a4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe724111f20 con 0x7fe7241036e0 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe7289a4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe724112220 con 0x7fe7241082a0 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe72259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 0x7fe7241985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe72259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 0x7fe7241985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40206/0 (socket says 172.21.15.2:40206) 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe72259c640 1 -- 172.21.15.2:0/3955315529 learned_addr learned my addr 172.21.15.2:0/3955315529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe722d9d640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7241082a0 0x7fe72419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.571+0000 7fe721d9b640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7241036e0 0x7fe724198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe72259c640 1 -- 172.21.15.2:0/3955315529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7241082a0 msgr2=0x7fe72419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe72259c640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7241082a0 0x7fe72419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe72259c640 1 -- 172.21.15.2:0/3955315529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7241036e0 msgr2=0x7fe724198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe72259c640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7241036e0 0x7fe724198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe72259c640 1 -- 172.21.15.2:0/3955315529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72419d590 con 0x7fe724102d30 2024-09-12T00:56:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe722d9d640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7241082a0 0x7fe72419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe721d9b640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7241036e0 0x7fe724198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe72259c640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 0x7fe7241985e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe714009230 tx=0x7fe714004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe7137fe640 1 -- 172.21.15.2:0/3955315529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71403f030 con 0x7fe724102d30 2024-09-12T00:56:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72419d820 con 0x7fe724102d30 2024-09-12T00:56:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe7137fe640 1 -- 172.21.15.2:0/3955315529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe714004440 con 0x7fe724102d30 2024-09-12T00:56:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe7137fe640 1 -- 172.21.15.2:0/3955315529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714035070 con 0x7fe724102d30 2024-09-12T00:56:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.572+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7241a5160 con 0x7fe724102d30 2024-09-12T00:56:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.574+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe724103110 con 0x7fe724102d30 2024-09-12T00:56:05.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.575+0000 7fe7137fe640 1 -- 172.21.15.2:0/3955315529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe714042030 con 0x7fe724102d30 2024-09-12T00:56:05.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.575+0000 7fe7137fe640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe70c0a2cf0 0x7fe70c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:05.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.576+0000 7fe7137fe640 1 -- 172.21.15.2:0/3955315529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe7140ef800 con 0x7fe724102d30 2024-09-12T00:56:05.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.576+0000 7fe721d9b640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe70c0a2cf0 0x7fe70c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:05.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.576+0000 7fe721d9b640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe70c0a2cf0 0x7fe70c0a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe7240fee70 tx=0x7fe718005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:05.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.580+0000 7fe7137fe640 1 -- 172.21.15.2:0/3955315529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7140bbd20 con 0x7fe724102d30 2024-09-12T00:56:05.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.824+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe72410a2b0 con 0x7fe724102d30 2024-09-12T00:56:05.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.825+0000 7fe7137fe640 1 -- 172.21.15.2:0/3955315529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7fe7140c0020 con 0x7fe724102d30 2024-09-12T00:56:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:56:05.824 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:56:05.825 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:56:05.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe70c0a2cf0 msgr2=0x7fe70c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:05.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe70c0a2cf0 0x7fe70c0a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe7240fee70 tx=0x7fe718005f90 comp rx=0 tx=0).stop 2024-09-12T00:56:05.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 msgr2=0x7fe7241985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:05.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 0x7fe7241985e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe714009230 tx=0x7fe714004040 comp rx=0 tx=0).stop 2024-09-12T00:56:05.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 shutdown_connections 2024-09-12T00:56:05.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe70c0a2cf0 0x7fe70c0a51b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7241082a0 0x7fe72419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7241036e0 0x7fe724198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 --2- 172.21.15.2:0/3955315529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe724102d30 0x7fe7241985e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:05.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 >> 172.21.15.2:0/3955315529 conn(0x7fe7240fc7d0 msgr2=0x7fe724105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:05.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.827+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 shutdown_connections 2024-09-12T00:56:05.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:05.828+0000 7fe7289a4640 1 -- 172.21.15.2:0/3955315529 wait complete. 2024-09-12T00:56:06.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:05 smithi002 ceph-mon[31210]: pgmap v98: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:56:06.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:05 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3955315529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:05 smithi167 ceph-mon[35234]: pgmap v98: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:56:06.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:05 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3955315529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:06.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:05 smithi071 ceph-mon[35276]: pgmap v98: 97 pgs: 97 active+clean; 95 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:56:06.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:05 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3955315529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:06.541 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:56:06.821 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 -- 172.21.15.2:0/2699765356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904106a70 msgr2=0x7fb904106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 --2- 172.21.15.2:0/2699765356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904106a70 0x7fb904106e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009930 tx=0x7fb8f402a420 comp rx=0 tx=0).stop 2024-09-12T00:56:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 -- 172.21.15.2:0/2699765356 shutdown_connections 2024-09-12T00:56:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 --2- 172.21.15.2:0/2699765356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb904101410 0x7fb90410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 --2- 172.21.15.2:0/2699765356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb904100a70 0x7fb904100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 --2- 172.21.15.2:0/2699765356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904106a70 0x7fb904106e50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 -- 172.21.15.2:0/2699765356 >> 172.21.15.2:0/2699765356 conn(0x7fb9040fc790 msgr2=0x7fb9040febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 -- 172.21.15.2:0/2699765356 shutdown_connections 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.340+0000 7fb9097a1640 1 -- 172.21.15.2:0/2699765356 wait complete. 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.341+0000 7fb9097a1640 1 Processor -- start 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.341+0000 7fb9097a1640 1 -- start start 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.341+0000 7fb9097a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb904100a70 0x7fb9041a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.341+0000 7fb9097a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904101410 0x7fb9041a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.341+0000 7fb9097a1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb904106a70 0x7fb90419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.341+0000 7fb9097a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb90410fdb0 con 0x7fb904101410 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.341+0000 7fb9097a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb90410fc30 con 0x7fb904100a70 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.341+0000 7fb9097a1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb90410ff30 con 0x7fb904106a70 2024-09-12T00:56:07.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904101410 0x7fb9041a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904101410 0x7fb9041a0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36650/0 (socket says 172.21.15.2:36650) 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9037fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb904106a70 0x7fb90419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9027fc640 1 -- 172.21.15.2:0/1109737828 learned_addr learned my addr 172.21.15.2:0/1109737828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb902ffd640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb904100a70 0x7fb9041a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9037fe640 1 -- 172.21.15.2:0/1109737828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb904100a70 msgr2=0x7fb9041a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9037fe640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb904100a70 0x7fb9041a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9037fe640 1 -- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904101410 msgr2=0x7fb9041a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9037fe640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904101410 0x7fb9041a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9037fe640 1 -- 172.21.15.2:0/1109737828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90419add0 con 0x7fb904106a70 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9027fc640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904101410 0x7fb9041a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9037fe640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb904106a70 0x7fb90419a650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009fd0 tx=0x7fb8fc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb8fbfff640 1 -- 172.21.15.2:0/1109737828 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00ce20 con 0x7fb904106a70 2024-09-12T00:56:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9097a1640 1 -- 172.21.15.2:0/1109737828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90419b0c0 con 0x7fb904106a70 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb8fbfff640 1 -- 172.21.15.2:0/1109737828 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8fc005020 con 0x7fb904106a70 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb8fbfff640 1 -- 172.21.15.2:0/1109737828 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc010720 con 0x7fb904106a70 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.342+0000 7fb9097a1640 1 -- 172.21.15.2:0/1109737828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9041a7160 con 0x7fb904106a70 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.345+0000 7fb8fbfff640 1 -- 172.21.15.2:0/1109737828 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fb8fc005540 con 0x7fb904106a70 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.346+0000 7fb8fbfff640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb8f00a2cf0 0x7fb8f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.346+0000 7fb902ffd640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb8f00a2cf0 0x7fb8f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.346+0000 7fb8fbfff640 1 -- 172.21.15.2:0/1109737828 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb8fc0cfb20 con 0x7fb904106a70 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.346+0000 7fb90bb7a740 1 Processor -- start 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.346+0000 7fb902ffd640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb8f00a2cf0 0x7fb8f00a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4006010 tx=0x7fb8f4000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.346+0000 7fb90bb7a740 1 -- start start 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699ed370 0x55fc699ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fc699482f0 con 0x55fc699e3b40 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fc698efcf0 con 0x55fc699e25d0 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fc699442b0 con 0x55fc699ed370 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb902ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb9027fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb902ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36652/0 (socket says 172.21.15.2:36652) 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb902ffd640 1 -- 172.21.15.2:0/3075270480 learned_addr learned my addr 172.21.15.2:0/3075270480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.347+0000 7fb9037fe640 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699ed370 0x55fc699ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb9027fc640 1 -- 172.21.15.2:0/3075270480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699ed370 msgr2=0x55fc699ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb9027fc640 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699ed370 0x55fc699ef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb9027fc640 1 -- 172.21.15.2:0/3075270480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 msgr2=0x55fc699e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb9027fc640 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb9027fc640 1 -- 172.21.15.2:0/3075270480 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc698d43a0 con 0x55fc699e25d0 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb9037fe640 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699ed370 0x55fc699ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb902ffd640 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb9027fc640 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699e2a10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0114c0 tx=0x7fb8ec011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=354ed69340983b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb8f97fa640 1 -- 172.21.15.2:0/3075270480 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec004030 con 0x55fc699e25d0 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb8f97fa640 1 -- 172.21.15.2:0/3075270480 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8ec0041d0 con 0x55fc699e25d0 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.348+0000 7fb8f97fa640 1 -- 172.21.15.2:0/3075270480 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00f8f0 con 0x55fc699e25d0 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3075270480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 msgr2=0x55fc699e2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699e2a10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0114c0 tx=0x7fb8ec011980 comp rx=0 tx=0).stop 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3075270480 shutdown_connections 2024-09-12T00:56:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699ed370 0x55fc699ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699e2a10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/3075270480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3075270480 >> 172.21.15.2:0/3075270480 conn(0x55fc699ab310 msgr2=0x55fc699dec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3075270480 shutdown_connections 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3075270480 wait complete. 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.349+0000 7fb90bb7a740 1 -- start start 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb90bb7a740 1 Processor -- start 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e3b40 0x55fc699e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699ea520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fc699f0070 con 0x55fc699ed370 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fc69903060 con 0x55fc699e3b40 2024-09-12T00:56:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fc699f01f0 con 0x55fc699e25d0 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb90bb7a740 10 client.0 _ll_register_callbacks cb 0x55fc696568c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb902ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb9027fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e3b40 0x55fc699e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb902ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699eccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52026/0 (socket says 172.21.15.2:52026) 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb9037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb902ffd640 1 -- 172.21.15.2:0/4151702298 learned_addr learned my addr 172.21.15.2:0/4151702298 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb902ffd640 1 -- 172.21.15.2:0/4151702298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e3b40 msgr2=0x55fc699e9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb902ffd640 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e3b40 0x55fc699e9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb902ffd640 1 -- 172.21.15.2:0/4151702298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 msgr2=0x55fc699ea520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb902ffd640 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699ea520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb902ffd640 1 -- 172.21.15.2:0/4151702298 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc696b93c0 con 0x55fc699e25d0 2024-09-12T00:56:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb9037fe640 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.350+0000 7fb9027fc640 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e3b40 0x55fc699e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb902ffd640 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699eccf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4004330 tx=0x7fb8f4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc0a26320c9f89d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb8ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/4151702298 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4035040 con 0x55fc699e25d0 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/4151702298 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb8f40048c0 con 0x55fc699e25d0 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb90bb7a740 1 -- 172.21.15.2:0/4151702298 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8ec0041d0 con 0x55fc699e25d0 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/4151702298 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb8f4004ac0 con 0x55fc699e25d0 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb90bb7a740 10 client.25594 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb90bb7a740 1 -- 172.21.15.2:0/4151702298 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fc699fbaf0 con 0x55fc699e25d0 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.351+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/4151702298 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8ec0041d0 con 0x55fc699e25d0 2024-09-12T00:56:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/4151702298 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb8f4003660 con 0x55fc699e25d0 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb90bb7a740 10 client.25594 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb90bb7a740 10 client.25594 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb90bb7a740 20 client.25594 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55fc699fcfb0 0x55fc699ff3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb90bb7a740 4 client.25594 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb90bb7a740 1 -- 172.21.15.2:0/4151702298 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc69955860 con 0x55fc699fcfb0 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb9027fc640 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55fc699fcfb0 0x55fc699ff3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb9027fc640 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55fc699fcfb0 0x55fc699ff3c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3cafb33373a6af1 server_cookie=682716a31be3a732 in_seq=0 out_seq=0 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.352+0000 7fb8ea7fc640 10 client.25594 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.353+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/4151702298 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc69955860 con 0x55fc699fcfb0 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.353+0000 7fb8ea7fc640 10 client.25594 handle_command_reply: tid=0 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.353+0000 7fb90bb7a740 1 client.25594 shutdown 2024-09-12T00:56:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.353+0000 7fb90bb7a740 1 -- 172.21.15.2:0/4151702298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 msgr2=0x55fc699eccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.353+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699eccf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4004330 tx=0x7fb8f4009260 comp rx=0 tx=0).stop 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 1 -- 172.21.15.2:0/4151702298 shutdown_connections 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55fc699fcfb0 0x55fc699ff3c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e3b40 0x55fc699e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/4151702298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699eccf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb8ea7fc640 0 client.25594 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 1 -- 172.21.15.2:0/4151702298 >> 172.21.15.2:0/4151702298 conn(0x55fc699ab310 msgr2=0x55fc699e4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 1 -- 172.21.15.2:0/4151702298 shutdown_connections 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 1 -- 172.21.15.2:0/4151702298 wait complete. 2024-09-12T00:56:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.354+0000 7fb90bb7a740 20 client.25594 trim_cache size 0 max 16384 2024-09-12T00:56:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb90bb7a740 1 Processor -- start 2024-09-12T00:56:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb90bb7a740 1 -- start start 2024-09-12T00:56:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699f9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699ed370 0x55fc699ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb9041ae010 con 0x55fc699e3b40 2024-09-12T00:56:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb9041ab8e0 con 0x55fc699ed370 2024-09-12T00:56:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb90bb7a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9041a9790 con 0x55fc699e25d0 2024-09-12T00:56:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb9027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb9027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36658/0 (socket says 172.21.15.2:36658) 2024-09-12T00:56:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb9027fc640 1 -- 172.21.15.2:0/3255002317 learned_addr learned my addr 172.21.15.2:0/3255002317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.369+0000 7fb902ffd640 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb9037fe640 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699ed370 0x55fc699ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb9027fc640 1 -- 172.21.15.2:0/3255002317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 msgr2=0x55fc699f9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb9027fc640 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699f9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb9027fc640 1 -- 172.21.15.2:0/3255002317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699ed370 msgr2=0x55fc699ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb9027fc640 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699ed370 0x55fc699ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb9027fc640 1 -- 172.21.15.2:0/3255002317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc699dfdd0 con 0x55fc699e3b40 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb902ffd640 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb9027fc640 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e9860 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec011e80 tx=0x7fb8ec005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ea649e2f438dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb8f8ff9640 1 -- 172.21.15.2:0/3255002317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec030070 con 0x55fc699e3b40 2024-09-12T00:56:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb8f8ff9640 1 -- 172.21.15.2:0/3255002317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8ec0042f0 con 0x55fc699e3b40 2024-09-12T00:56:07.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.370+0000 7fb8f8ff9640 1 -- 172.21.15.2:0/3255002317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec004b40 con 0x55fc699e3b40 2024-09-12T00:56:07.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3255002317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 msgr2=0x55fc699e9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e9860 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec011e80 tx=0x7fb8ec005d30 comp rx=0 tx=0).stop 2024-09-12T00:56:07.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3255002317 shutdown_connections 2024-09-12T00:56:07.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699ed370 0x55fc699ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699e3b40 0x55fc699e9860 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/3255002317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e25d0 0x55fc699f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3255002317 >> 172.21.15.2:0/3255002317 conn(0x55fc699ab310 msgr2=0x55fc699e8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3255002317 shutdown_connections 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.371+0000 7fb90bb7a740 1 -- 172.21.15.2:0/3255002317 wait complete. 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb90bb7a740 1 -- start start 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb90bb7a740 1 Processor -- start 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e3b40 0x55fc699e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb90bb7a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb902ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb9027fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e3b40 0x55fc699e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb9027fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e3b40 0x55fc699e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52054/0 (socket says 172.21.15.2:52054) 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb902ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:53648/0 (socket says 172.21.15.2:53648) 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.372+0000 7fb9037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb9037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36672/0 (socket says 172.21.15.2:36672) 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb9027fc640 1 -- 172.21.15.2:0/366588649 learned_addr learned my addr 172.21.15.2:0/366588649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb9041a9de0 con 0x55fc699ed370 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb9041ab210 con 0x55fc699e25d0 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9041aa470 con 0x55fc699e3b40 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb90bb7a740 10 client.0 _ll_register_callbacks cb 0x7fb8fc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb902ffd640 1 -- 172.21.15.2:0/366588649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e3b40 msgr2=0x55fc699e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb902ffd640 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e3b40 0x55fc699e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb902ffd640 1 -- 172.21.15.2:0/366588649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 msgr2=0x55fc699e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb902ffd640 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb902ffd640 1 -- 172.21.15.2:0/366588649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc699e7cf0 con 0x55fc699e25d0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb9027fc640 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e3b40 0x55fc699e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb9037fe640 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb902ffd640 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699f58e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4004650 tx=0x7fb8f4004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf35bb666484c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.373+0000 7fb8ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/366588649 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4067060 con 0x55fc699e25d0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8ec0042f0 con 0x55fc699e25d0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/366588649 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb8f40037f0 con 0x55fc699e25d0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/366588649 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb8f405e040 con 0x55fc699e25d0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb90bb7a740 10 client.25676 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fc69a05030 con 0x55fc699e25d0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/366588649 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8ec0042f0 con 0x55fc699e25d0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/366588649 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb8f4061070 con 0x55fc699e25d0 2024-09-12T00:56:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb90bb7a740 10 client.25676 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb90bb7a740 10 client.25676 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.374+0000 7fb90bb7a740 20 client.25676 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55fc69a68040 0x55fc69a6a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb90bb7a740 4 client.25676 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc6994fd70 con 0x55fc69a68040 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb9027fc640 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55fc69a68040 0x55fc69a6a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb9027fc640 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55fc69a68040 0x55fc69a6a460 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=daf778036df5ec9b server_cookie=983486d6e03166d1 in_seq=0 out_seq=0 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb8ea7fc640 10 client.25676 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb8ea7fc640 1 -- 172.21.15.2:0/366588649 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc6994fd70 con 0x55fc69a68040 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb8ea7fc640 10 client.25676 handle_command_reply: tid=0 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.375+0000 7fb90bb7a740 1 client.25676 shutdown 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 msgr2=0x55fc699f58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699f58e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4004650 tx=0x7fb8f4004970 comp rx=0 tx=0).stop 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 shutdown_connections 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55fc69a68040 0x55fc69a6a460 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc699ed370 0x55fc699e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc699e3b40 0x55fc699e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 --2- 172.21.15.2:0/366588649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc699e25d0 0x55fc699f58e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 >> 172.21.15.2:0/366588649 conn(0x55fc699ab310 msgr2=0x55fc699ddd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb8ea7fc640 0 client.25676 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 shutdown_connections 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 1 -- 172.21.15.2:0/366588649 wait complete. 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.376+0000 7fb90bb7a740 20 client.25676 trim_cache size 0 max 16384 2024-09-12T00:56:07.381 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 -- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb8f00a2cf0 msgr2=0x7fb8f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb8f00a2cf0 0x7fb8f00a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4006010 tx=0x7fb8f4000bc0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 -- 172.21.15.2:0/1109737828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb904106a70 msgr2=0x7fb90419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb904106a70 0x7fb90419a650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009fd0 tx=0x7fb8fc00ef10 comp rx=0 tx=0).stop 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 -- 172.21.15.2:0/1109737828 shutdown_connections 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb8f00a2cf0 0x7fb8f00a51b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb904106a70 0x7fb90419a650 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb904101410 0x7fb9041a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 --2- 172.21.15.2:0/1109737828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb904100a70 0x7fb9041a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 -- 172.21.15.2:0/1109737828 >> 172.21.15.2:0/1109737828 conn(0x7fb9040fc790 msgr2=0x7fb9040fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:07.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 -- 172.21.15.2:0/1109737828 shutdown_connections 2024-09-12T00:56:07.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:07.377+0000 7fb9097a1640 1 -- 172.21.15.2:0/1109737828 wait complete. 2024-09-12T00:56:08.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:56:08.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:07 smithi002 ceph-mon[31210]: pgmap v99: 97 pgs: 97 active+clean; 97 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 592 KiB/s wr, 109 op/s 2024-09-12T00:56:08.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:56:08.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:56:08.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:56:08.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:07 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:56:08.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:07 smithi167 ceph-mon[35234]: pgmap v99: 97 pgs: 97 active+clean; 97 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 592 KiB/s wr, 109 op/s 2024-09-12T00:56:08.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:56:08.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:56:08.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:56:08.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:07 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:56:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:08.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:07 smithi071 ceph-mon[35276]: pgmap v99: 97 pgs: 97 active+clean; 97 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 592 KiB/s wr, 109 op/s 2024-09-12T00:56:08.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:56:08.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:56:08.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:56:08.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:07 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:56:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 -- 172.21.15.2:0/3567736043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101e20 msgr2=0x7f853c1056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 --2- 172.21.15.2:0/3567736043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101e20 0x7f853c1056b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f852c009900 tx=0x7f852c02a410 comp rx=0 tx=0).stop 2024-09-12T00:56:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 -- 172.21.15.2:0/3567736043 shutdown_connections 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 --2- 172.21.15.2:0/3567736043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f853c105de0 0x7f853c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 --2- 172.21.15.2:0/3567736043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101e20 0x7f853c1056b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 --2- 172.21.15.2:0/3567736043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c101470 0x7f853c101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 -- 172.21.15.2:0/3567736043 >> 172.21.15.2:0/3567736043 conn(0x7f853c077230 msgr2=0x7f853c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 -- 172.21.15.2:0/3567736043 shutdown_connections 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.900+0000 7f85435ca640 1 -- 172.21.15.2:0/3567736043 wait complete. 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f85435ca640 1 Processor -- start 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f85435ca640 1 -- start start 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f85435ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101470 0x7f853c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f85435ca640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f853c101e20 0x7f853c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f85435ca640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c105de0 0x7f853c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f85435ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f853c110e40 con 0x7f853c101470 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f85435ca640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f853c110cc0 con 0x7f853c101e20 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f85435ca640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f853c110fc0 con 0x7f853c105de0 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f8541366640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101470 0x7f853c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f8541366640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101470 0x7f853c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36694/0 (socket says 172.21.15.2:36694) 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f8541366640 1 -- 172.21.15.2:0/4222359543 learned_addr learned my addr 172.21.15.2:0/4222359543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f8540b65640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f853c101e20 0x7f853c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.901+0000 7f8541b67640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c105de0 0x7f853c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f8540b65640 1 -- 172.21.15.2:0/4222359543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c105de0 msgr2=0x7f853c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f8540b65640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c105de0 0x7f853c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f8540b65640 1 -- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101470 msgr2=0x7f853c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f8540b65640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101470 0x7f853c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f8540b65640 1 -- 172.21.15.2:0/4222359543 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c19d3a0 con 0x7f853c101e20 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f8541b67640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c105de0 0x7f853c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f8540b65640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f853c101e20 0x7f853c198930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f852c005940 tx=0x7f852c0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f85327fc640 1 -- 172.21.15.2:0/4222359543 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c03f030 con 0x7f853c101e20 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f85435ca640 1 -- 172.21.15.2:0/4222359543 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853c19d630 con 0x7f853c101e20 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f85327fc640 1 -- 172.21.15.2:0/4222359543 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f852c0044c0 con 0x7f853c101e20 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f85327fc640 1 -- 172.21.15.2:0/4222359543 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c035070 con 0x7f853c101e20 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.902+0000 7f85435ca640 1 -- 172.21.15.2:0/4222359543 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f853c1a4f70 con 0x7f853c101e20 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.905+0000 7f85327fc640 1 -- 172.21.15.2:0/4222359543 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f852c042030 con 0x7f853c101e20 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.905+0000 7f85459a3740 1 Processor -- start 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.905+0000 7f85459a3740 1 -- start start 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f85459a3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 0x55aa28702090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f85459a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa287025d0 0x55aa28702a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f85459a3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa2870d370 0x55aa2870f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f85327fc640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85280a2cf0 0x7f85280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541366640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa287025d0 0x55aa28702a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8540b65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa2870d370 0x55aa2870f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541366640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa287025d0 0x55aa28702a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:53686/0 (socket says 172.21.15.2:53686) 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541366640 1 -- 172.21.15.2:0/2826837421 learned_addr learned my addr 172.21.15.2:0/2826837421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f85459a3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55aa286682f0 con 0x55aa2870d370 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f85459a3740 1 -- 172.21.15.2:0/2826837421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55aa2860fcf0 con 0x55aa287025d0 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f85459a3740 1 -- 172.21.15.2:0/2826837421 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aa286642b0 con 0x55aa28703b40 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541b67640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85280a2cf0 0x7f85280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541b67640 1 --2- 172.21.15.2:0/2826837421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 0x55aa28702090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f85327fc640 1 -- 172.21.15.2:0/4222359543 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f852c0ef7a0 con 0x7f853c101e20 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541366640 1 -- 172.21.15.2:0/2826837421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 msgr2=0x55aa28702090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541366640 1 --2- 172.21.15.2:0/2826837421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 0x55aa28702090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541366640 1 -- 172.21.15.2:0/2826837421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa2870d370 msgr2=0x55aa2870f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541366640 1 --2- 172.21.15.2:0/2826837421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa2870d370 0x55aa2870f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.906+0000 7f8541366640 1 -- 172.21.15.2:0/2826837421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa285f43a0 con 0x55aa287025d0 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.907+0000 7f8541366640 1 --2- 172.21.15.2:0/2826837421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa287025d0 0x55aa28702a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8538009e10 tx=0x7f8538011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce03a8866c4eee30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.907+0000 7f8541b67640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85280a2cf0 0x7f85280a51b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8534009fd0 tx=0x7f8534004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.907+0000 7f85277fe640 1 -- 172.21.15.2:0/2826837421 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853801e070 con 0x55aa287025d0 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.907+0000 7f85277fe640 1 -- 172.21.15.2:0/2826837421 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8538019b10 con 0x55aa287025d0 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.907+0000 7f85277fe640 1 -- 172.21.15.2:0/2826837421 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853800fbb0 con 0x55aa287025d0 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 -- 172.21.15.2:0/2826837421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa287025d0 msgr2=0x55aa28702a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 --2- 172.21.15.2:0/2826837421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa287025d0 0x55aa28702a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8538009e10 tx=0x7f8538011810 comp rx=0 tx=0).stop 2024-09-12T00:56:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 -- 172.21.15.2:0/2826837421 shutdown_connections 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 --2- 172.21.15.2:0/2826837421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa2870d370 0x55aa2870f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 --2- 172.21.15.2:0/2826837421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa287025d0 0x55aa28702a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 --2- 172.21.15.2:0/2826837421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 0x55aa28702090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 -- 172.21.15.2:0/2826837421 >> 172.21.15.2:0/2826837421 conn(0x55aa286cb310 msgr2=0x55aa286fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 -- 172.21.15.2:0/2826837421 shutdown_connections 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 -- 172.21.15.2:0/2826837421 wait complete. 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 -- start start 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.908+0000 7f85459a3740 1 Processor -- start 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f85459a3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa2870cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f85459a3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa2870a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f85459a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa2870a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f85459a3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55aa28710070 con 0x55aa28703b40 2024-09-12T00:56:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f85459a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55aa28623060 con 0x55aa2870d370 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f85459a3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aa287101f0 con 0x55aa287025d0 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f85459a3740 10 client.0 _ll_register_callbacks cb 0x55aa283768c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa2870a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8541366640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa2870cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8541b67640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa2870a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa2870a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36710/0 (socket says 172.21.15.2:36710) 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 -- 172.21.15.2:0/3766793392 learned_addr learned my addr 172.21.15.2:0/3766793392 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8541366640 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa2870cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52094/0 (socket says 172.21.15.2:52094) 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 -- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 msgr2=0x55aa2870cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa2870cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 -- 172.21.15.2:0/3766793392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 msgr2=0x55aa2870a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:08.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa2870a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 -- 172.21.15.2:0/3766793392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa283d93c0 con 0x55aa28703b40 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8541b67640 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa2870a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8541366640 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa2870cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8540b65640 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa2870a040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f852c0ecea0 tx=0x7f852c0bb8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d752ed34ad5e1dae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.909+0000 7f8524ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f8524ff9640 1 -- 172.21.15.2:0/3766793392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c049040 con 0x55aa28703b40 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f8524ff9640 1 -- 172.21.15.2:0/3766793392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f852c0ed0c0 con 0x55aa28703b40 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 1 -- 172.21.15.2:0/3766793392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8538019b10 con 0x55aa28703b40 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f8524ff9640 1 -- 172.21.15.2:0/3766793392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f852c0bffc0 con 0x55aa28703b40 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 10 client.16038 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 1 -- 172.21.15.2:0/3766793392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aa2871bb40 con 0x55aa28703b40 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f8524ff9640 1 -- 172.21.15.2:0/3766793392 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8538019b10 con 0x55aa28703b40 2024-09-12T00:56:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f8524ff9640 1 -- 172.21.15.2:0/3766793392 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f852c031bd0 con 0x55aa28703b40 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 10 client.16038 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 10 client.16038 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 20 client.16038 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55aa2871cf30 0x55aa2871f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 4 client.16038 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f85459a3740 1 -- 172.21.15.2:0/3766793392 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa28675860 con 0x55aa2871cf30 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.910+0000 7f8541366640 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55aa2871cf30 0x55aa2871f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.911+0000 7f8541366640 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55aa2871cf30 0x55aa2871f360 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=506373e5210f0840 server_cookie=a9cc22e80ae18a6c in_seq=0 out_seq=0 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.911+0000 7f8524ff9640 10 client.16038 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f8524ff9640 1 -- 172.21.15.2:0/3766793392 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa28675860 con 0x55aa2871cf30 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f8524ff9640 10 client.16038 handle_command_reply: tid=0 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 client.16038 shutdown 2024-09-12T00:56:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 -- 172.21.15.2:0/3766793392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 msgr2=0x55aa2870a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa2870a040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f852c0ecea0 tx=0x7f852c0bb8d0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 -- 172.21.15.2:0/3766793392 shutdown_connections 2024-09-12T00:56:08.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55aa2871cf30 0x55aa2871f360 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa2870a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa2870a040 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f8524ff9640 0 client.16038 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:56:08.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 --2- 172.21.15.2:0/3766793392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa2870cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 -- 172.21.15.2:0/3766793392 >> 172.21.15.2:0/3766793392 conn(0x55aa286cb310 msgr2=0x55aa28704960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 -- 172.21.15.2:0/3766793392 shutdown_connections 2024-09-12T00:56:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 1 -- 172.21.15.2:0/3766793392 wait complete. 2024-09-12T00:56:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.912+0000 7f85459a3740 20 client.16038 trim_cache size 0 max 16384 2024-09-12T00:56:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f85459a3740 1 Processor -- start 2024-09-12T00:56:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f85459a3740 1 -- start start 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f85459a3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa28703300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f85459a3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa28719310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f85459a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa286fe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f85459a3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1b0200 con 0x55aa28703b40 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f85459a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1adad0 con 0x55aa2870d370 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f85459a3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1ab920 con 0x55aa287025d0 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f8540b65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa28719310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f8540b65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa28719310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36724/0 (socket says 172.21.15.2:36724) 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f8540b65640 1 -- 172.21.15.2:0/2727738602 learned_addr learned my addr 172.21.15.2:0/2727738602 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.927+0000 7f8541366640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa28703300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8541366640 1 -- 172.21.15.2:0/2727738602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 msgr2=0x55aa286fe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8541366640 1 --2- 172.21.15.2:0/2727738602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa286fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8541366640 1 -- 172.21.15.2:0/2727738602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 msgr2=0x55aa28719310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8541366640 1 --2- 172.21.15.2:0/2727738602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa28719310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8541366640 1 -- 172.21.15.2:0/2727738602 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2870a9c0 con 0x55aa287025d0 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8541366640 1 --2- 172.21.15.2:0/2727738602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa28703300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f853801c040 tx=0x7f8538011e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b6951deb158e05c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8526ffd640 1 -- 172.21.15.2:0/2727738602 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538035070 con 0x55aa287025d0 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8526ffd640 1 -- 172.21.15.2:0/2727738602 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853801f040 con 0x55aa287025d0 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.928+0000 7f8526ffd640 1 -- 172.21.15.2:0/2727738602 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853801e040 con 0x55aa287025d0 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 -- 172.21.15.2:0/2727738602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 msgr2=0x55aa28703300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 --2- 172.21.15.2:0/2727738602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa28703300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f853801c040 tx=0x7f8538011e40 comp rx=0 tx=0).stop 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 -- 172.21.15.2:0/2727738602 shutdown_connections 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 --2- 172.21.15.2:0/2727738602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa286fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 --2- 172.21.15.2:0/2727738602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa28703b40 0x55aa28719310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 --2- 172.21.15.2:0/2727738602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa287025d0 0x55aa28703300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 -- 172.21.15.2:0/2727738602 >> 172.21.15.2:0/2727738602 conn(0x55aa286cb310 msgr2=0x55aa286f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 -- 172.21.15.2:0/2727738602 shutdown_connections 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 -- 172.21.15.2:0/2727738602 wait complete. 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 -- start start 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.929+0000 7f85459a3740 1 Processor -- start 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f85459a3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa287025d0 0x55aa28715710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f85459a3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 0x55aa28715c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f85459a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa28706950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f85459a3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1abf90 con 0x55aa287025d0 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f85459a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1ad400 con 0x55aa2870d370 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f85459a3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1ac660 con 0x55aa28703b40 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f85459a3740 10 client.0 _ll_register_callbacks cb 0x7f852c009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541366640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa287025d0 0x55aa28715710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541366640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa287025d0 0x55aa28715710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36738/0 (socket says 172.21.15.2:36738) 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541366640 1 -- 172.21.15.2:0/4067247443 learned_addr learned my addr 172.21.15.2:0/4067247443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541b67640 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa28706950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8540b65640 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 0x55aa28715c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541366640 1 -- 172.21.15.2:0/4067247443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 msgr2=0x55aa28715c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541366640 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 0x55aa28715c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541366640 1 -- 172.21.15.2:0/4067247443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 msgr2=0x55aa28706950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541366640 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa28706950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.930+0000 7f8541366640 1 -- 172.21.15.2:0/4067247443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa28707180 con 0x55aa287025d0 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f8541366640 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa287025d0 0x55aa28715710 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8538033040 tx=0x7f8538005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590bb6b83be49cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f8524ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f8524ff9640 1 -- 172.21.15.2:0/4067247443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853803e060 con 0x55aa287025d0 2024-09-12T00:56:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f8524ff9640 1 -- 172.21.15.2:0/4067247443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f853800f8f0 con 0x55aa287025d0 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f85459a3740 1 -- 172.21.15.2:0/4067247443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f853801f040 con 0x55aa287025d0 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f8524ff9640 1 -- 172.21.15.2:0/4067247443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8538035050 con 0x55aa287025d0 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f85459a3740 10 client.16044 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f85459a3740 1 -- 172.21.15.2:0/4067247443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aa287877c0 con 0x55aa287025d0 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.931+0000 7f8524ff9640 1 -- 172.21.15.2:0/4067247443 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853801f040 con 0x55aa287025d0 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.932+0000 7f8524ff9640 1 -- 172.21.15.2:0/4067247443 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f853802f070 con 0x55aa287025d0 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.932+0000 7f85459a3740 10 client.16044 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.932+0000 7f85459a3740 10 client.16044 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.932+0000 7f85459a3740 20 client.16044 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.932+0000 7f85459a3740 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55aa28787c40 0x55aa2878a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.932+0000 7f85459a3740 4 client.16044 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.932+0000 7f85459a3740 1 -- 172.21.15.2:0/4067247443 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa2866fd70 con 0x55aa28787c40 2024-09-12T00:56:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.932+0000 7f8540b65640 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55aa28787c40 0x55aa2878a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f8540b65640 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55aa28787c40 0x55aa2878a030 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=50948a7ecdd05ef7 server_cookie=8c80eb5d95b73d31 in_seq=0 out_seq=0 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f8524ff9640 10 client.16044 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f8524ff9640 1 -- 172.21.15.2:0/4067247443 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa2866fd70 con 0x55aa28787c40 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f8524ff9640 10 client.16044 handle_command_reply: tid=0 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f85459a3740 1 client.16044 shutdown 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f85459a3740 1 -- 172.21.15.2:0/4067247443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa287025d0 msgr2=0x55aa28715710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f85459a3740 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa287025d0 0x55aa28715710 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8538033040 tx=0x7f8538005f80 comp rx=0 tx=0).stop 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f85459a3740 1 -- 172.21.15.2:0/4067247443 shutdown_connections 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.933+0000 7f85459a3740 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55aa28787c40 0x55aa2878a030 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85459a3740 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aa2870d370 0x55aa28706950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85459a3740 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa28703b40 0x55aa28715c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f8524ff9640 0 client.16044 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:56:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85459a3740 1 --2- 172.21.15.2:0/4067247443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa287025d0 0x55aa28715710 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85459a3740 1 -- 172.21.15.2:0/4067247443 >> 172.21.15.2:0/4067247443 conn(0x55aa286cb310 msgr2=0x55aa286fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:08.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85459a3740 1 -- 172.21.15.2:0/4067247443 shutdown_connections 2024-09-12T00:56:08.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85459a3740 1 -- 172.21.15.2:0/4067247443 wait complete. 2024-09-12T00:56:08.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85459a3740 20 client.16044 trim_cache size 0 max 16384 2024-09-12T00:56:08.946 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85435ca640 1 -- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85280a2cf0 msgr2=0x7f85280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85435ca640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85280a2cf0 0x7f85280a51b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8534009fd0 tx=0x7f8534004a40 comp rx=0 tx=0).stop 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85435ca640 1 -- 172.21.15.2:0/4222359543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f853c101e20 msgr2=0x7f853c198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.934+0000 7f85435ca640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f853c101e20 0x7f853c198930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f852c005940 tx=0x7f852c0040c0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.935+0000 7f85435ca640 1 -- 172.21.15.2:0/4222359543 shutdown_connections 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.935+0000 7f85435ca640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85280a2cf0 0x7f85280a51b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.935+0000 7f85435ca640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c105de0 0x7f853c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.935+0000 7f85435ca640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f853c101e20 0x7f853c198930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.935+0000 7f85435ca640 1 --2- 172.21.15.2:0/4222359543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f853c101470 0x7f853c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.935+0000 7f85435ca640 1 -- 172.21.15.2:0/4222359543 >> 172.21.15.2:0/4222359543 conn(0x7f853c077230 msgr2=0x7f853c1003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.935+0000 7f85435ca640 1 -- 172.21.15.2:0/4222359543 shutdown_connections 2024-09-12T00:56:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:08.935+0000 7f85435ca640 1 -- 172.21.15.2:0/4222359543 wait complete. 2024-09-12T00:56:09.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:56:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:10.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:09 smithi002 ceph-mon[31210]: pgmap v100: 97 pgs: 97 active+clean; 97 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 591 KiB/s wr, 105 op/s 2024-09-12T00:56:10.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:09 smithi167 ceph-mon[35234]: pgmap v100: 97 pgs: 97 active+clean; 97 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 591 KiB/s wr, 105 op/s 2024-09-12T00:56:10.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:09 smithi071 ceph-mon[35276]: pgmap v100: 97 pgs: 97 active+clean; 97 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 591 KiB/s wr, 105 op/s 2024-09-12T00:56:10.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.816+0000 7f69c6959640 1 -- 172.21.15.2:0/1720371229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0106a70 msgr2=0x7f69c0106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.816+0000 7f69c6959640 1 --2- 172.21.15.2:0/1720371229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0106a70 0x7f69c0106e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009930 tx=0x7f69b002a420 comp rx=0 tx=0).stop 2024-09-12T00:56:10.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 -- 172.21.15.2:0/1720371229 shutdown_connections 2024-09-12T00:56:10.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 --2- 172.21.15.2:0/1720371229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69c0101410 0x7f69c010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 --2- 172.21.15.2:0/1720371229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0100a70 0x7f69c0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 --2- 172.21.15.2:0/1720371229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0106a70 0x7f69c0106e50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 -- 172.21.15.2:0/1720371229 >> 172.21.15.2:0/1720371229 conn(0x7f69c00fc790 msgr2=0x7f69c00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 -- 172.21.15.2:0/1720371229 shutdown_connections 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 -- 172.21.15.2:0/1720371229 wait complete. 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 Processor -- start 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.817+0000 7f69c6959640 1 -- start start 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c6959640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0100a70 0x7f69c0102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c6959640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0101410 0x7f69c0102b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c6959640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69c0106a70 0x7f69c01030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c6959640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f69c0110e70 con 0x7f69c0106a70 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c6959640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69c0110cf0 con 0x7f69c0100a70 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c6959640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69c0110ff0 con 0x7f69c0101410 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69c0106a70 0x7f69c01030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69bffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0100a70 0x7f69c0102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69c0106a70 0x7f69c01030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36754/0 (socket says 172.21.15.2:36754) 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 -- 172.21.15.2:0/435516580 learned_addr learned my addr 172.21.15.2:0/435516580 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69b7fff640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0101410 0x7f69c0102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 -- 172.21.15.2:0/435516580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0101410 msgr2=0x7f69c0102b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0101410 0x7f69c0102b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 -- 172.21.15.2:0/435516580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0100a70 msgr2=0x7f69c0102640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0100a70 0x7f69c0102640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 -- 172.21.15.2:0/435516580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c01a6980 con 0x7f69c0106a70 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69bffff640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0100a70 0x7f69c0102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69b7fff640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0101410 0x7f69c0102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.818+0000 7f69c4ef6640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69c0106a70 0x7f69c01030c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f69b800efd0 tx=0x7f69b800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:10.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.819+0000 7f69bdffb640 1 -- 172.21.15.2:0/435516580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8003b70 con 0x7f69c0106a70 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.819+0000 7f69bdffb640 1 -- 172.21.15.2:0/435516580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b8003d10 con 0x7f69c0106a70 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.819+0000 7f69bdffb640 1 -- 172.21.15.2:0/435516580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b80109f0 con 0x7f69c0106a70 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.819+0000 7f69c6959640 1 -- 172.21.15.2:0/435516580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c01a6c70 con 0x7f69c0106a70 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.819+0000 7f69c6959640 1 -- 172.21.15.2:0/435516580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c01a7160 con 0x7f69c0106a70 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69bdffb640 1 -- 172.21.15.2:0/435516580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f69b8004020 con 0x7f69c0106a70 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69c8d32740 1 Processor -- start 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69c8d32740 1 -- start start 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c7e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c7ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c89370 0x55f3b0c8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69c8d32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f3b0be42f0 con 0x55f3b0c7fb40 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69c8d32740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f3b0b8bcf0 con 0x55f3b0c7e5d0 2024-09-12T00:56:10.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.822+0000 7f69c8d32740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f3b0be02b0 con 0x55f3b0c89370 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c7e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c7e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36768/0 (socket says 172.21.15.2:36768) 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 -- 172.21.15.2:0/330916530 learned_addr learned my addr 172.21.15.2:0/330916530 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c89370 0x55f3b0c8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69bffff640 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c7ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 -- 172.21.15.2:0/330916530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c89370 msgr2=0x55f3b0c8b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c89370 0x55f3b0c8b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 -- 172.21.15.2:0/330916530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 msgr2=0x55f3b0c7ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c7ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 -- 172.21.15.2:0/330916530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3b0b703a0 con 0x55f3b0c7fb40 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69bdffb640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f69ac0a2cf0 0x7f69ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69bffff640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f69ac0a2cf0 0x7f69ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b7fff640 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c7e090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69a8013bf0 tx=0x7f69a8009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d584a16897043f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69bdffb640 1 -- 172.21.15.2:0/435516580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f69b80cf8c0 con 0x7f69c0106a70 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b67fc640 1 -- 172.21.15.2:0/330916530 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8013ce0 con 0x55f3b0c7fb40 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.823+0000 7f69b67fc640 1 -- 172.21.15.2:0/330916530 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a8011c70 con 0x55f3b0c7fb40 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69b67fc640 1 -- 172.21.15.2:0/330916530 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a800e3b0 con 0x55f3b0c7fb40 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 -- 172.21.15.2:0/330916530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 msgr2=0x55f3b0c7e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69bffff640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f69ac0a2cf0 0x7f69ac0a51b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009900 tx=0x7f69b00058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c7e090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69a8013bf0 tx=0x7f69a8009b70 comp rx=0 tx=0).stop 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 -- 172.21.15.2:0/330916530 shutdown_connections 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c89370 0x55f3b0c8b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c7ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 --2- 172.21.15.2:0/330916530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c7e090 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 -- 172.21.15.2:0/330916530 >> 172.21.15.2:0/330916530 conn(0x55f3b0c47310 msgr2=0x55f3b0c7ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 -- 172.21.15.2:0/330916530 shutdown_connections 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.824+0000 7f69c8d32740 1 -- 172.21.15.2:0/330916530 wait complete. 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 1 -- start start 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 1 Processor -- start 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c88c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c85f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c89370 0x55f3b0c86480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f3b0c8c010 con 0x55f3b0c7fb40 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f3b0b9f060 con 0x55f3b0c89370 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f3b0c8c190 con 0x55f3b0c7e5d0 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c8d32740 10 client.0 _ll_register_callbacks cb 0x55f3b08f28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c85f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69bffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c88c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69bffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c88c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52118/0 (socket says 172.21.15.2:52118) 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69bffff640 1 -- 172.21.15.2:0/1582009220 learned_addr learned my addr 172.21.15.2:0/1582009220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c85f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36772/0 (socket says 172.21.15.2:36772) 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.825+0000 7f69c4ef6640 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c89370 0x55f3b0c86480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69b7fff640 1 -- 172.21.15.2:0/1582009220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 msgr2=0x55f3b0c88c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69b7fff640 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c88c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69b7fff640 1 -- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c89370 msgr2=0x55f3b0c86480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69b7fff640 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c89370 0x55f3b0c86480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69b7fff640 1 -- 172.21.15.2:0/1582009220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3b09553c0 con 0x55f3b0c7fb40 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69c4ef6640 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c89370 0x55f3b0c86480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69b7fff640 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c85f40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f69a8011c40 tx=0x7f69a801f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa09895b280ed65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:10.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f699f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f699f7fe640 1 -- 172.21.15.2:0/1582009220 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a802d060 con 0x55f3b0c7fb40 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f699f7fe640 1 -- 172.21.15.2:0/1582009220 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f69a8013ce0 con 0x55f3b0c7fb40 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69c8d32740 1 -- 172.21.15.2:0/1582009220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a8011c70 con 0x55f3b0c7fb40 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f699f7fe640 1 -- 172.21.15.2:0/1582009220 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f69a8005040 con 0x55f3b0c7fb40 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69c8d32740 10 client.16056 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.826+0000 7f69c8d32740 1 -- 172.21.15.2:0/1582009220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3b0c97a00 con 0x55f3b0c7fb40 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f699f7fe640 1 -- 172.21.15.2:0/1582009220 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a8011c70 con 0x55f3b0c7fb40 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f699f7fe640 1 -- 172.21.15.2:0/1582009220 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f69a8020420 con 0x55f3b0c7fb40 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f69c8d32740 10 client.16056 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f69c8d32740 10 client.16056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f69c8d32740 20 client.16056 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f69c8d32740 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f3b0c98d50 0x55f3b0c9b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f69c8d32740 4 client.16056 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:10.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f69c8d32740 1 -- 172.21.15.2:0/1582009220 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3b0bf1860 con 0x55f3b0c98d50 2024-09-12T00:56:10.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.827+0000 7f69bffff640 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f3b0c98d50 0x55f3b0c9b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.828+0000 7f69bffff640 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f3b0c98d50 0x55f3b0c9b140 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18160cf5bf01fb78 server_cookie=bb7352223260f7f in_seq=0 out_seq=0 2024-09-12T00:56:10.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.828+0000 7f699f7fe640 10 client.16056 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:10.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.829+0000 7f699f7fe640 1 -- 172.21.15.2:0/1582009220 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3b0bf1860 con 0x55f3b0c98d50 2024-09-12T00:56:10.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.829+0000 7f699f7fe640 10 client.16056 handle_command_reply: tid=0 2024-09-12T00:56:10.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.829+0000 7f69c8d32740 1 client.16056 shutdown 2024-09-12T00:56:10.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.829+0000 7f69c8d32740 1 -- 172.21.15.2:0/1582009220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 msgr2=0x55f3b0c85f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.829+0000 7f69c8d32740 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c85f40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f69a8011c40 tx=0x7f69a801f940 comp rx=0 tx=0).stop 2024-09-12T00:56:10.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 1 -- 172.21.15.2:0/1582009220 shutdown_connections 2024-09-12T00:56:10.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f3b0c98d50 0x55f3b0c9b140 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c89370 0x55f3b0c86480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c85f40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 1 --2- 172.21.15.2:0/1582009220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c88c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f699f7fe640 0 client.16056 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:10.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 1 -- 172.21.15.2:0/1582009220 >> 172.21.15.2:0/1582009220 conn(0x55f3b0c47310 msgr2=0x55f3b0c80930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:10.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 1 -- 172.21.15.2:0/1582009220 shutdown_connections 2024-09-12T00:56:10.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 1 -- 172.21.15.2:0/1582009220 wait complete. 2024-09-12T00:56:10.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.830+0000 7f69c8d32740 20 client.16056 trim_cache size 0 max 16384 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.843+0000 7f69c8d32740 1 Processor -- start 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.843+0000 7f69c8d32740 1 -- start start 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7fb40 0x55f3b0ca08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0ca0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c8d32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01b2460 con 0x55f3b0c89370 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c8d32740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01afd30 con 0x55f3b0c7e5d0 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c8d32740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01adb80 con 0x55f3b0c7fb40 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c4ef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0ca0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69bffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7fb40 0x55f3b0ca08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c4ef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0ca0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36780/0 (socket says 172.21.15.2:36780) 2024-09-12T00:56:10.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69bffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c952e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:53770/0 (socket says 172.21.15.2:53770) 2024-09-12T00:56:10.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69c4ef6640 1 -- 172.21.15.2:0/3946130019 learned_addr learned my addr 172.21.15.2:0/3946130019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:10.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69b7fff640 1 -- 172.21.15.2:0/3946130019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 msgr2=0x55f3b0c952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:10.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69b7fff640 1 --2- 172.21.15.2:0/3946130019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69b7fff640 1 -- 172.21.15.2:0/3946130019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 msgr2=0x55f3b0ca0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:10.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69b7fff640 1 --2- 172.21.15.2:0/3946130019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0ca0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69b7fff640 1 -- 172.21.15.2:0/3946130019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3b0c81120 con 0x55f3b0c7fb40 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.844+0000 7f69b7fff640 1 --2- 172.21.15.2:0/3946130019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7fb40 0x55f3b0ca08d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69a80207f0 tx=0x7f69a8009b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7656e8ca2e40abab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69b5ffb640 1 -- 172.21.15.2:0/3946130019 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a802d070 con 0x55f3b0c7fb40 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69b5ffb640 1 -- 172.21.15.2:0/3946130019 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a8011c70 con 0x55f3b0c7fb40 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69b5ffb640 1 -- 172.21.15.2:0/3946130019 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a801fe40 con 0x55f3b0c7fb40 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69c8d32740 1 -- 172.21.15.2:0/3946130019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7fb40 msgr2=0x55f3b0ca08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69c8d32740 1 --2- 172.21.15.2:0/3946130019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7fb40 0x55f3b0ca08d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69a80207f0 tx=0x7f69a8009b70 comp rx=0 tx=0).stop 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69c8d32740 1 -- 172.21.15.2:0/3946130019 shutdown_connections 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69c8d32740 1 --2- 172.21.15.2:0/3946130019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0ca0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69c8d32740 1 --2- 172.21.15.2:0/3946130019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7fb40 0x55f3b0ca08d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69c8d32740 1 --2- 172.21.15.2:0/3946130019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.845+0000 7f69c8d32740 1 -- 172.21.15.2:0/3946130019 >> 172.21.15.2:0/3946130019 conn(0x55f3b0c47310 msgr2=0x55f3b0c85030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 -- 172.21.15.2:0/3946130019 shutdown_connections 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 -- 172.21.15.2:0/3946130019 wait complete. 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 -- start start 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 Processor -- start 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c914f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c91a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0c8c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01ae1f0 con 0x55f3b0c89370 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01af660 con 0x55f3b0c7fb40 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01ae8c0 con 0x55f3b0c7e5d0 2024-09-12T00:56:10.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.846+0000 7f69c8d32740 10 client.0 _ll_register_callbacks cb 0x7f69a8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0c8c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0c8c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36792/0 (socket says 172.21.15.2:36792) 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 -- 172.21.15.2:0/827092632 learned_addr learned my addr 172.21.15.2:0/827092632 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69bffff640 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69b7fff640 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c91a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 -- 172.21.15.2:0/827092632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 msgr2=0x55f3b0c914f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c914f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 -- 172.21.15.2:0/827092632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7fb40 msgr2=0x55f3b0c91a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c91a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 -- 172.21.15.2:0/827092632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3b0c8d220 con 0x55f3b0c89370 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c4ef6640 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0c8c9f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f69b809ba30 tx=0x7f69b8003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fddc1eef059277d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f699f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:10.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f699f7fe640 1 -- 172.21.15.2:0/827092632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b80b8030 con 0x55f3b0c89370 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f699f7fe640 1 -- 172.21.15.2:0/827092632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f69b8004310 con 0x55f3b0c89370 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.847+0000 7f69c8d32740 1 -- 172.21.15.2:0/827092632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a8011c70 con 0x55f3b0c89370 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f699f7fe640 1 -- 172.21.15.2:0/827092632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f69b809c430 con 0x55f3b0c89370 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69c8d32740 10 client.16062 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69c8d32740 1 -- 172.21.15.2:0/827092632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3b0d0bb30 con 0x55f3b0c89370 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f699f7fe640 1 -- 172.21.15.2:0/827092632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a8011c70 con 0x55f3b0c89370 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f699f7fe640 1 -- 172.21.15.2:0/827092632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f69b801f020 con 0x55f3b0c89370 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69c8d32740 10 client.16062 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69c8d32740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69c8d32740 20 client.16062 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69c8d32740 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f3b0d0c300 0x55f3b0d0e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69c8d32740 4 client.16062 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:56:10.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69c8d32740 1 -- 172.21.15.2:0/827092632 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3b0bebd70 con 0x55f3b0d0c300 2024-09-12T00:56:10.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.848+0000 7f69bffff640 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f3b0d0c300 0x55f3b0d0e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.849+0000 7f699f7fe640 10 client.16062 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.849+0000 7f69bffff640 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f3b0d0c300 0x55f3b0d0e720 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=877eb976038b54a3 server_cookie=ba82efd2ea95187f in_seq=0 out_seq=0 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f699f7fe640 1 -- 172.21.15.2:0/827092632 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3b0bebd70 con 0x55f3b0d0c300 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f699f7fe640 10 client.16062 handle_command_reply: tid=0 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 client.16062 shutdown 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 -- 172.21.15.2:0/827092632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 msgr2=0x55f3b0c8c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0c8c9f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f69b809ba30 tx=0x7f69b8003f40 comp rx=0 tx=0).stop 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 -- 172.21.15.2:0/827092632 shutdown_connections 2024-09-12T00:56:10.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f3b0d0c300 0x55f3b0d0e720 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3b0c89370 0x55f3b0c8c9f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3b0c7fb40 0x55f3b0c91a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 --2- 172.21.15.2:0/827092632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b0c7e5d0 0x55f3b0c914f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 -- 172.21.15.2:0/827092632 >> 172.21.15.2:0/827092632 conn(0x55f3b0c47310 msgr2=0x55f3b0c794e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f699f7fe640 0 client.16062 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 -- 172.21.15.2:0/827092632 shutdown_connections 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 1 -- 172.21.15.2:0/827092632 wait complete. 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.850+0000 7f69c8d32740 20 client.16062 trim_cache size 0 max 16384 2024-09-12T00:56:10.853 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:56:10.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 -- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f69ac0a2cf0 msgr2=0x7f69ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f69ac0a2cf0 0x7f69ac0a51b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009900 tx=0x7f69b00058d0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 -- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69c0106a70 msgr2=0x7f69c01030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:10.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69c0106a70 0x7f69c01030c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f69b800efd0 tx=0x7f69b800c6a0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 -- 172.21.15.2:0/435516580 shutdown_connections 2024-09-12T00:56:10.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f69ac0a2cf0 0x7f69ac0a51b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69c0106a70 0x7f69c01030c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c0101410 0x7f69c0102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 --2- 172.21.15.2:0/435516580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0100a70 0x7f69c0102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:10.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 -- 172.21.15.2:0/435516580 >> 172.21.15.2:0/435516580 conn(0x7f69c00fc790 msgr2=0x7f69c006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:10.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 -- 172.21.15.2:0/435516580 shutdown_connections 2024-09-12T00:56:10.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:10.851+0000 7f69c6959640 1 -- 172.21.15.2:0/435516580 wait complete. 2024-09-12T00:56:12.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:11 smithi002 ceph-mon[31210]: pgmap v101: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-09-12T00:56:12.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:11 smithi167 ceph-mon[35234]: pgmap v101: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-09-12T00:56:12.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:11 smithi071 ceph-mon[35276]: pgmap v101: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-09-12T00:56:12.748 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:56:12.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:56:12.876 INFO:tasks.workunit.client.0.smithi002.stdout:30000 trunc from 0x7bb2f to 0xcdf83 2024-09-12T00:56:13.025 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:13.235 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xffcdd 2024-09-12T00:56:13.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 -- 172.21.15.2:0/616344437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 msgr2=0x7f173810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 --2- 172.21.15.2:0/616344437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 0x7f173810ea90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1730009ca0 tx=0x7f173002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 -- 172.21.15.2:0/616344437 shutdown_connections 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 --2- 172.21.15.2:0/616344437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 0x7f173810ea90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 --2- 172.21.15.2:0/616344437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1738102790 0x7f17381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 --2- 172.21.15.2:0/616344437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738101de0 0x7f17381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 -- 172.21.15.2:0/616344437 >> 172.21.15.2:0/616344437 conn(0x7f17380fd8c0 msgr2=0x7f17380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 -- 172.21.15.2:0/616344437 shutdown_connections 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 -- 172.21.15.2:0/616344437 wait complete. 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.552+0000 7f173e80c640 1 Processor -- start 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173e80c640 1 -- start start 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173e80c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738101de0 0x7f17380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173e80c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1738102790 0x7f1738074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173e80c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 0x7f1738074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173e80c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1738111f70 con 0x7f1738106f10 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173e80c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1738111df0 con 0x7f1738102790 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173e80c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17381120f0 con 0x7f1738101de0 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173cda9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 0x7f1738074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173cda9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 0x7f1738074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36806/0 (socket says 172.21.15.2:36806) 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f173cda9640 1 -- 172.21.15.2:0/1714218848 learned_addr learned my addr 172.21.15.2:0/1714218848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f17377fe640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1738102790 0x7f1738074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.553+0000 7f1737fff640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738101de0 0x7f17380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f173cda9640 1 -- 172.21.15.2:0/1714218848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738101de0 msgr2=0x7f17380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f173cda9640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738101de0 0x7f17380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f173cda9640 1 -- 172.21.15.2:0/1714218848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1738102790 msgr2=0x7f1738074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f173cda9640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1738102790 0x7f1738074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f173cda9640 1 -- 172.21.15.2:0/1714218848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17381a6890 con 0x7f1738106f10 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f17377fe640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1738102790 0x7f1738074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f173cda9640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 0x7f1738074f70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1730031a20 tx=0x7f1730031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:13.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f17357fa640 1 -- 172.21.15.2:0/1714218848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730003b70 con 0x7f1738106f10 2024-09-12T00:56:13.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f17357fa640 1 -- 172.21.15.2:0/1714218848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1730003d10 con 0x7f1738106f10 2024-09-12T00:56:13.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f173e80c640 1 -- 172.21.15.2:0/1714218848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17381a6b20 con 0x7f1738106f10 2024-09-12T00:56:13.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f17357fa640 1 -- 172.21.15.2:0/1714218848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173002fc40 con 0x7f1738106f10 2024-09-12T00:56:13.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.554+0000 7f173e80c640 1 -- 172.21.15.2:0/1714218848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17381a7060 con 0x7f1738106f10 2024-09-12T00:56:13.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.557+0000 7f17357fa640 1 -- 172.21.15.2:0/1714218848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f1730004050 con 0x7f1738106f10 2024-09-12T00:56:13.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.557+0000 7f1740be5740 1 Processor -- start 2024-09-12T00:56:13.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.557+0000 7f1740be5740 1 -- start start 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.557+0000 7f17357fa640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17200a2cf0 0x7f17200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f17377fe640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17200a2cf0 0x7f17200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f1740be5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c419f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f17357fa640 1 -- 172.21.15.2:0/1714218848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f17300f0650 con 0x7f1738106f10 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f1740be5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c424800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f1740be5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c427130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f1740be5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cc7c37f280 con 0x55cc7c424d40 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f1740be5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cc7c326b10 con 0x55cc7c41a480 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f1740be5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cc7c37b240 con 0x55cc7c419b60 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c427130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f17377fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c424800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c427130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36818/0 (socket says 172.21.15.2:36818) 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 -- 172.21.15.2:0/3168374529 learned_addr learned my addr 172.21.15.2:0/3168374529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f17377fe640 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c424800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:53794/0 (socket says 172.21.15.2:53794) 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f1737fff640 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c419f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 -- 172.21.15.2:0/3168374529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 msgr2=0x55cc7c419f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c419f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 -- 172.21.15.2:0/3168374529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 msgr2=0x55cc7c424800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c424800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 -- 172.21.15.2:0/3168374529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7c3331f0 con 0x55cc7c424d40 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f17377fe640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17200a2cf0 0x7f17200a51b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1738075f80 tx=0x7f172c011c10 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.558+0000 7f173cda9640 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c427130 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f17300b9690 tx=0x7f17300bc800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf34269794de067 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f171e7fc640 1 -- 172.21.15.2:0/3168374529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300bccc0 con 0x55cc7c424d40 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f171e7fc640 1 -- 172.21.15.2:0/3168374529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1730036040 con 0x55cc7c424d40 2024-09-12T00:56:13.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f171e7fc640 1 -- 172.21.15.2:0/3168374529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300b9330 con 0x55cc7c424d40 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f1740be5740 1 -- 172.21.15.2:0/3168374529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 msgr2=0x55cc7c427130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f1740be5740 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c427130 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f17300b9690 tx=0x7f17300bc800 comp rx=0 tx=0).stop 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f1740be5740 1 -- 172.21.15.2:0/3168374529 shutdown_connections 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f1740be5740 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c427130 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f1740be5740 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c424800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f1740be5740 1 --2- 172.21.15.2:0/3168374529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c419f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.559+0000 7f1740be5740 1 -- 172.21.15.2:0/3168374529 >> 172.21.15.2:0/3168374529 conn(0x55cc7c4160f0 msgr2=0x55cc7c4164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.560+0000 7f1740be5740 1 -- 172.21.15.2:0/3168374529 shutdown_connections 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.560+0000 7f1740be5740 1 -- 172.21.15.2:0/3168374529 wait complete. 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.560+0000 7f1740be5740 1 -- start start 2024-09-12T00:56:13.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.560+0000 7f1740be5740 1 Processor -- start 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1740be5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c421be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1740be5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c422120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1740be5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c422660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1740be5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cc7c37f280 con 0x55cc7c424d40 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1740be5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cc7c339f10 con 0x55cc7c41a480 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1740be5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cc7c4276d0 con 0x55cc7c419b60 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1740be5740 10 client.0 _ll_register_callbacks cb 0x55cc7c302a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c421be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f17377fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c422120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c421be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52186/0 (socket says 172.21.15.2:52186) 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 -- 172.21.15.2:0/1090756560 learned_addr learned my addr 172.21.15.2:0/1090756560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f173cda9640 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c422660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 -- 172.21.15.2:0/1090756560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 msgr2=0x55cc7c422120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c422120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 -- 172.21.15.2:0/1090756560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 msgr2=0x55cc7c422660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c422660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 -- 172.21.15.2:0/1090756560 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7c0f06a0 con 0x55cc7c419b60 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f1737fff640 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c421be0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1728013710 tx=0x7f1728013b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9652a22abce1472b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.561+0000 7f17177fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.562+0000 7f17177fe640 1 -- 172.21.15.2:0/1090756560 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728020060 con 0x55cc7c419b60 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.562+0000 7f17177fe640 1 -- 172.21.15.2:0/1090756560 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f1728011d50 con 0x55cc7c419b60 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.562+0000 7f1740be5740 1 -- 172.21.15.2:0/1090756560 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1730036040 con 0x55cc7c419b60 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.562+0000 7f17177fe640 1 -- 172.21.15.2:0/1090756560 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f172800f450 con 0x55cc7c419b60 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.562+0000 7f1740be5740 10 client.25648 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:13.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.562+0000 7f1740be5740 1 -- 172.21.15.2:0/1090756560 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cc7c4330d0 con 0x55cc7c419b60 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.562+0000 7f17177fe640 1 -- 172.21.15.2:0/1090756560 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1730036040 con 0x55cc7c419b60 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.562+0000 7f17177fe640 1 -- 172.21.15.2:0/1090756560 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f172801a030 con 0x55cc7c419b60 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f1740be5740 10 client.25648 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f1740be5740 10 client.25648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f1740be5740 20 client.25648 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f1740be5740 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cc7c4345e0 0x55cc7c436a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f1740be5740 4 client.25648 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f1740be5740 1 -- 172.21.15.2:0/1090756560 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc7c38c7f0 con 0x55cc7c4345e0 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f17377fe640 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cc7c4345e0 0x55cc7c436a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f17377fe640 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cc7c4345e0 0x55cc7c436a50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7036f2f38e36903c server_cookie=31c0982eef8cc0eb in_seq=0 out_seq=0 2024-09-12T00:56:13.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.563+0000 7f17177fe640 10 client.25648 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:13.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f17177fe640 1 -- 172.21.15.2:0/1090756560 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc7c38c7f0 con 0x55cc7c4345e0 2024-09-12T00:56:13.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f17177fe640 10 client.25648 handle_command_reply: tid=0 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 client.25648 shutdown 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 -- 172.21.15.2:0/1090756560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 msgr2=0x55cc7c421be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c421be0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1728013710 tx=0x7f1728013b10 comp rx=0 tx=0).stop 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 -- 172.21.15.2:0/1090756560 shutdown_connections 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cc7c4345e0 0x55cc7c436a50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c422660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c422120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 --2- 172.21.15.2:0/1090756560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c421be0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 -- 172.21.15.2:0/1090756560 >> 172.21.15.2:0/1090756560 conn(0x55cc7c4160f0 msgr2=0x55cc7c415270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f17177fe640 0 client.25648 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 -- 172.21.15.2:0/1090756560 shutdown_connections 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.564+0000 7f1740be5740 1 -- 172.21.15.2:0/1090756560 wait complete. 2024-09-12T00:56:13.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.565+0000 7f1740be5740 20 client.25648 trim_cache size 0 max 16384 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1740be5740 1 Processor -- start 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1740be5740 1 -- start start 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1740be5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c43c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1740be5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c43c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1740be5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c41b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1740be5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17381b24a0 con 0x55cc7c424d40 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1740be5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17381afd70 con 0x55cc7c41a480 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1740be5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17381adbc0 con 0x55cc7c419b60 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1737fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c43c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f173cda9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c41b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1737fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c43c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52202/0 (socket says 172.21.15.2:52202) 2024-09-12T00:56:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f1737fff640 1 -- 172.21.15.2:0/953344128 learned_addr learned my addr 172.21.15.2:0/953344128 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f17377fe640 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c43c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f173cda9640 1 -- 172.21.15.2:0/953344128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 msgr2=0x55cc7c43c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:13.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f173cda9640 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c43c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f173cda9640 1 -- 172.21.15.2:0/953344128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 msgr2=0x55cc7c43c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:13.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.583+0000 7f173cda9640 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c43c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.584+0000 7f173cda9640 1 -- 172.21.15.2:0/953344128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7c436dc0 con 0x55cc7c424d40 2024-09-12T00:56:13.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.584+0000 7f1737fff640 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c43c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.584+0000 7f173cda9640 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c41b5b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x55cc7c41aa20 tx=0x7f173002f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2ba0e2d7f3caf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.584+0000 7f171dffb640 1 -- 172.21.15.2:0/953344128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300c58a0 con 0x55cc7c424d40 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.584+0000 7f171dffb640 1 -- 172.21.15.2:0/953344128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1730036040 con 0x55cc7c424d40 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.584+0000 7f171dffb640 1 -- 172.21.15.2:0/953344128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730004340 con 0x55cc7c424d40 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 -- 172.21.15.2:0/953344128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 msgr2=0x55cc7c41b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c41b5b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x55cc7c41aa20 tx=0x7f173002f710 comp rx=0 tx=0).stop 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 -- 172.21.15.2:0/953344128 shutdown_connections 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c424d40 0x55cc7c41b5b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c41a480 0x55cc7c43c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 --2- 172.21.15.2:0/953344128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c43c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 -- 172.21.15.2:0/953344128 >> 172.21.15.2:0/953344128 conn(0x55cc7c4160f0 msgr2=0x55cc7c420cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 -- 172.21.15.2:0/953344128 shutdown_connections 2024-09-12T00:56:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 -- 172.21.15.2:0/953344128 wait complete. 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.585+0000 7f1740be5740 1 -- start start 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1740be5740 1 Processor -- start 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1740be5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c42d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1740be5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c41a480 0x55cc7c4283c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1740be5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c424d40 0x55cc7c4289d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1740be5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17381ae230 con 0x55cc7c41a480 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1740be5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17381af6a0 con 0x55cc7c424d40 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1740be5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17381ae900 con 0x55cc7c419b60 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1740be5740 10 client.0 _ll_register_callbacks cb 0x7f1728009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f17377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c41a480 0x55cc7c4283c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1737fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c42d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f17377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c41a480 0x55cc7c4283c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36852/0 (socket says 172.21.15.2:36852) 2024-09-12T00:56:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f17377fe640 1 -- 172.21.15.2:0/2069034590 learned_addr learned my addr 172.21.15.2:0/2069034590 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f173cda9640 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c424d40 0x55cc7c4289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1737fff640 1 -- 172.21.15.2:0/2069034590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c424d40 msgr2=0x55cc7c4289d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1737fff640 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c424d40 0x55cc7c4289d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1737fff640 1 -- 172.21.15.2:0/2069034590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c41a480 msgr2=0x55cc7c4283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1737fff640 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c41a480 0x55cc7c4283c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f1737fff640 1 -- 172.21.15.2:0/2069034590 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7c429200 con 0x55cc7c419b60 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.586+0000 7f17377fe640 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c41a480 0x55cc7c4283c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f1737fff640 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c42d090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f172800e830 tx=0x7f1728005d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa798feb7bf835d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f17177fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f17177fe640 1 -- 172.21.15.2:0/2069034590 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172800eaa0 con 0x55cc7c419b60 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f17177fe640 1 -- 172.21.15.2:0/2069034590 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f172800ec40 con 0x55cc7c419b60 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f1740be5740 1 -- 172.21.15.2:0/2069034590 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1730036040 con 0x55cc7c419b60 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f17177fe640 1 -- 172.21.15.2:0/2069034590 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f172800ee60 con 0x55cc7c419b60 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f1740be5740 10 client.25654 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f1740be5740 1 -- 172.21.15.2:0/2069034590 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cc7c49f460 con 0x55cc7c419b60 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.587+0000 7f17177fe640 1 -- 172.21.15.2:0/2069034590 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1730036040 con 0x55cc7c419b60 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f17177fe640 1 -- 172.21.15.2:0/2069034590 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f172801a040 con 0x55cc7c419b60 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f1740be5740 10 client.25654 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f1740be5740 10 client.25654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f1740be5740 20 client.25654 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f1740be5740 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cc7c49fcc0 0x55cc7c4a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f1740be5740 4 client.25654 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f1740be5740 1 -- 172.21.15.2:0/2069034590 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cc7c386d00 con 0x55cc7c49fcc0 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f17377fe640 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cc7c49fcc0 0x55cc7c4a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f17377fe640 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cc7c49fcc0 0x55cc7c4a20e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b8dd5f76b8229a server_cookie=2c493c46c704309a in_seq=0 out_seq=0 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.588+0000 7f17177fe640 10 client.25654 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.589+0000 7f17177fe640 1 -- 172.21.15.2:0/2069034590 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cc7c386d00 con 0x55cc7c49fcc0 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.589+0000 7f17177fe640 10 client.25654 handle_command_reply: tid=0 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.589+0000 7f1740be5740 1 client.25654 shutdown 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 -- 172.21.15.2:0/2069034590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 msgr2=0x55cc7c42d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c42d090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f172800e830 tx=0x7f1728005d20 comp rx=0 tx=0).stop 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 -- 172.21.15.2:0/2069034590 shutdown_connections 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55cc7c49fcc0 0x55cc7c4a20e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cc7c424d40 0x55cc7c4289d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f17177fe640 0 client.25654 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc7c41a480 0x55cc7c4283c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 --2- 172.21.15.2:0/2069034590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc7c419b60 0x55cc7c42d090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 -- 172.21.15.2:0/2069034590 >> 172.21.15.2:0/2069034590 conn(0x55cc7c4160f0 msgr2=0x55cc7c423250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 -- 172.21.15.2:0/2069034590 shutdown_connections 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 1 -- 172.21.15.2:0/2069034590 wait complete. 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.590+0000 7f1740be5740 20 client.25654 trim_cache size 0 max 16384 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:56:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:56:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "bde3637f-c78e-49f7-87d2-e3e089e07e1e", 2024-09-12T00:56:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:56:13.594 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:56:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 -- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17200a2cf0 msgr2=0x7f17200a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17200a2cf0 0x7f17200a51b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1738075f80 tx=0x7f172c011c10 comp rx=0 tx=0).stop 2024-09-12T00:56:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 -- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 msgr2=0x7f1738074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 0x7f1738074f70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1730031a20 tx=0x7f1730031a50 comp rx=0 tx=0).stop 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 -- 172.21.15.2:0/1714218848 shutdown_connections 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17200a2cf0 0x7f17200a51b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1738106f10 0x7f1738074f70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1738102790 0x7f1738074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 --2- 172.21.15.2:0/1714218848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738101de0 0x7f17380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 -- 172.21.15.2:0/1714218848 >> 172.21.15.2:0/1714218848 conn(0x7f17380fd8c0 msgr2=0x7f17380feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 -- 172.21.15.2:0/1714218848 shutdown_connections 2024-09-12T00:56:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:13.591+0000 7f173e80c640 1 -- 172.21.15.2:0/1714218848 wait complete. 2024-09-12T00:56:14.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:13 smithi002 ceph-mon[31210]: pgmap v102: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 358 op/s 2024-09-12T00:56:14.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:13 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:56:14.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:13 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:13 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:56:14.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:13 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:13 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:56:14.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:13 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:13 smithi167 ceph-mon[35234]: pgmap v102: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 358 op/s 2024-09-12T00:56:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:13 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:56:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:13 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:13 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:56:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:13 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:13 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:56:14.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:13 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:56:14.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:13 smithi071 ceph-mon[35276]: pgmap v102: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 358 op/s 2024-09-12T00:56:14.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:13 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:56:14.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:13 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:13 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:56:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:13 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:13 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:56:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:13 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:14.687 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:14 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:14 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:14 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:14 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:14 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:14 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:14 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:15.191 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xffd97 2024-09-12T00:56:15.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 -- 172.21.15.2:0/872846067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 msgr2=0x7f647c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 --2- 172.21.15.2:0/872846067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 0x7f647c1021c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6478009900 tx=0x7f647802a410 comp rx=0 tx=0).stop 2024-09-12T00:56:15.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 -- 172.21.15.2:0/872846067 shutdown_connections 2024-09-12T00:56:15.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 --2- 172.21.15.2:0/872846067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c106f10 0x7f647c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 --2- 172.21.15.2:0/872846067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c102790 0x7f647c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 --2- 172.21.15.2:0/872846067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 0x7f647c1021c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 -- 172.21.15.2:0/872846067 >> 172.21.15.2:0/872846067 conn(0x7f647c0fd8c0 msgr2=0x7f647c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:15.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 -- 172.21.15.2:0/872846067 shutdown_connections 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.223+0000 7f6483980640 1 -- 172.21.15.2:0/872846067 wait complete. 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6483980640 1 Processor -- start 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6483980640 1 -- start start 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6483980640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 0x7f647c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6483980640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c102790 0x7f647c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6483980640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c106f10 0x7f647c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6483980640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f647c111f70 con 0x7f647c101de0 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6483980640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f647c111df0 con 0x7f647c106f10 2024-09-12T00:56:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6483980640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1120f0 con 0x7f647c102790 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f648171c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 0x7f647c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f648171c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 0x7f647c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36870/0 (socket says 172.21.15.2:36870) 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f648171c640 1 -- 172.21.15.2:0/795737226 learned_addr learned my addr 172.21.15.2:0/795737226 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6481f1d640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c106f10 0x7f647c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f6480f1b640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c102790 0x7f647c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f648171c640 1 -- 172.21.15.2:0/795737226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c102790 msgr2=0x7f647c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f648171c640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c102790 0x7f647c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f648171c640 1 -- 172.21.15.2:0/795737226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c106f10 msgr2=0x7f647c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f648171c640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c106f10 0x7f647c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.224+0000 7f648171c640 1 -- 172.21.15.2:0/795737226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c19d3e0 con 0x7f647c101de0 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.225+0000 7f648171c640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 0x7f647c198430 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6478006010 tx=0x7f64780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.225+0000 7f64727fc640 1 -- 172.21.15.2:0/795737226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647803f030 con 0x7f647c101de0 2024-09-12T00:56:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.225+0000 7f6483980640 1 -- 172.21.15.2:0/795737226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c19d670 con 0x7f647c101de0 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.225+0000 7f64727fc640 1 -- 172.21.15.2:0/795737226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6478003ce0 con 0x7f647c101de0 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.225+0000 7f64727fc640 1 -- 172.21.15.2:0/795737226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478035070 con 0x7f647c101de0 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.225+0000 7f6483980640 1 -- 172.21.15.2:0/795737226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1a4fb0 con 0x7f647c101de0 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f64727fc640 1 -- 172.21.15.2:0/795737226 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f6478042030 con 0x7f647c101de0 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6485d59740 1 Processor -- start 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6485d59740 1 -- start start 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6485d59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d988880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6485d59740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d988dc0 0x55e30d993140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6485d59740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d995a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6485d59740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e30d8ee2e0 con 0x55e30d988dc0 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6485d59740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e30d895ce0 con 0x55e30d993680 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6485d59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e30d8ea2a0 con 0x55e30d9884a0 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f648171c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d988dc0 0x55e30d993140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f648171c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d988dc0 0x55e30d993140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36884/0 (socket says 172.21.15.2:36884) 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6480f1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d995a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f648171c640 1 -- 172.21.15.2:0/2810203010 learned_addr learned my addr 172.21.15.2:0/2810203010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.228+0000 7f6481f1d640 1 --2- 172.21.15.2:0/2810203010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d988880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f6480f1b640 1 -- 172.21.15.2:0/2810203010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 msgr2=0x55e30d988880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f6480f1b640 1 --2- 172.21.15.2:0/2810203010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d988880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f6480f1b640 1 -- 172.21.15.2:0/2810203010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d988dc0 msgr2=0x55e30d993140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f6480f1b640 1 --2- 172.21.15.2:0/2810203010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d988dc0 0x55e30d993140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f6480f1b640 1 -- 172.21.15.2:0/2810203010 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30d87a440 con 0x55e30d993680 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f6480f1b640 1 --2- 172.21.15.2:0/2810203010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d995a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f646c005fd0 tx=0x7f646c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cae84c798661f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f64677fe640 1 -- 172.21.15.2:0/2810203010 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c00dea0 con 0x55e30d993680 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f64727fc640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f64677fe640 1 -- 172.21.15.2:0/2810203010 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f646c005500 con 0x55e30d993680 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f64677fe640 1 -- 172.21.15.2:0/2810203010 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c0116a0 con 0x55e30d993680 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f6481f1d640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.229+0000 7f64727fc640 1 -- 172.21.15.2:0/795737226 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f64780ef9b0 con 0x7f647c101de0 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 -- 172.21.15.2:0/2810203010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 msgr2=0x55e30d995a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 --2- 172.21.15.2:0/2810203010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d995a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f646c005fd0 tx=0x7f646c00f730 comp rx=0 tx=0).stop 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6481f1d640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f647400ae90 tx=0x7f647400a4d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 -- 172.21.15.2:0/2810203010 shutdown_connections 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 --2- 172.21.15.2:0/2810203010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d995a70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 --2- 172.21.15.2:0/2810203010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d988dc0 0x55e30d993140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 --2- 172.21.15.2:0/2810203010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d988880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 -- 172.21.15.2:0/2810203010 >> 172.21.15.2:0/2810203010 conn(0x55e30d984a30 msgr2=0x55e30d984e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 -- 172.21.15.2:0/2810203010 shutdown_connections 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 -- 172.21.15.2:0/2810203010 wait complete. 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 -- start start 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.230+0000 7f6485d59740 1 Processor -- start 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6485d59740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d9884a0 0x55e30d992f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6485d59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d988dc0 0x55e30d990210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6485d59740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d990750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6485d59740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e30d996250 con 0x55e30d9884a0 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6485d59740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e30d8a9050 con 0x55e30d993680 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6485d59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e30d9963d0 con 0x55e30d988dc0 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6485d59740 10 client.0 _ll_register_callbacks cb 0x55e30d8e9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f648171c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d9884a0 0x55e30d992f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6480f1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d988dc0 0x55e30d990210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6481f1d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d990750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6480f1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d988dc0 0x55e30d990210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:52244/0 (socket says 172.21.15.2:52244) 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f648171c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d9884a0 0x55e30d992f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36898/0 (socket says 172.21.15.2:36898) 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6480f1b640 1 -- 172.21.15.2:0/1535057882 learned_addr learned my addr 172.21.15.2:0/1535057882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.231+0000 7f6481f1d640 1 -- 172.21.15.2:0/1535057882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d988dc0 msgr2=0x55e30d990210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6481f1d640 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d988dc0 0x55e30d990210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6481f1d640 1 -- 172.21.15.2:0/1535057882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d9884a0 msgr2=0x55e30d992f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6481f1d640 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d9884a0 0x55e30d992f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6481f1d640 1 -- 172.21.15.2:0/1535057882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e30d65f3c0 con 0x55e30d993680 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f648171c640 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d9884a0 0x55e30d992f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:15.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6481f1d640 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d990750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6474010c90 tx=0x7f6474004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a553aef99d7afd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6464ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6464ff9640 1 -- 172.21.15.2:0/1535057882 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647402e060 con 0x55e30d993680 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6485d59740 1 -- 172.21.15.2:0/1535057882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f646c005500 con 0x55e30d993680 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6464ff9640 1 -- 172.21.15.2:0/1535057882 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6474016030 con 0x55e30d993680 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6464ff9640 1 -- 172.21.15.2:0/1535057882 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f64740200d0 con 0x55e30d993680 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6485d59740 10 client.25739 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.232+0000 7f6485d59740 1 -- 172.21.15.2:0/1535057882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e30d9a1c70 con 0x55e30d993680 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f6464ff9640 1 -- 172.21.15.2:0/1535057882 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f646c005500 con 0x55e30d993680 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f6464ff9640 1 -- 172.21.15.2:0/1535057882 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6474029410 con 0x55e30d993680 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f6485d59740 10 client.25739 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f6485d59740 10 client.25739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f6485d59740 20 client.25739 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:15.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f6485d59740 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e30d9a3030 0x55e30d9a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f6485d59740 4 client.25739 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:15.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f6485d59740 1 -- 172.21.15.2:0/1535057882 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e30d8fb850 con 0x55e30d9a3030 2024-09-12T00:56:15.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.233+0000 7f648171c640 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e30d9a3030 0x55e30d9a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.234+0000 7f648171c640 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e30d9a3030 0x55e30d9a54d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=678d07c119bdb340 server_cookie=c7271c4c94ccb062 in_seq=0 out_seq=0 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.234+0000 7f6464ff9640 10 client.25739 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6464ff9640 1 -- 172.21.15.2:0/1535057882 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e30d8fb850 con 0x55e30d9a3030 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6464ff9640 10 client.25739 handle_command_reply: tid=0 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 client.25739 shutdown 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 -- 172.21.15.2:0/1535057882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 msgr2=0x55e30d990750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d990750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6474010c90 tx=0x7f6474004ab0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 -- 172.21.15.2:0/1535057882 shutdown_connections 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e30d9a3030 0x55e30d9a54d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d993680 0x55e30d990750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d988dc0 0x55e30d990210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 --2- 172.21.15.2:0/1535057882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d9884a0 0x55e30d992f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6464ff9640 0 client.25739 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:15.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 -- 172.21.15.2:0/1535057882 >> 172.21.15.2:0/1535057882 conn(0x55e30d984a30 msgr2=0x55e30d98a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:15.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 -- 172.21.15.2:0/1535057882 shutdown_connections 2024-09-12T00:56:15.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 1 -- 172.21.15.2:0/1535057882 wait complete. 2024-09-12T00:56:15.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.235+0000 7f6485d59740 20 client.25739 trim_cache size 0 max 16384 2024-09-12T00:56:15.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.254+0000 7f6485d59740 1 Processor -- start 2024-09-12T00:56:15.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.254+0000 7f6485d59740 1 -- start start 2024-09-12T00:56:15.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6485d59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d99f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6485d59740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d98a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6485d59740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d9aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6485d59740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1ae0d0 con 0x55e30d993680 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6485d59740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1ab9a0 con 0x55e30d988dc0 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6485d59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1a97f0 con 0x55e30d9884a0 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6481f1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d9aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f648171c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d99f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6481f1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d9aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36914/0 (socket says 172.21.15.2:36914) 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6481f1d640 1 -- 172.21.15.2:0/4258467307 learned_addr learned my addr 172.21.15.2:0/4258467307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6480f1b640 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d98a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f648171c640 1 -- 172.21.15.2:0/4258467307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 msgr2=0x55e30d98a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f648171c640 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d98a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f648171c640 1 -- 172.21.15.2:0/4258467307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 msgr2=0x55e30d9aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f648171c640 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d9aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f648171c640 1 -- 172.21.15.2:0/4258467307 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30d9a5b50 con 0x55e30d9884a0 2024-09-12T00:56:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.255+0000 7f6481f1d640 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d9aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f648171c640 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d99f4b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64780ed6b0 tx=0x7f647802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260bf1081bcb6ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6466ffd640 1 -- 172.21.15.2:0/4258467307 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64780efe60 con 0x55e30d9884a0 2024-09-12T00:56:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6466ffd640 1 -- 172.21.15.2:0/4258467307 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f647803b580 con 0x55e30d9884a0 2024-09-12T00:56:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6466ffd640 1 -- 172.21.15.2:0/4258467307 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478049040 con 0x55e30d9884a0 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6485d59740 1 -- 172.21.15.2:0/4258467307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 msgr2=0x55e30d99f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6485d59740 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d99f4b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64780ed6b0 tx=0x7f647802a410 comp rx=0 tx=0).stop 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6485d59740 1 -- 172.21.15.2:0/4258467307 shutdown_connections 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6485d59740 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d9aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6485d59740 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d98a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6485d59740 1 --2- 172.21.15.2:0/4258467307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d99f4b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.256+0000 7f6485d59740 1 -- 172.21.15.2:0/4258467307 >> 172.21.15.2:0/4258467307 conn(0x55e30d984a30 msgr2=0x55e30d989ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.257+0000 7f6485d59740 1 -- 172.21.15.2:0/4258467307 shutdown_connections 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.257+0000 7f6485d59740 1 -- 172.21.15.2:0/4258467307 wait complete. 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.257+0000 7f6485d59740 1 -- start start 2024-09-12T00:56:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.257+0000 7f6485d59740 1 Processor -- start 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.257+0000 7f6485d59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d997490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.257+0000 7f6485d59740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d9979d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6485d59740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d997f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6485d59740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1a9e60 con 0x55e30d993680 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6485d59740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1ab2d0 con 0x55e30d988dc0 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6485d59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1aa530 con 0x55e30d9884a0 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6485d59740 10 client.0 _ll_register_callbacks cb 0x7f647400a8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6480f1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d9979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6480f1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d9979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:53886/0 (socket says 172.21.15.2:53886) 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6480f1b640 1 -- 172.21.15.2:0/3211533053 learned_addr learned my addr 172.21.15.2:0/3211533053 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f648171c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d997490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6481f1d640 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d997f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f648171c640 1 -- 172.21.15.2:0/3211533053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 msgr2=0x55e30d9979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f648171c640 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d9979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f648171c640 1 -- 172.21.15.2:0/3211533053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 msgr2=0x55e30d997f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f648171c640 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d997f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f648171c640 1 -- 172.21.15.2:0/3211533053 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e30da0ce90 con 0x55e30d9884a0 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6480f1b640 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d9979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f648171c640 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d997490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55e30d9961b0 tx=0x7f6478032ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e833922e82b9cd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6464ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.258+0000 7f6464ff9640 1 -- 172.21.15.2:0/3211533053 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64780efe60 con 0x55e30d9884a0 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6464ff9640 1 -- 172.21.15.2:0/3211533053 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f64780ed330 con 0x55e30d9884a0 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 1 -- 172.21.15.2:0/3211533053 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e30d8f5d60 con 0x55e30d9884a0 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6464ff9640 1 -- 172.21.15.2:0/3211533053 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6478049070 con 0x55e30d9884a0 2024-09-12T00:56:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 10 client.25669 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 1 -- 172.21.15.2:0/3211533053 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e30da0e180 con 0x55e30d9884a0 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6464ff9640 1 -- 172.21.15.2:0/3211533053 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e30d8f5d60 con 0x55e30d9884a0 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6464ff9640 1 -- 172.21.15.2:0/3211533053 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f64780b85b0 con 0x55e30d9884a0 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 10 client.25669 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 10 client.25669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 20 client.25669 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e30da0e8c0 0x55e30da10ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 4 client.25669 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6485d59740 1 -- 172.21.15.2:0/3211533053 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e30d872210 con 0x55e30da0e8c0 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.259+0000 7f6480f1b640 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e30da0e8c0 0x55e30da10ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6464ff9640 10 client.25669 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6480f1b640 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e30da0e8c0 0x55e30da10ce0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c82b0a4de537c5 server_cookie=92ce45677d26688c in_seq=0 out_seq=0 2024-09-12T00:56:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6464ff9640 1 -- 172.21.15.2:0/3211533053 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e30d872210 con 0x55e30da0e8c0 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6464ff9640 10 client.25669 handle_command_reply: tid=0 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 client.25669 shutdown 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 -- 172.21.15.2:0/3211533053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 msgr2=0x55e30d997490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d997490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55e30d9961b0 tx=0x7f6478032ae0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 -- 172.21.15.2:0/3211533053 shutdown_connections 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e30da0e8c0 0x55e30da10ce0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e30d993680 0x55e30d997f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e30d988dc0 0x55e30d9979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6464ff9640 0 client.25669 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 --2- 172.21.15.2:0/3211533053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e30d9884a0 0x55e30d997490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 -- 172.21.15.2:0/3211533053 >> 172.21.15.2:0/3211533053 conn(0x55e30d984a30 msgr2=0x55e30d992290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 -- 172.21.15.2:0/3211533053 shutdown_connections 2024-09-12T00:56:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.260+0000 7f6485d59740 1 -- 172.21.15.2:0/3211533053 wait complete. 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6485d59740 20 client.25669 trim_cache size 0 max 16384 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout: "bde3637f-c78e-49f7-87d2-e3e089e07e1e": { 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "bde3637f-c78e-49f7-87d2-e3e089e07e1e", 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:15.265 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:15.266 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:56:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 -- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 msgr2=0x7f64680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f647400ae90 tx=0x7f647400a4d0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 -- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 msgr2=0x7f647c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 0x7f647c198430 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6478006010 tx=0x7f64780042f0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 -- 172.21.15.2:0/795737226 shutdown_connections 2024-09-12T00:56:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c106f10 0x7f647c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c102790 0x7f647c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 --2- 172.21.15.2:0/795737226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c101de0 0x7f647c198430 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 -- 172.21.15.2:0/795737226 >> 172.21.15.2:0/795737226 conn(0x7f647c0fd8c0 msgr2=0x7f647c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 -- 172.21.15.2:0/795737226 shutdown_connections 2024-09-12T00:56:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:15.261+0000 7f6483980640 1 -- 172.21.15.2:0/795737226 wait complete. 2024-09-12T00:56:15.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:14 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:56:15.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:14 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:15.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:14 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:56:15.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:14 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:56:15.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:14 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:15.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:14 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:56:15.288 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:14 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:15.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:14 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:56:15.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:14 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:15.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:14 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:56:15.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:14 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:56:15.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:14 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:15.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:14 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:56:15.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:14 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:16.083 INFO:tasks.cephfs.filesystem:scrub status for tag:bde3637f-c78e-49f7-87d2-e3e089e07e1e - {'path': '/', 'tag': 'bde3637f-c78e-49f7-87d2-e3e089e07e1e', 'options': 'recursive,force'} 2024-09-12T00:56:16.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:15 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:16.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:15 smithi002 ceph-mon[31210]: pgmap v103: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 358 op/s 2024-09-12T00:56:16.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:15 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:16.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:15 smithi167 ceph-mon[35234]: pgmap v103: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 358 op/s 2024-09-12T00:56:16.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:15 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:56:16.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:15 smithi071 ceph-mon[35276]: pgmap v103: 97 pgs: 97 active+clean; 100 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 358 op/s 2024-09-12T00:56:18.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:17 smithi002 ceph-mon[31210]: pgmap v104: 97 pgs: 97 active+clean; 103 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 593 op/s 2024-09-12T00:56:18.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:17 smithi167 ceph-mon[35234]: pgmap v104: 97 pgs: 97 active+clean; 103 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 593 op/s 2024-09-12T00:56:18.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:17 smithi071 ceph-mon[35276]: pgmap v104: 97 pgs: 97 active+clean; 103 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 593 op/s 2024-09-12T00:56:20.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:19 smithi167 ceph-mon[35234]: pgmap v105: 97 pgs: 97 active+clean; 103 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 504 op/s 2024-09-12T00:56:20.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:19 smithi071 ceph-mon[35276]: pgmap v105: 97 pgs: 97 active+clean; 103 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 504 op/s 2024-09-12T00:56:20.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:19 smithi002 ceph-mon[31210]: pgmap v105: 97 pgs: 97 active+clean; 103 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 504 op/s 2024-09-12T00:56:22.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:21 smithi167 ceph-mon[35234]: pgmap v106: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.9 MiB/s wr, 724 op/s 2024-09-12T00:56:22.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:21 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:56:22.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:21 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:56:22.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:21 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:56:22.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:21 smithi071 ceph-mon[35276]: pgmap v106: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.9 MiB/s wr, 724 op/s 2024-09-12T00:56:22.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:21 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:56:22.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:21 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:56:22.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:21 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:56:22.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:21 smithi002 ceph-mon[31210]: pgmap v106: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.9 MiB/s wr, 724 op/s 2024-09-12T00:56:22.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:21 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:56:22.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:21 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:56:22.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:21 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:56:23.729 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0xffdb8 2024-09-12T00:56:24.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:24 smithi167 ceph-mon[35234]: pgmap v107: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 454 op/s 2024-09-12T00:56:24.296 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:24 smithi002 ceph-mon[31210]: pgmap v107: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 454 op/s 2024-09-12T00:56:24.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:24 smithi071 ceph-mon[35276]: pgmap v107: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 454 op/s 2024-09-12T00:56:26.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:26 smithi167 ceph-mon[35234]: pgmap v108: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 454 op/s 2024-09-12T00:56:26.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:26 smithi071 ceph-mon[35276]: pgmap v108: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 454 op/s 2024-09-12T00:56:26.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:26 smithi002 ceph-mon[31210]: pgmap v108: 97 pgs: 97 active+clean; 106 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 454 op/s 2024-09-12T00:56:28.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:28 smithi167 ceph-mon[35234]: pgmap v109: 97 pgs: 97 active+clean; 108 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 656 op/s 2024-09-12T00:56:28.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:28 smithi071 ceph-mon[35276]: pgmap v109: 97 pgs: 97 active+clean; 108 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 656 op/s 2024-09-12T00:56:28.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:28 smithi002 ceph-mon[31210]: pgmap v109: 97 pgs: 97 active+clean; 108 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 656 op/s 2024-09-12T00:56:30.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:30 smithi167 ceph-mon[35234]: pgmap v110: 97 pgs: 97 active+clean; 108 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 420 op/s 2024-09-12T00:56:30.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:30 smithi071 ceph-mon[35276]: pgmap v110: 97 pgs: 97 active+clean; 108 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 420 op/s 2024-09-12T00:56:30.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:30 smithi002 ceph-mon[31210]: pgmap v110: 97 pgs: 97 active+clean; 108 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 420 op/s 2024-09-12T00:56:32.150 INFO:tasks.workunit.client.0.smithi002.stdout:50000 copy from 0x898b8 to 0x92015, (0x875d bytes) at 0xb142c 2024-09-12T00:56:32.150 INFO:tasks.workunit.client.0.smithi002.stdout:All 50000 operations completed A-OK! 2024-09-12T00:56:32.153 INFO:tasks.workunit.client.0.smithi002.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-12T00:56:32.155 INFO:tasks.workunit.client.0.smithi002.stdout:Seed set to 1 2024-09-12T00:56:32.285 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-12T00:56:32.285 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-12T00:56:32.285 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-12T00:56:32.285 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-12T00:56:32.285 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support clone range, disabling! 2024-09-12T00:56:32.286 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-12T00:56:32.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:32 smithi167 ceph-mon[35234]: pgmap v111: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 620 op/s 2024-09-12T00:56:32.287 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero length punch hole 2024-09-12T00:56:32.287 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero length punch hole 2024-09-12T00:56:32.287 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero length punch hole 2024-09-12T00:56:32.288 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero size read 2024-09-12T00:56:32.288 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support exchange range, disabling! 2024-09-12T00:56:32.288 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero length punch hole 2024-09-12T00:56:32.288 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero size read 2024-09-12T00:56:32.288 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero length punch hole 2024-09-12T00:56:32.288 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x4310e9 2024-09-12T00:56:32.292 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0x954a45 2024-09-12T00:56:32.319 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x9bc582 2024-09-12T00:56:32.340 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x9eecbc 2024-09-12T00:56:32.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:32 smithi071 ceph-mon[35276]: pgmap v111: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 620 op/s 2024-09-12T00:56:32.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:32 smithi002 ceph-mon[31210]: pgmap v111: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 620 op/s 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0x9fdd84 2024-09-12T00:56:34.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:34 smithi167 ceph-mon[35234]: pgmap v112: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 401 op/s 2024-09-12T00:56:34.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:34 smithi071 ceph-mon[35276]: pgmap v112: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 401 op/s 2024-09-12T00:56:34.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:34 smithi002 ceph-mon[31210]: pgmap v112: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 401 op/s 2024-09-12T00:56:36.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:36 smithi167 ceph-mon[35234]: pgmap v113: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 401 op/s 2024-09-12T00:56:36.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:36 smithi071 ceph-mon[35276]: pgmap v113: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 401 op/s 2024-09-12T00:56:36.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:36 smithi002 ceph-mon[31210]: pgmap v113: 97 pgs: 97 active+clean; 112 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 401 op/s 2024-09-12T00:56:38.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:38 smithi167 ceph-mon[35234]: pgmap v114: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.4 MiB/s wr, 747 op/s 2024-09-12T00:56:38.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:38 smithi071 ceph-mon[35276]: pgmap v114: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.4 MiB/s wr, 747 op/s 2024-09-12T00:56:38.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:38 smithi002 ceph-mon[31210]: pgmap v114: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.4 MiB/s wr, 747 op/s 2024-09-12T00:56:40.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:40 smithi167 ceph-mon[35234]: pgmap v115: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.2 MiB/s wr, 545 op/s 2024-09-12T00:56:40.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:40 smithi071 ceph-mon[35276]: pgmap v115: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.2 MiB/s wr, 545 op/s 2024-09-12T00:56:40.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:40 smithi002 ceph-mon[31210]: pgmap v115: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.2 MiB/s wr, 545 op/s 2024-09-12T00:56:42.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:42 smithi167 ceph-mon[35234]: pgmap v116: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.4 MiB/s wr, 925 op/s 2024-09-12T00:56:42.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:42 smithi071 ceph-mon[35276]: pgmap v116: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.4 MiB/s wr, 925 op/s 2024-09-12T00:56:42.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:42 smithi002 ceph-mon[31210]: pgmap v116: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.4 MiB/s wr, 925 op/s 2024-09-12T00:56:43.420 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0x9ff773 2024-09-12T00:56:43.820 INFO:tasks.workunit.client.0.smithi002.stdout:20000 punch from 0x34ddcb to 0x35324f, (0x5484 bytes) 2024-09-12T00:56:44.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:44 smithi167 ceph-mon[35234]: pgmap v117: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 4.1 MiB/s wr, 725 op/s 2024-09-12T00:56:44.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:44 smithi071 ceph-mon[35276]: pgmap v117: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 4.1 MiB/s wr, 725 op/s 2024-09-12T00:56:44.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:44 smithi002 ceph-mon[31210]: pgmap v117: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 4.1 MiB/s wr, 725 op/s 2024-09-12T00:56:46.085 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:56:46.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:46 smithi167 ceph-mon[35234]: pgmap v118: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 4.1 MiB/s wr, 725 op/s 2024-09-12T00:56:46.374 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:46.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:46 smithi071 ceph-mon[35276]: pgmap v118: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 4.1 MiB/s wr, 725 op/s 2024-09-12T00:56:46.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:46 smithi002 ceph-mon[31210]: pgmap v118: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 4.1 MiB/s wr, 725 op/s 2024-09-12T00:56:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 -- 172.21.15.2:0/267745054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1082a0 msgr2=0x7f28ec10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 --2- 172.21.15.2:0/267745054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1082a0 0x7f28ec10ec40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009cd0 tx=0x7f28e402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 -- 172.21.15.2:0/267745054 shutdown_connections 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 --2- 172.21.15.2:0/267745054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1082a0 0x7f28ec10ec40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 --2- 172.21.15.2:0/267745054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ec1036e0 0x7f28ec107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 --2- 172.21.15.2:0/267745054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec102d30 0x7f28ec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 -- 172.21.15.2:0/267745054 >> 172.21.15.2:0/267745054 conn(0x7f28ec0fc7d0 msgr2=0x7f28ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 -- 172.21.15.2:0/267745054 shutdown_connections 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.919+0000 7f28f360c640 1 -- 172.21.15.2:0/267745054 wait complete. 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.920+0000 7f28f360c640 1 Processor -- start 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.920+0000 7f28f360c640 1 -- start start 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f360c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ec102d30 0x7f28ec100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f360c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1036e0 0x7f28ec100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f360c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec1082a0 0x7f28ec101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f360c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1120a0 con 0x7f28ec1036e0 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f360c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec111f20 con 0x7f28ec1082a0 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f360c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec112220 con 0x7f28ec102d30 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1036e0 0x7f28ec100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f13a8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ec102d30 0x7f28ec100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1036e0 0x7f28ec100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60950/0 (socket says 172.21.15.2:60950) 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 -- 172.21.15.2:0/1189166167 learned_addr learned my addr 172.21.15.2:0/1189166167 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec1082a0 0x7f28ec101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 -- 172.21.15.2:0/1189166167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ec102d30 msgr2=0x7f28ec100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ec102d30 0x7f28ec100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 -- 172.21.15.2:0/1189166167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec1082a0 msgr2=0x7f28ec101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec1082a0 0x7f28ec101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 -- 172.21.15.2:0/1189166167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec1a6a00 con 0x7f28ec1036e0 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec1082a0 0x7f28ec101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f13a8640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ec102d30 0x7f28ec100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.921+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1036e0 0x7f28ec100ed0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00d950 tx=0x7f28dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.922+0000 7f28e27fc640 1 -- 172.21.15.2:0/1189166167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc017070 con 0x7f28ec1036e0 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.922+0000 7f28f360c640 1 -- 172.21.15.2:0/1189166167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec1a6cf0 con 0x7f28ec1036e0 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.922+0000 7f28e27fc640 1 -- 172.21.15.2:0/1189166167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28dc009c30 con 0x7f28ec1036e0 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.922+0000 7f28e27fc640 1 -- 172.21.15.2:0/1189166167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0047a0 con 0x7f28ec1036e0 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.922+0000 7f28f360c640 1 -- 172.21.15.2:0/1189166167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec1a7220 con 0x7f28ec1036e0 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.924+0000 7f28e27fc640 1 -- 172.21.15.2:0/1189166167 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f28dc004020 con 0x7f28ec1036e0 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.925+0000 7f28e27fc640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28d80a2cf0 0x7f28d80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.925+0000 7f28f59e5740 1 Processor -- start 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.925+0000 7f28f59e5740 1 -- start start 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.925+0000 7f28e27fc640 1 -- 172.21.15.2:0/1189166167 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f28dc0cf0c0 con 0x7f28ec1036e0 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f13a8640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28d80a2cf0 0x7f28d80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68e8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68f3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68f3680 0x5606a68f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f59e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5606a684e2e0 con 0x5606a68e84a0 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f59e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5606a67f5ce0 con 0x5606a68f3680 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f59e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5606a684a2a0 con 0x5606a68e8dc0 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f1ba9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68f3680 0x5606a68f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f13a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68e8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f1ba9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68f3680 0x5606a68f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60566/0 (socket says 172.21.15.2:60566) 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f1ba9640 1 -- 172.21.15.2:0/3860091967 learned_addr learned my addr 172.21.15.2:0/3860091967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.926+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28f1ba9640 1 -- 172.21.15.2:0/3860091967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 msgr2=0x5606a68f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28f1ba9640 1 -- 172.21.15.2:0/3860091967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 msgr2=0x5606a68e8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68e8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28f1ba9640 1 -- 172.21.15.2:0/3860091967 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a67da440 con 0x5606a68f3680 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28f13a8640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28d80a2cf0 0x7f28d80a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f28e800bfd0 tx=0x7f28e8014cf0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68f3680 0x5606a68f5a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009430 tx=0x7f28e4009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2f09d9f1a3955d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28d77fe640 1 -- 172.21.15.2:0/3860091967 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40318c0 con 0x5606a68f3680 2024-09-12T00:56:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28d77fe640 1 -- 172.21.15.2:0/3860091967 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28e4036040 con 0x5606a68f3680 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.927+0000 7f28d77fe640 1 -- 172.21.15.2:0/3860091967 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4004570 con 0x5606a68f3680 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 -- 172.21.15.2:0/3860091967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68f3680 msgr2=0x5606a68f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68f3680 0x5606a68f5a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009430 tx=0x7f28e4009a20 comp rx=0 tx=0).stop 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 -- 172.21.15.2:0/3860091967 shutdown_connections 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68f3680 0x5606a68f5a70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 --2- 172.21.15.2:0/3860091967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68e8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 -- 172.21.15.2:0/3860091967 >> 172.21.15.2:0/3860091967 conn(0x5606a68e4a30 msgr2=0x5606a68e4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 -- 172.21.15.2:0/3860091967 shutdown_connections 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 -- 172.21.15.2:0/3860091967 wait complete. 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 -- start start 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.928+0000 7f28f59e5740 1 Processor -- start 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e8dc0 0x5606a68f0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68f3680 0x5606a68f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f59e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5606a68f6250 con 0x5606a68e84a0 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f59e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5606a6809050 con 0x5606a68e8dc0 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f59e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5606a68f63d0 con 0x5606a68f3680 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f59e5740 10 client.0 _ll_register_callbacks cb 0x5606a6849160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f13a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f0ba7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e8dc0 0x5606a68f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f13a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68f2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60968/0 (socket says 172.21.15.2:60968) 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f13a8640 1 -- 172.21.15.2:0/200606629 learned_addr learned my addr 172.21.15.2:0/200606629 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68f3680 0x5606a68f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f13a8640 1 -- 172.21.15.2:0/200606629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68f3680 msgr2=0x5606a68f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f13a8640 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68f3680 0x5606a68f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f13a8640 1 -- 172.21.15.2:0/200606629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e8dc0 msgr2=0x5606a68f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f13a8640 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e8dc0 0x5606a68f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f13a8640 1 -- 172.21.15.2:0/200606629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a65bf3c0 con 0x5606a68e84a0 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.929+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e8dc0 0x5606a68f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28f13a8640 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68f2f70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f28e8014170 tx=0x7f28e801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa137f6d43dbb0ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28d4ff9640 1 -- 172.21.15.2:0/200606629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8012950 con 0x5606a68e84a0 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28f59e5740 1 -- 172.21.15.2:0/200606629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e4036040 con 0x5606a68e84a0 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28d4ff9640 1 -- 172.21.15.2:0/200606629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f28e8012af0 con 0x5606a68e84a0 2024-09-12T00:56:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28d4ff9640 1 -- 172.21.15.2:0/200606629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28e8012cf0 con 0x5606a68e84a0 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28f59e5740 10 client.16110 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28f59e5740 1 -- 172.21.15.2:0/200606629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5606a6901bc0 con 0x5606a68e84a0 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28d4ff9640 1 -- 172.21.15.2:0/200606629 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28e4036040 con 0x5606a68e84a0 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28d4ff9640 1 -- 172.21.15.2:0/200606629 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f28e8004c70 con 0x5606a68e84a0 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28f59e5740 10 client.16110 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28f59e5740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.930+0000 7f28f59e5740 20 client.16110 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.931+0000 7f28f59e5740 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5606a6903080 0x5606a69054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.931+0000 7f28f59e5740 4 client.16110 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.931+0000 7f28f59e5740 1 -- 172.21.15.2:0/200606629 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606a685b850 con 0x5606a6903080 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.931+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5606a6903080 0x5606a69054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.931+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5606a6903080 0x5606a69054d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2f659162acfbd4d server_cookie=441057a389934c2d in_seq=0 out_seq=0 2024-09-12T00:56:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.931+0000 7f28d4ff9640 10 client.16110 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.932+0000 7f28d4ff9640 1 -- 172.21.15.2:0/200606629 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606a685b850 con 0x5606a6903080 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.932+0000 7f28d4ff9640 10 client.16110 handle_command_reply: tid=0 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.932+0000 7f28f59e5740 1 client.16110 shutdown 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 -- 172.21.15.2:0/200606629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 msgr2=0x5606a68f2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68f2f70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f28e8014170 tx=0x7f28e801a000 comp rx=0 tx=0).stop 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 -- 172.21.15.2:0/200606629 shutdown_connections 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5606a6903080 0x5606a69054d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68f3680 0x5606a68f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28d4ff9640 0 client.16110 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e8dc0 0x5606a68f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 --2- 172.21.15.2:0/200606629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68f2f70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 -- 172.21.15.2:0/200606629 >> 172.21.15.2:0/200606629 conn(0x5606a68e4a30 msgr2=0x5606a68ea760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 -- 172.21.15.2:0/200606629 shutdown_connections 2024-09-12T00:56:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 1 -- 172.21.15.2:0/200606629 wait complete. 2024-09-12T00:56:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.933+0000 7f28f59e5740 20 client.16110 trim_cache size 0 max 16384 2024-09-12T00:56:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f59e5740 1 Processor -- start 2024-09-12T00:56:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f59e5740 1 -- start start 2024-09-12T00:56:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68ff4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68eb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68e3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f59e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1b25a0 con 0x5606a68e84a0 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f59e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1afe70 con 0x5606a68e4a30 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f59e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1adcc0 con 0x5606a68e8dc0 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f0ba7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f0ba7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68eb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60982/0 (socket says 172.21.15.2:60982) 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f13a8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68ff4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f0ba7640 1 -- 172.21.15.2:0/2319618708 learned_addr learned my addr 172.21.15.2:0/2319618708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.953+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68e3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28f13a8640 1 -- 172.21.15.2:0/2319618708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 msgr2=0x5606a68e3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28f13a8640 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68e3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28f13a8640 1 -- 172.21.15.2:0/2319618708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 msgr2=0x5606a68eb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28f13a8640 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68eb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28f13a8640 1 -- 172.21.15.2:0/2319618708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a68e4860 con 0x5606a68e4a30 2024-09-12T00:56:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28f13a8640 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68ff4b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28e8016010 tx=0x7f28e80058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8137280f1373916c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28d6ffd640 1 -- 172.21.15.2:0/2319618708 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8035070 con 0x5606a68e4a30 2024-09-12T00:56:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28d6ffd640 1 -- 172.21.15.2:0/2319618708 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28e800bc20 con 0x5606a68e4a30 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.954+0000 7f28d6ffd640 1 -- 172.21.15.2:0/2319618708 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8012820 con 0x5606a68e4a30 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 -- 172.21.15.2:0/2319618708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 msgr2=0x5606a68ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68ff4b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28e8016010 tx=0x7f28e80058d0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 -- 172.21.15.2:0/2319618708 shutdown_connections 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e8dc0 0x5606a68e3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e84a0 0x5606a68eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 --2- 172.21.15.2:0/2319618708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68ff4b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 -- 172.21.15.2:0/2319618708 >> 172.21.15.2:0/2319618708 conn(0x5606a68e54b0 msgr2=0x5606a68e3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 -- 172.21.15.2:0/2319618708 shutdown_connections 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.955+0000 7f28f59e5740 1 -- 172.21.15.2:0/2319618708 wait complete. 2024-09-12T00:56:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 1 -- start start 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 1 Processor -- start 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e84a0 0x5606a68f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e8dc0 0x5606a68f7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1ae330 con 0x5606a68e8dc0 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1af7a0 con 0x5606a68e4a30 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1aea00 con 0x5606a68e84a0 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.956+0000 7f28f59e5740 10 client.0 _ll_register_callbacks cb 0x7f28e8014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f0ba7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e84a0 0x5606a68f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68fbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60596/0 (socket says 172.21.15.2:60596) 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 -- 172.21.15.2:0/1919607433 learned_addr learned my addr 172.21.15.2:0/1919607433 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e8dc0 0x5606a68f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 -- 172.21.15.2:0/1919607433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e84a0 msgr2=0x5606a68f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e84a0 0x5606a68f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 -- 172.21.15.2:0/1919607433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e8dc0 msgr2=0x5606a68f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e8dc0 0x5606a68f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 -- 172.21.15.2:0/1919607433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a68f7a70 con 0x5606a68e4a30 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f1ba9640 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e8dc0 0x5606a68f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e84a0 0x5606a68f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f13a8640 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68fbbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28e80143d0 tx=0x7f28e8029bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf10ba440a55b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:56:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28d4ff9640 1 -- 172.21.15.2:0/1919607433 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8035040 con 0x5606a68e4a30 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28d4ff9640 1 -- 172.21.15.2:0/1919607433 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f28e8012a30 con 0x5606a68e4a30 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.957+0000 7f28f59e5740 1 -- 172.21.15.2:0/1919607433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606a68f0af0 con 0x5606a68e4a30 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28d4ff9640 1 -- 172.21.15.2:0/1919607433 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28e8005040 con 0x5606a68e4a30 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f59e5740 10 client.25763 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f59e5740 1 -- 172.21.15.2:0/1919607433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5606a696dbd0 con 0x5606a68e4a30 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28d4ff9640 1 -- 172.21.15.2:0/1919607433 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5606a68f0af0 con 0x5606a68e4a30 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28d4ff9640 1 -- 172.21.15.2:0/1919607433 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f28e802bce0 con 0x5606a68e4a30 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f59e5740 10 client.25763 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f59e5740 10 client.25763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f59e5740 20 client.25763 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f59e5740 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5606a68f3680 0x5606a6970240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f59e5740 4 client.25763 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f59e5740 1 -- 172.21.15.2:0/1919607433 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5606a6855d60 con 0x5606a68f3680 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.958+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5606a68f3680 0x5606a6970240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28d4ff9640 10 client.25763 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f0ba7640 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5606a68f3680 0x5606a6970240 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d1c9607eb0bd29a server_cookie=d779ea45ac22f7c0 in_seq=0 out_seq=0 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28d4ff9640 1 -- 172.21.15.2:0/1919607433 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5606a6855d60 con 0x5606a68f3680 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28d4ff9640 10 client.25763 handle_command_reply: tid=0 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 client.25763 shutdown 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 -- 172.21.15.2:0/1919607433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 msgr2=0x5606a68fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68fbbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28e80143d0 tx=0x7f28e8029bd0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 -- 172.21.15.2:0/1919607433 shutdown_connections 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5606a68f3680 0x5606a6970240 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5606a68e8dc0 0x5606a68f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a68e84a0 0x5606a68f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28d4ff9640 0 client.25763 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 --2- 172.21.15.2:0/1919607433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5606a68e4a30 0x5606a68fbbc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.959+0000 7f28f59e5740 1 -- 172.21.15.2:0/1919607433 >> 172.21.15.2:0/1919607433 conn(0x5606a68e54b0 msgr2=0x5606a68f1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.960+0000 7f28f59e5740 1 -- 172.21.15.2:0/1919607433 shutdown_connections 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.960+0000 7f28f59e5740 1 -- 172.21.15.2:0/1919607433 wait complete. 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.960+0000 7f28f59e5740 20 client.25763 trim_cache size 0 max 16384 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:56:46.965 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.960+0000 7f28f360c640 1 -- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28d80a2cf0 msgr2=0x7f28d80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.960+0000 7f28f360c640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28d80a2cf0 0x7f28d80a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f28e800bfd0 tx=0x7f28e8014cf0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.960+0000 7f28f360c640 1 -- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1036e0 msgr2=0x7f28ec100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.960+0000 7f28f360c640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1036e0 0x7f28ec100ed0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00d950 tx=0x7f28dc00de10 comp rx=0 tx=0).stop 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.961+0000 7f28f360c640 1 -- 172.21.15.2:0/1189166167 shutdown_connections 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.961+0000 7f28f360c640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28d80a2cf0 0x7f28d80a51b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.961+0000 7f28f360c640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec1082a0 0x7f28ec101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.961+0000 7f28f360c640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec1036e0 0x7f28ec100ed0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.961+0000 7f28f360c640 1 --2- 172.21.15.2:0/1189166167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ec102d30 0x7f28ec100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:46.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.961+0000 7f28f360c640 1 -- 172.21.15.2:0/1189166167 >> 172.21.15.2:0/1189166167 conn(0x7f28ec0fc7d0 msgr2=0x7f28ec105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:46.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.961+0000 7f28f360c640 1 -- 172.21.15.2:0/1189166167 shutdown_connections 2024-09-12T00:56:46.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:46.961+0000 7f28f360c640 1 -- 172.21.15.2:0/1189166167 wait complete. 2024-09-12T00:56:48.004 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:56:48.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:56:48.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:48 smithi002 ceph-mon[31210]: pgmap v119: 97 pgs: 97 active+clean; 126 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.2 MiB/s wr, 1.08k op/s 2024-09-12T00:56:48.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:48 smithi167 ceph-mon[35234]: pgmap v119: 97 pgs: 97 active+clean; 126 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.2 MiB/s wr, 1.08k op/s 2024-09-12T00:56:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:48.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:48 smithi071 ceph-mon[35276]: pgmap v119: 97 pgs: 97 active+clean; 126 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.2 MiB/s wr, 1.08k op/s 2024-09-12T00:56:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 -- 172.21.15.2:0/665076142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528102790 msgr2=0x7f95281067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 --2- 172.21.15.2:0/665076142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528102790 0x7f95281067e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9518009900 tx=0x7f951802a410 comp rx=0 tx=0).stop 2024-09-12T00:56:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 -- 172.21.15.2:0/665076142 shutdown_connections 2024-09-12T00:56:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 --2- 172.21.15.2:0/665076142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9528106f10 0x7f952810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 --2- 172.21.15.2:0/665076142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528102790 0x7f95281067e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 --2- 172.21.15.2:0/665076142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9528101de0 0x7f95281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 -- 172.21.15.2:0/665076142 >> 172.21.15.2:0/665076142 conn(0x7f95280fd8c0 msgr2=0x7f95280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 -- 172.21.15.2:0/665076142 shutdown_connections 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 -- 172.21.15.2:0/665076142 wait complete. 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.793+0000 7f952fbc0640 1 Processor -- start 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952fbc0640 1 -- start start 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952fbc0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9528101de0 0x7f9528198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952fbc0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9528102790 0x7f9528198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952fbc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528106f10 0x7f952819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952fbc0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9528111f80 con 0x7f9528106f10 2024-09-12T00:56:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952fbc0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9528111e00 con 0x7f9528101de0 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952fbc0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9528112100 con 0x7f9528102790 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952e15d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528106f10 0x7f952819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952e15d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528106f10 0x7f952819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32776/0 (socket says 172.21.15.2:32776) 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952e15d640 1 -- 172.21.15.2:0/3252173279 learned_addr learned my addr 172.21.15.2:0/3252173279 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952d95c640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9528101de0 0x7f9528198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952d15b640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9528102790 0x7f9528198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952e15d640 1 -- 172.21.15.2:0/3252173279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9528102790 msgr2=0x7f9528198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952e15d640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9528102790 0x7f9528198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952e15d640 1 -- 172.21.15.2:0/3252173279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9528101de0 msgr2=0x7f9528198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952e15d640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9528101de0 0x7f9528198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952e15d640 1 -- 172.21.15.2:0/3252173279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952819d3d0 con 0x7f9528106f10 2024-09-12T00:56:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952d15b640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9528102790 0x7f9528198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.794+0000 7f952d95c640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9528101de0 0x7f9528198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.795+0000 7f952e15d640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528106f10 0x7f952819ccf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f952000eb10 tx=0x7f952000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.795+0000 7f951effd640 1 -- 172.21.15.2:0/3252173279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520004b20 con 0x7f9528106f10 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.795+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952819d6c0 con 0x7f9528106f10 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.795+0000 7f951effd640 1 -- 172.21.15.2:0/3252173279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9520004cc0 con 0x7f9528106f10 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.795+0000 7f951effd640 1 -- 172.21.15.2:0/3252173279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520010760 con 0x7f9528106f10 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.795+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95281a4fa0 con 0x7f9528106f10 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.796+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95281021c0 con 0x7f9528106f10 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.797+0000 7f951effd640 1 -- 172.21.15.2:0/3252173279 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f9520005020 con 0x7f9528106f10 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.798+0000 7f951effd640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f95140a2cf0 0x7f95140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.798+0000 7f951effd640 1 -- 172.21.15.2:0/3252173279 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f95200cfaa0 con 0x7f9528106f10 2024-09-12T00:56:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.798+0000 7f952d95c640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f95140a2cf0 0x7f95140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.799+0000 7f952d95c640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f95140a2cf0 0x7f95140a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9524005d00 tx=0x7f952400b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:48.803+0000 7f951effd640 1 -- 172.21.15.2:0/3252173279 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f952009c610 con 0x7f9528106f10 2024-09-12T00:56:49.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.042+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f952802d7c0 con 0x7f9528106f10 2024-09-12T00:56:49.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.043+0000 7f951effd640 1 -- 172.21.15.2:0/3252173279 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7f952009bf10 con 0x7f9528106f10 2024-09-12T00:56:49.042 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:56:49.042 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:56:49.043 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:56:49.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f95140a2cf0 msgr2=0x7f95140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:49.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f95140a2cf0 0x7f95140a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9524005d00 tx=0x7f952400b410 comp rx=0 tx=0).stop 2024-09-12T00:56:49.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528106f10 msgr2=0x7f952819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528106f10 0x7f952819ccf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f952000eb10 tx=0x7f952000c2d0 comp rx=0 tx=0).stop 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 shutdown_connections 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f95140a2cf0 0x7f95140a51b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528106f10 0x7f952819ccf0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9528102790 0x7f9528198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 --2- 172.21.15.2:0/3252173279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9528101de0 0x7f9528198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.045+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 >> 172.21.15.2:0/3252173279 conn(0x7f95280fd8c0 msgr2=0x7f95280fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.046+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 shutdown_connections 2024-09-12T00:56:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:49.046+0000 7f952fbc0640 1 -- 172.21.15.2:0/3252173279 wait complete. 2024-09-12T00:56:49.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:56:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:50.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:50 smithi002 ceph-mon[31210]: pgmap v120: 97 pgs: 97 active+clean; 126 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.3 MiB/s wr, 736 op/s 2024-09-12T00:56:50.233 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:50 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3252173279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:50.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:50 smithi167 ceph-mon[35234]: pgmap v120: 97 pgs: 97 active+clean; 126 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.3 MiB/s wr, 736 op/s 2024-09-12T00:56:50.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:50 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3252173279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:50.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:50 smithi071 ceph-mon[35276]: pgmap v120: 97 pgs: 97 active+clean; 126 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.3 MiB/s wr, 736 op/s 2024-09-12T00:56:50.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:50 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3252173279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/2943508130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102ef0 msgr2=0x7fa3c410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/2943508130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102ef0 0x7fa3c410da40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009900 tx=0x7fa3bc02a480 comp rx=0 tx=0).stop 2024-09-12T00:56:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/2943508130 shutdown_connections 2024-09-12T00:56:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/2943508130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102ef0 0x7fa3c410da40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/2943508130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3c4102570 0x7fa3c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/2943508130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3c4100e20 0x7fa3c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/2943508130 >> 172.21.15.2:0/2943508130 conn(0x7fa3c40fc7d0 msgr2=0x7fa3c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/2943508130 shutdown_connections 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.610+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/2943508130 wait complete. 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3cc3ed640 1 Processor -- start 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3cc3ed640 1 -- start start 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3cc3ed640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3c4100e20 0x7fa3c4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3cc3ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102570 0x7fa3c41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3cc3ed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3c4102ef0 0x7fa3c419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3cc3ed640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4110f80 con 0x7fa3c4102570 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3cc3ed640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4110e00 con 0x7fa3c4100e20 2024-09-12T00:56:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3cc3ed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4111100 con 0x7fa3c4102ef0 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3ca189640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3c4100e20 0x7fa3c4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.611+0000 7fa3c9988640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102570 0x7fa3c41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca189640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3c4100e20 0x7fa3c4198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60628/0 (socket says 172.21.15.2:60628) 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca189640 1 -- 172.21.15.2:0/3094822676 learned_addr learned my addr 172.21.15.2:0/3094822676 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca98a640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3c4102ef0 0x7fa3c419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca189640 1 -- 172.21.15.2:0/3094822676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3c4102ef0 msgr2=0x7fa3c419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca189640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3c4102ef0 0x7fa3c419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca189640 1 -- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102570 msgr2=0x7fa3c41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca189640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102570 0x7fa3c41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca189640 1 -- 172.21.15.2:0/3094822676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c419d420 con 0x7fa3c4100e20 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3c9988640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102570 0x7fa3c41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3ca189640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3c4100e20 0x7fa3c4198470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000db80 tx=0x7fa3c000b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3bb7fe640 1 -- 172.21.15.2:0/3094822676 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0017070 con 0x7fa3c4100e20 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/3094822676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c419d710 con 0x7fa3c4100e20 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3bb7fe640 1 -- 172.21.15.2:0/3094822676 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c0003b70 con 0x7fa3c4100e20 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3bb7fe640 1 -- 172.21.15.2:0/3094822676 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00106c0 con 0x7fa3c4100e20 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.612+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/3094822676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c41a4ff0 con 0x7fa3c4100e20 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.615+0000 7fa3bb7fe640 1 -- 172.21.15.2:0/3094822676 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fa3c0004020 con 0x7fa3c4100e20 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.615+0000 7fa3ce7c6740 1 Processor -- start 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ce7c6740 1 -- start start 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468d9f6b40 0x56468d9f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468d9f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da06b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56468d95b2f0 con 0x56468d9f55d0 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56468d902cf0 con 0x56468da04780 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56468d9572b0 con 0x56468d9f6b40 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ca189640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468d9f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ca189640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468d9f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32794/0 (socket says 172.21.15.2:32794) 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3ca189640 1 -- 172.21.15.2:0/2544628227 learned_addr learned my addr 172.21.15.2:0/2544628227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.616+0000 7fa3c9988640 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da06b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3bb7fe640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa3b00a2cf0 0x7fa3b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3ca189640 1 -- 172.21.15.2:0/2544628227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468d9f6b40 msgr2=0x56468d9f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3ca189640 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468d9f6b40 0x56468d9f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3ca189640 1 -- 172.21.15.2:0/2544628227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 msgr2=0x56468da06b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3ca98a640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa3b00a2cf0 0x7fa3b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3ca189640 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da06b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3ca189640 1 -- 172.21.15.2:0/2544628227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468d8e73a0 con 0x56468d9f55d0 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3c9988640 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da06b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3bb7fe640 1 -- 172.21.15.2:0/3094822676 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fa3c00cf240 con 0x7fa3c4100e20 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3ca189640 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468d9f5a10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00cc8b0 tx=0x7fa3c0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c18ad431fd39f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3ca98a640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa3b00a2cf0 0x7fa3b00a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0096c0 tx=0x7fa3bc031480 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.617+0000 7fa3b8dea640 1 -- 172.21.15.2:0/2544628227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c009b250 con 0x56468d9f55d0 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3b8dea640 1 -- 172.21.15.2:0/2544628227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c009be10 con 0x56468d9f55d0 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3b8dea640 1 -- 172.21.15.2:0/2544628227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0015110 con 0x56468d9f55d0 2024-09-12T00:56:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/2544628227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 msgr2=0x56468d9f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468d9f5a10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00cc8b0 tx=0x7fa3c0020000 comp rx=0 tx=0).stop 2024-09-12T00:56:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/2544628227 shutdown_connections 2024-09-12T00:56:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da06b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468d9f5a10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/2544628227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468d9f6b40 0x56468d9f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/2544628227 >> 172.21.15.2:0/2544628227 conn(0x56468d9be310 msgr2=0x56468d9f1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/2544628227 shutdown_connections 2024-09-12T00:56:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.618+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/2544628227 wait complete. 2024-09-12T00:56:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 1 -- start start 2024-09-12T00:56:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 1 Processor -- start 2024-09-12T00:56:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468da040e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f6b40 0x56468da01390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 0x56468da018f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56468da073c0 con 0x56468d9f6b40 2024-09-12T00:56:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56468d916060 con 0x56468d9f55d0 2024-09-12T00:56:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56468da07540 con 0x56468da04780 2024-09-12T00:56:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3c9988640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f6b40 0x56468da01390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ce7c6740 10 client.0 _ll_register_callbacks cb 0x56468d6698c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3c9988640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f6b40 0x56468da01390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32802/0 (socket says 172.21.15.2:32802) 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3c9988640 1 -- 172.21.15.2:0/85199051 learned_addr learned my addr 172.21.15.2:0/85199051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ca98a640 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 0x56468da018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.619+0000 7fa3ca189640 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468da040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3c9988640 1 -- 172.21.15.2:0/85199051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 msgr2=0x56468da018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3c9988640 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 0x56468da018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3c9988640 1 -- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 msgr2=0x56468da040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3c9988640 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468da040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3c9988640 1 -- 172.21.15.2:0/85199051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468d6cc3c0 con 0x56468d9f6b40 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3ca189640 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468da040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3c9988640 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f6b40 0x56468da01390 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4012d00 tx=0x7fa3b400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390941ef396b5b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3adffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3adffb640 1 -- 172.21.15.2:0/85199051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4009d90 con 0x56468d9f6b40 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/85199051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3c009be10 con 0x56468d9f6b40 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3adffb640 1 -- 172.21.15.2:0/85199051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fa3b40120d0 con 0x56468d9f6b40 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3adffb640 1 -- 172.21.15.2:0/85199051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa3b4010430 con 0x56468d9f6b40 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3ce7c6740 10 client.16134 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.620+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/85199051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56468da12eb0 con 0x56468d9f6b40 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.621+0000 7fa3adffb640 1 -- 172.21.15.2:0/85199051 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c009be10 con 0x56468d9f6b40 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.621+0000 7fa3adffb640 1 -- 172.21.15.2:0/85199051 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa3b401c4f0 con 0x56468d9f6b40 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.621+0000 7fa3ce7c6740 10 client.16134 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.621+0000 7fa3ce7c6740 10 client.16134 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.621+0000 7fa3ce7c6740 20 client.16134 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.621+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56468da14310 0x56468da16750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.621+0000 7fa3ce7c6740 4 client.16134 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.621+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/85199051 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56468d968860 con 0x56468da14310 2024-09-12T00:56:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.622+0000 7fa3ca189640 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56468da14310 0x56468da16750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.622+0000 7fa3ca189640 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56468da14310 0x56468da16750 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=364d78cdd737108c server_cookie=d8546af5bb263b80 in_seq=0 out_seq=0 2024-09-12T00:56:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.622+0000 7fa3adffb640 10 client.16134 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:56:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3adffb640 1 -- 172.21.15.2:0/85199051 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56468d968860 con 0x56468da14310 2024-09-12T00:56:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3adffb640 10 client.16134 handle_command_reply: tid=0 2024-09-12T00:56:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 client.16134 shutdown 2024-09-12T00:56:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/85199051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f6b40 msgr2=0x56468da01390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f6b40 0x56468da01390 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4012d00 tx=0x7fa3b400f790 comp rx=0 tx=0).stop 2024-09-12T00:56:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/85199051 shutdown_connections 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56468da14310 0x56468da16750 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 0x56468da018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f6b40 0x56468da01390 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/85199051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468da040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/85199051 >> 172.21.15.2:0/85199051 conn(0x56468d9be310 msgr2=0x56468d9f7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3adffb640 0 client.16134 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/85199051 shutdown_connections 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/85199051 wait complete. 2024-09-12T00:56:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.623+0000 7fa3ce7c6740 20 client.16134 trim_cache size 0 max 16384 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.638+0000 7fa3ce7c6740 1 Processor -- start 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.638+0000 7fa3ce7c6740 1 -- start start 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468d9f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 0x56468da10690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468da1c020 0x56468da1c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c41ae0d0 con 0x56468da1c020 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c41ab9a0 con 0x56468d9f55d0 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c41a97f0 con 0x56468da04780 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468d9f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca98a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468da1c020 0x56468da1c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468d9f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60648/0 (socket says 172.21.15.2:60648) 2024-09-12T00:56:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 -- 172.21.15.2:0/1199792413 learned_addr learned my addr 172.21.15.2:0/1199792413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3c9988640 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 0x56468da10690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 -- 172.21.15.2:0/1199792413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 msgr2=0x56468da10690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 0x56468da10690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 -- 172.21.15.2:0/1199792413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468da1c020 msgr2=0x56468da1c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468da1c020 0x56468da1c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 -- 172.21.15.2:0/1199792413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468da03d00 con 0x56468d9f55d0 2024-09-12T00:56:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca98a640 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468da1c020 0x56468da1c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.639+0000 7fa3ca189640 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468d9f1e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000dec0 tx=0x7fa3c00d2d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea2482905d617194 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.640+0000 7fa3affff640 1 -- 172.21.15.2:0/1199792413 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c007e540 con 0x56468d9f55d0 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.640+0000 7fa3affff640 1 -- 172.21.15.2:0/1199792413 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c00860d0 con 0x56468d9f55d0 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.640+0000 7fa3affff640 1 -- 172.21.15.2:0/1199792413 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c009b070 con 0x56468d9f55d0 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.640+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/1199792413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 msgr2=0x56468d9f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.640+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468d9f1e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000dec0 tx=0x7fa3c00d2d90 comp rx=0 tx=0).stop 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.640+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/1199792413 shutdown_connections 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.640+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468da1c020 0x56468da1c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.640+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da04780 0x56468da10690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/1199792413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468d9f55d0 0x56468d9f1e10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/1199792413 >> 172.21.15.2:0/1199792413 conn(0x56468d9be310 msgr2=0x56468d9f1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/1199792413 shutdown_connections 2024-09-12T00:56:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/1199792413 wait complete. 2024-09-12T00:56:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 -- start start 2024-09-12T00:56:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 Processor -- start 2024-09-12T00:56:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468da0c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da0cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da1c020 0x56468da097d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c41a9e60 con 0x56468d9f55d0 2024-09-12T00:56:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c41ab2d0 con 0x56468da04780 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c41aa530 con 0x56468da1c020 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ce7c6740 10 client.0 _ll_register_callbacks cb 0x7fa3b4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ca189640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468da0c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ca189640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468da0c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32822/0 (socket says 172.21.15.2:32822) 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.641+0000 7fa3ca189640 1 -- 172.21.15.2:0/3885491886 learned_addr learned my addr 172.21.15.2:0/3885491886 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3ca98a640 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da1c020 0x56468da097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3c9988640 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da0cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3ca189640 1 -- 172.21.15.2:0/3885491886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da1c020 msgr2=0x56468da097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3ca189640 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da1c020 0x56468da097d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3ca189640 1 -- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 msgr2=0x56468da0cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3ca189640 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da0cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3ca189640 1 -- 172.21.15.2:0/3885491886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468da09d10 con 0x56468d9f55d0 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3c9988640 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da0cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3ca189640 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468da0c800 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0079010 tx=0x7fa3c0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8247a81c556829 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3adffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3adffb640 1 -- 172.21.15.2:0/3885491886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00b4060 con 0x56468d9f55d0 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3adffb640 1 -- 172.21.15.2:0/3885491886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fa3c0004310 con 0x56468d9f55d0 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/3885491886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3c00860d0 con 0x56468d9f55d0 2024-09-12T00:56:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.642+0000 7fa3adffb640 1 -- 172.21.15.2:0/3885491886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa3c009b070 con 0x56468d9f55d0 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3ce7c6740 10 client.16140 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/3885491886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56468da7f7c0 con 0x56468d9f55d0 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3adffb640 1 -- 172.21.15.2:0/3885491886 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c00860d0 con 0x56468d9f55d0 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3adffb640 1 -- 172.21.15.2:0/3885491886 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa3c00ccbc0 con 0x56468d9f55d0 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3ce7c6740 10 client.16140 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3ce7c6740 10 client.16140 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3ce7c6740 20 client.16140 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56468da7f990 0x56468da81d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3ce7c6740 4 client.16140 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/3885491886 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56468d962d70 con 0x56468da7f990 2024-09-12T00:56:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.643+0000 7fa3c9988640 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56468da7f990 0x56468da81d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.644+0000 7fa3adffb640 10 client.16140 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.644+0000 7fa3c9988640 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56468da7f990 0x56468da81d80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d85ba869f1b05b0f server_cookie=14520fd0ddd0dbe9 in_seq=0 out_seq=0 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.644+0000 7fa3adffb640 1 -- 172.21.15.2:0/3885491886 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56468d962d70 con 0x56468da7f990 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.644+0000 7fa3adffb640 10 client.16140 handle_command_reply: tid=0 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.644+0000 7fa3ce7c6740 1 client.16140 shutdown 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.644+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/3885491886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 msgr2=0x56468da0c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.644+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468da0c800 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0079010 tx=0x7fa3c0009a50 comp rx=0 tx=0).stop 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/3885491886 shutdown_connections 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x56468da7f990 0x56468da81d80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56468da1c020 0x56468da097d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56468da04780 0x56468da0cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 1 --2- 172.21.15.2:0/3885491886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56468d9f55d0 0x56468da0c800 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/3885491886 >> 172.21.15.2:0/3885491886 conn(0x56468d9be310 msgr2=0x56468d9f1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:50.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3adffb640 0 client.16140 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:56:50.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/3885491886 shutdown_connections 2024-09-12T00:56:50.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 1 -- 172.21.15.2:0/3885491886 wait complete. 2024-09-12T00:56:50.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.645+0000 7fa3ce7c6740 20 client.16140 trim_cache size 0 max 16384 2024-09-12T00:56:50.652 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:56:50.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa3b00a2cf0 msgr2=0x7fa3b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa3b00a2cf0 0x7fa3b00a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0096c0 tx=0x7fa3bc031480 comp rx=0 tx=0).stop 2024-09-12T00:56:50.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/3094822676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3c4100e20 msgr2=0x7fa3c4198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:50.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3c4100e20 0x7fa3c4198470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000db80 tx=0x7fa3c000b630 comp rx=0 tx=0).stop 2024-09-12T00:56:50.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/3094822676 shutdown_connections 2024-09-12T00:56:50.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa3b00a2cf0 0x7fa3b00a51b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3c4102ef0 0x7fa3c419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3c4102570 0x7fa3c41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 --2- 172.21.15.2:0/3094822676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3c4100e20 0x7fa3c4198470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:50.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.646+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/3094822676 >> 172.21.15.2:0/3094822676 conn(0x7fa3c40fc7d0 msgr2=0x7fa3c406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:50.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.647+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/3094822676 shutdown_connections 2024-09-12T00:56:50.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:50.647+0000 7fa3cc3ed640 1 -- 172.21.15.2:0/3094822676 wait complete. 2024-09-12T00:56:50.660 INFO:tasks.workunit.client.0.smithi002.stdout:30000 trunc from 0x7a5444 to 0x143a5 2024-09-12T00:56:51.230 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-12T00:56:51.230 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.15 2024-09-12T00:56:51.230 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:56:51.543 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:56:51.596 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:52.136 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:52 smithi002 ceph-mon[31210]: pgmap v121: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.1 MiB/s wr, 1.06k op/s 2024-09-12T00:56:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 -- 172.21.15.2:0/2512299546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102ef0 msgr2=0x7f60c410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 --2- 172.21.15.2:0/2512299546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102ef0 0x7f60c410da40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009cd0 tx=0x7f60bc02a970 comp rx=0 tx=0).stop 2024-09-12T00:56:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 -- 172.21.15.2:0/2512299546 shutdown_connections 2024-09-12T00:56:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 --2- 172.21.15.2:0/2512299546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102ef0 0x7f60c410da40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 --2- 172.21.15.2:0/2512299546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c4102570 0x7f60c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 --2- 172.21.15.2:0/2512299546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4100e20 0x7f60c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 -- 172.21.15.2:0/2512299546 >> 172.21.15.2:0/2512299546 conn(0x7f60c40fc7d0 msgr2=0x7f60c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 -- 172.21.15.2:0/2512299546 shutdown_connections 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.136+0000 7f60cb610640 1 -- 172.21.15.2:0/2512299546 wait complete. 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60cb610640 1 Processor -- start 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60cb610640 1 -- start start 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60cb610640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4100e20 0x7f60c4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60cb610640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102570 0x7f60c4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60cb610640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c4102ef0 0x7f60c419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60cb610640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f60c4110f80 con 0x7f60c4100e20 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60cb610640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f60c4110e00 con 0x7f60c4102570 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60cb610640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f60c4111100 con 0x7f60c4102ef0 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60c93ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4100e20 0x7f60c4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60c93ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4100e20 0x7f60c4198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32840/0 (socket says 172.21.15.2:32840) 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60c93ac640 1 -- 172.21.15.2:0/2029149333 learned_addr learned my addr 172.21.15.2:0/2029149333 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60c8bab640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102570 0x7f60c4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.137+0000 7f60c9bad640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c4102ef0 0x7f60c419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60c93ac640 1 -- 172.21.15.2:0/2029149333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c4102ef0 msgr2=0x7f60c419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60c93ac640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c4102ef0 0x7f60c419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60c93ac640 1 -- 172.21.15.2:0/2029149333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102570 msgr2=0x7f60c4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60c93ac640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102570 0x7f60c4198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60c93ac640 1 -- 172.21.15.2:0/2029149333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c419d4e0 con 0x7f60c4100e20 2024-09-12T00:56:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60c8bab640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102570 0x7f60c4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60c9bad640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c4102ef0 0x7f60c419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60c93ac640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4100e20 0x7f60c4198530 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f60c000ea60 tx=0x7f60c000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60ba7fc640 1 -- 172.21.15.2:0/2029149333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c000cde0 con 0x7f60c4100e20 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60ba7fc640 1 -- 172.21.15.2:0/2029149333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c00035f0 con 0x7f60c4100e20 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60ba7fc640 1 -- 172.21.15.2:0/2029149333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0010670 con 0x7f60c4100e20 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c419d7d0 con 0x7f60c4100e20 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.138+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c40fcbb0 con 0x7f60c4100e20 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.139+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c4101200 con 0x7f60c4100e20 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.141+0000 7f60ba7fc640 1 -- 172.21.15.2:0/2029149333 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f60c00037a0 con 0x7f60c4100e20 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.141+0000 7f60ba7fc640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f60b00a2d70 0x7f60b00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.142+0000 7f60c8bab640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f60b00a2d70 0x7f60b00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.142+0000 7f60ba7fc640 1 -- 172.21.15.2:0/2029149333 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f60c00cf710 con 0x7f60c4100e20 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.142+0000 7f60c8bab640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f60b00a2d70 0x7f60b00a5230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f60c4106360 tx=0x7f60b4005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.146+0000 7f60ba7fc640 1 -- 172.21.15.2:0/2029149333 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60c009c2e0 con 0x7f60c4100e20 2024-09-12T00:56:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:52.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:52 smithi167 ceph-mon[35234]: pgmap v121: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.1 MiB/s wr, 1.06k op/s 2024-09-12T00:56:52.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.388+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60c4199890 con 0x7f60c4100e20 2024-09-12T00:56:52.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.389+0000 7f60ba7fc640 1 -- 172.21.15.2:0/2029149333 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11902 (secure 0 0 0) 0x7f60c009bbe0 con 0x7f60c4100e20 2024-09-12T00:56:52.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:56:52.388 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-12T00:54:36:272756+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:54:36.126032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:56:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f60b00a2d70 msgr2=0x7f60b00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f60b00a2d70 0x7f60b00a5230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f60c4106360 tx=0x7f60b4005f90 comp rx=0 tx=0).stop 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4100e20 msgr2=0x7f60c4198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4100e20 0x7f60c4198530 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f60c000ea60 tx=0x7f60c000ef20 comp rx=0 tx=0).stop 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 shutdown_connections 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f60b00a2d70 0x7f60b00a5230 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c4102ef0 0x7f60c419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60c4102570 0x7f60c4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 --2- 172.21.15.2:0/2029149333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4100e20 0x7f60c4198530 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 >> 172.21.15.2:0/2029149333 conn(0x7f60c40fc7d0 msgr2=0x7f60c406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:52.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 shutdown_connections 2024-09-12T00:56:52.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:52.391+0000 7f60cb610640 1 -- 172.21.15.2:0/2029149333 wait complete. 2024-09-12T00:56:52.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:52 smithi071 ceph-mon[35276]: pgmap v121: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.1 MiB/s wr, 1.06k op/s 2024-09-12T00:56:53.127 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0' 2024-09-12T00:56:53.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0 2024-09-12T00:56:53.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:53 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2029149333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:53.369 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:53 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2029149333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:53.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.370+0000 7f17bf045640 1 -- 172.21.15.2:0/1307282749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8103ff0 msgr2=0x7f17b81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.370+0000 7f17bf045640 1 --2- 172.21.15.2:0/1307282749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8103ff0 0x7f17b81043d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009900 tx=0x7f17ac02a410 comp rx=0 tx=0).stop 2024-09-12T00:56:53.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.370+0000 7f17bf045640 1 -- 172.21.15.2:0/1307282749 shutdown_connections 2024-09-12T00:56:53.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.370+0000 7f17bf045640 1 --2- 172.21.15.2:0/1307282749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b8109120 0x7f17b8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.370+0000 7f17bf045640 1 --2- 172.21.15.2:0/1307282749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17b81049a0 0x7f17b81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.370+0000 7f17bf045640 1 --2- 172.21.15.2:0/1307282749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8103ff0 0x7f17b81043d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.370+0000 7f17bf045640 1 -- 172.21.15.2:0/1307282749 >> 172.21.15.2:0/1307282749 conn(0x7f17b80ffab0 msgr2=0x7f17b8101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.370+0000 7f17bf045640 1 -- 172.21.15.2:0/1307282749 shutdown_connections 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.371+0000 7f17bf045640 1 -- 172.21.15.2:0/1307282749 wait complete. 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bf045640 1 Processor -- start 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bf045640 1 -- start start 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bf045640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b8103ff0 0x7f17b819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bf045640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17b81049a0 0x7f17b819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bf045640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8109120 0x7f17b819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bf045640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17b8114150 con 0x7f17b8109120 2024-09-12T00:56:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bf045640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17b8113fd0 con 0x7f17b81049a0 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bf045640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17b81142d0 con 0x7f17b8103ff0 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17b81049a0 0x7f17b819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bd5e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8109120 0x7f17b819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bcde1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b8103ff0 0x7f17b819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17b81049a0 0x7f17b819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60694/0 (socket says 172.21.15.2:60694) 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17bd5e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8109120 0x7f17b819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32846/0 (socket says 172.21.15.2:32846) 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.372+0000 7f17b7fff640 1 -- 172.21.15.2:0/2668409294 learned_addr learned my addr 172.21.15.2:0/2668409294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17bcde1640 1 -- 172.21.15.2:0/2668409294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17b81049a0 msgr2=0x7f17b819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17bcde1640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17b81049a0 0x7f17b819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17bcde1640 1 -- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8109120 msgr2=0x7f17b819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17bcde1640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8109120 0x7f17b819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17bcde1640 1 -- 172.21.15.2:0/2668409294 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b819f400 con 0x7f17b8103ff0 2024-09-12T00:56:53.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17bd5e2640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8109120 0x7f17b819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:53.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17bcde1640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b8103ff0 0x7f17b819a450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009850 tx=0x7f17ac030650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:53.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17b5ffb640 1 -- 172.21.15.2:0/2668409294 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac03f070 con 0x7f17b8103ff0 2024-09-12T00:56:53.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.373+0000 7f17b5ffb640 1 -- 172.21.15.2:0/2668409294 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17ac004460 con 0x7f17b8103ff0 2024-09-12T00:56:53.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.374+0000 7f17b5ffb640 1 -- 172.21.15.2:0/2668409294 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac035030 con 0x7f17b8103ff0 2024-09-12T00:56:53.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.374+0000 7f17bf045640 1 -- 172.21.15.2:0/2668409294 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b819f690 con 0x7f17b8103ff0 2024-09-12T00:56:53.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.375+0000 7f17bf045640 1 -- 172.21.15.2:0/2668409294 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b819faf0 con 0x7f17b8103ff0 2024-09-12T00:56:53.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.377+0000 7f17b5ffb640 1 -- 172.21.15.2:0/2668409294 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f17ac042070 con 0x7f17b8103ff0 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17b5ffb640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17a80a2bd0 0x7f17a80a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17c141e740 1 Processor -- start 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17b5ffb640 1 -- 172.21.15.2:0/2668409294 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f17ac0ef970 con 0x7f17b8103ff0 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17b7fff640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17a80a2bd0 0x7f17a80a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17c141e740 1 -- start start 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17c141e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055a7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17c141e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a75d0 0x563e055a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17c141e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055b2370 0x563e055b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17c141e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e0550d2f0 con 0x563e055b2370 2024-09-12T00:56:53.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17c141e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563e054b4cf0 con 0x563e055a8b40 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17c141e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563e055092b0 con 0x563e055a75d0 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.378+0000 7f17bcde1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bcde1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055a7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60700/0 (socket says 172.21.15.2:60700) 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bd5e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055b2370 0x563e055b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bcde1640 1 -- 172.21.15.2:0/3377213478 learned_addr learned my addr 172.21.15.2:0/3377213478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17b7fff640 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a75d0 0x563e055a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17b7fff640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17a80a2bd0 0x7f17a80a5090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f17a40095f0 tx=0x7f17a4005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bcde1640 1 -- 172.21.15.2:0/3377213478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a75d0 msgr2=0x563e055a7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bcde1640 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a75d0 0x563e055a7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bcde1640 1 -- 172.21.15.2:0/3377213478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055b2370 msgr2=0x563e055b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bcde1640 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055b2370 0x563e055b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bcde1640 1 -- 172.21.15.2:0/3377213478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e054993a0 con 0x563e055a8b40 2024-09-12T00:56:53.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17b7fff640 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a75d0 0x563e055a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17bcde1640 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055a7090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009900 tx=0x7f17ac0bb9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ef9dd3b708875d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17a2ffd640 1 -- 172.21.15.2:0/3377213478 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0bc4e0 con 0x563e055a8b40 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.379+0000 7f17a2ffd640 1 -- 172.21.15.2:0/3377213478 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17ac0bbde0 con 0x563e055a8b40 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17a2ffd640 1 -- 172.21.15.2:0/3377213478 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0ed3e0 con 0x563e055a8b40 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 -- 172.21.15.2:0/3377213478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 msgr2=0x563e055a7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055a7090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009900 tx=0x7f17ac0bb9e0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 -- 172.21.15.2:0/3377213478 shutdown_connections 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055b2370 0x563e055b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a75d0 0x563e055a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 --2- 172.21.15.2:0/3377213478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055a7090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 -- 172.21.15.2:0/3377213478 >> 172.21.15.2:0/3377213478 conn(0x563e05570310 msgr2=0x563e055a3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 -- 172.21.15.2:0/3377213478 shutdown_connections 2024-09-12T00:56:53.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.380+0000 7f17c141e740 1 -- 172.21.15.2:0/3377213478 wait complete. 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.381+0000 7f17c141e740 1 -- start start 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.381+0000 7f17c141e740 1 Processor -- start 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.381+0000 7f17c141e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.381+0000 7f17c141e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a8b40 0x563e055aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.381+0000 7f17c141e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055b2370 0x563e055af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bcde1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bcde1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32858/0 (socket says 172.21.15.2:32858) 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bcde1640 1 -- 172.21.15.2:0/1881972009 learned_addr learned my addr 172.21.15.2:0/1881972009 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17b7fff640 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a8b40 0x563e055aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e054b4cf0 con 0x563e055a75d0 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563e054c8060 con 0x563e055b2370 2024-09-12T00:56:53.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563e055b4e30 con 0x563e055a8b40 2024-09-12T00:56:53.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bd5e2640 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055b2370 0x563e055af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17c141e740 10 client.0 _ll_register_callbacks cb 0x563e0521b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bd5e2640 1 -- 172.21.15.2:0/1881972009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a8b40 msgr2=0x563e055aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bd5e2640 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a8b40 0x563e055aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bd5e2640 1 -- 172.21.15.2:0/1881972009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 msgr2=0x563e055b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bd5e2640 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.382+0000 7f17bd5e2640 1 -- 172.21.15.2:0/1881972009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e0527e3c0 con 0x563e055b2370 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f17bd5e2640 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055b2370 0x563e055af480 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009fd0 tx=0x7f17b0012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd245ec4e90596dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f1797fff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f1797fff640 1 -- 172.21.15.2:0/1881972009 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0003970 con 0x563e055b2370 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f1797fff640 1 -- 172.21.15.2:0/1881972009 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f17b0012e00 con 0x563e055b2370 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17ac0bbde0 con 0x563e055b2370 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f1797fff640 1 -- 172.21.15.2:0/1881972009 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f17b0003b10 con 0x563e055b2370 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f17c141e740 10 client.25805 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:53.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e055c06e0 con 0x563e055b2370 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.383+0000 7f1797fff640 1 -- 172.21.15.2:0/1881972009 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17ac0bbde0 con 0x563e055b2370 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.384+0000 7f1797fff640 1 -- 172.21.15.2:0/1881972009 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f17b001c480 con 0x563e055b2370 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.384+0000 7f17c141e740 10 client.25805 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.384+0000 7f17c141e740 10 client.25805 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.384+0000 7f17c141e740 20 client.25805 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.384+0000 7f17c141e740 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x563e055c1c40 0x563e055c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.384+0000 7f17c141e740 4 client.25805 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.384+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e0551a860 con 0x563e055c1c40 2024-09-12T00:56:53.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.384+0000 7f17bcde1640 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x563e055c1c40 0x563e055c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.385+0000 7f17bcde1640 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x563e055c1c40 0x563e055c4070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=849420c61f9c744 server_cookie=83edffca6cb2a142 in_seq=0 out_seq=0 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.385+0000 7f1797fff640 10 client.25805 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.385+0000 7f1797fff640 1 -- 172.21.15.2:0/1881972009 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e0551a860 con 0x563e055c1c40 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.385+0000 7f1797fff640 10 client.25805 handle_command_reply: tid=0 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.385+0000 7f17c141e740 1 client.25805 shutdown 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055b2370 msgr2=0x563e055af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055b2370 0x563e055af480 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009fd0 tx=0x7f17b0012820 comp rx=0 tx=0).stop 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 shutdown_connections 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x563e055c1c40 0x563e055c4070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f1797fff640 0 client.25805 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055b2370 0x563e055af480 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055a8b40 0x563e055aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 --2- 172.21.15.2:0/1881972009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 >> 172.21.15.2:0/1881972009 conn(0x563e05570310 msgr2=0x563e055a99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:53.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 shutdown_connections 2024-09-12T00:56:53.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 1 -- 172.21.15.2:0/1881972009 wait complete. 2024-09-12T00:56:53.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.386+0000 7f17c141e740 20 client.25805 trim_cache size 0 max 16384 2024-09-12T00:56:53.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.402+0000 7f17c141e740 1 Processor -- start 2024-09-12T00:56:53.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.402+0000 7f17c141e740 1 -- start start 2024-09-12T00:56:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.402+0000 7f17c141e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17c141e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17c141e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17c141e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17b81b21d0 con 0x563e055a75d0 2024-09-12T00:56:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17c141e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17b81afaa0 con 0x563e055a8b40 2024-09-12T00:56:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17c141e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17b81ad8f0 con 0x563e055b2370 2024-09-12T00:56:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60718/0 (socket says 172.21.15.2:60718) 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 -- 172.21.15.2:0/1431138411 learned_addr learned my addr 172.21.15.2:0/1431138411 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17bcde1640 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17bd5e2640 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 -- 172.21.15.2:0/1431138411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 msgr2=0x563e055aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 -- 172.21.15.2:0/1431138411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 msgr2=0x563e055bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 -- 172.21.15.2:0/1431138411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e055b02c0 con 0x563e055a8b40 2024-09-12T00:56:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17bcde1640 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17bd5e2640 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.403+0000 7f17b7fff640 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055aa120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17b8101730 tx=0x7f17a4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f0cac70d602669 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.404+0000 7f17a27fc640 1 -- 172.21.15.2:0/1431138411 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a401cb80 con 0x563e055a8b40 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.404+0000 7f17a27fc640 1 -- 172.21.15.2:0/1431138411 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a402b070 con 0x563e055a8b40 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.404+0000 7f17a27fc640 1 -- 172.21.15.2:0/1431138411 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a401b650 con 0x563e055a8b40 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 -- 172.21.15.2:0/1431138411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 msgr2=0x563e055aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055aa120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17b8101730 tx=0x7f17a4014000 comp rx=0 tx=0).stop 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 -- 172.21.15.2:0/1431138411 shutdown_connections 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055aa120 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 --2- 172.21.15.2:0/1431138411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 -- 172.21.15.2:0/1431138411 >> 172.21.15.2:0/1431138411 conn(0x563e05570310 msgr2=0x563e055ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 -- 172.21.15.2:0/1431138411 shutdown_connections 2024-09-12T00:56:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 -- 172.21.15.2:0/1431138411 wait complete. 2024-09-12T00:56:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 -- start start 2024-09-12T00:56:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.405+0000 7f17c141e740 1 Processor -- start 2024-09-12T00:56:53.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17c141e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055ba790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17c141e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17c141e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17c141e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17b81adf60 con 0x563e055a75d0 2024-09-12T00:56:53.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17bcde1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17c141e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17b81af3d0 con 0x563e055a8b40 2024-09-12T00:56:53.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17c141e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17b81ae630 con 0x563e055b2370 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17bcde1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055ba790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32866/0 (socket says 172.21.15.2:32866) 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17bcde1640 1 -- 172.21.15.2:0/3421563500 learned_addr learned my addr 172.21.15.2:0/3421563500 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17bd5e2640 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.406+0000 7f17c141e740 10 client.0 _ll_register_callbacks cb 0x7f17b000f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17bcde1640 1 -- 172.21.15.2:0/3421563500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 msgr2=0x563e055b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17bcde1640 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17bcde1640 1 -- 172.21.15.2:0/3421563500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 msgr2=0x563e055b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17bcde1640 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17bcde1640 1 -- 172.21.15.2:0/3421563500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e055b6810 con 0x563e055a75d0 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17b7fff640 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17bcde1640 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055ba790 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0bbae0 tx=0x7f17ac0bba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d599242d1bcae798 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f1797fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f1797fff640 1 -- 172.21.15.2:0/3421563500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0c0190 con 0x563e055a75d0 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f1797fff640 1 -- 172.21.15.2:0/3421563500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f17ac003d10 con 0x563e055a75d0 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17c141e740 1 -- 172.21.15.2:0/3421563500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17a402b070 con 0x563e055a75d0 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f1797fff640 1 -- 172.21.15.2:0/3421563500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f17ac0bbde0 con 0x563e055a75d0 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17c141e740 10 client.16164 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.407+0000 7f17c141e740 1 -- 172.21.15.2:0/3421563500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e0562c7d0 con 0x563e055a75d0 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f1797fff640 1 -- 172.21.15.2:0/3421563500 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a402b070 con 0x563e055a75d0 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f1797fff640 1 -- 172.21.15.2:0/3421563500 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f17ac0c45c0 con 0x563e055a75d0 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f17c141e740 10 client.16164 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f17c141e740 10 client.16164 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f17c141e740 20 client.16164 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f17c141e740 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x563e055c1c40 0x563e0562eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f17c141e740 4 client.16164 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:56:53.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f17c141e740 1 -- 172.21.15.2:0/3421563500 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563e05514d70 con 0x563e055c1c40 2024-09-12T00:56:53.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.408+0000 7f17b7fff640 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x563e055c1c40 0x563e0562eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:53.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f17b7fff640 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x563e055c1c40 0x563e0562eea0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=748758a5717e101d server_cookie=8c32377338e63b97 in_seq=0 out_seq=0 2024-09-12T00:56:53.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f1797fff640 10 client.16164 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:56:53.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f1797fff640 1 -- 172.21.15.2:0/3421563500 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563e05514d70 con 0x563e055c1c40 2024-09-12T00:56:53.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f1797fff640 10 client.16164 handle_command_reply: tid=0 2024-09-12T00:56:53.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f17c141e740 1 client.16164 shutdown 2024-09-12T00:56:53.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f17c141e740 1 -- 172.21.15.2:0/3421563500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 msgr2=0x563e055ba790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f17c141e740 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055ba790 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0bbae0 tx=0x7f17ac0bba50 comp rx=0 tx=0).stop 2024-09-12T00:56:53.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f17c141e740 1 -- 172.21.15.2:0/3421563500 shutdown_connections 2024-09-12T00:56:53.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f17c141e740 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x563e055c1c40 0x563e0562eea0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f1797fff640 0 client.16164 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:56:53.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.409+0000 7f17c141e740 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e055b2370 0x563e055b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.410+0000 7f17c141e740 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e055a8b40 0x563e055b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.410+0000 7f17c141e740 1 --2- 172.21.15.2:0/3421563500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e055a75d0 0x563e055ba790 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.410+0000 7f17c141e740 1 -- 172.21.15.2:0/3421563500 >> 172.21.15.2:0/3421563500 conn(0x563e05570310 msgr2=0x563e055b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:53.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.410+0000 7f17c141e740 1 -- 172.21.15.2:0/3421563500 shutdown_connections 2024-09-12T00:56:53.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.410+0000 7f17c141e740 1 -- 172.21.15.2:0/3421563500 wait complete. 2024-09-12T00:56:53.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.410+0000 7f17c141e740 20 client.16164 trim_cache size 0 max 16384 2024-09-12T00:56:53.416 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:56:53.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 -- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17a80a2bd0 msgr2=0x7f17a80a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17a80a2bd0 0x7f17a80a5090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f17a40095f0 tx=0x7f17a4005f90 comp rx=0 tx=0).stop 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 -- 172.21.15.2:0/2668409294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b8103ff0 msgr2=0x7f17b819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b8103ff0 0x7f17b819a450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009850 tx=0x7f17ac030650 comp rx=0 tx=0).stop 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 -- 172.21.15.2:0/2668409294 shutdown_connections 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f17a80a2bd0 0x7f17a80a5090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b8109120 0x7f17b819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17b81049a0 0x7f17b819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 --2- 172.21.15.2:0/2668409294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b8103ff0 0x7f17b819a450 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 -- 172.21.15.2:0/2668409294 >> 172.21.15.2:0/2668409294 conn(0x7f17b80ffab0 msgr2=0x7f17b80ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 -- 172.21.15.2:0/2668409294 shutdown_connections 2024-09-12T00:56:53.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:53.411+0000 7f17bf045640 1 -- 172.21.15.2:0/2668409294 wait complete. 2024-09-12T00:56:53.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:53 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2029149333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:56:54.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:54 smithi002 ceph-mon[31210]: pgmap v122: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 3.9 MiB/s wr, 677 op/s 2024-09-12T00:56:54.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:56:54.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:54 smithi167 ceph-mon[35234]: pgmap v122: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 3.9 MiB/s wr, 677 op/s 2024-09-12T00:56:54.325 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:54.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:54 smithi071 ceph-mon[35276]: pgmap v122: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 3.9 MiB/s wr, 677 op/s 2024-09-12T00:56:54.485 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x9ffb01 2024-09-12T00:56:54.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 -- 172.21.15.2:0/3796192754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554102ef0 msgr2=0x7f355410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:54.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 --2- 172.21.15.2:0/3796192754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554102ef0 0x7f355410da40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f354c009ca0 tx=0x7f354c02a950 comp rx=0 tx=0).stop 2024-09-12T00:56:54.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 -- 172.21.15.2:0/3796192754 shutdown_connections 2024-09-12T00:56:54.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 --2- 172.21.15.2:0/3796192754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554102ef0 0x7f355410da40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 --2- 172.21.15.2:0/3796192754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3554102570 0x7f35541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 --2- 172.21.15.2:0/3796192754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3554100e20 0x7f3554101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 -- 172.21.15.2:0/3796192754 >> 172.21.15.2:0/3796192754 conn(0x7f35540fc7d0 msgr2=0x7f35540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:54.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 -- 172.21.15.2:0/3796192754 shutdown_connections 2024-09-12T00:56:54.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.864+0000 7f355b927640 1 -- 172.21.15.2:0/3796192754 wait complete. 2024-09-12T00:56:54.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.865+0000 7f355b927640 1 Processor -- start 2024-09-12T00:56:54.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.865+0000 7f355b927640 1 -- start start 2024-09-12T00:56:54.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.865+0000 7f355b927640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554100e20 0x7f3554198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.865+0000 7f355b927640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3554102570 0x7f3554198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.865+0000 7f355b927640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3554102ef0 0x7f355419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f35596c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554100e20 0x7f3554198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f35596c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554100e20 0x7f3554198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32888/0 (socket says 172.21.15.2:32888) 2024-09-12T00:56:54.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3554110f80 con 0x7f3554100e20 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f35596c3640 1 -- 172.21.15.2:0/1479534569 learned_addr learned my addr 172.21.15.2:0/1479534569 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3554110e00 con 0x7f3554102ef0 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f3558ec2640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3554102570 0x7f3554198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3554111100 con 0x7f3554102570 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f3559ec4640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3554102ef0 0x7f355419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f35596c3640 1 -- 172.21.15.2:0/1479534569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3554102570 msgr2=0x7f3554198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f35596c3640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3554102570 0x7f3554198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f35596c3640 1 -- 172.21.15.2:0/1479534569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3554102ef0 msgr2=0x7f355419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f35596c3640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3554102ef0 0x7f355419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.866+0000 7f35596c3640 1 -- 172.21.15.2:0/1479534569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355419d510 con 0x7f3554100e20 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.867+0000 7f35596c3640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554100e20 0x7f3554198560 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f355000e9f0 tx=0x7f355000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.867+0000 7f354a7fc640 1 -- 172.21.15.2:0/1479534569 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355000cd80 con 0x7f3554100e20 2024-09-12T00:56:54.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.867+0000 7f354a7fc640 1 -- 172.21.15.2:0/1479534569 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3550005500 con 0x7f3554100e20 2024-09-12T00:56:54.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.867+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355419d800 con 0x7f3554100e20 2024-09-12T00:56:54.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.867+0000 7f354a7fc640 1 -- 172.21.15.2:0/1479534569 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550010690 con 0x7f3554100e20 2024-09-12T00:56:54.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.867+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3554107a10 con 0x7f3554100e20 2024-09-12T00:56:54.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.870+0000 7f354a7fc640 1 -- 172.21.15.2:0/1479534569 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f35500046c0 con 0x7f3554100e20 2024-09-12T00:56:54.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f355dd00740 1 Processor -- start 2024-09-12T00:56:54.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f355dd00740 1 -- start start 2024-09-12T00:56:54.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f355dd00740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 0x555aa5d32b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f355dd00740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d45d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f355dd00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d48630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f355dd00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aa5c97160 con 0x555aa5d46240 2024-09-12T00:56:54.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f355dd00740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555aa5c3e720 con 0x555aa5d33090 2024-09-12T00:56:54.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f355dd00740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555aa5c93120 con 0x555aa5d32770 2024-09-12T00:56:54.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f3558ec2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d48630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f354a7fc640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f35400a2d70 0x7f35400a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f3558ec2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d48630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32894/0 (socket says 172.21.15.2:32894) 2024-09-12T00:56:54.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.871+0000 7f3558ec2640 1 -- 172.21.15.2:0/2486994935 learned_addr learned my addr 172.21.15.2:0/2486994935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:54.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f35596c3640 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d45d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f354a7fc640 1 -- 172.21.15.2:0/1479534569 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f35500cf820 con 0x7f3554100e20 2024-09-12T00:56:54.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f3558ec2640 1 -- 172.21.15.2:0/2486994935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 msgr2=0x555aa5d32b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f3558ec2640 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 0x555aa5d32b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f3558ec2640 1 -- 172.21.15.2:0/2486994935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 msgr2=0x555aa5d45d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f3558ec2640 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d45d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f3558ec2640 1 -- 172.21.15.2:0/2486994935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa5a08ba0 con 0x555aa5d46240 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f35596c3640 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d45d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f3558ec2640 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d48630 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3544010df0 tx=0x7f3544005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9277d9c72b182a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f353f7fe640 1 -- 172.21.15.2:0/2486994935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544004050 con 0x555aa5d46240 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f3559ec4640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f35400a2d70 0x7f35400a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.872+0000 7f353f7fe640 1 -- 172.21.15.2:0/2486994935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35440041f0 con 0x555aa5d46240 2024-09-12T00:56:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f353f7fe640 1 -- 172.21.15.2:0/2486994935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354400f7e0 con 0x555aa5d46240 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f3559ec4640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f35400a2d70 0x7f35400a5230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f354c005e30 tx=0x7f354c005c50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f355dd00740 1 -- 172.21.15.2:0/2486994935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 msgr2=0x555aa5d48630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f355dd00740 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d48630 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3544010df0 tx=0x7f3544005f90 comp rx=0 tx=0).stop 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f355dd00740 1 -- 172.21.15.2:0/2486994935 shutdown_connections 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f355dd00740 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d48630 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f355dd00740 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d45d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f355dd00740 1 --2- 172.21.15.2:0/2486994935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 0x555aa5d32b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.873+0000 7f355dd00740 1 -- 172.21.15.2:0/2486994935 >> 172.21.15.2:0/2486994935 conn(0x555aa5d2ede0 msgr2=0x555aa5d2f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.874+0000 7f355dd00740 1 -- 172.21.15.2:0/2486994935 shutdown_connections 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.874+0000 7f355dd00740 1 -- 172.21.15.2:0/2486994935 wait complete. 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.874+0000 7f355dd00740 1 -- start start 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.874+0000 7f355dd00740 1 Processor -- start 2024-09-12T00:56:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f355dd00740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 0x555aa5d43170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f355dd00740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f355dd00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d43bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f355dd00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aa5d48e50 con 0x555aa5d46240 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f355dd00740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555aa5c1f900 con 0x555aa5d33090 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f355dd00740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555aa5d48fd0 con 0x555aa5d32770 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f355dd00740 10 client.0 _ll_register_callbacks cb 0x555aa5c1d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60750/0 (socket says 172.21.15.2:60750) 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 -- 172.21.15.2:0/1341015030 learned_addr learned my addr 172.21.15.2:0/1341015030 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f35596c3640 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 0x555aa5d43170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3559ec4640 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d43bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 -- 172.21.15.2:0/1341015030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 msgr2=0x555aa5d43170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 0x555aa5d43170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 -- 172.21.15.2:0/1341015030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 msgr2=0x555aa5d43bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d43bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 -- 172.21.15.2:0/1341015030 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa5c5fc50 con 0x555aa5d33090 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f3558ec2640 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d436b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3544003f40 tx=0x7f3544003cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de9a6ccb5e68530 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.875+0000 7f353cff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.876+0000 7f353cff9640 1 -- 172.21.15.2:0/1341015030 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544029060 con 0x555aa5d33090 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.876+0000 7f353cff9640 1 -- 172.21.15.2:0/1341015030 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f354400f560 con 0x555aa5d33090 2024-09-12T00:56:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.876+0000 7f355dd00740 1 -- 172.21.15.2:0/1341015030 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35440041f0 con 0x555aa5d33090 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.876+0000 7f353cff9640 1 -- 172.21.15.2:0/1341015030 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3544005c50 con 0x555aa5d33090 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.876+0000 7f355dd00740 10 client.25823 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.876+0000 7f355dd00740 1 -- 172.21.15.2:0/1341015030 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555aa5d54b90 con 0x555aa5d33090 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.876+0000 7f353cff9640 1 -- 172.21.15.2:0/1341015030 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35440041f0 con 0x555aa5d33090 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f353cff9640 1 -- 172.21.15.2:0/1341015030 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3544019780 con 0x555aa5d33090 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f355dd00740 10 client.25823 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f355dd00740 10 client.25823 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f355dd00740 20 client.25823 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f355dd00740 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555aa5d56330 0x555aa5d58750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f355dd00740 4 client.25823 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f355dd00740 1 -- 172.21.15.2:0/1341015030 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aa5ca4890 con 0x555aa5d56330 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f35596c3640 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555aa5d56330 0x555aa5d58750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.877+0000 7f353cff9640 10 client.25823 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.878+0000 7f35596c3640 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555aa5d56330 0x555aa5d58750 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e474f1b1617f2ca3 server_cookie=8e2fa08df8ef7070 in_seq=0 out_seq=0 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f353cff9640 1 -- 172.21.15.2:0/1341015030 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555aa5ca4890 con 0x555aa5d56330 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f353cff9640 10 client.25823 handle_command_reply: tid=0 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 client.25823 shutdown 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 -- 172.21.15.2:0/1341015030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 msgr2=0x555aa5d436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d436b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3544003f40 tx=0x7f3544003cb0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 -- 172.21.15.2:0/1341015030 shutdown_connections 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555aa5d56330 0x555aa5d58750 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d43bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d436b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 --2- 172.21.15.2:0/1341015030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d32770 0x555aa5d43170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f355dd00740 1 -- 172.21.15.2:0/1341015030 >> 172.21.15.2:0/1341015030 conn(0x555aa5d2ede0 msgr2=0x555aa5d34a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:54.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.879+0000 7f353cff9640 0 client.25823 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:54.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.880+0000 7f355dd00740 1 -- 172.21.15.2:0/1341015030 shutdown_connections 2024-09-12T00:56:54.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.880+0000 7f355dd00740 1 -- 172.21.15.2:0/1341015030 wait complete. 2024-09-12T00:56:54.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.880+0000 7f355dd00740 20 client.25823 trim_cache size 0 max 16384 2024-09-12T00:56:54.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f355dd00740 1 Processor -- start 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f355dd00740 1 -- start start 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f355dd00740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d32770 0x555aa5d348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f355dd00740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d33090 0x555aa5d5e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f355dd00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d5e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f355dd00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35541ae0a0 con 0x555aa5d46240 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f355dd00740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35541ab970 con 0x555aa5d32770 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f3559ec4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d5e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f35596c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d32770 0x555aa5d348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f3559ec4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d5e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32912/0 (socket says 172.21.15.2:32912) 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f3559ec4640 1 -- 172.21.15.2:0/2267585596 learned_addr learned my addr 172.21.15.2:0/2267585596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f355dd00740 1 -- 172.21.15.2:0/2267585596 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35541a97c0 con 0x555aa5d33090 2024-09-12T00:56:54.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f3558ec2640 1 --2- 172.21.15.2:0/2267585596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d33090 0x555aa5d5e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f35596c3640 1 -- 172.21.15.2:0/2267585596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d33090 msgr2=0x555aa5d5e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f35596c3640 1 --2- 172.21.15.2:0/2267585596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d33090 0x555aa5d5e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f35596c3640 1 -- 172.21.15.2:0/2267585596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 msgr2=0x555aa5d5e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f35596c3640 1 --2- 172.21.15.2:0/2267585596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d5e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.901+0000 7f35596c3640 1 -- 172.21.15.2:0/2267585596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa5d32ec0 con 0x555aa5d32770 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.902+0000 7f35596c3640 1 --2- 172.21.15.2:0/2267585596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d32770 0x555aa5d348d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f35500ccf20 tx=0x7f35500978e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637f1068c821e602 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.902+0000 7f353effd640 1 -- 172.21.15.2:0/2267585596 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355009c3f0 con 0x555aa5d32770 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.902+0000 7f353effd640 1 -- 172.21.15.2:0/2267585596 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f355009bcf0 con 0x555aa5d32770 2024-09-12T00:56:54.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.902+0000 7f353effd640 1 -- 172.21.15.2:0/2267585596 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35500a2890 con 0x555aa5d32770 2024-09-12T00:56:54.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 -- 172.21.15.2:0/2267585596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d32770 msgr2=0x555aa5d348d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:54.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 --2- 172.21.15.2:0/2267585596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d32770 0x555aa5d348d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f35500ccf20 tx=0x7f35500978e0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.903 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:54.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 -- 172.21.15.2:0/2267585596 shutdown_connections 2024-09-12T00:56:54.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 --2- 172.21.15.2:0/2267585596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d46240 0x555aa5d5e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 --2- 172.21.15.2:0/2267585596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d33090 0x555aa5d5e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 --2- 172.21.15.2:0/2267585596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d32770 0x555aa5d348d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 -- 172.21.15.2:0/2267585596 >> 172.21.15.2:0/2267585596 conn(0x555aa5d2ede0 msgr2=0x555aa5d341c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 -- 172.21.15.2:0/2267585596 shutdown_connections 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.903+0000 7f355dd00740 1 -- 172.21.15.2:0/2267585596 wait complete. 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 1 -- start start 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 1 Processor -- start 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d32770 0x555aa5d4e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d4e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d46240 0x555aa5d3f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35541a9e30 con 0x555aa5d32770 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35541ab2a0 con 0x555aa5d33090 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35541aa500 con 0x555aa5d46240 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f355dd00740 10 client.0 _ll_register_callbacks cb 0x7f3544010ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f35596c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d32770 0x555aa5d4e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f35596c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d32770 0x555aa5d4e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32920/0 (socket says 172.21.15.2:32920) 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f35596c3640 1 -- 172.21.15.2:0/3443662877 learned_addr learned my addr 172.21.15.2:0/3443662877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.904+0000 7f3558ec2640 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d4e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f3559ec4640 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d46240 0x555aa5d3f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f3558ec2640 1 -- 172.21.15.2:0/3443662877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d46240 msgr2=0x555aa5d3f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f3558ec2640 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d46240 0x555aa5d3f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f3558ec2640 1 -- 172.21.15.2:0/3443662877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d32770 msgr2=0x555aa5d4e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f3558ec2640 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d32770 0x555aa5d4e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f3558ec2640 1 -- 172.21.15.2:0/3443662877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa5d401d0 con 0x555aa5d33090 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f35596c3640 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d32770 0x555aa5d4e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f3558ec2640 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d4e980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3544003f70 tx=0x7f3544003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7800bbaa9040421f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f353cff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:56:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f353cff9640 1 -- 172.21.15.2:0/3443662877 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544039060 con 0x555aa5d33090 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f353cff9640 1 -- 172.21.15.2:0/3443662877 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f35440193f0 con 0x555aa5d33090 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f355dd00740 1 -- 172.21.15.2:0/3443662877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f355009bcf0 con 0x555aa5d33090 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f353cff9640 1 -- 172.21.15.2:0/3443662877 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3544029040 con 0x555aa5d33090 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f355dd00740 10 client.25829 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.905+0000 7f355dd00740 1 -- 172.21.15.2:0/3443662877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555aa5dc09d0 con 0x555aa5d33090 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f353cff9640 1 -- 172.21.15.2:0/3443662877 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f355009bcf0 con 0x555aa5d33090 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f353cff9640 1 -- 172.21.15.2:0/3443662877 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f354400e7b0 con 0x555aa5d33090 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f355dd00740 10 client.25829 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f355dd00740 10 client.25829 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f355dd00740 20 client.25829 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f355dd00740 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555aa5dc10b0 0x555aa5dc34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f355dd00740 4 client.25829 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}] 2024-09-12T00:56:54.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f355dd00740 1 -- 172.21.15.2:0/3443662877 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}) -- 0x555aa5c9ebe0 con 0x555aa5dc10b0 2024-09-12T00:56:54.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.906+0000 7f35596c3640 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555aa5dc10b0 0x555aa5dc34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:54.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.907+0000 7f353cff9640 10 client.25829 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:54.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:54.907+0000 7f35596c3640 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555aa5dc10b0 0x555aa5dc34d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b8b112f2000b153 server_cookie=9b31ddb760e3f8d in_seq=0 out_seq=0 2024-09-12T00:56:55.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 -- 172.21.15.2:0/1721670071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8102d30 msgr2=0x7f27e8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 --2- 172.21.15.2:0/1721670071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8102d30 0x7f27e8103110 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009930 tx=0x7f27e402a420 comp rx=0 tx=0).stop 2024-09-12T00:56:55.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 -- 172.21.15.2:0/1721670071 shutdown_connections 2024-09-12T00:56:55.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 --2- 172.21.15.2:0/1721670071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27e81082a0 0x7f27e810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 --2- 172.21.15.2:0/1721670071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e81036e0 0x7f27e8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 --2- 172.21.15.2:0/1721670071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8102d30 0x7f27e8103110 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 -- 172.21.15.2:0/1721670071 >> 172.21.15.2:0/1721670071 conn(0x7f27e80fc7d0 msgr2=0x7f27e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 -- 172.21.15.2:0/1721670071 shutdown_connections 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.371+0000 7f27efe26640 1 -- 172.21.15.2:0/1721670071 wait complete. 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27efe26640 1 Processor -- start 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27efe26640 1 -- start start 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27efe26640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8102d30 0x7f27e81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27efe26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e81036e0 0x7f27e8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27efe26640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27e81082a0 0x7f27e819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27efe26640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27e81120a0 con 0x7f27e81036e0 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27efe26640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27e8111f20 con 0x7f27e81082a0 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27efe26640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27e8112220 con 0x7f27e8102d30 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27ed3c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e81036e0 0x7f27e8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27ed3c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e81036e0 0x7f27e8198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32946/0 (socket says 172.21.15.2:32946) 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.372+0000 7f27ed3c1640 1 -- 172.21.15.2:0/2577603337 learned_addr learned my addr 172.21.15.2:0/2577603337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27e81082a0 0x7f27e819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27edbc2640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8102d30 0x7f27e81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27ed3c1640 1 -- 172.21.15.2:0/2577603337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8102d30 msgr2=0x7f27e81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8102d30 0x7f27e81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27ed3c1640 1 -- 172.21.15.2:0/2577603337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27e81082a0 msgr2=0x7f27e819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27e81082a0 0x7f27e819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27ed3c1640 1 -- 172.21.15.2:0/2577603337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e819d550 con 0x7f27e81036e0 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e81036e0 0x7f27e8198ae0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f27d800e9f0 tx=0x7f27d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27deffd640 1 -- 172.21.15.2:0/2577603337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d800ccc0 con 0x7f27e81036e0 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27deffd640 1 -- 172.21.15.2:0/2577603337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27d8010910 con 0x7f27e81036e0 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27efe26640 1 -- 172.21.15.2:0/2577603337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e819d840 con 0x7f27e81036e0 2024-09-12T00:56:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27deffd640 1 -- 172.21.15.2:0/2577603337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8018920 con 0x7f27e81036e0 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.373+0000 7f27efe26640 1 -- 172.21.15.2:0/2577603337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e81a5120 con 0x7f27e81036e0 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27deffd640 1 -- 172.21.15.2:0/2577603337 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f27d8010ac0 con 0x7f27e81036e0 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27f21ff740 1 Processor -- start 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27f21ff740 1 -- start start 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d95254e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d95254ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d95255b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27f21ff740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9524b42f0 con 0x55d952559370 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27f21ff740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d95245bcf0 con 0x55d95254e5d0 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.376+0000 7f27f21ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d9524b02b0 con 0x55d95254fb40 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27ed3c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d95255b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d95254ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d95254ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60784/0 (socket says 172.21.15.2:60784) 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 -- 172.21.15.2:0/3679438587 learned_addr learned my addr 172.21.15.2:0/3679438587 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/3679438587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d95254e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27deffd640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f27d40a2cf0 0x7f27d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 -- 172.21.15.2:0/3679438587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 msgr2=0x55d95254e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 --2- 172.21.15.2:0/3679438587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d95254e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 -- 172.21.15.2:0/3679438587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 msgr2=0x55d95255b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 --2- 172.21.15.2:0/3679438587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d95255b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 -- 172.21.15.2:0/3679438587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9524403a0 con 0x55d95254e5d0 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f27d40a2cf0 0x7f27d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27deffd640 1 -- 172.21.15.2:0/2577603337 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f27d80cf840 con 0x7f27e81036e0 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27edbc2640 1 --2- 172.21.15.2:0/3679438587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d95254ea10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27e402a940 tx=0x7f27e4005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8912f36a5249c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.377+0000 7f27d3fff640 1 -- 172.21.15.2:0/3679438587 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e403f070 con 0x55d95254e5d0 2024-09-12T00:56:55.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27d3fff640 1 -- 172.21.15.2:0/3679438587 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27e4004030 con 0x55d95254e5d0 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27d3fff640 1 -- 172.21.15.2:0/3679438587 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4035070 con 0x55d95254e5d0 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 -- 172.21.15.2:0/3679438587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 msgr2=0x55d95254ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f27d40a2cf0 0x7f27d40a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f27e0005fd0 tx=0x7f27e0014040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 --2- 172.21.15.2:0/3679438587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d95254ea10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27e402a940 tx=0x7f27e4005dd0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 -- 172.21.15.2:0/3679438587 shutdown_connections 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 --2- 172.21.15.2:0/3679438587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d95255b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 --2- 172.21.15.2:0/3679438587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d95254ea10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 --2- 172.21.15.2:0/3679438587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d95254e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 -- 172.21.15.2:0/3679438587 >> 172.21.15.2:0/3679438587 conn(0x55d952517310 msgr2=0x55d95254ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 -- 172.21.15.2:0/3679438587 shutdown_connections 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.378+0000 7f27f21ff740 1 -- 172.21.15.2:0/3679438587 wait complete. 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 1 -- start start 2024-09-12T00:56:55.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 1 Processor -- start 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d952558d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952555fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d952556570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d95255c010 con 0x55d952559370 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d95246f060 con 0x55d95254e5d0 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d95255c190 con 0x55d95254fb40 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27f21ff740 10 client.0 _ll_register_callbacks cb 0x55d9521c28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27ee3c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d952556570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27edbc2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d952558d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27ee3c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d952556570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32964/0 (socket says 172.21.15.2:32964) 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27edbc2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d952558d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:60788/0 (socket says 172.21.15.2:60788) 2024-09-12T00:56:55.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.379+0000 7f27ee3c3640 1 -- 172.21.15.2:0/1343087263 learned_addr learned my addr 172.21.15.2:0/1343087263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952555fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27ee3c3640 1 -- 172.21.15.2:0/1343087263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 msgr2=0x55d952555fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952555fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27ee3c3640 1 -- 172.21.15.2:0/1343087263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 msgr2=0x55d952558d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d952558d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27ee3c3640 1 -- 172.21.15.2:0/1343087263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9522253c0 con 0x55d952559370 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d952558d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952555fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d952556570 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f27e0010890 tx=0x7f27e0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f144fc580ef5ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27d17fa640 1 -- 172.21.15.2:0/1343087263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e001c890 con 0x55d952559370 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27f21ff740 1 -- 172.21.15.2:0/1343087263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27e4004030 con 0x55d952559370 2024-09-12T00:56:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27d17fa640 1 -- 172.21.15.2:0/1343087263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f27e001ca30 con 0x55d952559370 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27d17fa640 1 -- 172.21.15.2:0/1343087263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f27e001cc30 con 0x55d952559370 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27f21ff740 10 client.16194 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27f21ff740 1 -- 172.21.15.2:0/1343087263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d952567b10 con 0x55d952559370 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.380+0000 7f27d17fa640 1 -- 172.21.15.2:0/1343087263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27e4004030 con 0x55d952559370 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27d17fa640 1 -- 172.21.15.2:0/1343087263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f27e0025020 con 0x55d952559370 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27f21ff740 10 client.16194 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27f21ff740 10 client.16194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27f21ff740 20 client.16194 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d952568fd0 0x55d95256b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27f21ff740 4 client.16194 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27f21ff740 1 -- 172.21.15.2:0/1343087263 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9524c1860 con 0x55d952568fd0 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d952568fd0 0x55d95256b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27d17fa640 10 client.16194 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.381+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d952568fd0 0x55d95256b440 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=837e7e3f3d2d0da2 server_cookie=f07c6107a99eab7b in_seq=0 out_seq=0 2024-09-12T00:56:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27d17fa640 1 -- 172.21.15.2:0/1343087263 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9524c1860 con 0x55d952568fd0 2024-09-12T00:56:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27d17fa640 10 client.16194 handle_command_reply: tid=0 2024-09-12T00:56:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 client.16194 shutdown 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 -- 172.21.15.2:0/1343087263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 msgr2=0x55d952556570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d952556570 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f27e0010890 tx=0x7f27e0009500 comp rx=0 tx=0).stop 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 -- 172.21.15.2:0/1343087263 shutdown_connections 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d952568fd0 0x55d95256b440 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d952559370 0x55d952556570 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27d17fa640 0 client.16194 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952555fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1343087263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254e5d0 0x55d952558d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 -- 172.21.15.2:0/1343087263 >> 172.21.15.2:0/1343087263 conn(0x55d952517310 msgr2=0x55d952550960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 -- 172.21.15.2:0/1343087263 shutdown_connections 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 1 -- 172.21.15.2:0/1343087263 wait complete. 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.633+0000 7f27f21ff740 20 client.16194 trim_cache size 0 max 16384 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27f21ff740 1 Processor -- start 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27f21ff740 1 -- start start 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d9525652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952551120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d952559370 0x55d952551660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27f21ff740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27e81b0260 con 0x55d95254e5d0 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27f21ff740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27e81adb30 con 0x55d952559370 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27f21ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27e81ab980 con 0x55d95254fb40 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27edbc2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d9525652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27edbc2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d9525652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32978/0 (socket says 172.21.15.2:32978) 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27edbc2640 1 -- 172.21.15.2:0/1205873057 learned_addr learned my addr 172.21.15.2:0/1205873057 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d952559370 0x55d952551660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952551120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27edbc2640 1 -- 172.21.15.2:0/1205873057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 msgr2=0x55d952551120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952551120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27edbc2640 1 -- 172.21.15.2:0/1205873057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d952559370 msgr2=0x55d952551660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d952559370 0x55d952551660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27edbc2640 1 -- 172.21.15.2:0/1205873057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d952554f80 con 0x55d95254e5d0 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.647+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d952559370 0x55d952551660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.648+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d9525652b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f27e402a940 tx=0x7f27e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb263dbaaad9161 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.648+0000 7f27d37fe640 1 -- 172.21.15.2:0/1205873057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4035050 con 0x55d95254e5d0 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.648+0000 7f27d37fe640 1 -- 172.21.15.2:0/1205873057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27e4031940 con 0x55d95254e5d0 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.648+0000 7f27d37fe640 1 -- 172.21.15.2:0/1205873057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e403f040 con 0x55d95254e5d0 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 -- 172.21.15.2:0/1205873057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 msgr2=0x55d9525652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d9525652b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f27e402a940 tx=0x7f27e4000bc0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 -- 172.21.15.2:0/1205873057 shutdown_connections 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d952559370 0x55d952551660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d95254fb40 0x55d952551120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1205873057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d9525652b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 -- 172.21.15.2:0/1205873057 >> 172.21.15.2:0/1205873057 conn(0x55d952517310 msgr2=0x55d9525557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 -- 172.21.15.2:0/1205873057 shutdown_connections 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 -- 172.21.15.2:0/1205873057 wait complete. 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 -- start start 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.649+0000 7f27f21ff740 1 Processor -- start 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d952561790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254fb40 0x55d952561cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27f21ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d952559370 0x55d952552bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27f21ff740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27e81abff0 con 0x55d95254e5d0 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27f21ff740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27e81ad460 con 0x55d95254fb40 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27f21ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27e81ac6c0 con 0x55d952559370 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27f21ff740 10 client.0 _ll_register_callbacks cb 0x7f27e0009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27edbc2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d952561790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27edbc2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d952561790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32980/0 (socket says 172.21.15.2:32980) 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27edbc2640 1 -- 172.21.15.2:0/1603209521 learned_addr learned my addr 172.21.15.2:0/1603209521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254fb40 0x55d952561cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27ee3c3640 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d952559370 0x55d952552bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27edbc2640 1 -- 172.21.15.2:0/1603209521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d952559370 msgr2=0x55d952552bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d952559370 0x55d952552bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27edbc2640 1 -- 172.21.15.2:0/1603209521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254fb40 msgr2=0x55d952561cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254fb40 0x55d952561cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.650+0000 7f27edbc2640 1 -- 172.21.15.2:0/1603209521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d952553400 con 0x55d95254e5d0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27edbc2640 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d952561790 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f27e40053c0 tx=0x7f27e402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4822bf2aa477c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27d17fa640 1 -- 172.21.15.2:0/1603209521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4057060 con 0x55d95254e5d0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27d17fa640 1 -- 172.21.15.2:0/1603209521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f27e4004040 con 0x55d95254e5d0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 1 -- 172.21.15.2:0/1603209521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27e4031940 con 0x55d95254e5d0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27d17fa640 1 -- 172.21.15.2:0/1603209521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f27e403f040 con 0x55d95254e5d0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 10 client.16200 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 1 -- 172.21.15.2:0/1603209521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d9525d3970 con 0x55d95254e5d0 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27d17fa640 1 -- 172.21.15.2:0/1603209521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27e4031940 con 0x55d95254e5d0 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27d17fa640 1 -- 172.21.15.2:0/1603209521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f27e40035f0 con 0x55d95254e5d0 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 10 client.16200 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 10 client.16200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 20 client.16200 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9525d3b40 0x55d9525d5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 4 client.16200 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.651+0000 7f27f21ff740 1 -- 172.21.15.2:0/1603209521 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9524bbd70 con 0x55d9525d3b40 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.652+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9525d3b40 0x55d9525d5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.652+0000 7f27d17fa640 10 client.16200 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.652+0000 7f27ed3c1640 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9525d3b40 0x55d9525d5f30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48047c539cebfb1b server_cookie=a0a45f5c8c529835 in_seq=0 out_seq=0 2024-09-12T00:56:55.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27d17fa640 1 -- 172.21.15.2:0/1603209521 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9524bbd70 con 0x55d9525d3b40 2024-09-12T00:56:55.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27d17fa640 10 client.16200 handle_command_reply: tid=0 2024-09-12T00:56:55.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 client.16200 shutdown 2024-09-12T00:56:55.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 -- 172.21.15.2:0/1603209521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 msgr2=0x55d952561790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d952561790 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f27e40053c0 tx=0x7f27e402a420 comp rx=0 tx=0).stop 2024-09-12T00:56:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 -- 172.21.15.2:0/1603209521 shutdown_connections 2024-09-12T00:56:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d9525d3b40 0x55d9525d5f30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d952559370 0x55d952552bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d95254fb40 0x55d952561cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 --2- 172.21.15.2:0/1603209521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95254e5d0 0x55d952561790 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 -- 172.21.15.2:0/1603209521 >> 172.21.15.2:0/1603209521 conn(0x55d952517310 msgr2=0x55d952557830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:55.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27d17fa640 0 client.16200 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:55.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 -- 172.21.15.2:0/1603209521 shutdown_connections 2024-09-12T00:56:55.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 1 -- 172.21.15.2:0/1603209521 wait complete. 2024-09-12T00:56:55.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.798+0000 7f27f21ff740 20 client.16200 trim_cache size 0 max 16384 2024-09-12T00:56:55.801 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:56:55.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 -- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f27d40a2cf0 msgr2=0x7f27d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f27d40a2cf0 0x7f27d40a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f27e0005fd0 tx=0x7f27e0014040 comp rx=0 tx=0).stop 2024-09-12T00:56:55.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 -- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e81036e0 msgr2=0x7f27e8198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e81036e0 0x7f27e8198ae0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f27d800e9f0 tx=0x7f27d800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 -- 172.21.15.2:0/2577603337 shutdown_connections 2024-09-12T00:56:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f27d40a2cf0 0x7f27d40a51b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27e81082a0 0x7f27e819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e81036e0 0x7f27e8198ae0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 --2- 172.21.15.2:0/2577603337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8102d30 0x7f27e81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 -- 172.21.15.2:0/2577603337 >> 172.21.15.2:0/2577603337 conn(0x7f27e80fc7d0 msgr2=0x7f27e8105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 -- 172.21.15.2:0/2577603337 shutdown_connections 2024-09-12T00:56:55.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.799+0000 7f27efe26640 1 -- 172.21.15.2:0/2577603337 wait complete. 2024-09-12T00:56:55.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f353cff9640 1 -- 172.21.15.2:0/3443662877 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555aa5c9ebe0 con 0x555aa5dc10b0 2024-09-12T00:56:55.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f353cff9640 10 client.25829 handle_command_reply: tid=0 2024-09-12T00:56:55.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 client.25829 shutdown 2024-09-12T00:56:55.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 -- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 msgr2=0x555aa5d4e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d4e980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3544003f70 tx=0x7f3544003bb0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 -- 172.21.15.2:0/3443662877 shutdown_connections 2024-09-12T00:56:55.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x555aa5dc10b0 0x555aa5dc34d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555aa5d46240 0x555aa5d3f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f353cff9640 0 client.25829 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:55.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aa5d33090 0x555aa5d4e980 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 --2- 172.21.15.2:0/3443662877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa5d32770 0x555aa5d4e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.814+0000 7f355dd00740 1 -- 172.21.15.2:0/3443662877 >> 172.21.15.2:0/3443662877 conn(0x555aa5d2ede0 msgr2=0x555aa5d349e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:55.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355dd00740 1 -- 172.21.15.2:0/3443662877 shutdown_connections 2024-09-12T00:56:55.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355dd00740 1 -- 172.21.15.2:0/3443662877 wait complete. 2024-09-12T00:56:55.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355dd00740 20 client.25829 trim_cache size 0 max 16384 2024-09-12T00:56:55.817 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:56:55.820 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 27, 2024-09-12T00:56:55.820 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:56:55.820 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 14, 2024-09-12T00:56:55.821 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:56:55.821 INFO:teuthology.orchestra.run.smithi002.stdout: "d37d25ba": { 2024-09-12T00:56:55.821 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 14, 2024-09-12T00:56:55.821 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:56:55.821 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:56:55.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:56:55.822 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:56:55.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:56:55.822 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:56:55.822 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 140.2, 2024-09-12T00:56:55.822 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:56:55.822 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:56:55.823 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:56:55.823 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:56:55.823 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:56:55.823 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:56:55.823 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:55.823 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:55.824 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:55.824 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:55.824 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:56:55.824 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:56:55.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f35400a2d70 msgr2=0x7f35400a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355b927640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f35400a2d70 0x7f35400a5230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f354c005e30 tx=0x7f354c005c50 comp rx=0 tx=0).stop 2024-09-12T00:56:55.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554100e20 msgr2=0x7f3554198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:55.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355b927640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554100e20 0x7f3554198560 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f355000e9f0 tx=0x7f355000edf0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 shutdown_connections 2024-09-12T00:56:55.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.815+0000 7f355b927640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f35400a2d70 0x7f35400a5230 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.816+0000 7f355b927640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3554102ef0 0x7f355419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.816+0000 7f355b927640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3554102570 0x7f3554198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.816+0000 7f355b927640 1 --2- 172.21.15.2:0/1479534569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3554100e20 0x7f3554198560 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.816+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 >> 172.21.15.2:0/1479534569 conn(0x7f35540fc7d0 msgr2=0x7f3554103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.816+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 shutdown_connections 2024-09-12T00:56:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:55.816+0000 7f355b927640 1 -- 172.21.15.2:0/1479534569 wait complete. 2024-09-12T00:56:56.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:56 smithi002 ceph-mon[31210]: pgmap v123: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 3.9 MiB/s wr, 677 op/s 2024-09-12T00:56:56.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:56 smithi071 ceph-mon[35276]: pgmap v123: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 3.9 MiB/s wr, 677 op/s 2024-09-12T00:56:56.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:56 smithi167 ceph-mon[35234]: pgmap v123: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 3.9 MiB/s wr, 677 op/s 2024-09-12T00:56:56.745 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd37d25ba', quiesce took 5.5 seconds. Will release after: 14.649999999999999 2024-09-12T00:56:58.214 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:56:58.215 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:56:58.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:56:58 smithi071 ceph-mon[35276]: pgmap v124: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.4 MiB/s wr, 922 op/s 2024-09-12T00:56:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:56:58.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:56:58 smithi002 ceph-mon[31210]: pgmap v124: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.4 MiB/s wr, 922 op/s 2024-09-12T00:56:58.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:56:58 smithi167 ceph-mon[35234]: pgmap v124: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.4 MiB/s wr, 922 op/s 2024-09-12T00:56:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 -- 172.21.15.2:0/801262193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0100b30 msgr2=0x7f56b0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 --2- 172.21.15.2:0/801262193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0100b30 0x7f56b0100f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009900 tx=0x7f56ac02a470 comp rx=0 tx=0).stop 2024-09-12T00:56:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 -- 172.21.15.2:0/801262193 shutdown_connections 2024-09-12T00:56:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 --2- 172.21.15.2:0/801262193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56b0105f40 0x7f56b01063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 --2- 172.21.15.2:0/801262193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b0101450 0x7f56b0105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 --2- 172.21.15.2:0/801262193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0100b30 0x7f56b0100f10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 -- 172.21.15.2:0/801262193 >> 172.21.15.2:0/801262193 conn(0x7f56b00fc7a0 msgr2=0x7f56b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 -- 172.21.15.2:0/801262193 shutdown_connections 2024-09-12T00:56:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.928+0000 7f56b7f73640 1 -- 172.21.15.2:0/801262193 wait complete. 2024-09-12T00:56:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b7f73640 1 Processor -- start 2024-09-12T00:56:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b7f73640 1 -- start start 2024-09-12T00:56:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b7f73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b0100b30 0x7f56b01a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b7f73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0101450 0x7f56b01a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b7f73640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56b0105f40 0x7f56b019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b7f73640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56b0118570 con 0x7f56b0101450 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b7f73640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01183f0 con 0x7f56b0105f40 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b7f73640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01186f0 con 0x7f56b0100b30 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b550e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0101450 0x7f56b01a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b550e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0101450 0x7f56b01a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38756/0 (socket says 172.21.15.2:38756) 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b550e640 1 -- 172.21.15.2:0/2084845781 learned_addr learned my addr 172.21.15.2:0/2084845781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b6510640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56b0105f40 0x7f56b019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b0100b30 0x7f56b01a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b550e640 1 -- 172.21.15.2:0/2084845781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b0100b30 msgr2=0x7f56b01a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b550e640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b0100b30 0x7f56b01a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b550e640 1 -- 172.21.15.2:0/2084845781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56b0105f40 msgr2=0x7f56b019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b550e640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56b0105f40 0x7f56b019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b550e640 1 -- 172.21.15.2:0/2084845781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b019efd0 con 0x7f56b0101450 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.929+0000 7f56b6510640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56b0105f40 0x7f56b019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.930+0000 7f56b550e640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0101450 0x7f56b01a4c20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f56a000d750 tx=0x7f56a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.930+0000 7f56a6ffd640 1 -- 172.21.15.2:0/2084845781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0017070 con 0x7f56b0101450 2024-09-12T00:56:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.930+0000 7f56b7f73640 1 -- 172.21.15.2:0/2084845781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b019f2c0 con 0x7f56b0101450 2024-09-12T00:56:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.930+0000 7f56a6ffd640 1 -- 172.21.15.2:0/2084845781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a0005020 con 0x7f56b0101450 2024-09-12T00:56:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.930+0000 7f56a6ffd640 1 -- 172.21.15.2:0/2084845781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0004d00 con 0x7f56b0101450 2024-09-12T00:56:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.930+0000 7f56b7f73640 1 -- 172.21.15.2:0/2084845781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b01ab5b0 con 0x7f56b0101450 2024-09-12T00:56:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.932+0000 7f56a6ffd640 1 -- 172.21.15.2:0/2084845781 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f56a0009a30 con 0x7f56b0101450 2024-09-12T00:56:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.932+0000 7f56ba34c740 1 Processor -- start 2024-09-12T00:56:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56ba34c740 1 -- start start 2024-09-12T00:56:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a301130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56ba34c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d35a259280 con 0x55d35a2fed40 2024-09-12T00:56:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56ba34c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d35a200b10 con 0x55d35a2f4480 2024-09-12T00:56:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56ba34c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d35a255240 con 0x55d35a2f3b60 2024-09-12T00:56:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56b550e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a301130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56a6ffd640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f569c0a2cf0 0x7f569c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56b550e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a301130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38768/0 (socket says 172.21.15.2:38768) 2024-09-12T00:56:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56b550e640 1 -- 172.21.15.2:0/694571846 learned_addr learned my addr 172.21.15.2:0/694571846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56b6510640 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56b6510640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f569c0a2cf0 0x7f569c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.933+0000 7f56a6ffd640 1 -- 172.21.15.2:0/2084845781 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f56a00cef70 con 0x7f56b0101450 2024-09-12T00:56:58.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f56b550e640 1 -- 172.21.15.2:0/694571846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 msgr2=0x55d35a2f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:58.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f56b550e640 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f56b550e640 1 -- 172.21.15.2:0/694571846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 msgr2=0x55d35a2fe800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:58.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f56b550e640 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2fe800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f56b550e640 1 -- 172.21.15.2:0/694571846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d35a20d1f0 con 0x55d35a2fed40 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f56b6510640 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f56b550e640 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a301130 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f56a0097db0 tx=0x7f56a00054d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a2f8326e1e441b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f56b6510640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f569c0a2cf0 0x7f569c0a51b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56a8007310 tx=0x7f56a80072a0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f569bfff640 1 -- 172.21.15.2:0/694571846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0020050 con 0x55d35a2fed40 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f569bfff640 1 -- 172.21.15.2:0/694571846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a00a2b10 con 0x55d35a2fed40 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.934+0000 7f569bfff640 1 -- 172.21.15.2:0/694571846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a00051d0 con 0x55d35a2fed40 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 -- 172.21.15.2:0/694571846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 msgr2=0x55d35a301130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a301130 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f56a0097db0 tx=0x7f56a00054d0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 -- 172.21.15.2:0/694571846 shutdown_connections 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a301130 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 --2- 172.21.15.2:0/694571846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 -- 172.21.15.2:0/694571846 >> 172.21.15.2:0/694571846 conn(0x55d35a2f00f0 msgr2=0x55d35a2f04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:58.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 -- 172.21.15.2:0/694571846 shutdown_connections 2024-09-12T00:56:58.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 -- 172.21.15.2:0/694571846 wait complete. 2024-09-12T00:56:58.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 -- start start 2024-09-12T00:56:58.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.935+0000 7f56ba34c740 1 Processor -- start 2024-09-12T00:56:58.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2f3b60 0x55d35a2fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2fed40 0x55d35a2fc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56ba34c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d35a301910 con 0x55d35a2f3b60 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56ba34c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d35a213f10 con 0x55d35a2f4480 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56ba34c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d35a301a90 con 0x55d35a2fed40 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56ba34c740 10 client.0 _ll_register_callbacks cb 0x55d35a1dca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b5d0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2f3b60 0x55d35a2fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b5d0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2f3b60 0x55d35a2fbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38770/0 (socket says 172.21.15.2:38770) 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b5d0f640 1 -- 172.21.15.2:0/2684393796 learned_addr learned my addr 172.21.15.2:0/2684393796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b550e640 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b6510640 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2fed40 0x55d35a2fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b5d0f640 1 -- 172.21.15.2:0/2684393796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2fed40 msgr2=0x55d35a2fc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2fed40 0x55d35a2fc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b5d0f640 1 -- 172.21.15.2:0/2684393796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 msgr2=0x55d35a2fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b5d0f640 1 -- 172.21.15.2:0/2684393796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d359fca6a0 con 0x55d35a2f3b60 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.936+0000 7f56b6510640 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2fed40 0x55d35a2fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2f3b60 0x55d35a2fbb90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009900 tx=0x7f56ac0319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d899ccff51b6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56997fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56997fa640 1 -- 172.21.15.2:0/2684393796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac035040 con 0x55d35a2f3b60 2024-09-12T00:56:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56ba34c740 1 -- 172.21.15.2:0/2684393796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d35a2667f0 con 0x55d35a2f3b60 2024-09-12T00:56:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56997fa640 1 -- 172.21.15.2:0/2684393796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f56ac005020 con 0x55d35a2f3b60 2024-09-12T00:56:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56997fa640 1 -- 172.21.15.2:0/2684393796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f56ac005220 con 0x55d35a2f3b60 2024-09-12T00:56:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56ba34c740 10 client.16212 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56ba34c740 1 -- 172.21.15.2:0/2684393796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d35a30d4f0 con 0x55d35a2f3b60 2024-09-12T00:56:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56997fa640 1 -- 172.21.15.2:0/2684393796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d35a2667f0 con 0x55d35a2f3b60 2024-09-12T00:56:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56997fa640 1 -- 172.21.15.2:0/2684393796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f56ac003680 con 0x55d35a2f3b60 2024-09-12T00:56:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56ba34c740 10 client.16212 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56ba34c740 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.937+0000 7f56ba34c740 20 client.16212 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.938+0000 7f56ba34c740 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d35a30e9b0 0x55d35a310de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.938+0000 7f56ba34c740 4 client.16212 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.938+0000 7f56ba34c740 1 -- 172.21.15.2:0/2684393796 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d35a260d00 con 0x55d35a30e9b0 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.938+0000 7f56b550e640 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d35a30e9b0 0x55d35a310de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.938+0000 7f56997fa640 10 client.16212 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.938+0000 7f56b550e640 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d35a30e9b0 0x55d35a310de0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb00a44f02474c8e server_cookie=72c6fa3fff94d47a in_seq=0 out_seq=0 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56997fa640 1 -- 172.21.15.2:0/2684393796 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d35a260d00 con 0x55d35a30e9b0 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56997fa640 10 client.16212 handle_command_reply: tid=0 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 client.16212 shutdown 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 -- 172.21.15.2:0/2684393796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2f3b60 msgr2=0x55d35a2fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2f3b60 0x55d35a2fbb90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009900 tx=0x7f56ac0319b0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 -- 172.21.15.2:0/2684393796 shutdown_connections 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d35a30e9b0 0x55d35a310de0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2fed40 0x55d35a2fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 --2- 172.21.15.2:0/2684393796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2f3b60 0x55d35a2fbb90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56997fa640 0 client.16212 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 -- 172.21.15.2:0/2684393796 >> 172.21.15.2:0/2684393796 conn(0x55d35a2f00f0 msgr2=0x55d35a2f5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 -- 172.21.15.2:0/2684393796 shutdown_connections 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 1 -- 172.21.15.2:0/2684393796 wait complete. 2024-09-12T00:56:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.939+0000 7f56ba34c740 20 client.16212 trim_cache size 0 max 16384 2024-09-12T00:56:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56ba34c740 1 Processor -- start 2024-09-12T00:56:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56ba34c740 1 -- start start 2024-09-12T00:56:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f3b60 0x55d35a2f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f4480 0x55d35a3166b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a316bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56ba34c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01b67f0 con 0x55d35a2fed40 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56ba34c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01b40c0 con 0x55d35a2f3b60 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56ba34c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01b1f10 con 0x55d35a2f4480 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56b6510640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a316bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56b6510640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a316bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38778/0 (socket says 172.21.15.2:38778) 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.957+0000 7f56b6510640 1 -- 172.21.15.2:0/3845817807 learned_addr learned my addr 172.21.15.2:0/3845817807 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b550e640 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f4480 0x55d35a3166b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f3b60 0x55d35a2f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b6510640 1 -- 172.21.15.2:0/3845817807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f4480 msgr2=0x55d35a3166b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b6510640 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f4480 0x55d35a3166b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b6510640 1 -- 172.21.15.2:0/3845817807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f3b60 msgr2=0x55d35a2f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b6510640 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f3b60 0x55d35a2f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b6510640 1 -- 172.21.15.2:0/3845817807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d35a2eff20 con 0x55d35a2fed40 2024-09-12T00:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f3b60 0x55d35a2f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f56b6510640 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a316bf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f56a8007cf0 tx=0x7f56a8007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346fbe9356d34a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f569b7fe640 1 -- 172.21.15.2:0/3845817807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a802a480 con 0x55d35a2fed40 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f569b7fe640 1 -- 172.21.15.2:0/3845817807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a802ab00 con 0x55d35a2fed40 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.958+0000 7f569b7fe640 1 -- 172.21.15.2:0/3845817807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a801fa20 con 0x55d35a2fed40 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 -- 172.21.15.2:0/3845817807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 msgr2=0x55d35a316bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a316bf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f56a8007cf0 tx=0x7f56a8007620 comp rx=0 tx=0).stop 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 -- 172.21.15.2:0/3845817807 shutdown_connections 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a316bf0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f4480 0x55d35a3166b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 --2- 172.21.15.2:0/3845817807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f3b60 0x55d35a2f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 -- 172.21.15.2:0/3845817807 >> 172.21.15.2:0/3845817807 conn(0x55d35a2f00f0 msgr2=0x55d35a2f55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 -- 172.21.15.2:0/3845817807 shutdown_connections 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 -- 172.21.15.2:0/3845817807 wait complete. 2024-09-12T00:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 -- start start 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.959+0000 7f56ba34c740 1 Processor -- start 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56ba34c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a2f9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56ba34c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01b2580 con 0x55d35a2fed40 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56ba34c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01b39f0 con 0x55d35a2f4480 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56ba34c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01b2c50 con 0x55d35a2f3b60 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56ba34c740 10 client.0 _ll_register_callbacks cb 0x7f56ac005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a2f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a2f9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38790/0 (socket says 172.21.15.2:38790) 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 -- 172.21.15.2:0/154502771 learned_addr learned my addr 172.21.15.2:0/154502771 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b550e640 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 -- 172.21.15.2:0/154502771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 msgr2=0x55d35a2f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 -- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 msgr2=0x55d35a2f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 -- 172.21.15.2:0/154502771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d35a3052d0 con 0x55d35a2fed40 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b550e640 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56b6510640 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a2f9630 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f56a8004fd0 tx=0x7f56a800ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208d9990de83f9f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.960+0000 7f56997fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56997fa640 1 -- 172.21.15.2:0/154502771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a802a890 con 0x55d35a2fed40 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56997fa640 1 -- 172.21.15.2:0/154502771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f56a801f640 con 0x55d35a2fed40 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 1 -- 172.21.15.2:0/154502771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56a802ab00 con 0x55d35a2fed40 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56997fa640 1 -- 172.21.15.2:0/154502771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f56a801f840 con 0x55d35a2fed40 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 10 client.16218 fetch_fsmap learned FSMap version 27 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 1 -- 172.21.15.2:0/154502771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d35a379940 con 0x55d35a2fed40 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56997fa640 1 -- 172.21.15.2:0/154502771 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a802ab00 con 0x55d35a2fed40 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56997fa640 1 -- 172.21.15.2:0/154502771 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f56a80056b0 con 0x55d35a2fed40 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 10 client.16218 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 20 client.16218 populate_metadata read hostname 'smithi002' 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d35a379fe0 0x55d35a37c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 4 client.16218 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.961+0000 7f56ba34c740 1 -- 172.21.15.2:0/154502771 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d35a1dd110 con 0x55d35a379fe0 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.962+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d35a379fe0 0x55d35a37c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.962+0000 7f56b5d0f640 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d35a379fe0 0x55d35a37c400 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a0bdd9d39d71b67 server_cookie=27123f87a1c95f0b in_seq=0 out_seq=0 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.962+0000 7f56997fa640 10 client.16218 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.963+0000 7f56997fa640 1 -- 172.21.15.2:0/154502771 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d35a1dd110 con 0x55d35a379fe0 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.963+0000 7f56997fa640 10 client.16218 handle_command_reply: tid=0 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.963+0000 7f56ba34c740 1 client.16218 shutdown 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.963+0000 7f56ba34c740 1 -- 172.21.15.2:0/154502771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 msgr2=0x55d35a2f9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.963+0000 7f56ba34c740 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a2f9630 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f56a8004fd0 tx=0x7f56a800ef80 comp rx=0 tx=0).stop 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 1 -- 172.21.15.2:0/154502771 shutdown_connections 2024-09-12T00:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d35a379fe0 0x55d35a37c400 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d35a2fed40 0x55d35a2f9630 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d35a2f4480 0x55d35a2f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 1 --2- 172.21.15.2:0/154502771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d35a2f3b60 0x55d35a2f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 1 -- 172.21.15.2:0/154502771 >> 172.21.15.2:0/154502771 conn(0x55d35a2f00f0 msgr2=0x55d35a2f5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56997fa640 0 client.16218 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 1 -- 172.21.15.2:0/154502771 shutdown_connections 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 1 -- 172.21.15.2:0/154502771 wait complete. 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56ba34c740 20 client.16218 trim_cache size 0 max 16384 2024-09-12T00:56:58.969 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:56:58.970 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:56:58.970 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "09908246-d7fe-4211-b926-bd78fb2c98d0", 2024-09-12T00:56:58.970 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:56:58.970 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:56:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 -- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f569c0a2cf0 msgr2=0x7f569c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f569c0a2cf0 0x7f569c0a51b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56a8007310 tx=0x7f56a80072a0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 -- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0101450 msgr2=0x7f56b01a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:56:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0101450 0x7f56b01a4c20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f56a000d750 tx=0x7f56a000dc10 comp rx=0 tx=0).stop 2024-09-12T00:56:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 -- 172.21.15.2:0/2084845781 shutdown_connections 2024-09-12T00:56:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f569c0a2cf0 0x7f569c0a51b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56b0105f40 0x7f56b019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0101450 0x7f56b01a4c20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 --2- 172.21.15.2:0/2084845781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b0100b30 0x7f56b01a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:56:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.964+0000 7f56b7f73640 1 -- 172.21.15.2:0/2084845781 >> 172.21.15.2:0/2084845781 conn(0x7f56b00fc7a0 msgr2=0x7f56b01038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:56:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.965+0000 7f56b7f73640 1 -- 172.21.15.2:0/2084845781 shutdown_connections 2024-09-12T00:56:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:56:58.965+0000 7f56b7f73640 1 -- 172.21.15.2:0/2084845781 wait complete. 2024-09-12T00:56:59.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:57:00.056 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:00.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: pgmap v125: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.4 MiB/s wr, 565 op/s 2024-09-12T00:57:00.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:57:00.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:00.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:00.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.321 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:00.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:00.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:00.322 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:00 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: pgmap v125: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.4 MiB/s wr, 565 op/s 2024-09-12T00:57:00.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:00.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:00 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: pgmap v125: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.4 MiB/s wr, 565 op/s 2024-09-12T00:57:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:57:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:00.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:00.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:00.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:00 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:00.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 -- 172.21.15.2:0/3459372058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60101de0 msgr2=0x7eff601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 --2- 172.21.15.2:0/3459372058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60101de0 0x7eff601021c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009900 tx=0x7eff5c02a410 comp rx=0 tx=0).stop 2024-09-12T00:57:00.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 -- 172.21.15.2:0/3459372058 shutdown_connections 2024-09-12T00:57:00.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 --2- 172.21.15.2:0/3459372058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff60106f10 0x7eff6010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 --2- 172.21.15.2:0/3459372058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff60102790 0x7eff601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 --2- 172.21.15.2:0/3459372058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60101de0 0x7eff601021c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 -- 172.21.15.2:0/3459372058 >> 172.21.15.2:0/3459372058 conn(0x7eff600fd8c0 msgr2=0x7eff600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 -- 172.21.15.2:0/3459372058 shutdown_connections 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.546+0000 7eff67477640 1 -- 172.21.15.2:0/3459372058 wait complete. 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff67477640 1 Processor -- start 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff67477640 1 -- start start 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff67477640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff60101de0 0x7eff601984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff67477640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60102790 0x7eff601989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff67477640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff60106f10 0x7eff6019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff67477640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7eff60111fc0 con 0x7eff60102790 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff67477640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff60111e40 con 0x7eff60101de0 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff67477640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff60112140 con 0x7eff60106f10 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60102790 0x7eff601989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60102790 0x7eff601989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38816/0 (socket says 172.21.15.2:38816) 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 -- 172.21.15.2:0/1440087912 learned_addr learned my addr 172.21.15.2:0/1440087912 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff65213640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff60101de0 0x7eff601984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff65a14640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff60106f10 0x7eff6019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 -- 172.21.15.2:0/1440087912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff60106f10 msgr2=0x7eff6019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff60106f10 0x7eff6019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 -- 172.21.15.2:0/1440087912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff60101de0 msgr2=0x7eff601984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff60101de0 0x7eff601984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 -- 172.21.15.2:0/1440087912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6019d450 con 0x7eff60102790 2024-09-12T00:57:00.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff65213640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff60101de0 0x7eff601984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.547+0000 7eff64a12640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60102790 0x7eff601989e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7eff5000e9f0 tx=0x7eff5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.548+0000 7eff567fc640 1 -- 172.21.15.2:0/1440087912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5000cd80 con 0x7eff60102790 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.548+0000 7eff567fc640 1 -- 172.21.15.2:0/1440087912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff50010910 con 0x7eff60102790 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.548+0000 7eff67477640 1 -- 172.21.15.2:0/1440087912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6019d740 con 0x7eff60102790 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.548+0000 7eff567fc640 1 -- 172.21.15.2:0/1440087912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50018990 con 0x7eff60102790 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.548+0000 7eff67477640 1 -- 172.21.15.2:0/1440087912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff601a5020 con 0x7eff60102790 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.550+0000 7eff567fc640 1 -- 172.21.15.2:0/1440087912 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7eff50010ac0 con 0x7eff60102790 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.550+0000 7eff69850740 1 Processor -- start 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff69850740 1 -- start start 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff69850740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff69850740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff69850740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff69850740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fbbd5402e0 con 0x55fbbd5dadc0 2024-09-12T00:57:00.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff69850740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fbbd4e7ce0 con 0x55fbbd5da4a0 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff69850740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fbbd53c2a0 con 0x55fbbd5e5680 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff567fc640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7eff4c0a2cf0 0x7eff4c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65213640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65213640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38828/0 (socket says 172.21.15.2:38828) 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65213640 1 -- 172.21.15.2:0/2310499517 learned_addr learned my addr 172.21.15.2:0/2310499517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65a14640 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65a14640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7eff4c0a2cf0 0x7eff4c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff567fc640 1 -- 172.21.15.2:0/1440087912 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7eff500cf990 con 0x7eff60102790 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65213640 1 -- 172.21.15.2:0/2310499517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5e5680 msgr2=0x55fbbd5e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff64a12640 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65213640 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65213640 1 -- 172.21.15.2:0/2310499517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 msgr2=0x55fbbd5da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65213640 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5da880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65213640 1 -- 172.21.15.2:0/2310499517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbd4cc440 con 0x55fbbd5dadc0 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff64a12640 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.551+0000 7eff65a14640 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.552+0000 7eff65213640 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e5140 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009230 tx=0x7eff5c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a84625008c9e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.552+0000 7eff65a14640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7eff4c0a2cf0 0x7eff4c0a51b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff58005c40 tx=0x7eff58005bd0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.552+0000 7eff4b7fe640 1 -- 172.21.15.2:0/2310499517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c035030 con 0x55fbbd5dadc0 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.552+0000 7eff4b7fe640 1 -- 172.21.15.2:0/2310499517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff5c005520 con 0x55fbbd5dadc0 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.552+0000 7eff4b7fe640 1 -- 172.21.15.2:0/2310499517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0035f0 con 0x55fbbd5dadc0 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 -- 172.21.15.2:0/2310499517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5dadc0 msgr2=0x55fbbd5e5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e5140 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009230 tx=0x7eff5c0040c0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 -- 172.21.15.2:0/2310499517 shutdown_connections 2024-09-12T00:57:00.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e5140 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 --2- 172.21.15.2:0/2310499517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 -- 172.21.15.2:0/2310499517 >> 172.21.15.2:0/2310499517 conn(0x55fbbd5d6a30 msgr2=0x55fbbd5d6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 -- 172.21.15.2:0/2310499517 shutdown_connections 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 -- 172.21.15.2:0/2310499517 wait complete. 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 -- start start 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.553+0000 7eff69850740 1 Processor -- start 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff69850740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff69850740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff69850740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff69850740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fbbd5e8250 con 0x55fbbd5e5680 2024-09-12T00:57:00.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff69850740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fbbd4fb050 con 0x55fbbd5da4a0 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff69850740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fbbd5e83d0 con 0x55fbbd5dadc0 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff69850740 10 client.0 _ll_register_callbacks cb 0x55fbbd53b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38832/0 (socket says 172.21.15.2:38832) 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 -- 172.21.15.2:0/1374762815 learned_addr learned my addr 172.21.15.2:0/1374762815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65213640 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff64a12640 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 -- 172.21.15.2:0/1374762815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 msgr2=0x55fbbd5e2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 -- 172.21.15.2:0/1374762815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 msgr2=0x55fbbd5e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5e4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 -- 172.21.15.2:0/1374762815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbd2b13c0 con 0x55fbbd5e5680 2024-09-12T00:57:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff65a14640 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e27b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7eff5800db90 tx=0x7eff58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e40c55923b7a21f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.554+0000 7eff48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff48ff9640 1 -- 172.21.15.2:0/1374762815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58024030 con 0x55fbbd5e5680 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff48ff9640 1 -- 172.21.15.2:0/1374762815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7eff5801b070 con 0x55fbbd5e5680 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 1 -- 172.21.15.2:0/1374762815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff5c005520 con 0x55fbbd5e5680 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff48ff9640 1 -- 172.21.15.2:0/1374762815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff58030050 con 0x55fbbd5e5680 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 10 client.16230 fetch_fsmap learned FSMap version 27 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 1 -- 172.21.15.2:0/1374762815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fbbd5f3bc0 con 0x55fbbd5e5680 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff48ff9640 1 -- 172.21.15.2:0/1374762815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff5c005520 con 0x55fbbd5e5680 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff48ff9640 1 -- 172.21.15.2:0/1374762815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7eff5801e040 con 0x55fbbd5e5680 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 10 client.16230 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 20 client.16230 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fbbd5f5020 0x55fbbd5f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 4 client.16230 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.555+0000 7eff69850740 1 -- 172.21.15.2:0/1374762815 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbbd54d850 con 0x55fbbd5f5020 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.556+0000 7eff65213640 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fbbd5f5020 0x55fbbd5f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.556+0000 7eff48ff9640 10 client.16230 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.556+0000 7eff65213640 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fbbd5f5020 0x55fbbd5f74c0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a52ac1c49f86055 server_cookie=5940d131f7ca709a in_seq=0 out_seq=0 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff48ff9640 1 -- 172.21.15.2:0/1374762815 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbbd54d850 con 0x55fbbd5f5020 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff48ff9640 10 client.16230 handle_command_reply: tid=0 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 client.16230 shutdown 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 -- 172.21.15.2:0/1374762815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5e5680 msgr2=0x55fbbd5e27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e27b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7eff5800db90 tx=0x7eff58004a40 comp rx=0 tx=0).stop 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 -- 172.21.15.2:0/1374762815 shutdown_connections 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fbbd5f5020 0x55fbbd5f74c0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5e5680 0x55fbbd5e27b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5e2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 --2- 172.21.15.2:0/1374762815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff48ff9640 0 client.16230 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 -- 172.21.15.2:0/1374762815 >> 172.21.15.2:0/1374762815 conn(0x55fbbd5d6a30 msgr2=0x55fbbd5dc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 -- 172.21.15.2:0/1374762815 shutdown_connections 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 1 -- 172.21.15.2:0/1374762815 wait complete. 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.557+0000 7eff69850740 20 client.16230 trim_cache size 0 max 16384 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.574+0000 7eff69850740 1 Processor -- start 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.574+0000 7eff69850740 1 -- start start 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff69850740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff69850740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff69850740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff69850740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7eff601b0250 con 0x55fbbd5d6a30 2024-09-12T00:57:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff69850740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff601adb20 con 0x55fbbd5da4a0 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff69850740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff601ab970 con 0x55fbbd5dadc0 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5e41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38834/0 (socket says 172.21.15.2:38834) 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 -- 172.21.15.2:0/536059032 learned_addr learned my addr 172.21.15.2:0/536059032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65a14640 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff64a12640 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 -- 172.21.15.2:0/536059032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 msgr2=0x55fbbd5fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 -- 172.21.15.2:0/536059032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 msgr2=0x55fbbd5fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 -- 172.21.15.2:0/536059032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbd5dabf0 con 0x55fbbd5d6a30 2024-09-12T00:57:00.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff64a12640 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.575+0000 7eff65213640 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5e41e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009900 tx=0x7eff5c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0145e6a32363a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff4affd640 1 -- 172.21.15.2:0/536059032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c035040 con 0x55fbbd5d6a30 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff4affd640 1 -- 172.21.15.2:0/536059032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff5c0051a0 con 0x55fbbd5d6a30 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff4affd640 1 -- 172.21.15.2:0/536059032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c031ba0 con 0x55fbbd5d6a30 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 -- 172.21.15.2:0/536059032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5d6a30 msgr2=0x55fbbd5e41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5e41e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009900 tx=0x7eff5c000bc0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 -- 172.21.15.2:0/536059032 shutdown_connections 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 --2- 172.21.15.2:0/536059032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5e41e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 -- 172.21.15.2:0/536059032 >> 172.21.15.2:0/536059032 conn(0x55fbbd5e2910 msgr2=0x55fbbd5e3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 -- 172.21.15.2:0/536059032 shutdown_connections 2024-09-12T00:57:00.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.576+0000 7eff69850740 1 -- 172.21.15.2:0/536059032 wait complete. 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 1 -- start start 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 1 Processor -- start 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5edd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5eb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7eff601abfe0 con 0x55fbbd5da4a0 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff601ad450 con 0x55fbbd5dadc0 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff601ac6b0 con 0x55fbbd5d6a30 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff69850740 10 client.0 _ll_register_callbacks cb 0x7eff580127e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff64a12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff64a12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38844/0 (socket says 172.21.15.2:38844) 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff64a12640 1 -- 172.21.15.2:0/120872609 learned_addr learned my addr 172.21.15.2:0/120872609 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.577+0000 7eff65a14640 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff65213640 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff64a12640 1 -- 172.21.15.2:0/120872609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5d6a30 msgr2=0x55fbbd5edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff64a12640 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5edd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff64a12640 1 -- 172.21.15.2:0/120872609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5dadc0 msgr2=0x55fbbd5eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff64a12640 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5eb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff64a12640 1 -- 172.21.15.2:0/120872609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbd5ebdf0 con 0x55fbbd5da4a0 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff64a12640 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5eb0d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff50000c00 tx=0x7eff5009b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395ad2fa0e3a38f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff48ff9640 1 -- 172.21.15.2:0/120872609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500cd4c0 con 0x55fbbd5da4a0 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff48ff9640 1 -- 172.21.15.2:0/120872609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7eff50018b30 con 0x55fbbd5da4a0 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff69850740 1 -- 172.21.15.2:0/120872609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff5c0051a0 con 0x55fbbd5da4a0 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff48ff9640 1 -- 172.21.15.2:0/120872609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff500a4a70 con 0x55fbbd5da4a0 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff69850740 10 client.16236 fetch_fsmap learned FSMap version 27 2024-09-12T00:57:00.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff69850740 1 -- 172.21.15.2:0/120872609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fbbd65fdf0 con 0x55fbbd5da4a0 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.578+0000 7eff48ff9640 1 -- 172.21.15.2:0/120872609 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff5c0051a0 con 0x55fbbd5da4a0 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff48ff9640 1 -- 172.21.15.2:0/120872609 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7eff50097b50 con 0x55fbbd5da4a0 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff69850740 10 client.16236 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff69850740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff69850740 20 client.16236 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff69850740 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fbbd5e5680 0x55fbbd662550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff69850740 4 client.16236 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff69850740 1 -- 172.21.15.2:0/120872609 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fbbd547d60 con 0x55fbbd5e5680 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff65213640 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fbbd5e5680 0x55fbbd662550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff48ff9640 10 client.16236 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.579+0000 7eff65213640 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fbbd5e5680 0x55fbbd662550 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2f954b2b2a9d17 server_cookie=841cf52881d4ea44 in_seq=0 out_seq=0 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff48ff9640 1 -- 172.21.15.2:0/120872609 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fbbd547d60 con 0x55fbbd5e5680 2024-09-12T00:57:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff48ff9640 10 client.16236 handle_command_reply: tid=0 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 client.16236 shutdown 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 -- 172.21.15.2:0/120872609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5da4a0 msgr2=0x55fbbd5eb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5eb0d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff50000c00 tx=0x7eff5009b820 comp rx=0 tx=0).stop 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 -- 172.21.15.2:0/120872609 shutdown_connections 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fbbd5e5680 0x55fbbd662550 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff48ff9640 0 client.16236 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbbd5dadc0 0x55fbbd5eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbbd5da4a0 0x55fbbd5eb0d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 --2- 172.21.15.2:0/120872609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbbd5d6a30 0x55fbbd5edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 -- 172.21.15.2:0/120872609 >> 172.21.15.2:0/120872609 conn(0x55fbbd5e2910 msgr2=0x55fbbd5e42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 -- 172.21.15.2:0/120872609 shutdown_connections 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 1 -- 172.21.15.2:0/120872609 wait complete. 2024-09-12T00:57:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.580+0000 7eff69850740 20 client.16236 trim_cache size 0 max 16384 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout: "09908246-d7fe-4211-b926-bd78fb2c98d0": { 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "09908246-d7fe-4211-b926-bd78fb2c98d0", 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:00.596 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:00.597 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:57:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 -- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7eff4c0a2cf0 msgr2=0x7eff4c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7eff4c0a2cf0 0x7eff4c0a51b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff58005c40 tx=0x7eff58005bd0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 -- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60102790 msgr2=0x7eff601989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60102790 0x7eff601989e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7eff5000e9f0 tx=0x7eff5000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 -- 172.21.15.2:0/1440087912 shutdown_connections 2024-09-12T00:57:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7eff4c0a2cf0 0x7eff4c0a51b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff60106f10 0x7eff6019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60102790 0x7eff601989e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 --2- 172.21.15.2:0/1440087912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff60101de0 0x7eff601984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 -- 172.21.15.2:0/1440087912 >> 172.21.15.2:0/1440087912 conn(0x7eff600fd8c0 msgr2=0x7eff600fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 -- 172.21.15.2:0/1440087912 shutdown_connections 2024-09-12T00:57:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:00.581+0000 7eff67477640 1 -- 172.21.15.2:0/1440087912 wait complete. 2024-09-12T00:57:01.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:01 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:01.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:01 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:01.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:01 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:01.559 INFO:tasks.cephfs.filesystem:scrub status for tag:09908246-d7fe-4211-b926-bd78fb2c98d0 - {'path': '/', 'tag': '09908246-d7fe-4211-b926-bd78fb2c98d0', 'options': 'recursive,force'} 2024-09-12T00:57:02.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:02 smithi071 ceph-mon[35276]: pgmap v126: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.4 MiB/s wr, 584 op/s 2024-09-12T00:57:02.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:02 smithi002 ceph-mon[31210]: pgmap v126: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.4 MiB/s wr, 584 op/s 2024-09-12T00:57:02.536 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:02 smithi167 ceph-mon[35234]: pgmap v126: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.4 MiB/s wr, 584 op/s 2024-09-12T00:57:03.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:03 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:57:03.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:03 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:57:03.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:03 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:57:04.343 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:04 smithi071 ceph-mon[35276]: pgmap v127: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-12T00:57:04.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:04 smithi002 ceph-mon[31210]: pgmap v127: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-12T00:57:04.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:04 smithi167 ceph-mon[35234]: pgmap v127: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-12T00:57:06.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:06 smithi071 ceph-mon[35276]: pgmap v128: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-12T00:57:06.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:06 smithi002 ceph-mon[31210]: pgmap v128: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-12T00:57:06.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:06 smithi167 ceph-mon[35234]: pgmap v128: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-12T00:57:07.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:07 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:57:07.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:07 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:57:07.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:07 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:57:07.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:07 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:57:07.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:07 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:57:07.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:07 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:57:07.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:07 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:57:07.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:07 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:57:07.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:07 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:57:08.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:08 smithi071 ceph-mon[35276]: pgmap v129: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-09-12T00:57:08.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:08 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:57:08.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:08 smithi002 ceph-mon[31210]: pgmap v129: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-09-12T00:57:08.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:08 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:57:08.536 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:08 smithi167 ceph-mon[35234]: pgmap v129: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-09-12T00:57:08.540 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:08 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:57:09.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:57:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:57:09.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:57:09.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:57:09.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:57:09.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:57:09.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:57:09.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:57:09.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:57:10.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:10 smithi071 ceph-mon[35276]: pgmap v130: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:57:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:10 smithi002 ceph-mon[31210]: pgmap v130: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:57:10.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:10 smithi167 ceph-mon[35234]: pgmap v130: 97 pgs: 97 active+clean; 131 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-12T00:57:11.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:57:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:12.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.144+0000 7fdd80d41640 1 -- 172.21.15.2:0/2823979798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 msgr2=0x7fdd7c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.144+0000 7fdd80d41640 1 --2- 172.21.15.2:0/2823979798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 0x7fdd7c1029b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009900 tx=0x7fdd7002a480 comp rx=0 tx=0).stop 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.144+0000 7fdd80d41640 1 -- 172.21.15.2:0/2823979798 shutdown_connections 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.145+0000 7fdd80d41640 1 --2- 172.21.15.2:0/2823979798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd7c102ef0 0x7fdd7c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.145+0000 7fdd80d41640 1 --2- 172.21.15.2:0/2823979798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 0x7fdd7c1029b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.145+0000 7fdd80d41640 1 --2- 172.21.15.2:0/2823979798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd7c100e20 0x7fdd7c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.145+0000 7fdd80d41640 1 -- 172.21.15.2:0/2823979798 >> 172.21.15.2:0/2823979798 conn(0x7fdd7c0fc7d0 msgr2=0x7fdd7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.145+0000 7fdd80d41640 1 -- 172.21.15.2:0/2823979798 shutdown_connections 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.145+0000 7fdd80d41640 1 -- 172.21.15.2:0/2823979798 wait complete. 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.145+0000 7fdd80d41640 1 Processor -- start 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.145+0000 7fdd80d41640 1 -- start start 2024-09-12T00:57:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd80d41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd7c100e20 0x7fdd7c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd80d41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 0x7fdd7c197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd80d41640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd7c102ef0 0x7fdd7c197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd80d41640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c110fa0 con 0x7fdd7c102570 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd80d41640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c110e20 con 0x7fdd7c102ef0 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd80d41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c111120 con 0x7fdd7c100e20 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 0x7fdd7c197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 0x7fdd7c197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56302/0 (socket says 172.21.15.2:56302) 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 -- 172.21.15.2:0/3878301831 learned_addr learned my addr 172.21.15.2:0/3878301831 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd7a59c640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd7c100e20 0x7fdd7c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd7ad9d640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd7c102ef0 0x7fdd7c197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 -- 172.21.15.2:0/3878301831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd7c100e20 msgr2=0x7fdd7c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd7c100e20 0x7fdd7c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 -- 172.21.15.2:0/3878301831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd7c102ef0 msgr2=0x7fdd7c197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd7c102ef0 0x7fdd7c197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 -- 172.21.15.2:0/3878301831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c1a6a30 con 0x7fdd7c102570 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd7a59c640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd7c100e20 0x7fdd7c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd79d9b640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 0x7fdd7c197700 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdd70006010 tx=0x7fdd70003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.146+0000 7fdd6b7fe640 1 -- 172.21.15.2:0/3878301831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7003f070 con 0x7fdd7c102570 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.147+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7c1a6cc0 con 0x7fdd7c102570 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.147+0000 7fdd6b7fe640 1 -- 172.21.15.2:0/3878301831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd70031c30 con 0x7fdd7c102570 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.147+0000 7fdd6b7fe640 1 -- 172.21.15.2:0/3878301831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70035030 con 0x7fdd7c102570 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.147+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7c1a71a0 con 0x7fdd7c102570 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.148+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd7c101200 con 0x7fdd7c102570 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.149+0000 7fdd6b7fe640 1 -- 172.21.15.2:0/3878301831 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fdd70042070 con 0x7fdd7c102570 2024-09-12T00:57:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.149+0000 7fdd6b7fe640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd640a2cf0 0x7fdd640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.149+0000 7fdd7a59c640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd640a2cf0 0x7fdd640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.150+0000 7fdd6b7fe640 1 -- 172.21.15.2:0/3878301831 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fdd700efdb0 con 0x7fdd7c102570 2024-09-12T00:57:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.150+0000 7fdd7a59c640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd640a2cf0 0x7fdd640a51b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c009930 tx=0x7fdd6c008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.154+0000 7fdd6b7fe640 1 -- 172.21.15.2:0/3878301831 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd70031de0 con 0x7fdd7c102570 2024-09-12T00:57:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.367+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd7c1090c0 con 0x7fdd7c102570 2024-09-12T00:57:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.367+0000 7fdd6b7fe640 1 -- 172.21.15.2:0/3878301831 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11900 (secure 0 0 0) 0x7fdd700bc980 con 0x7fdd7c102570 2024-09-12T00:57:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:57:12.368 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-12T00:57:02:048049+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:57:01.130770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:57:12.368 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-12T00:57:12.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.369+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd640a2cf0 msgr2=0x7fdd640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:12.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.369+0000 7fdd80d41640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd640a2cf0 0x7fdd640a51b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c009930 tx=0x7fdd6c008040 comp rx=0 tx=0).stop 2024-09-12T00:57:12.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.369+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 msgr2=0x7fdd7c197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:12.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.369+0000 7fdd80d41640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 0x7fdd7c197700 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdd70006010 tx=0x7fdd70003c10 comp rx=0 tx=0).stop 2024-09-12T00:57:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.370+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 shutdown_connections 2024-09-12T00:57:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.370+0000 7fdd80d41640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd640a2cf0 0x7fdd640a51b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.370+0000 7fdd80d41640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd7c102ef0 0x7fdd7c197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.370+0000 7fdd80d41640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c102570 0x7fdd7c197700 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.370+0000 7fdd80d41640 1 --2- 172.21.15.2:0/3878301831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd7c100e20 0x7fdd7c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.370+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 >> 172.21.15.2:0/3878301831 conn(0x7fdd7c0fc7d0 msgr2=0x7fdd7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.370+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 shutdown_connections 2024-09-12T00:57:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:12.370+0000 7fdd80d41640 1 -- 172.21.15.2:0/3878301831 wait complete. 2024-09-12T00:57:12.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:12 smithi071 ceph-mon[35276]: pgmap v131: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-09-12T00:57:12.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:12 smithi002 ceph-mon[31210]: pgmap v131: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-09-12T00:57:12.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:12 smithi167 ceph-mon[35234]: pgmap v131: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-09-12T00:57:13.084 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --set-id d37d25ba --release --await' 2024-09-12T00:57:13.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --set-id d37d25ba --release --await 2024-09-12T00:57:13.346 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:13.585 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:13 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3878301831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:13.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:13 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3878301831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:13.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:13 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3878301831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 -- 172.21.15.2:0/3780102620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28102790 msgr2=0x7f1b281067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 --2- 172.21.15.2:0/3780102620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28102790 0x7f1b281067e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009900 tx=0x7f1b1802a410 comp rx=0 tx=0).stop 2024-09-12T00:57:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 -- 172.21.15.2:0/3780102620 shutdown_connections 2024-09-12T00:57:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 --2- 172.21.15.2:0/3780102620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b28106f10 0x7f1b2810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 --2- 172.21.15.2:0/3780102620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28102790 0x7f1b281067e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 --2- 172.21.15.2:0/3780102620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b28101de0 0x7f1b281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 -- 172.21.15.2:0/3780102620 >> 172.21.15.2:0/3780102620 conn(0x7f1b280fd8c0 msgr2=0x7f1b280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 -- 172.21.15.2:0/3780102620 shutdown_connections 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.784+0000 7f1b3021c640 1 -- 172.21.15.2:0/3780102620 wait complete. 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b3021c640 1 Processor -- start 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b3021c640 1 -- start start 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b3021c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28101de0 0x7f1b28198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b3021c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b28102790 0x7f1b28198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b3021c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b28106f10 0x7f1b2819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b3021c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b28111f90 con 0x7f1b28101de0 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b3021c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b28111e10 con 0x7f1b28102790 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b3021c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b28112110 con 0x7f1b28106f10 2024-09-12T00:57:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b2dfb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28101de0 0x7f1b28198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b2dfb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28101de0 0x7f1b28198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56314/0 (socket says 172.21.15.2:56314) 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.785+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/55199144 learned_addr learned my addr 172.21.15.2:0/55199144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b2e7b9640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b28106f10 0x7f1b2819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b28102790 0x7f1b28198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/55199144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b28106f10 msgr2=0x7f1b2819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b28106f10 0x7f1b2819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/55199144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b28102790 msgr2=0x7f1b28198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b28102790 0x7f1b28198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/55199144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2819d3c0 con 0x7f1b28101de0 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28101de0 0x7f1b28198410 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400b4a0 tx=0x7f1b2400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b1effd640 1 -- 172.21.15.2:0/55199144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24014070 con 0x7f1b28101de0 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b3021c640 1 -- 172.21.15.2:0/55199144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2819d6b0 con 0x7f1b28101de0 2024-09-12T00:57:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b1effd640 1 -- 172.21.15.2:0/55199144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b24010af0 con 0x7f1b28101de0 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b1effd640 1 -- 172.21.15.2:0/55199144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24017d10 con 0x7f1b28101de0 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.786+0000 7f1b3021c640 1 -- 172.21.15.2:0/55199144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b281a4f90 con 0x7f1b28101de0 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.788+0000 7f1b1effd640 1 -- 172.21.15.2:0/55199144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f1b24017070 con 0x7f1b28101de0 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.789+0000 7f1b325f5740 1 Processor -- start 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.789+0000 7f1b325f5740 1 -- start start 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.789+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa57440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.789+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa61d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.789+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa64630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.789+0000 7f1b325f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558bcf9bc620 con 0x558bcfa57980 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.789+0000 7f1b325f5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558bcf963e50 con 0x558bcfa62240 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.789+0000 7f1b325f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558bcf9b85e0 con 0x558bcfa57060 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa61d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa61d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56326/0 (socket says 172.21.15.2:56326) 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/3589636725 learned_addr learned my addr 172.21.15.2:0/3589636725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2e7b9640 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa57440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b1effd640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b140a2cf0 0x7f1b140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa64630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/3589636725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 msgr2=0x558bcfa57440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa57440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/3589636725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 msgr2=0x558bcfa64630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa64630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/3589636725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bcf954d40 con 0x558bcfa57980 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2e7b9640 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa57440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2e7b9640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b140a2cf0 0x7f1b140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b1effd640 1 -- 172.21.15.2:0/55199144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f1b240ce7c0 con 0x7f1b28101de0 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.790+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa61d00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1b24097710 tx=0x7f1b24020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d236ce44cf72990 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b13fff640 1 -- 172.21.15.2:0/3589636725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2409a6a0 con 0x558bcfa57980 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b13fff640 1 -- 172.21.15.2:0/3589636725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2401d170 con 0x558bcfa57980 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b2e7b9640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b140a2cf0 0x7f1b140a51b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b20007fd0 tx=0x7f1b20004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b13fff640 1 -- 172.21.15.2:0/3589636725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2401ecf0 con 0x558bcfa57980 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b325f5740 1 -- 172.21.15.2:0/3589636725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 msgr2=0x558bcfa61d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa61d00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1b24097710 tx=0x7f1b24020000 comp rx=0 tx=0).stop 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b325f5740 1 -- 172.21.15.2:0/3589636725 shutdown_connections 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa64630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa61d00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3589636725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa57440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.791+0000 7f1b325f5740 1 -- 172.21.15.2:0/3589636725 >> 172.21.15.2:0/3589636725 conn(0x558bcfa535f0 msgr2=0x558bcfa539d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:13.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.792+0000 7f1b325f5740 1 -- 172.21.15.2:0/3589636725 shutdown_connections 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.792+0000 7f1b325f5740 1 -- 172.21.15.2:0/3589636725 wait complete. 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.792+0000 7f1b325f5740 1 -- start start 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.792+0000 7f1b325f5740 1 Processor -- start 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa5f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa5fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b325f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558bcfa64e10 con 0x558bcfa57980 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b325f5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558bcf944f10 con 0x558bcfa62240 2024-09-12T00:57:13.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b325f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558bcfa64f90 con 0x558bcfa57060 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b325f5740 10 client.0 _ll_register_callbacks cb 0x558bcf968db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa5f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa5f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56340/0 (socket says 172.21.15.2:56340) 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 -- 172.21.15.2:0/4010450696 learned_addr learned my addr 172.21.15.2:0/4010450696 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2e7b9640 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa5fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 -- 172.21.15.2:0/4010450696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 msgr2=0x558bcfa5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa5f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 -- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 msgr2=0x558bcfa5fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa5fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 -- 172.21.15.2:0/4010450696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bcf6cb580 con 0x558bcfa57980 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2e7b9640 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa5fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa5f5e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1b1802a930 tx=0x7f1b18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd265293e963c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b117fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b117fa640 1 -- 172.21.15.2:0/4010450696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18035040 con 0x558bcfa57980 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b117fa640 1 -- 172.21.15.2:0/4010450696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f1b18005020 con 0x558bcfa57980 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.793+0000 7f1b325f5740 1 -- 172.21.15.2:0/4010450696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558bcf9c9b90 con 0x558bcfa57980 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b117fa640 1 -- 172.21.15.2:0/4010450696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b18005220 con 0x558bcfa57980 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b325f5740 10 client.16254 fetch_fsmap learned FSMap version 28 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b325f5740 1 -- 172.21.15.2:0/4010450696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558bcf795960 con 0x558bcfa57980 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b117fa640 1 -- 172.21.15.2:0/4010450696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558bcf9c9b90 con 0x558bcfa57980 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b117fa640 1 -- 172.21.15.2:0/4010450696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f1b18003710 con 0x558bcfa57980 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b325f5740 10 client.16254 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T00:57:13.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b325f5740 10 client.16254 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b325f5740 20 client.16254 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b325f5740 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x558bcfa71dd0 0x558bcfa74210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b325f5740 4 client.16254 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b325f5740 1 -- 172.21.15.2:0/4010450696 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bcf9c40a0 con 0x558bcfa71dd0 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.794+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x558bcfa71dd0 0x558bcfa74210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.795+0000 7f1b117fa640 10 client.16254 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.795+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x558bcfa71dd0 0x558bcfa74210 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d556c1b11036022 server_cookie=d78cadf44bb1d3c4 in_seq=0 out_seq=0 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b117fa640 1 -- 172.21.15.2:0/4010450696 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bcf9c40a0 con 0x558bcfa71dd0 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b117fa640 10 client.16254 handle_command_reply: tid=0 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 client.16254 shutdown 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 -- 172.21.15.2:0/4010450696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 msgr2=0x558bcfa5f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa5f5e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1b1802a930 tx=0x7f1b18004270 comp rx=0 tx=0).stop 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 -- 172.21.15.2:0/4010450696 shutdown_connections 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x558bcfa71dd0 0x558bcfa74210 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa5fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa5f5e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b117fa640 0 client.16254 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 --2- 172.21.15.2:0/4010450696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 -- 172.21.15.2:0/4010450696 >> 172.21.15.2:0/4010450696 conn(0x558bcfa535f0 msgr2=0x558bcfa59320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 -- 172.21.15.2:0/4010450696 shutdown_connections 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 1 -- 172.21.15.2:0/4010450696 wait complete. 2024-09-12T00:57:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.796+0000 7f1b325f5740 20 client.16254 trim_cache size 0 max 16384 2024-09-12T00:57:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b325f5740 1 Processor -- start 2024-09-12T00:57:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b325f5740 1 -- start start 2024-09-12T00:57:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa59ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa52640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa79ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b325f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b281b0310 con 0x558bcfa57980 2024-09-12T00:57:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b325f5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b281adbe0 con 0x558bcfa62240 2024-09-12T00:57:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b325f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b281aba30 con 0x558bcfa57060 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b2d7b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa52640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b2d7b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa52640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56348/0 (socket says 172.21.15.2:56348) 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.813+0000 7f1b2d7b7640 1 -- 172.21.15.2:0/2118958001 learned_addr learned my addr 172.21.15.2:0/2118958001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b2d7b7640 1 -- 172.21.15.2:0/2118958001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 msgr2=0x558bcfa59ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/2118958001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa59ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b2d7b7640 1 -- 172.21.15.2:0/2118958001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 msgr2=0x558bcfa79ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/2118958001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa79ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b2d7b7640 1 -- 172.21.15.2:0/2118958001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bcfa577b0 con 0x558bcfa57980 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/2118958001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa52640 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1b18003ad0 tx=0x7f1b18005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d58224ff51d6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b137fe640 1 -- 172.21.15.2:0/2118958001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18035070 con 0x558bcfa57980 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b137fe640 1 -- 172.21.15.2:0/2118958001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b180053c0 con 0x558bcfa57980 2024-09-12T00:57:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.814+0000 7f1b137fe640 1 -- 172.21.15.2:0/2118958001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18045d10 con 0x558bcfa57980 2024-09-12T00:57:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 -- 172.21.15.2:0/2118958001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 msgr2=0x558bcfa52640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 --2- 172.21.15.2:0/2118958001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa52640 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1b18003ad0 tx=0x7f1b18005990 comp rx=0 tx=0).stop 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 -- 172.21.15.2:0/2118958001 shutdown_connections 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 --2- 172.21.15.2:0/2118958001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa62240 0x558bcfa79ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 --2- 172.21.15.2:0/2118958001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57980 0x558bcfa52640 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 --2- 172.21.15.2:0/2118958001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa57060 0x558bcfa59ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 -- 172.21.15.2:0/2118958001 >> 172.21.15.2:0/2118958001 conn(0x558bcfa535f0 msgr2=0x558bcfa51f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 -- 172.21.15.2:0/2118958001 shutdown_connections 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 -- 172.21.15.2:0/2118958001 wait complete. 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 -- start start 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.815+0000 7f1b325f5740 1 Processor -- start 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57060 0x558bcfa667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa57980 0x558bcfa66d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b325f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa62240 0x558bcfad5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b325f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b281ac0a0 con 0x558bcfa57060 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b325f5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b281ad510 con 0x558bcfa57980 2024-09-12T00:57:13.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b325f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b281ac770 con 0x558bcfa62240 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b325f5740 10 client.0 _ll_register_callbacks cb 0x7f1b18031a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2dfb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57060 0x558bcfa667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2dfb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57060 0x558bcfa667e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56362/0 (socket says 172.21.15.2:56362) 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/3858024325 learned_addr learned my addr 172.21.15.2:0/3858024325 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa57980 0x558bcfa66d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/3858024325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa62240 msgr2=0x558bcfad5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa62240 0x558bcfad5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/3858024325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa57980 msgr2=0x558bcfa66d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa57980 0x558bcfa66d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.816+0000 7f1b2dfb8640 1 -- 172.21.15.2:0/3858024325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bcfad60e0 con 0x558bcfa57060 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b2dfb8640 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57060 0x558bcfa667e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009420 tx=0x7f1b24000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65c46e7eef7ff4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b117fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b117fa640 1 -- 172.21.15.2:0/3858024325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2409b440 con 0x558bcfa57060 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b117fa640 1 -- 172.21.15.2:0/3858024325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f1b24098de0 con 0x558bcfa57060 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 1 -- 172.21.15.2:0/3858024325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b180053c0 con 0x558bcfa57060 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b117fa640 1 -- 172.21.15.2:0/3858024325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b2409ad40 con 0x558bcfa57060 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 10 client.16260 fetch_fsmap learned FSMap version 28 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 1 -- 172.21.15.2:0/3858024325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558bcfadd4e0 con 0x558bcfa57060 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b117fa640 1 -- 172.21.15.2:0/3858024325 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b180053c0 con 0x558bcfa57060 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b117fa640 1 -- 172.21.15.2:0/3858024325 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f1b2409afa0 con 0x558bcfa57060 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 10 client.16260 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 10 client.16260 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 20 client.16260 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x558bcfadd820 0x558bcfadfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 4 client.16260 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d37d25ba", "release": true, "await": true}] 2024-09-12T00:57:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.817+0000 7f1b325f5740 1 -- 172.21.15.2:0/3858024325 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d37d25ba", "release": true, "await": true}) -- 0x558bcf9405a0 con 0x558bcfadd820 2024-09-12T00:57:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.818+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x558bcfadd820 0x558bcfadfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.818+0000 7f1b2d7b7640 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x558bcfadd820 0x558bcfadfc10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8850f82ad667d327 server_cookie=cb5c6b26938f0db7 in_seq=0 out_seq=0 2024-09-12T00:57:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:13.818+0000 7f1b117fa640 10 client.16260 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.002+0000 7f1b117fa640 1 -- 172.21.15.2:0/3858024325 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558bcf9405a0 con 0x558bcfadd820 2024-09-12T00:57:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.002+0000 7f1b117fa640 10 client.16260 handle_command_reply: tid=0 2024-09-12T00:57:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 client.16260 shutdown 2024-09-12T00:57:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 -- 172.21.15.2:0/3858024325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57060 msgr2=0x558bcfa667e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57060 0x558bcfa667e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009420 tx=0x7f1b24000bc0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 -- 172.21.15.2:0/3858024325 shutdown_connections 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x558bcfadd820 0x558bcfadfc10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558bcfa62240 0x558bcfad5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bcfa57980 0x558bcfa66d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b117fa640 0 client.16260 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 --2- 172.21.15.2:0/3858024325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bcfa57060 0x558bcfa667e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 -- 172.21.15.2:0/3858024325 >> 172.21.15.2:0/3858024325 conn(0x558bcfa535f0 msgr2=0x558bcfa5f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 -- 172.21.15.2:0/3858024325 shutdown_connections 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 1 -- 172.21.15.2:0/3858024325 wait complete. 2024-09-12T00:57:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.003+0000 7f1b325f5740 20 client.16260 trim_cache size 0 max 16384 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 28, 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 16, 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "d37d25ba": { 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 16, 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:57:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 140.2, 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:57:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:14.007 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 -- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b140a2cf0 msgr2=0x7f1b140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b140a2cf0 0x7f1b140a51b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b20007fd0 tx=0x7f1b20004a40 comp rx=0 tx=0).stop 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 -- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28101de0 msgr2=0x7f1b28198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28101de0 0x7f1b28198410 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400b4a0 tx=0x7f1b2400b960 comp rx=0 tx=0).stop 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 -- 172.21.15.2:0/55199144 shutdown_connections 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f1b140a2cf0 0x7f1b140a51b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b28106f10 0x7f1b2819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b28102790 0x7f1b28198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 --2- 172.21.15.2:0/55199144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b28101de0 0x7f1b28198410 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 -- 172.21.15.2:0/55199144 >> 172.21.15.2:0/55199144 conn(0x7f1b280fd8c0 msgr2=0x7f1b280fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 -- 172.21.15.2:0/55199144 shutdown_connections 2024-09-12T00:57:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:14.004+0000 7f1b3021c640 1 -- 172.21.15.2:0/55199144 wait complete. 2024-09-12T00:57:14.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:14 smithi071 ceph-mon[35276]: pgmap v132: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-12T00:57:14.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:14 smithi002 ceph-mon[31210]: pgmap v132: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-12T00:57:14.755 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd37d25ba', total seconds elapsed: 23.5 2024-09-12T00:57:14.756 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.15 2024-09-12T00:57:14.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:57:14.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:14 smithi167 ceph-mon[35234]: pgmap v132: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-12T00:57:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:15.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 -- 172.21.15.2:0/1032623657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 msgr2=0x7fc9dc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:15.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 --2- 172.21.15.2:0/1032623657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 0x7fc9dc101200 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009900 tx=0x7fc9cc02a480 comp rx=0 tx=0).stop 2024-09-12T00:57:15.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 -- 172.21.15.2:0/1032623657 shutdown_connections 2024-09-12T00:57:15.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 --2- 172.21.15.2:0/1032623657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 --2- 172.21.15.2:0/1032623657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9dc102570 0x7fc9dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 --2- 172.21.15.2:0/1032623657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 0x7fc9dc101200 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 -- 172.21.15.2:0/1032623657 >> 172.21.15.2:0/1032623657 conn(0x7fc9dc0fc7d0 msgr2=0x7fc9dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 -- 172.21.15.2:0/1032623657 shutdown_connections 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.529+0000 7fc9e2370640 1 -- 172.21.15.2:0/1032623657 wait complete. 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e2370640 1 Processor -- start 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e2370640 1 -- start start 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e2370640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 0x7fc9dc1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e2370640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9dc102570 0x7fc9dc197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e2370640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e2370640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc110f80 con 0x7fc9dc100e20 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e2370640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc110e00 con 0x7fc9dc102ef0 2024-09-12T00:57:15.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e2370640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc111100 con 0x7fc9dc102570 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 0x7fc9dc1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 0x7fc9dc1973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56372/0 (socket says 172.21.15.2:56372) 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9dbfff640 1 -- 172.21.15.2:0/3264318063 learned_addr learned my addr 172.21.15.2:0/3264318063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9db7fe640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9dc102570 0x7fc9dc197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.530+0000 7fc9e090d640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9dbfff640 1 -- 172.21.15.2:0/3264318063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9dc102570 msgr2=0x7fc9dc197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9dbfff640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9dc102570 0x7fc9dc197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9dbfff640 1 -- 172.21.15.2:0/3264318063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9dc102ef0 msgr2=0x7fc9dc19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9dbfff640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9dbfff640 1 -- 172.21.15.2:0/3264318063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc19c370 con 0x7fc9dc100e20 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9db7fe640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9dc102570 0x7fc9dc197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9dbfff640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 0x7fc9dc1973c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc006010 tx=0x7fc9cc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:15.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9d97fa640 1 -- 172.21.15.2:0/3264318063 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc03f070 con 0x7fc9dc100e20 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9d97fa640 1 -- 172.21.15.2:0/3264318063 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9cc031c30 con 0x7fc9dc100e20 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc19c600 con 0x7fc9dc100e20 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9d97fa640 1 -- 172.21.15.2:0/3264318063 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc035030 con 0x7fc9dc100e20 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.531+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc069f70 con 0x7fc9dc100e20 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.532+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9dc1021b0 con 0x7fc9dc100e20 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.534+0000 7fc9d97fa640 1 -- 172.21.15.2:0/3264318063 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc9cc042070 con 0x7fc9dc100e20 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.535+0000 7fc9d97fa640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9c40a2d70 0x7fc9c40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.535+0000 7fc9db7fe640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9c40a2d70 0x7fc9c40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.535+0000 7fc9d97fa640 1 -- 172.21.15.2:0/3264318063 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc9cc0eff60 con 0x7fc9dc100e20 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.536+0000 7fc9db7fe640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9c40a2d70 0x7fc9c40a5230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0ffdc0 tx=0x7fc9d000f040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:15.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.540+0000 7fc9d97fa640 1 -- 172.21.15.2:0/3264318063 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9cc0bc4e0 con 0x7fc9dc100e20 2024-09-12T00:57:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.772+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9dc101200 con 0x7fc9dc100e20 2024-09-12T00:57:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.772+0000 7fc9d97fa640 1 -- 172.21.15.2:0/3264318063 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11900 (secure 0 0 0) 0x7fc9dc101200 con 0x7fc9dc100e20 2024-09-12T00:57:15.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:57:15.773 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-12T00:57:02:048049+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:57:01.130770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:57:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-12T00:57:15.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9c40a2d70 msgr2=0x7fc9c40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9c40a2d70 0x7fc9c40a5230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0ffdc0 tx=0x7fc9d000f040 comp rx=0 tx=0).stop 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 msgr2=0x7fc9dc1973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 0x7fc9dc1973c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc006010 tx=0x7fc9cc003c10 comp rx=0 tx=0).stop 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 shutdown_connections 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9c40a2d70 0x7fc9c40a5230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9dc102570 0x7fc9dc197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 --2- 172.21.15.2:0/3264318063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc100e20 0x7fc9dc1973c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 >> 172.21.15.2:0/3264318063 conn(0x7fc9dc0fc7d0 msgr2=0x7fc9dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 shutdown_connections 2024-09-12T00:57:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:15.775+0000 7fc9e2370640 1 -- 172.21.15.2:0/3264318063 wait complete. 2024-09-12T00:57:16.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:16 smithi002 ceph-mon[31210]: pgmap v133: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-12T00:57:16.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:16 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3264318063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:16.550 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0' 2024-09-12T00:57:16.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0 2024-09-12T00:57:16.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:16 smithi071 ceph-mon[35276]: pgmap v133: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-12T00:57:16.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:16 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3264318063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:16.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:16 smithi167 ceph-mon[35234]: pgmap v133: 97 pgs: 97 active+clean; 133 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-12T00:57:16.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:16 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3264318063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:16.827 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:17.063 INFO:tasks.workunit.client.0.smithi002.stdout:40000 mapwrite 0x1becad thru 0x1c6a92 (0x7de6 bytes) 2024-09-12T00:57:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.333+0000 7fb551c67640 1 -- 172.21.15.2:0/2529029455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c102570 msgr2=0x7fb54c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.333+0000 7fb551c67640 1 --2- 172.21.15.2:0/2529029455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c102570 0x7fb54c1029b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb540009900 tx=0x7fb54002a480 comp rx=0 tx=0).stop 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.334+0000 7fb551c67640 1 -- 172.21.15.2:0/2529029455 shutdown_connections 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.334+0000 7fb551c67640 1 --2- 172.21.15.2:0/2529029455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb54c102ef0 0x7fb54c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.334+0000 7fb551c67640 1 --2- 172.21.15.2:0/2529029455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c102570 0x7fb54c1029b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.334+0000 7fb551c67640 1 --2- 172.21.15.2:0/2529029455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb54c100e20 0x7fb54c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.334+0000 7fb551c67640 1 -- 172.21.15.2:0/2529029455 >> 172.21.15.2:0/2529029455 conn(0x7fb54c0fc7d0 msgr2=0x7fb54c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.334+0000 7fb551c67640 1 -- 172.21.15.2:0/2529029455 shutdown_connections 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.334+0000 7fb551c67640 1 -- 172.21.15.2:0/2529029455 wait complete. 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.334+0000 7fb551c67640 1 Processor -- start 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb551c67640 1 -- start start 2024-09-12T00:57:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb551c67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c100e20 0x7fb54c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb551c67640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb54c102570 0x7fb54c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb551c67640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb54c102ef0 0x7fb54c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb551c67640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c110f80 con 0x7fb54c100e20 2024-09-12T00:57:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb551c67640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c110e00 con 0x7fb54c102ef0 2024-09-12T00:57:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb551c67640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c111100 con 0x7fb54c102570 2024-09-12T00:57:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c100e20 0x7fb54c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c100e20 0x7fb54c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38436/0 (socket says 172.21.15.2:38436) 2024-09-12T00:57:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54b7fe640 1 -- 172.21.15.2:0/3452143920 learned_addr learned my addr 172.21.15.2:0/3452143920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54affd640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb54c102570 0x7fb54c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54bfff640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb54c102ef0 0x7fb54c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54b7fe640 1 -- 172.21.15.2:0/3452143920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb54c102570 msgr2=0x7fb54c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb54c102570 0x7fb54c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54b7fe640 1 -- 172.21.15.2:0/3452143920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb54c102ef0 msgr2=0x7fb54c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb54c102ef0 0x7fb54c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.335+0000 7fb54b7fe640 1 -- 172.21.15.2:0/3452143920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c1a6970 con 0x7fb54c100e20 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.336+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c100e20 0x7fb54c0fcc80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00e9f0 tx=0x7fb53c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.336+0000 7fb548ff9640 1 -- 172.21.15.2:0/3452143920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00cd80 con 0x7fb54c100e20 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.336+0000 7fb548ff9640 1 -- 172.21.15.2:0/3452143920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb53c010910 con 0x7fb54c100e20 2024-09-12T00:57:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.336+0000 7fb551c67640 1 -- 172.21.15.2:0/3452143920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54c1a6c60 con 0x7fb54c100e20 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.336+0000 7fb548ff9640 1 -- 172.21.15.2:0/3452143920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c018990 con 0x7fb54c100e20 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.336+0000 7fb551c67640 1 -- 172.21.15.2:0/3452143920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54c1a71c0 con 0x7fb54c100e20 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb548ff9640 1 -- 172.21.15.2:0/3452143920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fb53c010ac0 con 0x7fb54c100e20 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb554040740 1 Processor -- start 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb554040740 1 -- start start 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb554040740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb547c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb554040740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb5524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb554040740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb554e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb554040740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5621eb4ac160 con 0x5621eb548170 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb554040740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5621eb453720 con 0x5621eb552a30 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb554040740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5621eb4a8120 con 0x5621eb547850 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb5524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb54bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb547c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb5524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38448/0 (socket says 172.21.15.2:38448) 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.339+0000 7fb54b7fe640 1 -- 172.21.15.2:0/787535711 learned_addr learned my addr 172.21.15.2:0/787535711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb548ff9640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5340a2d70 0x7fb5340a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54affd640 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb554e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54bfff640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5340a2d70 0x7fb5340a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb548ff9640 1 -- 172.21.15.2:0/3452143920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb53c0cf760 con 0x7fb54c100e20 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54bfff640 1 -- 172.21.15.2:0/787535711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 msgr2=0x5621eb554e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54bfff640 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb554e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54bfff640 1 -- 172.21.15.2:0/787535711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 msgr2=0x5621eb5524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54bfff640 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb5524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54bfff640 1 -- 172.21.15.2:0/787535711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621eb21dba0 con 0x5621eb547850 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb5524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54bfff640 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb547c30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb544005fd0 tx=0x7fb544013e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebe30827dcd097a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.340+0000 7fb54bfff640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5340a2d70 0x7fb5340a5230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb54401e000 tx=0x7fb544020000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb531ffb640 1 -- 172.21.15.2:0/787535711 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54400fc60 con 0x5621eb547850 2024-09-12T00:57:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb531ffb640 1 -- 172.21.15.2:0/787535711 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb544023030 con 0x5621eb547850 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb531ffb640 1 -- 172.21.15.2:0/787535711 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544010c40 con 0x5621eb547850 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb554040740 1 -- 172.21.15.2:0/787535711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 msgr2=0x5621eb547c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb554040740 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb547c30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb544005fd0 tx=0x7fb544013e50 comp rx=0 tx=0).stop 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb554040740 1 -- 172.21.15.2:0/787535711 shutdown_connections 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb554040740 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb554e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb554040740 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb5524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb554040740 1 --2- 172.21.15.2:0/787535711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb547c30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.341+0000 7fb554040740 1 -- 172.21.15.2:0/787535711 >> 172.21.15.2:0/787535711 conn(0x5621eb543de0 msgr2=0x5621eb5441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.342+0000 7fb554040740 1 -- 172.21.15.2:0/787535711 shutdown_connections 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.342+0000 7fb554040740 1 -- 172.21.15.2:0/787535711 wait complete. 2024-09-12T00:57:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.342+0000 7fb554040740 1 -- start start 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb554040740 1 Processor -- start 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb554040740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb54f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb554040740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb548170 0x5621eb54fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb554040740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb552a30 0x5621eb5503d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb554040740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5621eb555600 con 0x5621eb547850 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb554040740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5621eb434900 con 0x5621eb548170 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb554040740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5621eb555780 con 0x5621eb552a30 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb554040740 10 client.0 _ll_register_callbacks cb 0x5621eb432780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb54f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb54bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb552a30 0x5621eb5503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb54bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb552a30 0x5621eb5503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:33196/0 (socket says 172.21.15.2:33196) 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.343+0000 7fb54bfff640 1 -- 172.21.15.2:0/4068717562 learned_addr learned my addr 172.21.15.2:0/4068717562 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb54b7fe640 1 -- 172.21.15.2:0/4068717562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb552a30 msgr2=0x5621eb5503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb552a30 0x5621eb5503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb54b7fe640 1 -- 172.21.15.2:0/4068717562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb548170 msgr2=0x5621eb54fe90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb548170 0x5621eb54fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb54b7fe640 1 -- 172.21.15.2:0/4068717562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621eb474c50 con 0x5621eb547850 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb54bfff640 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb552a30 0x5621eb5503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb554040740 1 -- 172.21.15.2:0/4068717562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb544023030 con 0x5621eb547850 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb54f950 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb53c09bc10 tx=0x7fb53c0cce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0549fe38671c16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.344+0000 7fb52affd640 10 client.16278 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.345+0000 7fb52affd640 1 -- 172.21.15.2:0/4068717562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0cd280 con 0x5621eb547850 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.345+0000 7fb52affd640 1 -- 172.21.15.2:0/4068717562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb53c0cfb50 con 0x5621eb547850 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.345+0000 7fb52affd640 1 -- 172.21.15.2:0/4068717562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb53c0cfd50 con 0x5621eb547850 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.346+0000 7fb554040740 10 client.16278 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.346+0000 7fb554040740 1 -- 172.21.15.2:0/4068717562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5621eb561280 con 0x5621eb547850 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.349+0000 7fb52affd640 1 -- 172.21.15.2:0/4068717562 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fb53c018b30 con 0x5621eb547850 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.349+0000 7fb554040740 10 client.16278 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.349+0000 7fb554040740 10 client.16278 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.349+0000 7fb554040740 20 client.16278 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.349+0000 7fb554040740 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5621eb562630 0x5621eb564a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.349+0000 7fb554040740 4 client.16278 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.349+0000 7fb554040740 1 -- 172.21.15.2:0/4068717562 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621eb4b9890 con 0x5621eb562630 2024-09-12T00:57:17.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.349+0000 7fb54affd640 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5621eb562630 0x5621eb564a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb52affd640 10 client.16278 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:17.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb54affd640 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5621eb562630 0x5621eb564a40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a6af1ca3cd8df1 server_cookie=3f19b2fde4067b72 in_seq=0 out_seq=0 2024-09-12T00:57:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb52affd640 1 -- 172.21.15.2:0/4068717562 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621eb4b9890 con 0x5621eb562630 2024-09-12T00:57:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb52affd640 10 client.16278 handle_command_reply: tid=0 2024-09-12T00:57:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 client.16278 shutdown 2024-09-12T00:57:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 -- 172.21.15.2:0/4068717562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 msgr2=0x5621eb54f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb54f950 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb53c09bc10 tx=0x7fb53c0cce20 comp rx=0 tx=0).stop 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 -- 172.21.15.2:0/4068717562 shutdown_connections 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5621eb562630 0x5621eb564a40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb552a30 0x5621eb5503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb548170 0x5621eb54fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 --2- 172.21.15.2:0/4068717562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb54f950 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb52affd640 0 client.16278 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.350+0000 7fb554040740 1 -- 172.21.15.2:0/4068717562 >> 172.21.15.2:0/4068717562 conn(0x5621eb543de0 msgr2=0x5621eb549b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.351+0000 7fb554040740 1 -- 172.21.15.2:0/4068717562 shutdown_connections 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.351+0000 7fb554040740 1 -- 172.21.15.2:0/4068717562 wait complete. 2024-09-12T00:57:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.351+0000 7fb554040740 20 client.16278 trim_cache size 0 max 16384 2024-09-12T00:57:17.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.370+0000 7fb554040740 1 Processor -- start 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.370+0000 7fb554040740 1 -- start start 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.370+0000 7fb554040740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb54a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.370+0000 7fb554040740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb56a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb554040740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb56a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb554040740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c1b24f0 con 0x5621eb548170 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb554040740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c1afdc0 con 0x5621eb552a30 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb554040740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c1adc10 con 0x5621eb547850 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb56a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb56a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38466/0 (socket says 172.21.15.2:38466) 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 -- 172.21.15.2:0/2718531616 learned_addr learned my addr 172.21.15.2:0/2718531616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54bfff640 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb56a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb54a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 -- 172.21.15.2:0/2718531616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 msgr2=0x5621eb54a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb54a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 -- 172.21.15.2:0/2718531616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 msgr2=0x5621eb56a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb56a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 -- 172.21.15.2:0/2718531616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621eb547fa0 con 0x5621eb548170 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb54a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54bfff640 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb56a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.371+0000 7fb54affd640 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb56a2b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb5400314e0 tx=0x7fb5400058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9014ff2864cee25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb5317fa640 1 -- 172.21.15.2:0/2718531616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540035040 con 0x5621eb548170 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb5317fa640 1 -- 172.21.15.2:0/2718531616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb540005500 con 0x5621eb548170 2024-09-12T00:57:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb5317fa640 1 -- 172.21.15.2:0/2718531616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540004e60 con 0x5621eb548170 2024-09-12T00:57:17.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb554040740 1 -- 172.21.15.2:0/2718531616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 msgr2=0x5621eb56a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:17.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb554040740 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb56a2b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb5400314e0 tx=0x7fb5400058d0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb554040740 1 -- 172.21.15.2:0/2718531616 shutdown_connections 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb554040740 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb56a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb554040740 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb548170 0x5621eb56a2b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb554040740 1 --2- 172.21.15.2:0/2718531616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb547850 0x5621eb54a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.372+0000 7fb554040740 1 -- 172.21.15.2:0/2718531616 >> 172.21.15.2:0/2718531616 conn(0x5621eb543de0 msgr2=0x5621eb5519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 -- 172.21.15.2:0/2718531616 shutdown_connections 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 -- 172.21.15.2:0/2718531616 wait complete. 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 -- start start 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 Processor -- start 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb55a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb548170 0x5621eb55af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb5579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c1ae280 con 0x5621eb547850 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c1af6f0 con 0x5621eb552a30 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.373+0000 7fb554040740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c1ae950 con 0x5621eb548170 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb554040740 10 client.0 _ll_register_callbacks cb 0x7fb53c09bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb55a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb55a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38474/0 (socket says 172.21.15.2:38474) 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 -- 172.21.15.2:0/1895050150 learned_addr learned my addr 172.21.15.2:0/1895050150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54affd640 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb548170 0x5621eb55af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54bfff640 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb5579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 -- 172.21.15.2:0/1895050150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb548170 msgr2=0x5621eb55af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb548170 0x5621eb55af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 -- 172.21.15.2:0/1895050150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 msgr2=0x5621eb5579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb5579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 -- 172.21.15.2:0/1895050150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621eb557fe0 con 0x5621eb547850 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb54b7fe640 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb55a9d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb53c099f30 tx=0x7fb53c0d0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e267022627e3cb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb52affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb52affd640 1 -- 172.21.15.2:0/1895050150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0cd280 con 0x5621eb547850 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb554040740 1 -- 172.21.15.2:0/1895050150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb540005500 con 0x5621eb547850 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb52affd640 1 -- 172.21.15.2:0/1895050150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb53c09b0d0 con 0x5621eb547850 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb52affd640 1 -- 172.21.15.2:0/1895050150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb53c0a4840 con 0x5621eb547850 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.374+0000 7fb554040740 10 client.16284 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb554040740 1 -- 172.21.15.2:0/1895050150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5621eb5cdbb0 con 0x5621eb547850 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb52affd640 1 -- 172.21.15.2:0/1895050150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb540005500 con 0x5621eb547850 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb52affd640 1 -- 172.21.15.2:0/1895050150 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fb53c09abd0 con 0x5621eb547850 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb554040740 10 client.16284 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb554040740 10 client.16284 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb554040740 20 client.16284 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb554040740 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5621eb5ce340 0x5621eb5d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb554040740 4 client.16284 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}] 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb554040740 1 -- 172.21.15.2:0/1895050150 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}) -- 0x5621eb4b3be0 con 0x5621eb5ce340 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.375+0000 7fb54affd640 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5621eb5ce340 0x5621eb5d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.376+0000 7fb54affd640 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5621eb5ce340 0x5621eb5d0730 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8806aed4bd679dff server_cookie=4502e057eba2ed2d in_seq=0 out_seq=0 2024-09-12T00:57:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:17.376+0000 7fb52affd640 10 client.16284 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:17.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:17 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:57:17.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:17 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:57:17.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:17 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:57:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb52affd640 1 -- 172.21.15.2:0/1895050150 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5621eb4b3be0 con 0x5621eb5ce340 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb52affd640 10 client.16284 handle_command_reply: tid=0 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 client.16284 shutdown 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 -- 172.21.15.2:0/1895050150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 msgr2=0x5621eb55a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb55a9d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb53c099f30 tx=0x7fb53c0d0000 comp rx=0 tx=0).stop 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 -- 172.21.15.2:0/1895050150 shutdown_connections 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5621eb5ce340 0x5621eb5d0730 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5621eb552a30 0x5621eb5579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb52affd640 0 client.16284 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621eb548170 0x5621eb55af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 --2- 172.21.15.2:0/1895050150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621eb547850 0x5621eb55a9d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 -- 172.21.15.2:0/1895050150 >> 172.21.15.2:0/1895050150 conn(0x5621eb543de0 msgr2=0x5621eb5426a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 -- 172.21.15.2:0/1895050150 shutdown_connections 2024-09-12T00:57:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 1 -- 172.21.15.2:0/1895050150 wait complete. 2024-09-12T00:57:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.272+0000 7fb554040740 20 client.16284 trim_cache size 0 max 16384 2024-09-12T00:57:18.274 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:57:18.274 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 29, 2024-09-12T00:57:18.274 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:57:18.274 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 18, 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "7c12ffb": { 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 18, 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 140.2, 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:57:18.275 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "QUIESCED", 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:18.276 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:57:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 -- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5340a2d70 msgr2=0x7fb5340a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5340a2d70 0x7fb5340a5230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb54401e000 tx=0x7fb544020000 comp rx=0 tx=0).stop 2024-09-12T00:57:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 -- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c100e20 msgr2=0x7fb54c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c100e20 0x7fb54c0fcc80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00e9f0 tx=0x7fb53c00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 -- 172.21.15.2:0/3452143920 shutdown_connections 2024-09-12T00:57:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5340a2d70 0x7fb5340a5230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb54c102ef0 0x7fb54c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb54c102570 0x7fb54c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 --2- 172.21.15.2:0/3452143920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb54c100e20 0x7fb54c0fcc80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 -- 172.21.15.2:0/3452143920 >> 172.21.15.2:0/3452143920 conn(0x7fb54c0fc7d0 msgr2=0x7fb54c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 -- 172.21.15.2:0/3452143920 shutdown_connections 2024-09-12T00:57:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:18.273+0000 7fb551c67640 1 -- 172.21.15.2:0/3452143920 wait complete. 2024-09-12T00:57:18.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:18 smithi002 ceph-mon[31210]: pgmap v134: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 692 KiB/s wr, 122 op/s 2024-09-12T00:57:18.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:18 smithi071 ceph-mon[35276]: pgmap v134: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 692 KiB/s wr, 122 op/s 2024-09-12T00:57:18.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:18 smithi167 ceph-mon[35234]: pgmap v134: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 692 KiB/s wr, 122 op/s 2024-09-12T00:57:19.053 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7c12ffb', quiesce took 4.3 seconds. Will release after: 15.849999999999998 2024-09-12T00:57:20.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:20 smithi071 ceph-mon[35276]: pgmap v135: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 690 KiB/s wr, 119 op/s 2024-09-12T00:57:20.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:20 smithi002 ceph-mon[31210]: pgmap v135: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 690 KiB/s wr, 119 op/s 2024-09-12T00:57:20.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:20 smithi167 ceph-mon[35234]: pgmap v135: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 690 KiB/s wr, 119 op/s 2024-09-12T00:57:22.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:22 smithi071 ceph-mon[35276]: pgmap v136: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-12T00:57:22.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:22 smithi002 ceph-mon[31210]: pgmap v136: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-12T00:57:22.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:22 smithi167 ceph-mon[35234]: pgmap v136: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-12T00:57:24.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:24 smithi071 ceph-mon[35276]: pgmap v137: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-12T00:57:24.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:24 smithi002 ceph-mon[31210]: pgmap v137: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-12T00:57:24.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:24 smithi167 ceph-mon[35234]: pgmap v137: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-12T00:57:26.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:26 smithi071 ceph-mon[35276]: pgmap v138: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-12T00:57:26.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:26 smithi002 ceph-mon[31210]: pgmap v138: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-12T00:57:26.789 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:26 smithi167 ceph-mon[35234]: pgmap v138: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-12T00:57:28.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:28 smithi071 ceph-mon[35276]: pgmap v139: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-12T00:57:28.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:28 smithi002 ceph-mon[31210]: pgmap v139: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-12T00:57:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:28 smithi167 ceph-mon[35234]: pgmap v139: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-12T00:57:30.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:30 smithi071 ceph-mon[35276]: pgmap v140: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 527 KiB/s wr, 100 op/s 2024-09-12T00:57:30.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:30 smithi002 ceph-mon[31210]: pgmap v140: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 527 KiB/s wr, 100 op/s 2024-09-12T00:57:30.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:30 smithi167 ceph-mon[35234]: pgmap v140: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 527 KiB/s wr, 100 op/s 2024-09-12T00:57:31.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:57:31.837 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:32.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.309+0000 7f77c7319640 1 -- 172.21.15.2:0/157582972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 msgr2=0x7f77c0110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.309+0000 7f77c7319640 1 --2- 172.21.15.2:0/157582972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 0x7f77c0110870 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009ca0 tx=0x7f77b802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 -- 172.21.15.2:0/157582972 shutdown_connections 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 --2- 172.21.15.2:0/157582972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 0x7f77c0110870 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 --2- 172.21.15.2:0/157582972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0101280 0x7f77c010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 --2- 172.21.15.2:0/157582972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77c01008d0 0x7f77c0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 -- 172.21.15.2:0/157582972 >> 172.21.15.2:0/157582972 conn(0x7f77c00fc7a0 msgr2=0x7f77c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 -- 172.21.15.2:0/157582972 shutdown_connections 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 -- 172.21.15.2:0/157582972 wait complete. 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 Processor -- start 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.310+0000 7f77c7319640 1 -- start start 2024-09-12T00:57:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c7319640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c01008d0 0x7f77c019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c7319640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77c0101280 0x7f77c019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c7319640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 0x7f77c019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c7319640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01141f0 con 0x7f77c010e480 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c7319640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0114070 con 0x7f77c0101280 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c7319640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0114370 con 0x7f77c01008d0 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 0x7f77c019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 0x7f77c019efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58720/0 (socket says 172.21.15.2:58720) 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 -- 172.21.15.2:0/3285785287 learned_addr learned my addr 172.21.15.2:0/3285785287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c48b4640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77c0101280 0x7f77c019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c50b5640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c01008d0 0x7f77c019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 -- 172.21.15.2:0/3285785287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c01008d0 msgr2=0x7f77c019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c01008d0 0x7f77c019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 -- 172.21.15.2:0/3285785287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77c0101280 msgr2=0x7f77c019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77c0101280 0x7f77c019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 -- 172.21.15.2:0/3285785287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c019f6c0 con 0x7f77c010e480 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.311+0000 7f77c58b6640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 0x7f77c019efe0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f77b802ade0 tx=0x7f77b80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.312+0000 7f77b67fc640 1 -- 172.21.15.2:0/3285785287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b8003b70 con 0x7f77c010e480 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.312+0000 7f77c7319640 1 -- 172.21.15.2:0/3285785287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c019f950 con 0x7f77c010e480 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.312+0000 7f77b67fc640 1 -- 172.21.15.2:0/3285785287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b8003d10 con 0x7f77c010e480 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.312+0000 7f77b67fc640 1 -- 172.21.15.2:0/3285785287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b802fcf0 con 0x7f77c010e480 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.312+0000 7f77c7319640 1 -- 172.21.15.2:0/3285785287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01a7290 con 0x7f77c010e480 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.314+0000 7f77b67fc640 1 -- 172.21.15.2:0/3285785287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f77b8004050 con 0x7f77c010e480 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c96f2740 1 Processor -- start 2024-09-12T00:57:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c96f2740 1 -- start start 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a6354a0 0x561c2a635880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a640140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a640680 0x561c2a642a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c96f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561c2a59b2e0 con 0x561c2a640680 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c96f2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561c2a542ce0 con 0x561c2a635dc0 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c96f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561c2a5972a0 con 0x561c2a6354a0 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c48b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a640680 0x561c2a642a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c48b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a640680 0x561c2a642a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58732/0 (socket says 172.21.15.2:58732) 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c48b4640 1 -- 172.21.15.2:0/2039153407 learned_addr learned my addr 172.21.15.2:0/2039153407 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c50b5640 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a640140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77b67fc640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f77ac0a2cf0 0x7f77ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c48b4640 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a6354a0 0x561c2a635880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.315+0000 7f77c58b6640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f77ac0a2cf0 0x7f77ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77c48b4640 1 -- 172.21.15.2:0/2039153407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a6354a0 msgr2=0x561c2a635880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77c48b4640 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a6354a0 0x561c2a635880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77c48b4640 1 -- 172.21.15.2:0/2039153407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 msgr2=0x561c2a640140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77c48b4640 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a640140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77c48b4640 1 -- 172.21.15.2:0/2039153407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c2a527440 con 0x561c2a640680 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77b67fc640 1 -- 172.21.15.2:0/3285785287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f77b80f06b0 con 0x7f77c010e480 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77c50b5640 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a640140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77c48b4640 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a640680 0x561c2a642a70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f77b00127a0 tx=0x7f77b000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493fb28dc4c95722 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77c58b6640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f77ac0a2cf0 0x7f77ac0a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f77b80bcc50 tx=0x7f77b802a8c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:32.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77ab7fe640 1 -- 172.21.15.2:0/2039153407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0012d20 con 0x561c2a640680 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77ab7fe640 1 -- 172.21.15.2:0/2039153407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b0005020 con 0x561c2a640680 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.316+0000 7f77ab7fe640 1 -- 172.21.15.2:0/2039153407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0004b20 con 0x561c2a640680 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 -- 172.21.15.2:0/2039153407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a640680 msgr2=0x561c2a642a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a640680 0x561c2a642a70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f77b00127a0 tx=0x7f77b000b7c0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 -- 172.21.15.2:0/2039153407 shutdown_connections 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a640680 0x561c2a642a70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a640140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 --2- 172.21.15.2:0/2039153407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a6354a0 0x561c2a635880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 -- 172.21.15.2:0/2039153407 >> 172.21.15.2:0/2039153407 conn(0x561c2a631a30 msgr2=0x561c2a631e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 -- 172.21.15.2:0/2039153407 shutdown_connections 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.317+0000 7f77c96f2740 1 -- 172.21.15.2:0/2039153407 wait complete. 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 1 -- start start 2024-09-12T00:57:32.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 1 Processor -- start 2024-09-12T00:57:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a63d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a63d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a64c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561c2a643250 con 0x561c2a6354a0 2024-09-12T00:57:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561c2a556050 con 0x561c2a635dc0 2024-09-12T00:57:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561c2a6433d0 con 0x561c2a63df20 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c96f2740 10 client.0 _ll_register_callbacks cb 0x561c2a596160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c48b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a63d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c48b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a63d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58740/0 (socket says 172.21.15.2:58740) 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.318+0000 7f77c48b4640 1 -- 172.21.15.2:0/1521923848 learned_addr learned my addr 172.21.15.2:0/1521923848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c50b5640 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a63d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a64c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c48b4640 1 -- 172.21.15.2:0/1521923848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 msgr2=0x561c2a64c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a64c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c48b4640 1 -- 172.21.15.2:0/1521923848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 msgr2=0x561c2a63d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a63d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c48b4640 1 -- 172.21.15.2:0/1521923848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c2a30c3c0 con 0x561c2a6354a0 2024-09-12T00:57:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a63d4a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f77b0015040 tx=0x7f77b000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9388e535b31a000 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1521923848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b002c060 con 0x561c2a6354a0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1521923848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f77b0004030 con 0x561c2a6354a0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c96f2740 1 -- 172.21.15.2:0/1521923848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b0005020 con 0x561c2a6354a0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1521923848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77b0004230 con 0x561c2a6354a0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c96f2740 10 client.16296 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.319+0000 7f77c96f2740 1 -- 172.21.15.2:0/1521923848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561c2a64f200 con 0x561c2a6354a0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1521923848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b0005020 con 0x561c2a6354a0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1521923848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f77b0010970 con 0x561c2a6354a0 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77c96f2740 10 client.16296 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77c96f2740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77c96f2740 20 client.16296 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561c2a650550 0x561c2a652940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77c96f2740 4 client.16296 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77c96f2740 1 -- 172.21.15.2:0/1521923848 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c2a5a8850 con 0x561c2a650550 2024-09-12T00:57:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.320+0000 7f77c50b5640 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561c2a650550 0x561c2a652940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77a8ff9640 10 client.16296 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c50b5640 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561c2a650550 0x561c2a652940 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d80a09f19600e266 server_cookie=124bfd6e2ca6e037 in_seq=0 out_seq=0 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1521923848 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c2a5a8850 con 0x561c2a650550 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77a8ff9640 10 client.16296 handle_command_reply: tid=0 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c96f2740 1 client.16296 shutdown 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c96f2740 1 -- 172.21.15.2:0/1521923848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 msgr2=0x561c2a63d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a63d4a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f77b0015040 tx=0x7f77b000b5b0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c96f2740 1 -- 172.21.15.2:0/1521923848 shutdown_connections 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561c2a650550 0x561c2a652940 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a64c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a63d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1521923848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a63d4a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.322+0000 7f77c96f2740 1 -- 172.21.15.2:0/1521923848 >> 172.21.15.2:0/1521923848 conn(0x561c2a631a30 msgr2=0x561c2a637790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.321+0000 7f77a8ff9640 0 client.16296 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.322+0000 7f77c96f2740 1 -- 172.21.15.2:0/1521923848 shutdown_connections 2024-09-12T00:57:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.322+0000 7f77c96f2740 1 -- 172.21.15.2:0/1521923848 wait complete. 2024-09-12T00:57:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.322+0000 7f77c96f2740 20 client.16296 trim_cache size 0 max 16384 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c96f2740 1 Processor -- start 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c96f2740 1 -- start start 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a64c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a64c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a657ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c96f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01b24b0 con 0x561c2a6354a0 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c96f2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01afd80 con 0x561c2a635dc0 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c96f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01adbd0 con 0x561c2a63df20 2024-09-12T00:57:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.339+0000 7f77c48b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a64c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c48b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a64c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58748/0 (socket says 172.21.15.2:58748) 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c48b4640 1 -- 172.21.15.2:0/2700522563 learned_addr learned my addr 172.21.15.2:0/2700522563 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c50b5640 1 --2- 172.21.15.2:0/2700522563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a64c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c48b4640 1 -- 172.21.15.2:0/2700522563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 msgr2=0x561c2a657ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c48b4640 1 --2- 172.21.15.2:0/2700522563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a657ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c48b4640 1 -- 172.21.15.2:0/2700522563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 msgr2=0x561c2a64c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c48b4640 1 --2- 172.21.15.2:0/2700522563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a64c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c48b4640 1 -- 172.21.15.2:0/2700522563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c2a635bf0 con 0x561c2a6354a0 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77c48b4640 1 --2- 172.21.15.2:0/2700522563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a64c4b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f77b0005ce0 tx=0x7f77b0013f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0eae52a974a584 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77aaffd640 1 -- 172.21.15.2:0/2700522563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b002c070 con 0x561c2a6354a0 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77aaffd640 1 -- 172.21.15.2:0/2700522563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b0016040 con 0x561c2a6354a0 2024-09-12T00:57:32.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.340+0000 7f77aaffd640 1 -- 172.21.15.2:0/2700522563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0003870 con 0x561c2a6354a0 2024-09-12T00:57:32.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 -- 172.21.15.2:0/2700522563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 msgr2=0x561c2a64c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 --2- 172.21.15.2:0/2700522563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a64c4b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f77b0005ce0 tx=0x7f77b0013f40 comp rx=0 tx=0).stop 2024-09-12T00:57:32.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 -- 172.21.15.2:0/2700522563 shutdown_connections 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 --2- 172.21.15.2:0/2700522563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a657ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 --2- 172.21.15.2:0/2700522563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a635dc0 0x561c2a64c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 --2- 172.21.15.2:0/2700522563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a6354a0 0x561c2a64c4b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 -- 172.21.15.2:0/2700522563 >> 172.21.15.2:0/2700522563 conn(0x561c2a631a30 msgr2=0x561c2a63c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 -- 172.21.15.2:0/2700522563 shutdown_connections 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 -- 172.21.15.2:0/2700522563 wait complete. 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 -- start start 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.341+0000 7f77c96f2740 1 Processor -- start 2024-09-12T00:57:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a6354a0 0x561c2a648c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a635dc0 0x561c2a643f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c96f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a6444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c96f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01ae240 con 0x561c2a635dc0 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c96f2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01af6b0 con 0x561c2a6354a0 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c96f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01ae910 con 0x561c2a63df20 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c96f2740 10 client.0 _ll_register_callbacks cb 0x7f77bc0093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a635dc0 0x561c2a643f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a635dc0 0x561c2a643f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58764/0 (socket says 172.21.15.2:58764) 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 -- 172.21.15.2:0/1620316573 learned_addr learned my addr 172.21.15.2:0/1620316573 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a6354a0 0x561c2a648c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a6444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 -- 172.21.15.2:0/1620316573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 msgr2=0x561c2a6444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a6444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 -- 172.21.15.2:0/1620316573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a6354a0 msgr2=0x561c2a648c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a6354a0 0x561c2a648c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 -- 172.21.15.2:0/1620316573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c2a644bb0 con 0x561c2a635dc0 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a6444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77c50b5640 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a635dc0 0x561c2a643f80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x561c2a63eae0 tx=0x7f77bc009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf795e93747da2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.342+0000 7f77a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1620316573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc023070 con 0x561c2a635dc0 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1620316573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f77bc015cc0 con 0x561c2a635dc0 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 1 -- 172.21.15.2:0/1620316573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b0016040 con 0x561c2a635dc0 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1620316573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77bc02f050 con 0x561c2a635dc0 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 10 client.16302 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 1 -- 172.21.15.2:0/1620316573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561c2a6baf40 con 0x561c2a635dc0 2024-09-12T00:57:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1620316573 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b0016040 con 0x561c2a635dc0 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1620316573 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f77bc01e070 con 0x561c2a635dc0 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 10 client.16302 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 20 client.16302 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561c2a6bb6f0 0x561c2a6bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 4 client.16302 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.343+0000 7f77c96f2740 1 -- 172.21.15.2:0/1620316573 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561c2a63dd70 con 0x561c2a6bb6f0 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561c2a6bb6f0 0x561c2a6bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77a8ff9640 10 client.16302 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c48b4640 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561c2a6bb6f0 0x561c2a6bdb10 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f4fea5bb2089d6e server_cookie=42a6a98f8cf2bcf2 in_seq=0 out_seq=0 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77a8ff9640 1 -- 172.21.15.2:0/1620316573 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561c2a63dd70 con 0x561c2a6bb6f0 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77a8ff9640 10 client.16302 handle_command_reply: tid=0 2024-09-12T00:57:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 client.16302 shutdown 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 -- 172.21.15.2:0/1620316573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a635dc0 msgr2=0x561c2a643f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a635dc0 0x561c2a643f80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x561c2a63eae0 tx=0x7f77bc009ed0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 -- 172.21.15.2:0/1620316573 shutdown_connections 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561c2a6bb6f0 0x561c2a6bdb10 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c2a63df20 0x561c2a6444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561c2a635dc0 0x561c2a643f80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 --2- 172.21.15.2:0/1620316573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561c2a6354a0 0x561c2a648c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77a8ff9640 0 client.16302 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.344+0000 7f77c96f2740 1 -- 172.21.15.2:0/1620316573 >> 172.21.15.2:0/1620316573 conn(0x561c2a631a30 msgr2=0x561c2a630350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c96f2740 1 -- 172.21.15.2:0/1620316573 shutdown_connections 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c96f2740 1 -- 172.21.15.2:0/1620316573 wait complete. 2024-09-12T00:57:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c96f2740 20 client.16302 trim_cache size 0 max 16384 2024-09-12T00:57:32.350 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:57:32.350 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:57:32.350 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:57:32.350 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 -- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f77ac0a2cf0 msgr2=0x7f77ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f77ac0a2cf0 0x7f77ac0a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f77b80bcc50 tx=0x7f77b802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 -- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 msgr2=0x7f77c019efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 0x7f77c019efe0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f77b802ade0 tx=0x7f77b80319f0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 -- 172.21.15.2:0/3285785287 shutdown_connections 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f77ac0a2cf0 0x7f77ac0a51b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77c010e480 0x7f77c019efe0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77c0101280 0x7f77c019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 --2- 172.21.15.2:0/3285785287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c01008d0 0x7f77c019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 -- 172.21.15.2:0/3285785287 >> 172.21.15.2:0/3285785287 conn(0x7f77c00fc7a0 msgr2=0x7f77c00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 -- 172.21.15.2:0/3285785287 shutdown_connections 2024-09-12T00:57:32.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:32.345+0000 7f77c7319640 1 -- 172.21.15.2:0/3285785287 wait complete. 2024-09-12T00:57:32.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:32 smithi002 ceph-mon[31210]: pgmap v141: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 527 KiB/s wr, 103 op/s 2024-09-12T00:57:32.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:32 smithi071 ceph-mon[35276]: pgmap v141: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 527 KiB/s wr, 103 op/s 2024-09-12T00:57:32.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:32 smithi167 ceph-mon[35234]: pgmap v141: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 527 KiB/s wr, 103 op/s 2024-09-12T00:57:33.086 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:57:33.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:57:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.889+0000 7fdd3cd97640 1 -- 172.21.15.2:0/616487658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd38102d40 msgr2=0x7fdd38103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.889+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/616487658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd38102d40 0x7fdd38103120 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009900 tx=0x7fdd2802a480 comp rx=0 tx=0).stop 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.889+0000 7fdd3cd97640 1 -- 172.21.15.2:0/616487658 shutdown_connections 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.889+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/616487658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd3810c170 0x7fdd3810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.889+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/616487658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd38103660 0x7fdd3810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.889+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/616487658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd38102d40 0x7fdd38103120 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.890+0000 7fdd3cd97640 1 -- 172.21.15.2:0/616487658 >> 172.21.15.2:0/616487658 conn(0x7fdd380fc7a0 msgr2=0x7fdd380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.890+0000 7fdd3cd97640 1 -- 172.21.15.2:0/616487658 shutdown_connections 2024-09-12T00:57:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.890+0000 7fdd3cd97640 1 -- 172.21.15.2:0/616487658 wait complete. 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.890+0000 7fdd3cd97640 1 Processor -- start 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.890+0000 7fdd3cd97640 1 -- start start 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.890+0000 7fdd3cd97640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd38102d40 0x7fdd38198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd3cd97640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd38103660 0x7fdd38198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd3cd97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd3810c170 0x7fdd3819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd3cd97640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38111fc0 con 0x7fdd3810c170 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd3cd97640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38111e40 con 0x7fdd38102d40 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd3cd97640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38112140 con 0x7fdd38103660 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd3810c170 0x7fdd3819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd3810c170 0x7fdd3819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58776/0 (socket says 172.21.15.2:58776) 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 -- 172.21.15.2:0/3643734582 learned_addr learned my addr 172.21.15.2:0/3643734582 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd3659c640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd38102d40 0x7fdd38198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd35d9b640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd38103660 0x7fdd38198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 -- 172.21.15.2:0/3643734582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd38103660 msgr2=0x7fdd38198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd38103660 0x7fdd38198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 -- 172.21.15.2:0/3643734582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd38102d40 msgr2=0x7fdd38198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd38102d40 0x7fdd38198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 -- 172.21.15.2:0/3643734582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3819d3b0 con 0x7fdd3810c170 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd36d9d640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd3810c170 0x7fdd3819ccd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000cce0 tx=0x7fdd3000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd2f7fe640 1 -- 172.21.15.2:0/3643734582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000f450 con 0x7fdd3810c170 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.891+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3819d6a0 con 0x7fdd3810c170 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.892+0000 7fdd2f7fe640 1 -- 172.21.15.2:0/3643734582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd3000fad0 con 0x7fdd3810c170 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.892+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd381a4f80 con 0x7fdd3810c170 2024-09-12T00:57:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.892+0000 7fdd2f7fe640 1 -- 172.21.15.2:0/3643734582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30018c10 con 0x7fdd3810c170 2024-09-12T00:57:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.893+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd38103120 con 0x7fdd3810c170 2024-09-12T00:57:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.894+0000 7fdd2f7fe640 1 -- 172.21.15.2:0/3643734582 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fdd3000f5f0 con 0x7fdd3810c170 2024-09-12T00:57:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.895+0000 7fdd2f7fe640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd240a2d70 0x7fdd240a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.895+0000 7fdd3659c640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd240a2d70 0x7fdd240a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.895+0000 7fdd2f7fe640 1 -- 172.21.15.2:0/3643734582 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fdd300cfaa0 con 0x7fdd3810c170 2024-09-12T00:57:33.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.896+0000 7fdd3659c640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd240a2d70 0x7fdd240a5230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000c00 tx=0x7fdd28005df0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:33.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:33.899+0000 7fdd2f7fe640 1 -- 172.21.15.2:0/3643734582 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd30014030 con 0x7fdd3810c170 2024-09-12T00:57:34.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.109+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd38199760 con 0x7fdd3810c170 2024-09-12T00:57:34.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.110+0000 7fdd2f7fe640 1 -- 172.21.15.2:0/3643734582 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11899 (secure 0 0 0) 0x7fdd38199760 con 0x7fdd3810c170 2024-09-12T00:57:34.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:57:34.109 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"btime":"2024-09-12T00:57:16:338130+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:57:16.129856+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:57:34.110 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-09-12T00:57:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd240a2d70 msgr2=0x7fdd240a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd240a2d70 0x7fdd240a5230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000c00 tx=0x7fdd28005df0 comp rx=0 tx=0).stop 2024-09-12T00:57:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd3810c170 msgr2=0x7fdd3819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd3810c170 0x7fdd3819ccd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000cce0 tx=0x7fdd3000a620 comp rx=0 tx=0).stop 2024-09-12T00:57:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 shutdown_connections 2024-09-12T00:57:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fdd240a2d70 0x7fdd240a5230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd3810c170 0x7fdd3819ccd0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:34.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd38103660 0x7fdd38198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:34.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 --2- 172.21.15.2:0/3643734582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd38102d40 0x7fdd38198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:34.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 >> 172.21.15.2:0/3643734582 conn(0x7fdd380fc7a0 msgr2=0x7fdd380fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:34.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 shutdown_connections 2024-09-12T00:57:34.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:34.112+0000 7fdd3cd97640 1 -- 172.21.15.2:0/3643734582 wait complete. 2024-09-12T00:57:34.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:34 smithi002 ceph-mon[31210]: pgmap v142: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-12T00:57:34.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:34 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3643734582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:34.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:34 smithi071 ceph-mon[35276]: pgmap v142: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-12T00:57:34.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:34 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3643734582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:34 smithi167 ceph-mon[35234]: pgmap v142: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-12T00:57:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:34 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3643734582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:34.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:57:34.903 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:57:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 -- 172.21.15.2:0/1781999265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928102d90 msgr2=0x7f4928103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 --2- 172.21.15.2:0/1781999265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928102d90 0x7f4928103170 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4918009930 tx=0x7f491802a420 comp rx=0 tx=0).stop 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 -- 172.21.15.2:0/1781999265 shutdown_connections 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 --2- 172.21.15.2:0/1781999265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4928108290 0x7f492810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 --2- 172.21.15.2:0/1781999265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4928103740 0x7f4928107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 --2- 172.21.15.2:0/1781999265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928102d90 0x7f4928103170 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 -- 172.21.15.2:0/1781999265 >> 172.21.15.2:0/1781999265 conn(0x7f49280fc7d0 msgr2=0x7f49280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 -- 172.21.15.2:0/1781999265 shutdown_connections 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.559+0000 7f492d259640 1 -- 172.21.15.2:0/1781999265 wait complete. 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492d259640 1 Processor -- start 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492d259640 1 -- start start 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492d259640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4928102d90 0x7f49281009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492d259640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4928103740 0x7f4928100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492d259640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928108290 0x7f4928101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492d259640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49281120d0 con 0x7f4928108290 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492d259640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4928111f50 con 0x7f4928102d90 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492d259640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4928112250 con 0x7f4928103740 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928108290 0x7f4928101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928108290 0x7f4928101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58786/0 (socket says 172.21.15.2:58786) 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492759e640 1 -- 172.21.15.2:0/2203387109 learned_addr learned my addr 172.21.15.2:0/2203387109 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f4926d9d640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4928102d90 0x7f49281009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f491ffff640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4928103740 0x7f4928100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492759e640 1 -- 172.21.15.2:0/2203387109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4928103740 msgr2=0x7f4928100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492759e640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4928103740 0x7f4928100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492759e640 1 -- 172.21.15.2:0/2203387109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4928102d90 msgr2=0x7f49281009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492759e640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4928102d90 0x7f49281009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f492759e640 1 -- 172.21.15.2:0/2203387109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49281aaf80 con 0x7f4928108290 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.560+0000 7f4926d9d640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4928102d90 0x7f49281009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.561+0000 7f492759e640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928108290 0x7f4928101470 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f492000b970 tx=0x7f492000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.561+0000 7f4924d99640 1 -- 172.21.15.2:0/2203387109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920019070 con 0x7f4928108290 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.561+0000 7f4924d99640 1 -- 172.21.15.2:0/2203387109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f492000cb40 con 0x7f4928108290 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.561+0000 7f492d259640 1 -- 172.21.15.2:0/2203387109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49281ab1b0 con 0x7f4928108290 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.561+0000 7f4924d99640 1 -- 172.21.15.2:0/2203387109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920007650 con 0x7f4928108290 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.561+0000 7f492d259640 1 -- 172.21.15.2:0/2203387109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49281ab6f0 con 0x7f4928108290 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.563+0000 7f4924d99640 1 -- 172.21.15.2:0/2203387109 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f492001c070 con 0x7f4928108290 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492f632740 1 Processor -- start 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492f632740 1 -- start start 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492f632740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f1b40 0x55efe59f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492f632740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe59f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492f632740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59fb370 0x55efe59fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492f632740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55efe59562f0 con 0x55efe59f1b40 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492f632740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55efe58fdcf0 con 0x55efe59f05d0 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492f632740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55efe59522b0 con 0x55efe59fb370 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f491ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f1b40 0x55efe59f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f4924d99640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f49140a2cf0 0x7f49140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f491ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f1b40 0x55efe59f0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58798/0 (socket says 172.21.15.2:58798) 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f491ffff640 1 -- 172.21.15.2:0/938919887 learned_addr learned my addr 172.21.15.2:0/938919887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f492759e640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f49140a2cf0 0x7f49140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f4926d9d640 1 --2- 172.21.15.2:0/938919887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe59f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f4924d99640 1 -- 172.21.15.2:0/2203387109 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f49200ce9b0 con 0x7f4928108290 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f491ffff640 1 -- 172.21.15.2:0/938919887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59fb370 msgr2=0x55efe59fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f491ffff640 1 --2- 172.21.15.2:0/938919887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59fb370 0x55efe59fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.564+0000 7f491ffff640 1 -- 172.21.15.2:0/938919887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 msgr2=0x55efe59f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.565+0000 7f491ffff640 1 --2- 172.21.15.2:0/938919887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe59f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.565+0000 7f491ffff640 1 -- 172.21.15.2:0/938919887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe58e23a0 con 0x55efe59f1b40 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.565+0000 7f491ffff640 1 --2- 172.21.15.2:0/938919887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f1b40 0x55efe59f0090 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f491000bc80 tx=0x7f49100127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d927f26cb69d49bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.565+0000 7f492759e640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f49140a2cf0 0x7f49140a51b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4920097440 tx=0x7f492000e040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.565+0000 7f491d7fa640 1 -- 172.21.15.2:0/938919887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49100120d0 con 0x55efe59f1b40 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.565+0000 7f491d7fa640 1 -- 172.21.15.2:0/938919887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4910016070 con 0x55efe59f1b40 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.565+0000 7f491d7fa640 1 -- 172.21.15.2:0/938919887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49100049e0 con 0x55efe59f1b40 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 -- 172.21.15.2:0/938919887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f1b40 msgr2=0x55efe59f0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 --2- 172.21.15.2:0/938919887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f1b40 0x55efe59f0090 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f491000bc80 tx=0x7f49100127c0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 -- 172.21.15.2:0/938919887 shutdown_connections 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 --2- 172.21.15.2:0/938919887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59fb370 0x55efe59fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 --2- 172.21.15.2:0/938919887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe59f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 --2- 172.21.15.2:0/938919887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f1b40 0x55efe59f0090 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 -- 172.21.15.2:0/938919887 >> 172.21.15.2:0/938919887 conn(0x55efe59b9310 msgr2=0x55efe59ecc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 -- 172.21.15.2:0/938919887 shutdown_connections 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 -- 172.21.15.2:0/938919887 wait complete. 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 -- start start 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.566+0000 7f492f632740 1 Processor -- start 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f492f632740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f05d0 0x55efe59fac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f492f632740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f1b40 0x55efe59f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f492f632740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59fb370 0x55efe59f8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f492f632740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55efe59fe070 con 0x55efe59f05d0 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f492f632740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55efe5911060 con 0x55efe59f1b40 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f492f632740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55efe59fe1f0 con 0x55efe59fb370 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f492f632740 10 client.0 _ll_register_callbacks cb 0x55efe56648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:35.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f05d0 0x55efe59fac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f05d0 0x55efe59fac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58812/0 (socket says 172.21.15.2:58812) 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 -- 172.21.15.2:0/854439413 learned_addr learned my addr 172.21.15.2:0/854439413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f4926d9d640 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f1b40 0x55efe59f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 -- 172.21.15.2:0/854439413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59fb370 msgr2=0x55efe59f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59fb370 0x55efe59f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 -- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f1b40 msgr2=0x55efe59f7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f1b40 0x55efe59f7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 -- 172.21.15.2:0/854439413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efe56c73c0 con 0x55efe59f05d0 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f4926d9d640 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f1b40 0x55efe59f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f491ffff640 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f05d0 0x55efe59fac30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4910015040 tx=0x7f49100053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8df86a6729b3d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f490e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f490e7fc640 1 -- 172.21.15.2:0/854439413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910028060 con 0x55efe59f05d0 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f490e7fc640 1 -- 172.21.15.2:0/854439413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f49100104f0 con 0x55efe59f05d0 2024-09-12T00:57:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.567+0000 7f492f632740 1 -- 172.21.15.2:0/854439413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4910016070 con 0x55efe59f05d0 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f490e7fc640 1 -- 172.21.15.2:0/854439413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4910010920 con 0x55efe59f05d0 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f492f632740 10 client.16320 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f492f632740 1 -- 172.21.15.2:0/854439413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55efe5a09a30 con 0x55efe59f05d0 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f490e7fc640 1 -- 172.21.15.2:0/854439413 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4910016070 con 0x55efe59f05d0 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f490e7fc640 1 -- 172.21.15.2:0/854439413 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f4910023ce0 con 0x55efe59f05d0 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f492f632740 10 client.16320 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f492f632740 10 client.16320 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f492f632740 20 client.16320 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f492f632740 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55efe5a0ad80 0x55efe5a0d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f492f632740 4 client.16320 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.568+0000 7f492f632740 1 -- 172.21.15.2:0/854439413 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efe5963860 con 0x55efe5a0ad80 2024-09-12T00:57:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.569+0000 7f4926d9d640 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55efe5a0ad80 0x55efe5a0d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.569+0000 7f4926d9d640 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55efe5a0ad80 0x55efe5a0d170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0d6996d6e8f2b54 server_cookie=a4d5f359216322f in_seq=0 out_seq=0 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.569+0000 7f490e7fc640 10 client.16320 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f490e7fc640 1 -- 172.21.15.2:0/854439413 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55efe5963860 con 0x55efe5a0ad80 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f490e7fc640 10 client.16320 handle_command_reply: tid=0 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 client.16320 shutdown 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 -- 172.21.15.2:0/854439413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f05d0 msgr2=0x55efe59fac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f05d0 0x55efe59fac30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4910015040 tx=0x7f49100053a0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 -- 172.21.15.2:0/854439413 shutdown_connections 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55efe5a0ad80 0x55efe5a0d170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59fb370 0x55efe59f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f1b40 0x55efe59f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f490e7fc640 0 client.16320 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 --2- 172.21.15.2:0/854439413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59f05d0 0x55efe59fac30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 -- 172.21.15.2:0/854439413 >> 172.21.15.2:0/854439413 conn(0x55efe59b9310 msgr2=0x55efe59f2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 -- 172.21.15.2:0/854439413 shutdown_connections 2024-09-12T00:57:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 1 -- 172.21.15.2:0/854439413 wait complete. 2024-09-12T00:57:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.570+0000 7f492f632740 20 client.16320 trim_cache size 0 max 16384 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.584+0000 7f492f632740 1 Processor -- start 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.584+0000 7f492f632740 1 -- start start 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f492f632740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe59ebc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f492f632740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59f3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f492f632740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59f3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f492f632740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49281b6960 con 0x55efe59fb370 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f492f632740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f49281b4230 con 0x55efe59f05d0 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f492f632740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f49281b2080 con 0x55efe59f1b40 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59f3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58818/0 (socket says 172.21.15.2:58818) 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 -- 172.21.15.2:0/430344429 learned_addr learned my addr 172.21.15.2:0/430344429 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe59ebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f4926d9d640 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 -- 172.21.15.2:0/430344429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 msgr2=0x55efe59f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 -- 172.21.15.2:0/430344429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 msgr2=0x55efe59ebc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe59ebc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.585+0000 7f491ffff640 1 -- 172.21.15.2:0/430344429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe59ed1a0 con 0x55efe59fb370 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.586+0000 7f491ffff640 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59f3660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f491000b830 tx=0x7f49100127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc10c5bef20dbae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.586+0000 7f491cff9640 1 -- 172.21.15.2:0/430344429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910028040 con 0x55efe59fb370 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.586+0000 7f491cff9640 1 -- 172.21.15.2:0/430344429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4910016070 con 0x55efe59fb370 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.586+0000 7f491cff9640 1 -- 172.21.15.2:0/430344429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491001ab50 con 0x55efe59fb370 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 -- 172.21.15.2:0/430344429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 msgr2=0x55efe59f3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59f3660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f491000b830 tx=0x7f49100127c0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 -- 172.21.15.2:0/430344429 shutdown_connections 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59f3660 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 --2- 172.21.15.2:0/430344429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe59ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 -- 172.21.15.2:0/430344429 >> 172.21.15.2:0/430344429 conn(0x55efe59b9310 msgr2=0x55efe59eb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 -- 172.21.15.2:0/430344429 shutdown_connections 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 -- 172.21.15.2:0/430344429 wait complete. 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 -- start start 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.587+0000 7f492f632740 1 Processor -- start 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f492f632740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe5a03a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f492f632740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59fed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f492f632740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59ff270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f492f632740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49281b26f0 con 0x55efe59fb370 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f492f632740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f49281b3b60 con 0x55efe59f05d0 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f492f632740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f49281b2dc0 con 0x55efe59f1b40 2024-09-12T00:57:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f492f632740 10 client.0 _ll_register_callbacks cb 0x7f491000b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f491ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59ff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f4926d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f491ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59ff270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58822/0 (socket says 172.21.15.2:58822) 2024-09-12T00:57:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f491ffff640 1 -- 172.21.15.2:0/1092023202 learned_addr learned my addr 172.21.15.2:0/1092023202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f491ffff640 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe5a03a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f4926d9d640 1 -- 172.21.15.2:0/1092023202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 msgr2=0x55efe5a03a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f4926d9d640 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe5a03a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f4926d9d640 1 -- 172.21.15.2:0/1092023202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 msgr2=0x55efe59ff270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f4926d9d640 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59ff270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f4926d9d640 1 -- 172.21.15.2:0/1092023202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efe59eb310 con 0x55efe59f1b40 2024-09-12T00:57:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.588+0000 7f491ffff640 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f4926d9d640 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59fed30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4918009230 tx=0x7f4918004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c190586ed100c7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f490e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f490e7fc640 1 -- 172.21.15.2:0/1092023202 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4918035040 con 0x55efe59f1b40 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f490e7fc640 1 -- 172.21.15.2:0/1092023202 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f4918005220 con 0x55efe59f1b40 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f492f632740 1 -- 172.21.15.2:0/1092023202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4910016070 con 0x55efe59f1b40 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f490e7fc640 1 -- 172.21.15.2:0/1092023202 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4918005420 con 0x55efe59f1b40 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f492f632740 10 client.25849 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f492f632740 1 -- 172.21.15.2:0/1092023202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55efe5a75380 con 0x55efe59f1b40 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.589+0000 7f490e7fc640 1 -- 172.21.15.2:0/1092023202 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4910016070 con 0x55efe59f1b40 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f490e7fc640 1 -- 172.21.15.2:0/1092023202 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f4918031820 con 0x55efe59f1b40 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f492f632740 10 client.25849 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f492f632740 10 client.25849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f492f632740 20 client.25849 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f492f632740 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55efe5a75b80 0x55efe5a77fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f492f632740 4 client.25849 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f492f632740 1 -- 172.21.15.2:0/1092023202 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55efe595dd70 con 0x55efe5a75b80 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f491ffff640 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55efe5a75b80 0x55efe5a77fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f490e7fc640 10 client.25849 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.590+0000 7f491ffff640 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55efe5a75b80 0x55efe5a77fa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=34727fb6c07448ff server_cookie=cef0ccaf8a5c5dfd in_seq=0 out_seq=0 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f490e7fc640 1 -- 172.21.15.2:0/1092023202 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55efe595dd70 con 0x55efe5a75b80 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f490e7fc640 10 client.25849 handle_command_reply: tid=0 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 client.25849 shutdown 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 -- 172.21.15.2:0/1092023202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 msgr2=0x55efe59fed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59fed30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4918009230 tx=0x7f4918004250 comp rx=0 tx=0).stop 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 -- 172.21.15.2:0/1092023202 shutdown_connections 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55efe5a75b80 0x55efe5a77fa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55efe59fb370 0x55efe59ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f490e7fc640 0 client.25849 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:57:35.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efe59f1b40 0x55efe59fed30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 --2- 172.21.15.2:0/1092023202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55efe59f05d0 0x55efe5a03a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 -- 172.21.15.2:0/1092023202 >> 172.21.15.2:0/1092023202 conn(0x55efe59b9310 msgr2=0x55efe59ebd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:35.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 -- 172.21.15.2:0/1092023202 shutdown_connections 2024-09-12T00:57:35.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 1 -- 172.21.15.2:0/1092023202 wait complete. 2024-09-12T00:57:35.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.591+0000 7f492f632740 20 client.25849 trim_cache size 0 max 16384 2024-09-12T00:57:35.596 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:57:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 -- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f49140a2cf0 msgr2=0x7f49140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f49140a2cf0 0x7f49140a51b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4920097440 tx=0x7f492000e040 comp rx=0 tx=0).stop 2024-09-12T00:57:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 -- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928108290 msgr2=0x7f4928101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928108290 0x7f4928101470 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f492000b970 tx=0x7f492000be30 comp rx=0 tx=0).stop 2024-09-12T00:57:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 -- 172.21.15.2:0/2203387109 shutdown_connections 2024-09-12T00:57:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f49140a2cf0 0x7f49140a51b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4928108290 0x7f4928101470 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4928103740 0x7f4928100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 --2- 172.21.15.2:0/2203387109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4928102d90 0x7f49281009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 -- 172.21.15.2:0/2203387109 >> 172.21.15.2:0/2203387109 conn(0x7f49280fc7d0 msgr2=0x7f4928105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 -- 172.21.15.2:0/2203387109 shutdown_connections 2024-09-12T00:57:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:35.592+0000 7f492d259640 1 -- 172.21.15.2:0/2203387109 wait complete. 2024-09-12T00:57:36.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:57:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:36.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:36 smithi002 ceph-mon[31210]: pgmap v143: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-12T00:57:36.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:36 smithi071 ceph-mon[35276]: pgmap v143: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-12T00:57:36.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:36 smithi167 ceph-mon[35234]: pgmap v143: 97 pgs: 97 active+clean; 138 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-12T00:57:36.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 -- 172.21.15.2:0/3620413328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 msgr2=0x7f5850106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:36.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 --2- 172.21.15.2:0/3620413328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 0x7f5850106e60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5840009930 tx=0x7f584002a420 comp rx=0 tx=0).stop 2024-09-12T00:57:36.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 -- 172.21.15.2:0/3620413328 shutdown_connections 2024-09-12T00:57:36.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 --2- 172.21.15.2:0/3620413328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5850101420 0x7f585010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:36.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 --2- 172.21.15.2:0/3620413328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5850100a80 0x7f5850100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:36.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 --2- 172.21.15.2:0/3620413328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 0x7f5850106e60 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:36.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 -- 172.21.15.2:0/3620413328 >> 172.21.15.2:0/3620413328 conn(0x7f58500fc7a0 msgr2=0x7f58500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 -- 172.21.15.2:0/3620413328 shutdown_connections 2024-09-12T00:57:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.814+0000 7f5855a67640 1 -- 172.21.15.2:0/3620413328 wait complete. 2024-09-12T00:57:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f5855a67640 1 Processor -- start 2024-09-12T00:57:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f5855a67640 1 -- start start 2024-09-12T00:57:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f5855a67640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5850100a80 0x7f585019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f5855a67640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5850101420 0x7f585019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f5855a67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 0x7f585019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f5855a67640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5850110e40 con 0x7f5850106a80 2024-09-12T00:57:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f5855a67640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5850110cc0 con 0x7f5850101420 2024-09-12T00:57:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f5855a67640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5850110fc0 con 0x7f5850100a80 2024-09-12T00:57:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f584ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 0x7f585019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f584ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 0x7f585019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37862/0 (socket says 172.21.15.2:37862) 2024-09-12T00:57:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f584ffff640 1 -- 172.21.15.2:0/1870402365 learned_addr learned my addr 172.21.15.2:0/1870402365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.815+0000 7f584f7fe640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5850100a80 0x7f585019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584effd640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5850101420 0x7f585019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584ffff640 1 -- 172.21.15.2:0/1870402365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5850100a80 msgr2=0x7f585019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584ffff640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5850100a80 0x7f585019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584ffff640 1 -- 172.21.15.2:0/1870402365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5850101420 msgr2=0x7f585019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584ffff640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5850101420 0x7f585019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584ffff640 1 -- 172.21.15.2:0/1870402365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585019f690 con 0x7f5850106a80 2024-09-12T00:57:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584effd640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5850101420 0x7f585019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584ffff640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 0x7f585019efb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5848009fd0 tx=0x7f584800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584cff9640 1 -- 172.21.15.2:0/1870402365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848017070 con 0x7f5850106a80 2024-09-12T00:57:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585019f980 con 0x7f5850106a80 2024-09-12T00:57:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584cff9640 1 -- 172.21.15.2:0/1870402365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5848003e50 con 0x7f5850106a80 2024-09-12T00:57:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f584cff9640 1 -- 172.21.15.2:0/1870402365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480106c0 con 0x7f5850106a80 2024-09-12T00:57:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.816+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58501a7260 con 0x7f5850106a80 2024-09-12T00:57:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.817+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5850100ee0 con 0x7f5850106a80 2024-09-12T00:57:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.818+0000 7f584cff9640 1 -- 172.21.15.2:0/1870402365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f5848003970 con 0x7f5850106a80 2024-09-12T00:57:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.819+0000 7f584cff9640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58380a2cf0 0x7f58380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.820+0000 7f584f7fe640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58380a2cf0 0x7f58380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.820+0000 7f584cff9640 1 -- 172.21.15.2:0/1870402365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f58480cf190 con 0x7f5850106a80 2024-09-12T00:57:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.820+0000 7f584f7fe640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58380a2cf0 0x7f58380a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f58400058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:36.823+0000 7f584cff9640 1 -- 172.21.15.2:0/1870402365 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f584809bd80 con 0x7f5850106a80 2024-09-12T00:57:36.869 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.048+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58501a7490 con 0x7f5850106a80 2024-09-12T00:57:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.048+0000 7f584cff9640 1 -- 172.21.15.2:0/1870402365 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11899 (secure 0 0 0) 0x7f584809b680 con 0x7f5850106a80 2024-09-12T00:57:37.047 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:57:37.048 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"btime":"2024-09-12T00:57:16:338130+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:57:16.129856+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:57:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-09-12T00:57:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58380a2cf0 msgr2=0x7f58380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58380a2cf0 0x7f58380a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f58400058d0 comp rx=0 tx=0).stop 2024-09-12T00:57:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 msgr2=0x7f585019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 0x7f585019efb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5848009fd0 tx=0x7f584800b260 comp rx=0 tx=0).stop 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 shutdown_connections 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58380a2cf0 0x7f58380a51b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5850106a80 0x7f585019efb0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5850101420 0x7f585019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 --2- 172.21.15.2:0/1870402365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5850100a80 0x7f585019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.050+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 >> 172.21.15.2:0/1870402365 conn(0x7f58500fc7a0 msgr2=0x7f585006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.051+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 shutdown_connections 2024-09-12T00:57:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:37.051+0000 7f5855a67640 1 -- 172.21.15.2:0/1870402365 wait complete. 2024-09-12T00:57:37.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:37 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1870402365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:37.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:37 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1870402365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:37.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:37 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1870402365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:57:37.864 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --set-id 7c12ffb --release --await' 2024-09-12T00:57:37.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --set-id 7c12ffb --release --await 2024-09-12T00:57:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.127+0000 7f8a73f01640 1 -- 172.21.15.2:0/1140630132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 msgr2=0x7f8a6c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.127+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1140630132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 0x7f8a6c074970 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009900 tx=0x7f8a6002a480 comp rx=0 tx=0).stop 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.127+0000 7f8a73f01640 1 -- 172.21.15.2:0/1140630132 shutdown_connections 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.127+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1140630132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c112b90 0x7f8a6c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.127+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1140630132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a6c074eb0 0x7f8a6c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.127+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1140630132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 0x7f8a6c074970 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.127+0000 7f8a73f01640 1 -- 172.21.15.2:0/1140630132 >> 172.21.15.2:0/1140630132 conn(0x7f8a6c0fd8c0 msgr2=0x7f8a6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.128+0000 7f8a73f01640 1 -- 172.21.15.2:0/1140630132 shutdown_connections 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.128+0000 7f8a73f01640 1 -- 172.21.15.2:0/1140630132 wait complete. 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.128+0000 7f8a73f01640 1 Processor -- start 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.128+0000 7f8a73f01640 1 -- start start 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a73f01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 0x7f8a6c1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a73f01640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c074eb0 0x7f8a6c1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a73f01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a6c112b90 0x7f8a6c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a73f01640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1185e0 con 0x7f8a6c074590 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a73f01640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c118460 con 0x7f8a6c074eb0 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a73f01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c118760 con 0x7f8a6c112b90 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 0x7f8a6c1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 0x7f8a6c1a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37878/0 (socket says 172.21.15.2:37878) 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 -- 172.21.15.2:0/1440707545 learned_addr learned my addr 172.21.15.2:0/1440707545 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a6c112b90 0x7f8a6c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a7149c640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c074eb0 0x7f8a6c1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 -- 172.21.15.2:0/1440707545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a6c112b90 msgr2=0x7f8a6c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a6c112b90 0x7f8a6c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 -- 172.21.15.2:0/1440707545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c074eb0 msgr2=0x7f8a6c1a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c074eb0 0x7f8a6c1a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 -- 172.21.15.2:0/1440707545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c19f000 con 0x7f8a6c074590 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a6c112b90 0x7f8a6c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 0x7f8a6c1a4710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8a60005ab0 tx=0x7f8a600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a5effd640 1 -- 172.21.15.2:0/1440707545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6003f030 con 0x7f8a6c074590 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a5effd640 1 -- 172.21.15.2:0/1440707545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a60003ce0 con 0x7f8a6c074590 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a73f01640 1 -- 172.21.15.2:0/1440707545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6c19f290 con 0x7f8a6c074590 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.129+0000 7f8a5effd640 1 -- 172.21.15.2:0/1440707545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60035070 con 0x7f8a6c074590 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.130+0000 7f8a73f01640 1 -- 172.21.15.2:0/1440707545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6c1ab5e0 con 0x7f8a6c074590 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.132+0000 7f8a5effd640 1 -- 172.21.15.2:0/1440707545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f8a60042030 con 0x7f8a6c074590 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.132+0000 7f8a762da740 1 Processor -- start 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.132+0000 7f8a762da740 1 -- start start 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.132+0000 7f8a762da740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 0x5588c0adc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.132+0000 7f8a762da740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0adca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.132+0000 7f8a762da740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a762da740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5588c0a422f0 con 0x5588c0ae7370 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a762da740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5588c09e9cf0 con 0x5588c0adc5d0 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a762da740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5588c0a3e2b0 con 0x5588c0addb40 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a5effd640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a580a2d70 0x7f8a580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7249e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 0x5588c0adc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37894/0 (socket says 172.21.15.2:37894) 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 -- 172.21.15.2:0/2166980078 learned_addr learned my addr 172.21.15.2:0/2166980078 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a580a2d70 0x7f8a580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a5effd640 1 -- 172.21.15.2:0/1440707545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8a600efe00 con 0x7f8a6c074590 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/2166980078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0adca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 -- 172.21.15.2:0/2166980078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 msgr2=0x5588c0adc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 --2- 172.21.15.2:0/2166980078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 0x5588c0adc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 -- 172.21.15.2:0/2166980078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 msgr2=0x5588c0adca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 --2- 172.21.15.2:0/2166980078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0adca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 -- 172.21.15.2:0/2166980078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588c09ce3a0 con 0x5588c0ae7370 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a580a2d70 0x7f8a580a5230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009440 tx=0x7f8a640093d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a7149c640 1 --2- 172.21.15.2:0/2166980078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae9760 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800cc00 tx=0x7f8a6800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9562264667f788a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.133+0000 7f8a57fff640 1 -- 172.21.15.2:0/2166980078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68005220 con 0x5588c0ae7370 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a57fff640 1 -- 172.21.15.2:0/2166980078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a68004c80 con 0x5588c0ae7370 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a57fff640 1 -- 172.21.15.2:0/2166980078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68010800 con 0x5588c0ae7370 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 -- 172.21.15.2:0/2166980078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 msgr2=0x5588c0ae9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 --2- 172.21.15.2:0/2166980078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae9760 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800cc00 tx=0x7f8a6800e720 comp rx=0 tx=0).stop 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 -- 172.21.15.2:0/2166980078 shutdown_connections 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 --2- 172.21.15.2:0/2166980078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae9760 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 --2- 172.21.15.2:0/2166980078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0adca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 --2- 172.21.15.2:0/2166980078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 0x5588c0adc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 -- 172.21.15.2:0/2166980078 >> 172.21.15.2:0/2166980078 conn(0x5588c0aa5310 msgr2=0x5588c0ad8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 -- 172.21.15.2:0/2166980078 shutdown_connections 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.134+0000 7f8a762da740 1 -- 172.21.15.2:0/2166980078 wait complete. 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 1 -- start start 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 1 Processor -- start 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0ae6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 0x5588c0ae3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5588c0aea070 con 0x5588c0ae7370 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5588c09fd060 con 0x5588c0adc5d0 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5588c0aea1f0 con 0x5588c0addb40 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a762da740 10 client.0 _ll_register_callbacks cb 0x5588c07508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a7249e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a7249e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37906/0 (socket says 172.21.15.2:37906) 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.135+0000 7f8a7249e640 1 -- 172.21.15.2:0/1012227194 learned_addr learned my addr 172.21.15.2:0/1012227194 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a7149c640 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 0x5588c0ae3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0ae6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a7249e640 1 -- 172.21.15.2:0/1012227194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 msgr2=0x5588c0ae3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 0x5588c0ae3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a7249e640 1 -- 172.21.15.2:0/1012227194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 msgr2=0x5588c0ae6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0ae6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a7249e640 1 -- 172.21.15.2:0/1012227194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588c07b33c0 con 0x5588c0ae7370 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0ae6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae44a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400afa0 tx=0x7f8a64004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b661ec0edf22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a557fa640 1 -- 172.21.15.2:0/1012227194 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64029060 con 0x5588c0ae7370 2024-09-12T00:57:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a762da740 1 -- 172.21.15.2:0/1012227194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a68004c80 con 0x5588c0ae7370 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a557fa640 1 -- 172.21.15.2:0/1012227194 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8a6401b9a0 con 0x5588c0ae7370 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a557fa640 1 -- 172.21.15.2:0/1012227194 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a64013040 con 0x5588c0ae7370 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a762da740 10 client.16344 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a762da740 1 -- 172.21.15.2:0/1012227194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5588c0af5ab0 con 0x5588c0ae7370 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.136+0000 7f8a557fa640 1 -- 172.21.15.2:0/1012227194 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a68004c80 con 0x5588c0ae7370 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a557fa640 1 -- 172.21.15.2:0/1012227194 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8a64019cd0 con 0x5588c0ae7370 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a762da740 10 client.16344 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a762da740 10 client.16344 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a762da740 20 client.16344 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a762da740 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5588c0af6ec0 0x5588c0af92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a762da740 4 client.16344 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a762da740 1 -- 172.21.15.2:0/1012227194 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588c0a4f860 con 0x5588c0af6ec0 2024-09-12T00:57:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5588c0af6ec0 0x5588c0af92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5588c0af6ec0 0x5588c0af92b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c13b9cf4dc8fd2df server_cookie=f985815471c97202 in_seq=0 out_seq=0 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.137+0000 7f8a557fa640 10 client.16344 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.138+0000 7f8a557fa640 1 -- 172.21.15.2:0/1012227194 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588c0a4f860 con 0x5588c0af6ec0 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.138+0000 7f8a557fa640 10 client.16344 handle_command_reply: tid=0 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.138+0000 7f8a762da740 1 client.16344 shutdown 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.138+0000 7f8a762da740 1 -- 172.21.15.2:0/1012227194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 msgr2=0x5588c0ae44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.138+0000 7f8a762da740 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae44a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400afa0 tx=0x7f8a64004b50 comp rx=0 tx=0).stop 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 1 -- 172.21.15.2:0/1012227194 shutdown_connections 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5588c0af6ec0 0x5588c0af92b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0ae7370 0x5588c0ae44a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0addb40 0x5588c0ae3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a557fa640 0 client.16344 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 1 --2- 172.21.15.2:0/1012227194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0ae6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 1 -- 172.21.15.2:0/1012227194 >> 172.21.15.2:0/1012227194 conn(0x5588c0aa5310 msgr2=0x5588c0ade960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 1 -- 172.21.15.2:0/1012227194 shutdown_connections 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 1 -- 172.21.15.2:0/1012227194 wait complete. 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.139+0000 7f8a762da740 20 client.16344 trim_cache size 0 max 16384 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a762da740 1 Processor -- start 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a762da740 1 -- start start 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a762da740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0adc5d0 0x5588c0af3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a762da740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0addb40 0x5588c0afeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a762da740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a762da740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1b68c0 con 0x5588c0adc5d0 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a762da740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1b4190 con 0x5588c0addb40 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a762da740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1b1fe0 con 0x5588c0ae7370 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a71c9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0adc5d0 0x5588c0af3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a71c9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0adc5d0 0x5588c0af3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37908/0 (socket says 172.21.15.2:37908) 2024-09-12T00:57:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a71c9d640 1 -- 172.21.15.2:0/1027506277 learned_addr learned my addr 172.21.15.2:0/1027506277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a71c9d640 1 -- 172.21.15.2:0/1027506277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 msgr2=0x5588c0aff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a7149c640 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0addb40 0x5588c0afeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aff0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a71c9d640 1 -- 172.21.15.2:0/1027506277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0addb40 msgr2=0x5588c0afeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.152+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0addb40 0x5588c0afeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a71c9d640 1 -- 172.21.15.2:0/1027506277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588c0af9910 con 0x5588c0adc5d0 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a7249e640 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a7149c640 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0addb40 0x5588c0afeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0adc5d0 0x5588c0af3310 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8a600bbfb0 tx=0x7f8a600b7e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5107d63f6ee7c692 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a577fe640 1 -- 172.21.15.2:0/1027506277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60049040 con 0x5588c0adc5d0 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a577fe640 1 -- 172.21.15.2:0/1027506277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a600c0660 con 0x5588c0adc5d0 2024-09-12T00:57:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a577fe640 1 -- 172.21.15.2:0/1027506277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6003b460 con 0x5588c0adc5d0 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a762da740 1 -- 172.21.15.2:0/1027506277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0adc5d0 msgr2=0x5588c0af3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a762da740 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0adc5d0 0x5588c0af3310 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8a600bbfb0 tx=0x7f8a600b7e70 comp rx=0 tx=0).stop 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a762da740 1 -- 172.21.15.2:0/1027506277 shutdown_connections 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a762da740 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a762da740 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0addb40 0x5588c0afeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.153+0000 7f8a762da740 1 --2- 172.21.15.2:0/1027506277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0adc5d0 0x5588c0af3310 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 -- 172.21.15.2:0/1027506277 >> 172.21.15.2:0/1027506277 conn(0x5588c0aa5310 msgr2=0x5588c0ae2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 -- 172.21.15.2:0/1027506277 shutdown_connections 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 -- 172.21.15.2:0/1027506277 wait complete. 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 -- start start 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 Processor -- start 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0aeb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0addb40 0x5588c0aeb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aebc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1b2650 con 0x5588c0addb40 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1b3ac0 con 0x5588c0adc5d0 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.154+0000 7f8a762da740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1b2d20 con 0x5588c0ae7370 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a762da740 10 client.0 _ll_register_callbacks cb 0x7f8a64009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0addb40 0x5588c0aeb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0addb40 0x5588c0aeb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37918/0 (socket says 172.21.15.2:37918) 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 -- 172.21.15.2:0/3676443578 learned_addr learned my addr 172.21.15.2:0/3676443578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7249e640 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aebc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0aeb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 -- 172.21.15.2:0/3676443578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 msgr2=0x5588c0aebc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aebc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 -- 172.21.15.2:0/3676443578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 msgr2=0x5588c0aeb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0aeb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 -- 172.21.15.2:0/3676443578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588c0b60b60 con 0x5588c0addb40 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0aeb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a7149c640 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0addb40 0x5588c0aeb730 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x5588c0add070 tx=0x7f8a68005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ba661bde234917 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a557fa640 1 -- 172.21.15.2:0/3676443578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a680037f0 con 0x5588c0addb40 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a762da740 1 -- 172.21.15.2:0/3676443578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a600c0660 con 0x5588c0addb40 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a557fa640 1 -- 172.21.15.2:0/3676443578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8a68003990 con 0x5588c0addb40 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.155+0000 7f8a557fa640 1 -- 172.21.15.2:0/3676443578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a680057a0 con 0x5588c0addb40 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a762da740 10 client.16350 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a762da740 1 -- 172.21.15.2:0/3676443578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5588c0b61dc0 con 0x5588c0addb40 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a557fa640 1 -- 172.21.15.2:0/3676443578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a600c0660 con 0x5588c0addb40 2024-09-12T00:57:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a557fa640 1 -- 172.21.15.2:0/3676443578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8a6801aca0 con 0x5588c0addb40 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a762da740 10 client.16350 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a762da740 10 client.16350 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a762da740 20 client.16350 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a762da740 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5588c0b62390 0x5588c0b647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a762da740 4 client.16350 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a762da740 1 -- 172.21.15.2:0/3676443578 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588c0a49d70 con 0x5588c0b62390 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.156+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5588c0b62390 0x5588c0b647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a557fa640 10 client.16350 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a71c9d640 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5588c0b62390 0x5588c0b647b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29a546d61d06a9e0 server_cookie=28f34c1f56488b43 in_seq=0 out_seq=0 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a557fa640 1 -- 172.21.15.2:0/3676443578 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588c0a49d70 con 0x5588c0b62390 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a557fa640 10 client.16350 handle_command_reply: tid=0 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 client.16350 shutdown 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 -- 172.21.15.2:0/3676443578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0addb40 msgr2=0x5588c0aeb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0addb40 0x5588c0aeb730 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x5588c0add070 tx=0x7f8a68005630 comp rx=0 tx=0).stop 2024-09-12T00:57:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 -- 172.21.15.2:0/3676443578 shutdown_connections 2024-09-12T00:57:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5588c0b62390 0x5588c0b647b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588c0ae7370 0x5588c0aebc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c0addb40 0x5588c0aeb730 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a557fa640 0 client.16350 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:57:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 --2- 172.21.15.2:0/3676443578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5588c0adc5d0 0x5588c0aeb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 -- 172.21.15.2:0/3676443578 >> 172.21.15.2:0/3676443578 conn(0x5588c0aa5310 msgr2=0x5588c0ae5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 -- 172.21.15.2:0/3676443578 shutdown_connections 2024-09-12T00:57:38.183 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 1 -- 172.21.15.2:0/3676443578 wait complete. 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.157+0000 7f8a762da740 20 client.16350 trim_cache size 0 max 16384 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 -- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a580a2d70 msgr2=0x7f8a580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a580a2d70 0x7f8a580a5230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009440 tx=0x7f8a640093d0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 -- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 msgr2=0x7f8a6c1a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 0x7f8a6c1a4710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8a60005ab0 tx=0x7f8a600042f0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 -- 172.21.15.2:0/1440707545 shutdown_connections 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8a580a2d70 0x7f8a580a5230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a6c112b90 0x7f8a6c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c074eb0 0x7f8a6c1a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 --2- 172.21.15.2:0/1440707545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c074590 0x7f8a6c1a4710 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:38.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 -- 172.21.15.2:0/1440707545 >> 172.21.15.2:0/1440707545 conn(0x7f8a6c0fd8c0 msgr2=0x7f8a6c0fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:38.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 -- 172.21.15.2:0/1440707545 shutdown_connections 2024-09-12T00:57:38.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:38.158+0000 7f8a73f01640 1 -- 172.21.15.2:0/1440707545 wait complete. 2024-09-12T00:57:38.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:38 smithi071 ceph-mon[35276]: pgmap v144: 97 pgs: 97 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-09-12T00:57:38.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:38 smithi002 ceph-mon[31210]: pgmap v144: 97 pgs: 97 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-09-12T00:57:38.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:38 smithi167 ceph-mon[35234]: pgmap v144: 97 pgs: 97 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-09-12T00:57:39.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:57:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 -- 172.21.15.2:0/215162652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 msgr2=0x7f68fc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 --2- 172.21.15.2:0/215162652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 0x7f68fc1067e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009900 tx=0x7f68ec02a410 comp rx=0 tx=0).stop 2024-09-12T00:57:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 -- 172.21.15.2:0/215162652 shutdown_connections 2024-09-12T00:57:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 --2- 172.21.15.2:0/215162652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68fc106f10 0x7f68fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 --2- 172.21.15.2:0/215162652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 0x7f68fc1067e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 --2- 172.21.15.2:0/215162652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68fc101de0 0x7f68fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 -- 172.21.15.2:0/215162652 >> 172.21.15.2:0/215162652 conn(0x7f68fc0fd8c0 msgr2=0x7f68fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 -- 172.21.15.2:0/215162652 shutdown_connections 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.598+0000 7f69040d5640 1 -- 172.21.15.2:0/215162652 wait complete. 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.599+0000 7f69040d5640 1 Processor -- start 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.599+0000 7f69040d5640 1 -- start start 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.599+0000 7f69040d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68fc101de0 0x7f68fc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.599+0000 7f69040d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 0x7f68fc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.599+0000 7f69040d5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68fc106f10 0x7f68fc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.599+0000 7f69040d5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc111f30 con 0x7f68fc102790 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.599+0000 7f69040d5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc111db0 con 0x7f68fc106f10 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.599+0000 7f69040d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1120b0 con 0x7f68fc101de0 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 0x7f68fc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 0x7f68fc198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37926/0 (socket says 172.21.15.2:37926) 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 -- 172.21.15.2:0/3697927852 learned_addr learned my addr 172.21.15.2:0/3697927852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901e71640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68fc101de0 0x7f68fc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6902672640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68fc106f10 0x7f68fc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 -- 172.21.15.2:0/3697927852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68fc101de0 msgr2=0x7f68fc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68fc101de0 0x7f68fc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 -- 172.21.15.2:0/3697927852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68fc106f10 msgr2=0x7f68fc19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68fc106f10 0x7f68fc19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 -- 172.21.15.2:0/3697927852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68fc19d3e0 con 0x7f68fc102790 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f6901670640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 0x7f68fc198970 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f68ec006010 tx=0x7f68ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f68f2ffd640 1 -- 172.21.15.2:0/3697927852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec03f030 con 0x7f68fc102790 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f68f2ffd640 1 -- 172.21.15.2:0/3697927852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68ec003ce0 con 0x7f68fc102790 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f69040d5640 1 -- 172.21.15.2:0/3697927852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68fc19d670 con 0x7f68fc102790 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f68f2ffd640 1 -- 172.21.15.2:0/3697927852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec035070 con 0x7f68fc102790 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.600+0000 7f69040d5640 1 -- 172.21.15.2:0/3697927852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68fc1a4fb0 con 0x7f68fc102790 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f68f2ffd640 1 -- 172.21.15.2:0/3697927852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f68ec042030 con 0x7f68fc102790 2024-09-12T00:57:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f69064ae740 1 Processor -- start 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f69064ae740 1 -- start start 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f69064ae740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b5e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f69064ae740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b68d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f69064ae740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b6b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f69064ae740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e80ac3620 con 0x563e80b5e980 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f69064ae740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563e80a6ae50 con 0x563e80b69240 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f69064ae740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563e80abf5e0 con 0x563e80b5e060 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f6901e71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b68d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f6901e71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b68d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37930/0 (socket says 172.21.15.2:37930) 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.603+0000 7f6901e71640 1 -- 172.21.15.2:0/1427640026 learned_addr learned my addr 172.21.15.2:0/1427640026 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6902672640 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b5e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f68f2ffd640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f68e80a2cf0 0x7f68e80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6901670640 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b6b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6901e71640 1 -- 172.21.15.2:0/1427640026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 msgr2=0x563e80b5e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6901e71640 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b5e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6901e71640 1 -- 172.21.15.2:0/1427640026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 msgr2=0x563e80b6b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6902672640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f68e80a2cf0 0x7f68e80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6901e71640 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b6b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6901e71640 1 -- 172.21.15.2:0/1427640026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e80a5bd40 con 0x563e80b5e980 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f68f2ffd640 1 -- 172.21.15.2:0/3697927852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f68ec0efb10 con 0x7f68fc102790 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6901670640 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b6b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6901e71640 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b68d00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f68f800bd10 tx=0x7f68f80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a01569993f481 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f6902672640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f68e80a2cf0 0x7f68e80a51b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68f4005fd0 tx=0x7f68f4004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f68e7fff640 1 -- 172.21.15.2:0/1427640026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8004030 con 0x563e80b5e980 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f68e7fff640 1 -- 172.21.15.2:0/1427640026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f80041d0 con 0x563e80b5e980 2024-09-12T00:57:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.604+0000 7f68e7fff640 1 -- 172.21.15.2:0/1427640026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8011820 con 0x563e80b5e980 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 -- 172.21.15.2:0/1427640026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 msgr2=0x563e80b68d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b68d00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f68f800bd10 tx=0x7f68f80107a0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 -- 172.21.15.2:0/1427640026 shutdown_connections 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b6b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b68d00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 --2- 172.21.15.2:0/1427640026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b5e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 -- 172.21.15.2:0/1427640026 >> 172.21.15.2:0/1427640026 conn(0x563e80b5a5f0 msgr2=0x563e80b5a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 -- 172.21.15.2:0/1427640026 shutdown_connections 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 -- 172.21.15.2:0/1427640026 wait complete. 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.605+0000 7f69064ae740 1 -- start start 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f69064ae740 1 Processor -- start 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f69064ae740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b66170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f69064ae740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f69064ae740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b66bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f69064ae740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e80b6be10 con 0x563e80b5e980 2024-09-12T00:57:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f69064ae740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563e80a4bf10 con 0x563e80b69240 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f69064ae740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563e80b6bf90 con 0x563e80b5e060 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f69064ae740 10 client.0 _ll_register_callbacks cb 0x563e80a6fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901670640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901670640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37938/0 (socket says 172.21.15.2:37938) 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901670640 1 -- 172.21.15.2:0/3248277478 learned_addr learned my addr 172.21.15.2:0/3248277478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6902672640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b66bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901e71640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b66170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901670640 1 -- 172.21.15.2:0/3248277478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 msgr2=0x563e80b66170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901670640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b66170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901670640 1 -- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 msgr2=0x563e80b66bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901670640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b66bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901670640 1 -- 172.21.15.2:0/3248277478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e807d2580 con 0x563e80b5e980 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6901e71640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b66170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:57:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.606+0000 7f6902672640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b66bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f6901670640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b666b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0b8550 tx=0x7f68ec087280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5816394ed7a1f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f68e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f68e57fa640 1 -- 172.21.15.2:0/3248277478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec049030 con 0x563e80b5e980 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f68e57fa640 1 -- 172.21.15.2:0/3248277478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f68ec0ed430 con 0x563e80b5e980 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 1 -- 172.21.15.2:0/3248277478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68f80041d0 con 0x563e80b5e980 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f68e57fa640 1 -- 172.21.15.2:0/3248277478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68ec0bba50 con 0x563e80b5e980 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 10 client.16362 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 1 -- 172.21.15.2:0/3248277478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563e8089c960 con 0x563e80b5e980 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f68e57fa640 1 -- 172.21.15.2:0/3248277478 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f80041d0 con 0x563e80b5e980 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f68e57fa640 1 -- 172.21.15.2:0/3248277478 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f68ec088050 con 0x563e80b5e980 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 10 client.16362 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 10 client.16362 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:57:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 20 client.16362 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563e80b78c50 0x563e80b7b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 4 client.16362 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.607+0000 7f69064ae740 1 -- 172.21.15.2:0/3248277478 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e80ad0b90 con 0x563e80b78c50 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.608+0000 7f6901e71640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563e80b78c50 0x563e80b7b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.608+0000 7f6901e71640 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563e80b78c50 0x563e80b7b0c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbab5e4990cc3f26 server_cookie=b292a1c5272d564e in_seq=0 out_seq=0 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.608+0000 7f68e57fa640 10 client.16362 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f68e57fa640 1 -- 172.21.15.2:0/3248277478 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e80ad0b90 con 0x563e80b78c50 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f68e57fa640 10 client.16362 handle_command_reply: tid=0 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 client.16362 shutdown 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 -- 172.21.15.2:0/3248277478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 msgr2=0x563e80b666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b666b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0b8550 tx=0x7f68ec087280 comp rx=0 tx=0).stop 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 -- 172.21.15.2:0/3248277478 shutdown_connections 2024-09-12T00:57:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563e80b78c50 0x563e80b7b0c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80b66bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e980 0x563e80b666b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 --2- 172.21.15.2:0/3248277478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e060 0x563e80b66170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f68e57fa640 0 client.16362 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 -- 172.21.15.2:0/3248277478 >> 172.21.15.2:0/3248277478 conn(0x563e80b5a5f0 msgr2=0x563e80b602d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 -- 172.21.15.2:0/3248277478 shutdown_connections 2024-09-12T00:57:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 1 -- 172.21.15.2:0/3248277478 wait complete. 2024-09-12T00:57:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.609+0000 7f69064ae740 20 client.16362 trim_cache size 0 max 16384 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.627+0000 7f69064ae740 1 Processor -- start 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.627+0000 7f69064ae740 1 -- start start 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f69064ae740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b5e060 0x563e80b680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f69064ae740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f69064ae740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b69240 0x563e80b80f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f69064ae740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1b0260 con 0x563e80b69240 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f69064ae740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1adb30 con 0x563e80b5e060 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f69064ae740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1ab980 con 0x563e80b5e980 2024-09-12T00:57:39.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6902672640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b69240 0x563e80b80f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6902672640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b69240 0x563e80b80f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37944/0 (socket says 172.21.15.2:37944) 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6902672640 1 -- 172.21.15.2:0/2263067029 learned_addr learned my addr 172.21.15.2:0/2263067029 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6901670640 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6901e71640 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b5e060 0x563e80b680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6902672640 1 -- 172.21.15.2:0/2263067029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 msgr2=0x563e80b809d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6902672640 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b809d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6902672640 1 -- 172.21.15.2:0/2263067029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b5e060 msgr2=0x563e80b680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6902672640 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b5e060 0x563e80b680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6902672640 1 -- 172.21.15.2:0/2263067029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e80b5e7b0 con 0x563e80b69240 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.628+0000 7f6901e71640 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b5e060 0x563e80b680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.629+0000 7f6902672640 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b69240 0x563e80b80f10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f68f4012710 tx=0x7f68f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d5bf45dcaad4b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.629+0000 7f68e77fe640 1 -- 172.21.15.2:0/2263067029 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4029440 con 0x563e80b69240 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.629+0000 7f68e77fe640 1 -- 172.21.15.2:0/2263067029 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f401f8f0 con 0x563e80b69240 2024-09-12T00:57:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.629+0000 7f68e77fe640 1 -- 172.21.15.2:0/2263067029 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4028a10 con 0x563e80b69240 2024-09-12T00:57:39.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 -- 172.21.15.2:0/2263067029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b69240 msgr2=0x563e80b80f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b69240 0x563e80b80f10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f68f4012710 tx=0x7f68f4009840 comp rx=0 tx=0).stop 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 -- 172.21.15.2:0/2263067029 shutdown_connections 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b69240 0x563e80b80f10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b809d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 --2- 172.21.15.2:0/2263067029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b5e060 0x563e80b680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 -- 172.21.15.2:0/2263067029 >> 172.21.15.2:0/2263067029 conn(0x563e80b5a5f0 msgr2=0x563e80b679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 -- 172.21.15.2:0/2263067029 shutdown_connections 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.630+0000 7f69064ae740 1 -- 172.21.15.2:0/2263067029 wait complete. 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 1 -- start start 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 1 Processor -- start 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e060 0x563e80bdf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80bdba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1abff0 con 0x563e80b5e060 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1ad460 con 0x563e80b69240 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1ac6c0 con 0x563e80b5e980 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.631+0000 7f69064ae740 10 client.0 _ll_register_callbacks cb 0x7f68ec0b8390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901e71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e060 0x563e80bdf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901670640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901e71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e060 0x563e80bdf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37946/0 (socket says 172.21.15.2:37946) 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901e71640 1 -- 172.21.15.2:0/2551935822 learned_addr learned my addr 172.21.15.2:0/2551935822 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6902672640 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80bdba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901670640 1 -- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 msgr2=0x563e80bdba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901670640 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80bdba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901670640 1 -- 172.21.15.2:0/2551935822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e060 msgr2=0x563e80bdf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901670640 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e060 0x563e80bdf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901670640 1 -- 172.21.15.2:0/2551935822 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e80bdbf40 con 0x563e80b5e980 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6902672640 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80bdba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f6901670640 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b717b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68ec000c00 tx=0x7f68ec0ed6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=523c28248defa300 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.632+0000 7f68e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f68e57fa640 1 -- 172.21.15.2:0/2551935822 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec049070 con 0x563e80b5e980 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f68e57fa640 1 -- 172.21.15.2:0/2551935822 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f68ec0bc350 con 0x563e80b5e980 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f69064ae740 1 -- 172.21.15.2:0/2551935822 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68f401f8f0 con 0x563e80b5e980 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f68e57fa640 1 -- 172.21.15.2:0/2551935822 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68ec0044e0 con 0x563e80b5e980 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f69064ae740 10 client.25882 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f69064ae740 1 -- 172.21.15.2:0/2551935822 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563e80becd80 con 0x563e80b5e980 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f68e57fa640 1 -- 172.21.15.2:0/2551935822 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f401f8f0 con 0x563e80b5e980 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f68e57fa640 1 -- 172.21.15.2:0/2551935822 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f68ec0b3050 con 0x563e80b5e980 2024-09-12T00:57:39.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f69064ae740 10 client.25882 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:39.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f69064ae740 10 client.25882 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:57:39.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f69064ae740 20 client.25882 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:39.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.633+0000 7f69064ae740 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563e80bed310 0x563e80bef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:39.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.634+0000 7f69064ae740 4 client.25882 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7c12ffb", "release": true, "await": true}] 2024-09-12T00:57:39.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.634+0000 7f69064ae740 1 -- 172.21.15.2:0/2551935822 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7c12ffb", "release": true, "await": true}) -- 0x563e80acb0a0 con 0x563e80bed310 2024-09-12T00:57:39.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.634+0000 7f6901e71640 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563e80bed310 0x563e80bef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:39.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.634+0000 7f68e57fa640 10 client.25882 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:39.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.634+0000 7f6901e71640 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563e80bed310 0x563e80bef730 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49feb1bab894ed8 server_cookie=fab91922b162006f in_seq=0 out_seq=0 2024-09-12T00:57:39.656 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f68e57fa640 1 -- 172.21.15.2:0/2551935822 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x563e80acb0a0 con 0x563e80bed310 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f68e57fa640 10 client.25882 handle_command_reply: tid=0 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 client.25882 shutdown 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 -- 172.21.15.2:0/2551935822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 msgr2=0x563e80b717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b717b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68ec000c00 tx=0x7f68ec0ed6c0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 -- 172.21.15.2:0/2551935822 shutdown_connections 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563e80bed310 0x563e80bef730 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563e80b69240 0x563e80bdba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f68e57fa640 0 client.25882 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e80b5e980 0x563e80b717b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 --2- 172.21.15.2:0/2551935822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e80b5e060 0x563e80bdf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.843+0000 7f69064ae740 1 -- 172.21.15.2:0/2551935822 >> 172.21.15.2:0/2551935822 conn(0x563e80b5a5f0 msgr2=0x563e80b66950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69064ae740 1 -- 172.21.15.2:0/2551935822 shutdown_connections 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69064ae740 1 -- 172.21.15.2:0/2551935822 wait complete. 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69064ae740 20 client.25882 trim_cache size 0 max 16384 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 29, 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 20, 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": { 2024-09-12T00:57:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "7c12ffb": { 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "version": 20, 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "age_ref": 0.0, 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "timeout": 90.0, 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "expiration": 140.2, 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "members": { 2024-09-12T00:57:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "file:/": { 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "excluded": false, 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "state": { 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RELEASED", 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "age": 0.0 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:57:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69040d5640 1 -- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f68e80a2cf0 msgr2=0x7f68e80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69040d5640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f68e80a2cf0 0x7f68e80a51b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68f4005fd0 tx=0x7f68f4004ab0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69040d5640 1 -- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 msgr2=0x7f68fc198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69040d5640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 0x7f68fc198970 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f68ec006010 tx=0x7f68ec0042f0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69040d5640 1 -- 172.21.15.2:0/3697927852 shutdown_connections 2024-09-12T00:57:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.844+0000 7f69040d5640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f68e80a2cf0 0x7f68e80a51b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.845+0000 7f69040d5640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68fc106f10 0x7f68fc19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.845+0000 7f69040d5640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68fc102790 0x7f68fc198970 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.845+0000 7f69040d5640 1 --2- 172.21.15.2:0/3697927852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68fc101de0 0x7f68fc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:39.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.845+0000 7f69040d5640 1 -- 172.21.15.2:0/3697927852 >> 172.21.15.2:0/3697927852 conn(0x7f68fc0fd8c0 msgr2=0x7f68fc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:39.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.845+0000 7f69040d5640 1 -- 172.21.15.2:0/3697927852 shutdown_connections 2024-09-12T00:57:39.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:39.845+0000 7f69040d5640 1 -- 172.21.15.2:0/3697927852 wait complete. 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.331+0000 7f36c5dde640 1 -- 172.21.15.2:0/52386289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c0102d30 msgr2=0x7f36c0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.331+0000 7f36c5dde640 1 --2- 172.21.15.2:0/52386289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c0102d30 0x7f36c0103110 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009930 tx=0x7f36b002a420 comp rx=0 tx=0).stop 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.331+0000 7f36c5dde640 1 -- 172.21.15.2:0/52386289 shutdown_connections 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.331+0000 7f36c5dde640 1 --2- 172.21.15.2:0/52386289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36c01082a0 0x7f36c010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.331+0000 7f36c5dde640 1 --2- 172.21.15.2:0/52386289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36c01036e0 0x7f36c0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.331+0000 7f36c5dde640 1 --2- 172.21.15.2:0/52386289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c0102d30 0x7f36c0103110 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.331+0000 7f36c5dde640 1 -- 172.21.15.2:0/52386289 >> 172.21.15.2:0/52386289 conn(0x7f36c00fc7d0 msgr2=0x7f36c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.332+0000 7f36c5dde640 1 -- 172.21.15.2:0/52386289 shutdown_connections 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.332+0000 7f36c5dde640 1 -- 172.21.15.2:0/52386289 wait complete. 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.332+0000 7f36c5dde640 1 Processor -- start 2024-09-12T00:57:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.332+0000 7f36c5dde640 1 -- start start 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36c5dde640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36c0102d30 0x7f36c0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36c5dde640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36c01036e0 0x7f36c0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36c5dde640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c01082a0 0x7f36c0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36c5dde640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01120a0 con 0x7f36c01082a0 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36c5dde640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36c0111f20 con 0x7f36c01036e0 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36c5dde640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f36c0112220 con 0x7f36c0102d30 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36bffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c01082a0 0x7f36c0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36bffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c01082a0 0x7f36c0101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37968/0 (socket says 172.21.15.2:37968) 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36bf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36c0102d30 0x7f36c0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36beffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36c01036e0 0x7f36c0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36bffff640 1 -- 172.21.15.2:0/525736626 learned_addr learned my addr 172.21.15.2:0/525736626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36beffd640 1 -- 172.21.15.2:0/525736626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36c0102d30 msgr2=0x7f36c0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36beffd640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36c0102d30 0x7f36c0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36beffd640 1 -- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c01082a0 msgr2=0x7f36c0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36beffd640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c01082a0 0x7f36c0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36beffd640 1 -- 172.21.15.2:0/525736626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c01a6a60 con 0x7f36c01036e0 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36c0102d30 0x7f36c0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.333+0000 7f36bffff640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c01082a0 0x7f36c0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.334+0000 7f36beffd640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36c01036e0 0x7f36c0100ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36c00697d0 tx=0x7f36b400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.334+0000 7f36bcff9640 1 -- 172.21.15.2:0/525736626 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b400cc40 con 0x7f36c01036e0 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.334+0000 7f36bcff9640 1 -- 172.21.15.2:0/525736626 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b400cde0 con 0x7f36c01036e0 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.334+0000 7f36c5dde640 1 -- 172.21.15.2:0/525736626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c01a6d50 con 0x7f36c01036e0 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.334+0000 7f36bcff9640 1 -- 172.21.15.2:0/525736626 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b40188e0 con 0x7f36c01036e0 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.334+0000 7f36c5dde640 1 -- 172.21.15.2:0/525736626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c01a7230 con 0x7f36c01036e0 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.336+0000 7f36bcff9640 1 -- 172.21.15.2:0/525736626 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f36b4010430 con 0x7f36c01036e0 2024-09-12T00:57:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36c81b7740 1 Processor -- start 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36bcff9640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36a80a2cf0 0x7f36a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36c81b7740 1 -- start start 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36bffff640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36a80a2cf0 0x7f36a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36bcff9640 1 -- 172.21.15.2:0/525736626 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f36b40cf760 con 0x7f36c01036e0 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aea4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36c81b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56061ae0a2f0 con 0x56061aea45d0 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36c81b7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56061adb1cf0 con 0x56061aea5b40 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36c81b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56061ae062b0 con 0x56061aeaf370 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36bf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36bf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:50526/0 (socket says 172.21.15.2:50526) 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36bf7fe640 1 -- 172.21.15.2:0/2402525675 learned_addr learned my addr 172.21.15.2:0/2402525675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36beffd640 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aea4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.337+0000 7f36bffff640 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36bf7fe640 1 -- 172.21.15.2:0/2402525675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 msgr2=0x56061aeb1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36bf7fe640 1 -- 172.21.15.2:0/2402525675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 msgr2=0x56061aea4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aea4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36bf7fe640 1 -- 172.21.15.2:0/2402525675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56061ad963a0 con 0x56061aea5b40 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36bffff640 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36bffff640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36a80a2cf0 0x7f36a80a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f36b80049d0 tx=0x7f36b8011bf0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea4090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f36b0000c00 tx=0x7f36b0005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e345c57fe63f109d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36a5ffb640 1 -- 172.21.15.2:0/2402525675 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b0035040 con 0x56061aea5b40 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36a5ffb640 1 -- 172.21.15.2:0/2402525675 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b0031830 con 0x56061aea5b40 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.338+0000 7f36a5ffb640 1 -- 172.21.15.2:0/2402525675 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b0003e60 con 0x56061aea5b40 2024-09-12T00:57:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 -- 172.21.15.2:0/2402525675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 msgr2=0x56061aea4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea4090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f36b0000c00 tx=0x7f36b0005d50 comp rx=0 tx=0).stop 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 -- 172.21.15.2:0/2402525675 shutdown_connections 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aea4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 --2- 172.21.15.2:0/2402525675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea4090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 -- 172.21.15.2:0/2402525675 >> 172.21.15.2:0/2402525675 conn(0x56061ae6d310 msgr2=0x56061aea0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 -- 172.21.15.2:0/2402525675 shutdown_connections 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.339+0000 7f36c81b7740 1 -- 172.21.15.2:0/2402525675 wait complete. 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 1 -- start start 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 1 Processor -- start 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aea45d0 0x56061aeaed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeabfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aeaf370 0x56061aeac560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56061aeb2010 con 0x56061aea5b40 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56061adc5060 con 0x56061aeaf370 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56061aeb2190 con 0x56061aea45d0 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.340+0000 7f36c81b7740 10 client.0 _ll_register_callbacks cb 0x56061ab188c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.341+0000 7f36bffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aeaf370 0x56061aeac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.341+0000 7f36bf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aea45d0 0x56061aeaed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.341+0000 7f36bf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aea45d0 0x56061aeaed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:43050/0 (socket says 172.21.15.2:43050) 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.341+0000 7f36bf7fe640 1 -- 172.21.15.2:0/3019651605 learned_addr learned my addr 172.21.15.2:0/3019651605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.341+0000 7f36beffd640 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeabfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36bffff640 1 -- 172.21.15.2:0/3019651605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aea45d0 msgr2=0x56061aeaed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36bffff640 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aea45d0 0x56061aeaed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36bffff640 1 -- 172.21.15.2:0/3019651605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 msgr2=0x56061aeabfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36bffff640 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeabfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36bffff640 1 -- 172.21.15.2:0/3019651605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56061ab7b3c0 con 0x56061aeaf370 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36bffff640 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aeaf370 0x56061aeac560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x56061aea5070 tx=0x7f36b8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4fcb9d1c427459b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f369effd640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f369effd640 1 -- 172.21.15.2:0/3019651605 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8017040 con 0x56061aeaf370 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f369effd640 1 -- 172.21.15.2:0/3019651605 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f36b8009050 con 0x56061aeaf370 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36c81b7740 1 -- 172.21.15.2:0/3019651605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36b0031830 con 0x56061aeaf370 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f369effd640 1 -- 172.21.15.2:0/3019651605 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36b801f720 con 0x56061aeaf370 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36c81b7740 10 client.25982 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.342+0000 7f36c81b7740 1 -- 172.21.15.2:0/3019651605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56061aebda60 con 0x56061aeaf370 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f369effd640 1 -- 172.21.15.2:0/3019651605 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b0031830 con 0x56061aeaf370 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f369effd640 1 -- 172.21.15.2:0/3019651605 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f36b8027a40 con 0x56061aeaf370 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f36c81b7740 10 client.25982 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f36c81b7740 10 client.25982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f36c81b7740 20 client.25982 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56061aebef20 0x56061aec13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f36c81b7740 4 client.25982 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f36c81b7740 1 -- 172.21.15.2:0/3019651605 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56061ae17860 con 0x56061aebef20 2024-09-12T00:57:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.343+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56061aebef20 0x56061aec13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.344+0000 7f369effd640 10 client.25982 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.344+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56061aebef20 0x56061aec13c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=979700d417152051 server_cookie=cd33a361bd8b81a8 in_seq=0 out_seq=0 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.344+0000 7f369effd640 1 -- 172.21.15.2:0/3019651605 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56061ae17860 con 0x56061aebef20 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.344+0000 7f369effd640 10 client.25982 handle_command_reply: tid=0 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.344+0000 7f36c81b7740 1 client.25982 shutdown 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.344+0000 7f36c81b7740 1 -- 172.21.15.2:0/3019651605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aeaf370 msgr2=0x56061aeac560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.344+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aeaf370 0x56061aeac560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x56061aea5070 tx=0x7f36b8004ab0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 1 -- 172.21.15.2:0/3019651605 shutdown_connections 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56061aebef20 0x56061aec13c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aeaf370 0x56061aeac560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeabfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3019651605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aea45d0 0x56061aeaed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 1 -- 172.21.15.2:0/3019651605 >> 172.21.15.2:0/3019651605 conn(0x56061ae6d310 msgr2=0x56061aea6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f369effd640 0 client.25982 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 1 -- 172.21.15.2:0/3019651605 shutdown_connections 2024-09-12T00:57:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 1 -- 172.21.15.2:0/3019651605 wait complete. 2024-09-12T00:57:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.345+0000 7f36c81b7740 20 client.25982 trim_cache size 0 max 16384 2024-09-12T00:57:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36c81b7740 1 Processor -- start 2024-09-12T00:57:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36c81b7740 1 -- start start 2024-09-12T00:57:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aeadf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aea7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36c81b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01b24f0 con 0x56061aea45d0 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36c81b7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01afdc0 con 0x56061aea5b40 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36c81b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01adc10 con 0x56061aeaf370 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aeadf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aeadf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37992/0 (socket says 172.21.15.2:37992) 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36bf7fe640 1 -- 172.21.15.2:0/3534668417 learned_addr learned my addr 172.21.15.2:0/3534668417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36bffff640 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aea7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.360+0000 7f36beffd640 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36bf7fe640 1 -- 172.21.15.2:0/3534668417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 msgr2=0x56061aea7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aea7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36bf7fe640 1 -- 172.21.15.2:0/3534668417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 msgr2=0x56061aea7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36bf7fe640 1 -- 172.21.15.2:0/3534668417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56061aea7ba0 con 0x56061aea45d0 2024-09-12T00:57:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aeadf30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f36b0031ba0 tx=0x7f36b002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcee51b390b58905 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36a57fa640 1 -- 172.21.15.2:0/3534668417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b0035040 con 0x56061aea45d0 2024-09-12T00:57:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36a57fa640 1 -- 172.21.15.2:0/3534668417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b00035f0 con 0x56061aea45d0 2024-09-12T00:57:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.361+0000 7f36a57fa640 1 -- 172.21.15.2:0/3534668417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b00516c0 con 0x56061aea45d0 2024-09-12T00:57:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 -- 172.21.15.2:0/3534668417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 msgr2=0x56061aeadf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aeadf30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f36b0031ba0 tx=0x7f36b002a420 comp rx=0 tx=0).stop 2024-09-12T00:57:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 -- 172.21.15.2:0/3534668417 shutdown_connections 2024-09-12T00:57:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aea7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea5b40 0x56061aea7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3534668417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea45d0 0x56061aeadf30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 -- 172.21.15.2:0/3534668417 >> 172.21.15.2:0/3534668417 conn(0x56061ae6d310 msgr2=0x56061aead820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 -- 172.21.15.2:0/3534668417 shutdown_connections 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 -- 172.21.15.2:0/3534668417 wait complete. 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.362+0000 7f36c81b7740 1 -- start start 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36c81b7740 1 Processor -- start 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea45d0 0x56061aeb79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeb2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36c81b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36c81b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01ae280 con 0x56061aea5b40 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36c81b7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01af6f0 con 0x56061aea45d0 2024-09-12T00:57:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36c81b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01ae950 con 0x56061aeaf370 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36c81b7740 10 client.0 _ll_register_callbacks cb 0x7f36b800fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeb2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeb2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38008/0 (socket says 172.21.15.2:38008) 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36beffd640 1 -- 172.21.15.2:0/3935684147 learned_addr learned my addr 172.21.15.2:0/3935684147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea45d0 0x56061aeb79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.363+0000 7f36bffff640 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36beffd640 1 -- 172.21.15.2:0/3935684147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 msgr2=0x56061aeb3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36beffd640 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36beffd640 1 -- 172.21.15.2:0/3935684147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea45d0 msgr2=0x56061aeb79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36beffd640 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea45d0 0x56061aeb79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36beffd640 1 -- 172.21.15.2:0/3935684147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56061aeb38b0 con 0x56061aea5b40 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36beffd640 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeb2d00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f36b409b9e0 tx=0x7f36b409ffe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc7b6cc44463e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f369effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f369effd640 1 -- 172.21.15.2:0/3935684147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b40a4610 con 0x56061aea5b40 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f369effd640 1 -- 172.21.15.2:0/3935684147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f36b409b130 con 0x56061aea5b40 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36c81b7740 1 -- 172.21.15.2:0/3935684147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36b00035f0 con 0x56061aea5b40 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f369effd640 1 -- 172.21.15.2:0/3935684147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36b4010bf0 con 0x56061aea5b40 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36c81b7740 10 client.16386 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f36c81b7740 1 -- 172.21.15.2:0/3935684147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56061af29b80 con 0x56061aea5b40 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f369effd640 1 -- 172.21.15.2:0/3935684147 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b00035f0 con 0x56061aea5b40 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.364+0000 7f369effd640 1 -- 172.21.15.2:0/3935684147 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f36b40b4070 con 0x56061aea5b40 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36c81b7740 10 client.16386 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36c81b7740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36c81b7740 20 client.16386 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56061af2a300 0x56061af2c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36c81b7740 4 client.16386 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36c81b7740 1 -- 172.21.15.2:0/3935684147 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56061ae11d70 con 0x56061af2a300 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56061af2a300 0x56061af2c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f369effd640 10 client.16386 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36bf7fe640 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56061af2a300 0x56061af2c720 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f2ebc94ae03862e server_cookie=29dc8e27767ffc28 in_seq=0 out_seq=0 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f369effd640 1 -- 172.21.15.2:0/3935684147 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56061ae11d70 con 0x56061af2a300 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f369effd640 10 client.16386 handle_command_reply: tid=0 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.365+0000 7f36c81b7740 1 client.16386 shutdown 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 -- 172.21.15.2:0/3935684147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 msgr2=0x56061aeb2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeb2d00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f36b409b9e0 tx=0x7f36b409ffe0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 -- 172.21.15.2:0/3935684147 shutdown_connections 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56061af2a300 0x56061af2c720 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56061aeaf370 0x56061aeb3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56061aea5b40 0x56061aeb2d00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 --2- 172.21.15.2:0/3935684147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56061aea45d0 0x56061aeb79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 -- 172.21.15.2:0/3935684147 >> 172.21.15.2:0/3935684147 conn(0x56061ae6d310 msgr2=0x56061aeae040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f369effd640 0 client.16386 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 -- 172.21.15.2:0/3935684147 shutdown_connections 2024-09-12T00:57:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 1 -- 172.21.15.2:0/3935684147 wait complete. 2024-09-12T00:57:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.366+0000 7f36c81b7740 20 client.16386 trim_cache size 0 max 16384 2024-09-12T00:57:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:57:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 -- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36a80a2cf0 msgr2=0x7f36a80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36a80a2cf0 0x7f36a80a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f36b80049d0 tx=0x7f36b8011bf0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 -- 172.21.15.2:0/525736626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36c01036e0 msgr2=0x7f36c0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36c01036e0 0x7f36c0100ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36c00697d0 tx=0x7f36b400ee50 comp rx=0 tx=0).stop 2024-09-12T00:57:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 -- 172.21.15.2:0/525736626 shutdown_connections 2024-09-12T00:57:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36a80a2cf0 0x7f36a80a51b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c01082a0 0x7f36c0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36c01036e0 0x7f36c0100ed0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 --2- 172.21.15.2:0/525736626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36c0102d30 0x7f36c0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 -- 172.21.15.2:0/525736626 >> 172.21.15.2:0/525736626 conn(0x7f36c00fc7d0 msgr2=0x7f36c0105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 -- 172.21.15.2:0/525736626 shutdown_connections 2024-09-12T00:57:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:40.367+0000 7f36c5dde640 1 -- 172.21.15.2:0/525736626 wait complete. 2024-09-12T00:57:40.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:40 smithi002 ceph-mon[31210]: pgmap v145: 97 pgs: 97 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-12T00:57:40.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:40 smithi071 ceph-mon[35276]: pgmap v145: 97 pgs: 97 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-12T00:57:40.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:40 smithi167 ceph-mon[35234]: pgmap v145: 97 pgs: 97 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-12T00:57:41.749 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7c12ffb', total seconds elapsed: 27.0 2024-09-12T00:57:42.158 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:57:42.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:57:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:42.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:42 smithi002 ceph-mon[31210]: pgmap v146: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 390 KiB/s wr, 67 op/s 2024-09-12T00:57:42.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:42 smithi071 ceph-mon[35276]: pgmap v146: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 390 KiB/s wr, 67 op/s 2024-09-12T00:57:42.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:42 smithi167 ceph-mon[35234]: pgmap v146: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 390 KiB/s wr, 67 op/s 2024-09-12T00:57:42.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 -- 172.21.15.2:0/1340049268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 msgr2=0x7f647c1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 --2- 172.21.15.2:0/1340049268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 0x7f647c1067d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f646c009900 tx=0x7f646c02a410 comp rx=0 tx=0).stop 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 -- 172.21.15.2:0/1340049268 shutdown_connections 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 --2- 172.21.15.2:0/1340049268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c106f00 0x7f647c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 --2- 172.21.15.2:0/1340049268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 0x7f647c1067d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 --2- 172.21.15.2:0/1340049268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c101dd0 0x7f647c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 -- 172.21.15.2:0/1340049268 >> 172.21.15.2:0/1340049268 conn(0x7f647c0fd8b0 msgr2=0x7f647c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 -- 172.21.15.2:0/1340049268 shutdown_connections 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.947+0000 7f648469e640 1 -- 172.21.15.2:0/1340049268 wait complete. 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648469e640 1 Processor -- start 2024-09-12T00:57:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648469e640 1 -- start start 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648469e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c101dd0 0x7f647c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648469e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 0x7f647c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648469e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c106f00 0x7f647c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648469e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f647c111f60 con 0x7f647c102780 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648469e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f647c111de0 con 0x7f647c101dd0 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648469e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1120e0 con 0x7f647c106f00 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f648243a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c101dd0 0x7f647c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.948+0000 7f6481c39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 0x7f647c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f648243a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c101dd0 0x7f647c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:50568/0 (socket says 172.21.15.2:50568) 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f648243a640 1 -- 172.21.15.2:0/796129098 learned_addr learned my addr 172.21.15.2:0/796129098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f6482c3b640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c106f00 0x7f647c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f6481c39640 1 -- 172.21.15.2:0/796129098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c106f00 msgr2=0x7f647c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f6481c39640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c106f00 0x7f647c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f6481c39640 1 -- 172.21.15.2:0/796129098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c101dd0 msgr2=0x7f647c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f6481c39640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c101dd0 0x7f647c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f6481c39640 1 -- 172.21.15.2:0/796129098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c1a6980 con 0x7f647c102780 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f648243a640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c101dd0 0x7f647c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f6481c39640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 0x7f647c074a30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f646c005940 tx=0x7f646c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f64737fe640 1 -- 172.21.15.2:0/796129098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c03f030 con 0x7f647c102780 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f648469e640 1 -- 172.21.15.2:0/796129098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c1a6c10 con 0x7f647c102780 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f64737fe640 1 -- 172.21.15.2:0/796129098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f646c0044c0 con 0x7f647c102780 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.949+0000 7f64737fe640 1 -- 172.21.15.2:0/796129098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c035070 con 0x7f647c102780 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.950+0000 7f648469e640 1 -- 172.21.15.2:0/796129098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1a7140 con 0x7f647c102780 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.952+0000 7f64737fe640 1 -- 172.21.15.2:0/796129098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f646c042030 con 0x7f647c102780 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6486a77740 1 Processor -- start 2024-09-12T00:57:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6486a77740 1 -- start start 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6486a77740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fc6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6486a77740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc7480 0x560b47fd1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6486a77740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fd4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6486a77740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b47f2c280 con 0x560b47fc6b60 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6486a77740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560b47ed3b10 con 0x560b47fc7480 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6486a77740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560b47f28240 con 0x560b47fd1d40 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6482c3b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fc6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6482c3b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fc6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38040/0 (socket says 172.21.15.2:38040) 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f6482c3b640 1 -- 172.21.15.2:0/3245742060 learned_addr learned my addr 172.21.15.2:0/3245742060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.953+0000 7f648243a640 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc7480 0x560b47fd1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f6481c39640 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fd4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f64737fe640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f648243a640 1 -- 172.21.15.2:0/3245742060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 msgr2=0x560b47fd4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f648243a640 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fd4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f648243a640 1 -- 172.21.15.2:0/3245742060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 msgr2=0x560b47fc6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f648243a640 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fc6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f648243a640 1 -- 172.21.15.2:0/3245742060 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b47ee01f0 con 0x560b47fc7480 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f6482c3b640 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fc6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f64737fe640 1 -- 172.21.15.2:0/796129098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f646c0ef770 con 0x7f647c102780 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f6482c3b640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f648243a640 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc7480 0x560b47fd1800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6478011510 tx=0x7f64780119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348502cf3ee3b7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f6470ff9640 1 -- 172.21.15.2:0/3245742060 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647801e070 con 0x560b47fc7480 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f6470ff9640 1 -- 172.21.15.2:0/3245742060 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f647800faa0 con 0x560b47fc7480 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.954+0000 7f6470ff9640 1 -- 172.21.15.2:0/3245742060 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478019bd0 con 0x560b47fc7480 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6482c3b640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6474010790 tx=0x7f6474004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 -- 172.21.15.2:0/3245742060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc7480 msgr2=0x560b47fd1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc7480 0x560b47fd1800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6478011510 tx=0x7f64780119d0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 -- 172.21.15.2:0/3245742060 shutdown_connections 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fd4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc7480 0x560b47fd1800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 --2- 172.21.15.2:0/3245742060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fc6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 -- 172.21.15.2:0/3245742060 >> 172.21.15.2:0/3245742060 conn(0x560b47fc30f0 msgr2=0x560b47fc34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 -- 172.21.15.2:0/3245742060 shutdown_connections 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 -- 172.21.15.2:0/3245742060 wait complete. 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.955+0000 7f6486a77740 1 -- start start 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6486a77740 1 Processor -- start 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6486a77740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6486a77740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fcf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6486a77740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fcf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6486a77740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b47fd4910 con 0x560b47fc7480 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6486a77740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560b47ee6f10 con 0x560b47fc6b60 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6486a77740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560b47fd4a90 con 0x560b47fd1d40 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6486a77740 10 client.0 _ll_register_callbacks cb 0x560b47eafa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fcf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f648243a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fcf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38052/0 (socket says 172.21.15.2:38052) 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 -- 172.21.15.2:0/3012450887 learned_addr learned my addr 172.21.15.2:0/3012450887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6482c3b640 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fcf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 -- 172.21.15.2:0/3012450887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 msgr2=0x560b47fcf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fcf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 -- 172.21.15.2:0/3012450887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 msgr2=0x560b47fceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 -- 172.21.15.2:0/3012450887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b47c9d6a0 con 0x560b47fc7480 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f648243a640 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6481c39640 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fcf0e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f646c0b8610 tx=0x7f646c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47342dbf487f45d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.956+0000 7f6465ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6465ffb640 1 -- 172.21.15.2:0/3012450887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c049070 con 0x560b47fc7480 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6465ffb640 1 -- 172.21.15.2:0/3012450887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f646c0b82b0 con 0x560b47fc7480 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 1 -- 172.21.15.2:0/3012450887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f647800faa0 con 0x560b47fc7480 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6465ffb640 1 -- 172.21.15.2:0/3012450887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f646c0bb5a0 con 0x560b47fc7480 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 10 client.16398 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 1 -- 172.21.15.2:0/3012450887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560b47fe04a0 con 0x560b47fc7480 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6465ffb640 1 -- 172.21.15.2:0/3012450887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f647800faa0 con 0x560b47fc7480 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6465ffb640 1 -- 172.21.15.2:0/3012450887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f646c0bbea0 con 0x560b47fc7480 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 10 client.16398 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 20 client.16398 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b47fe1900 0x560b47fe3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 4 client.16398 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f6486a77740 1 -- 172.21.15.2:0/3012450887 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b47f397f0 con 0x560b47fe1900 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.957+0000 7f648243a640 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b47fe1900 0x560b47fe3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.958+0000 7f648243a640 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b47fe1900 0x560b47fe3d90 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c3bf75218e5766f server_cookie=1a0cb2cd072af2a1 in_seq=0 out_seq=0 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.958+0000 7f6465ffb640 10 client.16398 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6465ffb640 1 -- 172.21.15.2:0/3012450887 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b47f397f0 con 0x560b47fe1900 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6465ffb640 10 client.16398 handle_command_reply: tid=0 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 client.16398 shutdown 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 -- 172.21.15.2:0/3012450887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 msgr2=0x560b47fcf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fcf0e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f646c0b8610 tx=0x7f646c005b50 comp rx=0 tx=0).stop 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 -- 172.21.15.2:0/3012450887 shutdown_connections 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b47fe1900 0x560b47fe3d90 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fcf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fcf0e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 --2- 172.21.15.2:0/3012450887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 -- 172.21.15.2:0/3012450887 >> 172.21.15.2:0/3012450887 conn(0x560b47fc30f0 msgr2=0x560b47fc8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6465ffb640 0 client.16398 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 -- 172.21.15.2:0/3012450887 shutdown_connections 2024-09-12T00:57:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 1 -- 172.21.15.2:0/3012450887 wait complete. 2024-09-12T00:57:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.959+0000 7f6486a77740 20 client.16398 trim_cache size 0 max 16384 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6486a77740 1 Processor -- start 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6486a77740 1 -- start start 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6486a77740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fd0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6486a77740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fc7480 0x560b47fe9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6486a77740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fd1d40 0x560b47fe9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6486a77740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1b2420 con 0x560b47fc6b60 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6486a77740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1afcf0 con 0x560b47fd1d40 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6486a77740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1adb40 con 0x560b47fc7480 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f648243a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fd0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f648243a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fd0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38068/0 (socket says 172.21.15.2:38068) 2024-09-12T00:57:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f648243a640 1 -- 172.21.15.2:0/4113118799 learned_addr learned my addr 172.21.15.2:0/4113118799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6481c39640 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fc7480 0x560b47fe9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.978+0000 7f6482c3b640 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fd1d40 0x560b47fe9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f648243a640 1 -- 172.21.15.2:0/4113118799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fc7480 msgr2=0x560b47fe9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f648243a640 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fc7480 0x560b47fe9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f648243a640 1 -- 172.21.15.2:0/4113118799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fd1d40 msgr2=0x560b47fe9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f648243a640 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fd1d40 0x560b47fe9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f648243a640 1 -- 172.21.15.2:0/4113118799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b47fc72b0 con 0x560b47fc6b60 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f648243a640 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fd0a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f64780197a0 tx=0x7f64780196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9bac175a1128d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f6467fff640 1 -- 172.21.15.2:0/4113118799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478034070 con 0x560b47fc6b60 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f6467fff640 1 -- 172.21.15.2:0/4113118799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6478005040 con 0x560b47fc6b60 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.979+0000 7f6467fff640 1 -- 172.21.15.2:0/4113118799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647801e040 con 0x560b47fc6b60 2024-09-12T00:57:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 -- 172.21.15.2:0/4113118799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 msgr2=0x560b47fd0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fd0a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f64780197a0 tx=0x7f64780196c0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 -- 172.21.15.2:0/4113118799 shutdown_connections 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fd1d40 0x560b47fe9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fc7480 0x560b47fe9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 --2- 172.21.15.2:0/4113118799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc6b60 0x560b47fd0a00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 -- 172.21.15.2:0/4113118799 >> 172.21.15.2:0/4113118799 conn(0x560b47fc30f0 msgr2=0x560b47fd02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 -- 172.21.15.2:0/4113118799 shutdown_connections 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 -- 172.21.15.2:0/4113118799 wait complete. 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 -- start start 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.980+0000 7f6486a77740 1 Processor -- start 2024-09-12T00:57:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6486a77740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fd5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6486a77740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fd60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6486a77740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fd6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6486a77740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1ae1b0 con 0x560b47fc7480 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6486a77740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1af620 con 0x560b47fc6b60 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6486a77740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f647c1ae880 con 0x560b47fd1d40 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6486a77740 10 client.0 _ll_register_callbacks cb 0x7f646c031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6481c39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fd60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6481c39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fd60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38080/0 (socket says 172.21.15.2:38080) 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f648243a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fd5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6481c39640 1 -- 172.21.15.2:0/921595691 learned_addr learned my addr 172.21.15.2:0/921595691 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6482c3b640 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fd6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6481c39640 1 -- 172.21.15.2:0/921595691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 msgr2=0x560b47fd6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6481c39640 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fd6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6481c39640 1 -- 172.21.15.2:0/921595691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 msgr2=0x560b47fd5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6481c39640 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fd5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.981+0000 7f6481c39640 1 -- 172.21.15.2:0/921595691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b4804b7b0 con 0x560b47fc7480 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6481c39640 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fd60e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f646c0b80a0 tx=0x7f646c03b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9fbe92dab61352 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6465ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6465ffb640 1 -- 172.21.15.2:0/921595691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c049070 con 0x560b47fc7480 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6465ffb640 1 -- 172.21.15.2:0/921595691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f646c0c4620 con 0x560b47fc7480 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6486a77740 1 -- 172.21.15.2:0/921595691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6478005040 con 0x560b47fc7480 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6465ffb640 1 -- 172.21.15.2:0/921595691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f646c0bc340 con 0x560b47fc7480 2024-09-12T00:57:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6486a77740 10 client.16404 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6486a77740 1 -- 172.21.15.2:0/921595691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560b4804cab0 con 0x560b47fc7480 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6465ffb640 1 -- 172.21.15.2:0/921595691 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6478005040 con 0x560b47fc7480 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6465ffb640 1 -- 172.21.15.2:0/921595691 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f646c0bb120 con 0x560b47fc7480 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6486a77740 10 client.16404 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6486a77740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6486a77740 20 client.16404 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.982+0000 7f6486a77740 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4804d010 0x560b4804f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.983+0000 7f6486a77740 4 client.16404 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.983+0000 7f6486a77740 1 -- 172.21.15.2:0/921595691 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560b47f33d00 con 0x560b4804d010 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.983+0000 7f648243a640 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4804d010 0x560b4804f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.983+0000 7f648243a640 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4804d010 0x560b4804f430 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c09c12b60ab3e0ab server_cookie=ab7a1008077f7765 in_seq=0 out_seq=0 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.983+0000 7f6465ffb640 10 client.16404 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.984+0000 7f6465ffb640 1 -- 172.21.15.2:0/921595691 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560b47f33d00 con 0x560b4804d010 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.984+0000 7f6465ffb640 10 client.16404 handle_command_reply: tid=0 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.984+0000 7f6486a77740 1 client.16404 shutdown 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 -- 172.21.15.2:0/921595691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 msgr2=0x560b47fd60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fd60e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f646c0b80a0 tx=0x7f646c03b4d0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 -- 172.21.15.2:0/921595691 shutdown_connections 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560b4804d010 0x560b4804f430 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b47fd1d40 0x560b47fd6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b47fc7480 0x560b47fd60e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6465ffb640 0 client.16404 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 --2- 172.21.15.2:0/921595691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b47fc6b60 0x560b47fd5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 -- 172.21.15.2:0/921595691 >> 172.21.15.2:0/921595691 conn(0x560b47fc30f0 msgr2=0x560b47fc8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 -- 172.21.15.2:0/921595691 shutdown_connections 2024-09-12T00:57:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 1 -- 172.21.15.2:0/921595691 wait complete. 2024-09-12T00:57:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.985+0000 7f6486a77740 20 client.16404 trim_cache size 0 max 16384 2024-09-12T00:57:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:57:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:57:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "cd65fd41-7553-43b9-a403-795895d7d9e7", 2024-09-12T00:57:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:57:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:57:42.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 -- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 msgr2=0x7f64680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6474010790 tx=0x7f6474004a40 comp rx=0 tx=0).stop 2024-09-12T00:57:42.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 -- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 msgr2=0x7f647c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:42.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 0x7f647c074a30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f646c005940 tx=0x7f646c0040c0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 -- 172.21.15.2:0/796129098 shutdown_connections 2024-09-12T00:57:42.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f64680a2cf0 0x7f64680a51b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647c106f00 0x7f647c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f647c102780 0x7f647c074a30 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 --2- 172.21.15.2:0/796129098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f647c101dd0 0x7f647c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:42.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 -- 172.21.15.2:0/796129098 >> 172.21.15.2:0/796129098 conn(0x7f647c0fd8b0 msgr2=0x7f647c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:42.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 -- 172.21.15.2:0/796129098 shutdown_connections 2024-09-12T00:57:42.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:42.986+0000 7f648469e640 1 -- 172.21.15.2:0/796129098 wait complete. 2024-09-12T00:57:43.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:43 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:57:43.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:43 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:43 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:43.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:43 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:43.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:43 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:43 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:43.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:43 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:43 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:57:43.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:43 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:43 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:43.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:43 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:43.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:43 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:43 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:43.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:43 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:43 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:57:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:43 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:43 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:43 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:43 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:43 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:43.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:43 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:43.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:57:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:57:44.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:44 smithi002 ceph-mon[31210]: pgmap v147: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 390 KiB/s wr, 64 op/s 2024-09-12T00:57:44.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:44 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:44.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:44 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:44.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:44 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:57:44.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:44 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:44.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:44 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 -- 172.21.15.2:0/479498407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 msgr2=0x7f2aac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/479498407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 0x7f2aac1067e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009900 tx=0x7f2aa002a410 comp rx=0 tx=0).stop 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 -- 172.21.15.2:0/479498407 shutdown_connections 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/479498407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aac106f10 0x7f2aac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/479498407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 0x7f2aac1067e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/479498407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2aac101de0 0x7f2aac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 -- 172.21.15.2:0/479498407 >> 172.21.15.2:0/479498407 conn(0x7f2aac0fd8c0 msgr2=0x7f2aac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 -- 172.21.15.2:0/479498407 shutdown_connections 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.573+0000 7f2ab1d05640 1 -- 172.21.15.2:0/479498407 wait complete. 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2ab1d05640 1 Processor -- start 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2ab1d05640 1 -- start start 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2ab1d05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aac101de0 0x7f2aac198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2ab1d05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 0x7f2aac198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2ab1d05640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2aac106f10 0x7f2aac19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2ab1d05640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac111f70 con 0x7f2aac102790 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2ab1d05640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac111df0 con 0x7f2aac106f10 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2ab1d05640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac1120f0 con 0x7f2aac101de0 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 0x7f2aac198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aac101de0 0x7f2aac198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 0x7f2aac198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38108/0 (socket says 172.21.15.2:38108) 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aac101de0 0x7f2aac198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:43128/0 (socket says 172.21.15.2:43128) 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2aaaffd640 1 -- 172.21.15.2:0/3344995378 learned_addr learned my addr 172.21.15.2:0/3344995378 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.574+0000 7f2aabfff640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2aac106f10 0x7f2aac19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aaaffd640 1 -- 172.21.15.2:0/3344995378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aac101de0 msgr2=0x7f2aac198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aac101de0 0x7f2aac198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aaaffd640 1 -- 172.21.15.2:0/3344995378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2aac106f10 msgr2=0x7f2aac19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2aac106f10 0x7f2aac19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aaaffd640 1 -- 172.21.15.2:0/3344995378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac19d400 con 0x7f2aac102790 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 0x7f2aac198990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0006010 tx=0x7f2aa0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aa8ff9640 1 -- 172.21.15.2:0/3344995378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa003f030 con 0x7f2aac102790 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2ab1d05640 1 -- 172.21.15.2:0/3344995378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac19d690 con 0x7f2aac102790 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aa8ff9640 1 -- 172.21.15.2:0/3344995378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2aa0004440 con 0x7f2aac102790 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2aa8ff9640 1 -- 172.21.15.2:0/3344995378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0035070 con 0x7f2aac102790 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.575+0000 7f2ab1d05640 1 -- 172.21.15.2:0/3344995378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac1a4fd0 con 0x7f2aac102790 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2aa8ff9640 1 -- 172.21.15.2:0/3344995378 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f2aa0042030 con 0x7f2aac102790 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2ab40de740 1 Processor -- start 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2ab40de740 1 -- start start 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7c4a0 0x561d33b7c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7cdc0 0x561d33b87140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b87680 0x561d33b89a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2ab40de740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d33ae22e0 con 0x561d33b7cdc0 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2ab40de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561d33a89ce0 con 0x561d33b87680 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2ab40de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561d33ade2a0 con 0x561d33b7c4a0 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7cdc0 0x561d33b87140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7cdc0 0x561d33b87140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38114/0 (socket says 172.21.15.2:38114) 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2aab7fe640 1 -- 172.21.15.2:0/828337800 learned_addr learned my addr 172.21.15.2:0/828337800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2aabfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7c4a0 0x561d33b7c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.578+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b87680 0x561d33b89a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aa8ff9640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2a940a2cf0 0x7f2a940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aab7fe640 1 -- 172.21.15.2:0/828337800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7c4a0 msgr2=0x561d33b7c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7c4a0 0x561d33b7c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aab7fe640 1 -- 172.21.15.2:0/828337800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b87680 msgr2=0x561d33b89a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b87680 0x561d33b89a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aab7fe640 1 -- 172.21.15.2:0/828337800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d33a6e440 con 0x561d33b7cdc0 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aabfff640 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7c4a0 0x561d33b7c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b87680 0x561d33b89a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aabfff640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2a940a2cf0 0x7f2a940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aa8ff9640 1 -- 172.21.15.2:0/3344995378 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2aa00ef8a0 con 0x7f2aac102790 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7cdc0 0x561d33b87140 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009c80 tx=0x7f2a9c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae05bde0bdd58416 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2a91ffb640 1 -- 172.21.15.2:0/828337800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c012450 con 0x561d33b7cdc0 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2a91ffb640 1 -- 172.21.15.2:0/828337800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a9c012ad0 con 0x561d33b7cdc0 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.579+0000 7f2a91ffb640 1 -- 172.21.15.2:0/828337800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00fb80 con 0x561d33b7cdc0 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 -- 172.21.15.2:0/828337800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7cdc0 msgr2=0x561d33b87140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2aabfff640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2a940a2cf0 0x7f2a940a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009fd0 tx=0x7f2aa4004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7cdc0 0x561d33b87140 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009c80 tx=0x7f2a9c0117b0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 -- 172.21.15.2:0/828337800 shutdown_connections 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b87680 0x561d33b89a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7cdc0 0x561d33b87140 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 --2- 172.21.15.2:0/828337800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7c4a0 0x561d33b7c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 -- 172.21.15.2:0/828337800 >> 172.21.15.2:0/828337800 conn(0x561d33b78a30 msgr2=0x561d33b78e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 -- 172.21.15.2:0/828337800 shutdown_connections 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.580+0000 7f2ab40de740 1 -- 172.21.15.2:0/828337800 wait complete. 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 1 -- start start 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 1 Processor -- start 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b84220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b87680 0x561d33b84760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d33b8a250 con 0x561d33b87680 2024-09-12T00:57:44.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561d33a9d050 con 0x561d33b7c4a0 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561d33b8a3d0 con 0x561d33b7cdc0 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2ab40de740 10 client.0 _ll_register_callbacks cb 0x561d33add160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b87680 0x561d33b84760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b84220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2aabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b87680 0x561d33b84760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38128/0 (socket says 172.21.15.2:38128) 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.581+0000 7f2aabfff640 1 -- 172.21.15.2:0/1914122240 learned_addr learned my addr 172.21.15.2:0/1914122240 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2aaaffd640 1 -- 172.21.15.2:0/1914122240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 msgr2=0x561d33b86f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b86f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2aaaffd640 1 -- 172.21.15.2:0/1914122240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b87680 msgr2=0x561d33b84760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b87680 0x561d33b84760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2aaaffd640 1 -- 172.21.15.2:0/1914122240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d338533c0 con 0x561d33b7cdc0 2024-09-12T00:57:44.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2aabfff640 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b87680 0x561d33b84760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b84220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00ecfa0 tx=0x7f2aa00f3040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7cfcd14580a9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2a8affd640 1 -- 172.21.15.2:0/1914122240 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0049070 con 0x561d33b7cdc0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2ab40de740 1 -- 172.21.15.2:0/1914122240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a9c012ad0 con 0x561d33b7cdc0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2a8affd640 1 -- 172.21.15.2:0/1914122240 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2aa00ed220 con 0x561d33b7cdc0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2a8affd640 1 -- 172.21.15.2:0/1914122240 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2aa00bb8b0 con 0x561d33b7cdc0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2ab40de740 10 client.25930 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.582+0000 7f2ab40de740 1 -- 172.21.15.2:0/1914122240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561d33b8a2b0 con 0x561d33b7cdc0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2a8affd640 1 -- 172.21.15.2:0/1914122240 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a9c012ad0 con 0x561d33b7cdc0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2a8affd640 1 -- 172.21.15.2:0/1914122240 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f2aa00bbfd0 con 0x561d33b7cdc0 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2ab40de740 10 client.25930 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2ab40de740 10 client.25930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:44.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2ab40de740 20 client.25930 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:44.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561d33b97090 0x561d33b994a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2ab40de740 4 client.25930 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:57:44.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2ab40de740 1 -- 172.21.15.2:0/1914122240 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d33aef850 con 0x561d33b97090 2024-09-12T00:57:44.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561d33b97090 0x561d33b994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2a8affd640 10 client.25930 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:44.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.583+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561d33b97090 0x561d33b994a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3e930a3554e7f7f server_cookie=57654645163cff30 in_seq=0 out_seq=0 2024-09-12T00:57:44.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2a8affd640 1 -- 172.21.15.2:0/1914122240 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d33aef850 con 0x561d33b97090 2024-09-12T00:57:44.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2a8affd640 10 client.25930 handle_command_reply: tid=0 2024-09-12T00:57:44.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2ab40de740 1 client.25930 shutdown 2024-09-12T00:57:44.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2ab40de740 1 -- 172.21.15.2:0/1914122240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 msgr2=0x561d33b84220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b84220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00ecfa0 tx=0x7f2aa00f3040 comp rx=0 tx=0).stop 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2ab40de740 1 -- 172.21.15.2:0/1914122240 shutdown_connections 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561d33b97090 0x561d33b994a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2a8affd640 0 client.25930 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.584+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b87680 0x561d33b84760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.585+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b84220 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.585+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1914122240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.585+0000 7f2ab40de740 1 -- 172.21.15.2:0/1914122240 >> 172.21.15.2:0/1914122240 conn(0x561d33b78a30 msgr2=0x561d33b7e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.585+0000 7f2ab40de740 1 -- 172.21.15.2:0/1914122240 shutdown_connections 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.585+0000 7f2ab40de740 1 -- 172.21.15.2:0/1914122240 wait complete. 2024-09-12T00:57:44.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.585+0000 7f2ab40de740 20 client.25930 trim_cache size 0 max 16384 2024-09-12T00:57:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2ab40de740 1 Processor -- start 2024-09-12T00:57:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2ab40de740 1 -- start start 2024-09-12T00:57:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b78a30 0x561d33b934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b7f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b9edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2ab40de740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac1b0210 con 0x561d33b78a30 2024-09-12T00:57:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2ab40de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac1adae0 con 0x561d33b7c4a0 2024-09-12T00:57:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2ab40de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac1ab930 con 0x561d33b7cdc0 2024-09-12T00:57:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b78a30 0x561d33b934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b7f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b78a30 0x561d33b934b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38136/0 (socket says 172.21.15.2:38136) 2024-09-12T00:57:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2aab7fe640 1 -- 172.21.15.2:0/1211653606 learned_addr learned my addr 172.21.15.2:0/1211653606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.604+0000 7f2aabfff640 1 --2- 172.21.15.2:0/1211653606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b9edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2aab7fe640 1 -- 172.21.15.2:0/1211653606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 msgr2=0x561d33b9edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1211653606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b9edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2aab7fe640 1 -- 172.21.15.2:0/1211653606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 msgr2=0x561d33b7f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1211653606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b7f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2aab7fe640 1 -- 172.21.15.2:0/1211653606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d33b89dd0 con 0x561d33b78a30 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1211653606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b78a30 0x561d33b934b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c01c040 tx=0x7f2a9c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790c439b4425e1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2a917fa640 1 -- 172.21.15.2:0/1211653606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c009580 con 0x561d33b78a30 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2a917fa640 1 -- 172.21.15.2:0/1211653606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a9c00f560 con 0x561d33b78a30 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.605+0000 7f2a917fa640 1 -- 172.21.15.2:0/1211653606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0038e0 con 0x561d33b78a30 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 -- 172.21.15.2:0/1211653606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b78a30 msgr2=0x561d33b934b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1211653606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b78a30 0x561d33b934b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c01c040 tx=0x7f2a9c009b80 comp rx=0 tx=0).stop 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 -- 172.21.15.2:0/1211653606 shutdown_connections 2024-09-12T00:57:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1211653606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b7cdc0 0x561d33b9edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1211653606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7c4a0 0x561d33b7f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1211653606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b78a30 0x561d33b934b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 -- 172.21.15.2:0/1211653606 >> 172.21.15.2:0/1211653606 conn(0x561d33b848c0 msgr2=0x561d33b7f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 -- 172.21.15.2:0/1211653606 shutdown_connections 2024-09-12T00:57:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.606+0000 7f2ab40de740 1 -- 172.21.15.2:0/1211653606 wait complete. 2024-09-12T00:57:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.607+0000 7f2ab40de740 1 -- start start 2024-09-12T00:57:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.607+0000 7f2ab40de740 1 Processor -- start 2024-09-12T00:57:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.607+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b78a30 0x561d33b8f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.607+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7c4a0 0x561d33b8fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.607+0000 7f2ab40de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7cdc0 0x561d33b8abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.607+0000 7f2ab40de740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac1abfa0 con 0x561d33b7c4a0 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2ab40de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac1ad410 con 0x561d33b7cdc0 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2ab40de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac1ac670 con 0x561d33b78a30 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7c4a0 0x561d33b8fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2ab40de740 10 client.0 _ll_register_callbacks cb 0x7f2aa003b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b78a30 0x561d33b8f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7c4a0 0x561d33b8fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38152/0 (socket says 172.21.15.2:38152) 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b78a30 0x561d33b8f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:43156/0 (socket says 172.21.15.2:43156) 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aaaffd640 1 -- 172.21.15.2:0/1705854982 learned_addr learned my addr 172.21.15.2:0/1705854982 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aabfff640 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7cdc0 0x561d33b8abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aab7fe640 1 -- 172.21.15.2:0/1705854982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7cdc0 msgr2=0x561d33b8abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7cdc0 0x561d33b8abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aab7fe640 1 -- 172.21.15.2:0/1705854982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7c4a0 msgr2=0x561d33b8fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7c4a0 0x561d33b8fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aab7fe640 1 -- 172.21.15.2:0/1705854982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d33b8b3a0 con 0x561d33b78a30 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2aab7fe640 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b78a30 0x561d33b8f650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c01c040 tx=0x7f2a9c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb5e89ae89cae553 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2a8affd640 1 -- 172.21.15.2:0/1705854982 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c03e060 con 0x561d33b78a30 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2a8affd640 1 -- 172.21.15.2:0/1705854982 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2a9c0055d0 con 0x561d33b78a30 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.608+0000 7f2ab40de740 1 -- 172.21.15.2:0/1705854982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a9c00f560 con 0x561d33b78a30 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2a8affd640 1 -- 172.21.15.2:0/1705854982 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2a9c00f850 con 0x561d33b78a30 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2ab40de740 10 client.25936 fetch_fsmap learned FSMap version 29 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2ab40de740 1 -- 172.21.15.2:0/1705854982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561d33c017f0 con 0x561d33b78a30 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2a8affd640 1 -- 172.21.15.2:0/1705854982 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a9c00f560 con 0x561d33b78a30 2024-09-12T00:57:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2a8affd640 1 -- 172.21.15.2:0/1705854982 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f2a9c02f460 con 0x561d33b78a30 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2ab40de740 10 client.25936 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2ab40de740 10 client.25936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2ab40de740 20 client.25936 populate_metadata read hostname 'smithi002' 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561d33b87680 0x561d33c03d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2ab40de740 4 client.25936 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2ab40de740 1 -- 172.21.15.2:0/1705854982 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561d33ae9d60 con 0x561d33b87680 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.609+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561d33b87680 0x561d33c03d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2a8affd640 10 client.25936 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2aaaffd640 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561d33b87680 0x561d33c03d30 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c92c9f567c72b159 server_cookie=fedaa3ab8cf82b46 in_seq=0 out_seq=0 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2a8affd640 1 -- 172.21.15.2:0/1705854982 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561d33ae9d60 con 0x561d33b87680 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2a8affd640 10 client.25936 handle_command_reply: tid=0 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 client.25936 shutdown 2024-09-12T00:57:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 -- 172.21.15.2:0/1705854982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b78a30 msgr2=0x561d33b8f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b78a30 0x561d33b8f650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c01c040 tx=0x7f2a9c005f10 comp rx=0 tx=0).stop 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 -- 172.21.15.2:0/1705854982 shutdown_connections 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561d33b87680 0x561d33c03d30 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d33b7cdc0 0x561d33b8abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d33b7c4a0 0x561d33b8fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 --2- 172.21.15.2:0/1705854982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d33b78a30 0x561d33b8f650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 -- 172.21.15.2:0/1705854982 >> 172.21.15.2:0/1705854982 conn(0x561d33b848c0 msgr2=0x561d33b862a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2a8affd640 0 client.25936 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 -- 172.21.15.2:0/1705854982 shutdown_connections 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.610+0000 7f2ab40de740 1 -- 172.21.15.2:0/1705854982 wait complete. 2024-09-12T00:57:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab40de740 20 client.25936 trim_cache size 0 max 16384 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: "cd65fd41-7553-43b9-a403-795895d7d9e7": { 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "cd65fd41-7553-43b9-a403-795895d7d9e7", 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:57:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:57:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 -- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2a940a2cf0 msgr2=0x7f2a940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2a940a2cf0 0x7f2a940a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009fd0 tx=0x7f2aa4004a40 comp rx=0 tx=0).stop 2024-09-12T00:57:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 -- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 msgr2=0x7f2aac198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:57:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 0x7f2aac198990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0006010 tx=0x7f2aa0004040 comp rx=0 tx=0).stop 2024-09-12T00:57:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 -- 172.21.15.2:0/3344995378 shutdown_connections 2024-09-12T00:57:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2a940a2cf0 0x7f2a940a51b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2aac106f10 0x7f2aac19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac102790 0x7f2aac198990 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 --2- 172.21.15.2:0/3344995378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aac101de0 0x7f2aac198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:57:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.611+0000 7f2ab1d05640 1 -- 172.21.15.2:0/3344995378 >> 172.21.15.2:0/3344995378 conn(0x7f2aac0fd8c0 msgr2=0x7f2aac0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:57:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.612+0000 7f2ab1d05640 1 -- 172.21.15.2:0/3344995378 shutdown_connections 2024-09-12T00:57:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:57:44.612+0000 7f2ab1d05640 1 -- 172.21.15.2:0/3344995378 wait complete. 2024-09-12T00:57:44.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:44 smithi071 ceph-mon[35276]: pgmap v147: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 390 KiB/s wr, 64 op/s 2024-09-12T00:57:44.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:44 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:44.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:44 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:44.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:44 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:57:44.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:44 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:44.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:44 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:44 smithi167 ceph-mon[35234]: pgmap v147: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 390 KiB/s wr, 64 op/s 2024-09-12T00:57:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:44 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:44 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:44 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:57:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:44 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:44.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:44 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:57:45.556 INFO:tasks.cephfs.filesystem:scrub status for tag:cd65fd41-7553-43b9-a403-795895d7d9e7 - {'path': '/', 'tag': 'cd65fd41-7553-43b9-a403-795895d7d9e7', 'options': 'recursive,force'} 2024-09-12T00:57:46.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:46 smithi071 ceph-mon[35276]: pgmap v148: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 390 KiB/s wr, 64 op/s 2024-09-12T00:57:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:46 smithi002 ceph-mon[31210]: pgmap v148: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 390 KiB/s wr, 64 op/s 2024-09-12T00:57:46.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:46 smithi167 ceph-mon[35234]: pgmap v148: 97 pgs: 97 active+clean; 143 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 390 KiB/s wr, 64 op/s 2024-09-12T00:57:47.709 INFO:tasks.workunit.client.0.smithi002.stdout:50000 write 0x5304f4 thru 0x53fa11 (0xf51e bytes) 2024-09-12T00:57:47.710 INFO:tasks.workunit.client.0.smithi002.stdout:All 50000 operations completed A-OK! 2024-09-12T00:57:47.713 INFO:tasks.workunit.client.0.smithi002.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-12T00:57:47.716 INFO:tasks.workunit.client.0.smithi002.stdout:Seed set to 1 2024-09-12T00:57:48.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:48 smithi071 ceph-mon[35276]: pgmap v149: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T00:57:48.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:48 smithi002 ceph-mon[31210]: pgmap v149: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T00:57:48.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:48 smithi167 ceph-mon[35234]: pgmap v149: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T00:57:48.902 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-12T00:57:48.902 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-12T00:57:48.904 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-12T00:57:48.905 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-12T00:57:48.905 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support clone range, disabling! 2024-09-12T00:57:48.908 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-12T00:57:48.911 INFO:tasks.workunit.client.0.smithi002.stderr:main: filesystem does not support exchange range, disabling! 2024-09-12T00:57:48.911 INFO:tasks.workunit.client.0.smithi002.stdout:skipping zero size read 2024-09-12T00:57:48.921 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x1c37b90 2024-09-12T00:57:48.928 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x5bd330d 2024-09-12T00:57:48.941 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0x637bf99 2024-09-12T00:57:49.106 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0x63d9b9c 2024-09-12T00:57:50.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:50 smithi071 ceph-mon[35276]: pgmap v150: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.0 MiB/s wr, 332 op/s 2024-09-12T00:57:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:50 smithi002 ceph-mon[31210]: pgmap v150: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.0 MiB/s wr, 332 op/s 2024-09-12T00:57:50.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:50 smithi167 ceph-mon[35234]: pgmap v150: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.0 MiB/s wr, 332 op/s 2024-09-12T00:57:51.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:51 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:57:51.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:51 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:57:51.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:51 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:57:51.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:51 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:57:51.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:51 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:57:51.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:51 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:57:52.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:52 smithi071 ceph-mon[35276]: pgmap v151: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 3.1 MiB/s wr, 609 op/s 2024-09-12T00:57:52.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:52 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:57:52.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:52 smithi002 ceph-mon[31210]: pgmap v151: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 3.1 MiB/s wr, 609 op/s 2024-09-12T00:57:52.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:52 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:57:52.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:52 smithi167 ceph-mon[35234]: pgmap v151: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 3.1 MiB/s wr, 609 op/s 2024-09-12T00:57:52.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:52 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:57:54.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:54 smithi071 ceph-mon[35276]: pgmap v152: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-12T00:57:54.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:54 smithi002 ceph-mon[31210]: pgmap v152: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-12T00:57:54.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:54 smithi167 ceph-mon[35234]: pgmap v152: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-12T00:57:56.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:56 smithi002 ceph-mon[31210]: pgmap v153: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-12T00:57:56.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:56 smithi071 ceph-mon[35276]: pgmap v153: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-12T00:57:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:56 smithi167 ceph-mon[35234]: pgmap v153: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-12T00:57:58.656 INFO:tasks.workunit.client.0.smithi002.stdout:10000 mapread 0x33cc4e3 thru 0x33cec16 (0x2734 bytes) 2024-09-12T00:57:58.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:57:58 smithi071 ceph-mon[35276]: pgmap v154: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.0 MiB/s wr, 1.04k op/s 2024-09-12T00:57:58.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:57:58 smithi002 ceph-mon[31210]: pgmap v154: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.0 MiB/s wr, 1.04k op/s 2024-09-12T00:57:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:57:58 smithi167 ceph-mon[35234]: pgmap v154: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.0 MiB/s wr, 1.04k op/s 2024-09-12T00:58:00.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:00 smithi071 ceph-mon[35276]: pgmap v155: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 769 op/s 2024-09-12T00:58:00.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:00 smithi002 ceph-mon[31210]: pgmap v155: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 769 op/s 2024-09-12T00:58:00.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:00 smithi167 ceph-mon[35234]: pgmap v155: 97 pgs: 97 active+clean; 162 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 769 op/s 2024-09-12T00:58:02.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:02 smithi071 ceph-mon[35276]: pgmap v156: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.7 MiB/s wr, 1.27k op/s 2024-09-12T00:58:02.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:02 smithi002 ceph-mon[31210]: pgmap v156: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.7 MiB/s wr, 1.27k op/s 2024-09-12T00:58:02.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:02 smithi167 ceph-mon[35234]: pgmap v156: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.7 MiB/s wr, 1.27k op/s 2024-09-12T00:58:04.459 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x63e5d2a 2024-09-12T00:58:04.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:04 smithi071 ceph-mon[35276]: pgmap v157: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 994 op/s 2024-09-12T00:58:04.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:04 smithi002 ceph-mon[31210]: pgmap v157: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 994 op/s 2024-09-12T00:58:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:04 smithi167 ceph-mon[35234]: pgmap v157: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 994 op/s 2024-09-12T00:58:06.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:06 smithi071 ceph-mon[35276]: pgmap v158: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 994 op/s 2024-09-12T00:58:06.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:06 smithi002 ceph-mon[31210]: pgmap v158: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 994 op/s 2024-09-12T00:58:06.785 INFO:tasks.workunit.client.0.smithi002.stdout:truncating to largest ever: 0x63e9b52 2024-09-12T00:58:06.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:06 smithi167 ceph-mon[35234]: pgmap v158: 97 pgs: 97 active+clean; 195 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 994 op/s 2024-09-12T00:58:08.570 INFO:tasks.workunit.client.0.smithi002.stdout:20000 read 0xa6cbf1 thru 0xa6e358 (0x1768 bytes) 2024-09-12T00:58:08.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:08 smithi071 ceph-mon[35276]: pgmap v159: 97 pgs: 97 active+clean; 213 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 4.1 MiB/s wr, 1.47k op/s 2024-09-12T00:58:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:08 smithi002 ceph-mon[31210]: pgmap v159: 97 pgs: 97 active+clean; 213 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 4.1 MiB/s wr, 1.47k op/s 2024-09-12T00:58:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:08 smithi167 ceph-mon[35234]: pgmap v159: 97 pgs: 97 active+clean; 213 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 4.1 MiB/s wr, 1.47k op/s 2024-09-12T00:58:09.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:58:09.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:58:09.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:58:09.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:58:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:58:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:58:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:58:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:58:09.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:58:09.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:58:09.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:58:09.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:58:10.288 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0x63ed6b9 2024-09-12T00:58:10.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:10 smithi071 ceph-mon[35276]: pgmap v160: 97 pgs: 97 active+clean; 213 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.8 MiB/s wr, 981 op/s 2024-09-12T00:58:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:10 smithi002 ceph-mon[31210]: pgmap v160: 97 pgs: 97 active+clean; 213 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.8 MiB/s wr, 981 op/s 2024-09-12T00:58:10.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:10 smithi167 ceph-mon[35234]: pgmap v160: 97 pgs: 97 active+clean; 213 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.8 MiB/s wr, 981 op/s 2024-09-12T00:58:12.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:12 smithi071 ceph-mon[35276]: pgmap v161: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 4.2 MiB/s wr, 1.43k op/s 2024-09-12T00:58:12.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:12 smithi002 ceph-mon[31210]: pgmap v161: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 4.2 MiB/s wr, 1.43k op/s 2024-09-12T00:58:12.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:12 smithi167 ceph-mon[35234]: pgmap v161: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 4.2 MiB/s wr, 1.43k op/s 2024-09-12T00:58:14.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:14 smithi071 ceph-mon[35276]: pgmap v162: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 932 op/s 2024-09-12T00:58:14.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:14 smithi002 ceph-mon[31210]: pgmap v162: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 932 op/s 2024-09-12T00:58:14.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:14 smithi167 ceph-mon[35234]: pgmap v162: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 932 op/s 2024-09-12T00:58:15.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:58:15.872 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/1393701284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8104010 msgr2=0x7fb5f81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/1393701284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8104010 0x7fb5f81043f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009900 tx=0x7fb5ec02a410 comp rx=0 tx=0).stop 2024-09-12T00:58:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/1393701284 shutdown_connections 2024-09-12T00:58:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/1393701284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8109140 0x7fb5f8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/1393701284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f81049c0 0x7fb5f8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/1393701284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8104010 0x7fb5f81043f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/1393701284 >> 172.21.15.2:0/1393701284 conn(0x7fb5f80ffa50 msgr2=0x7fb5f8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/1393701284 shutdown_connections 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.409+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/1393701284 wait complete. 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5ff1dd640 1 Processor -- start 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5ff1dd640 1 -- start start 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5ff1dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104010 0x7fb5f819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5ff1dd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f81049c0 0x7fb5f819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5ff1dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8109140 0x7fb5f819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5ff1dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8114140 con 0x7fb5f8109140 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5ff1dd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8113fc0 con 0x7fb5f81049c0 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5ff1dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81142c0 con 0x7fb5f8104010 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5fd77a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8109140 0x7fb5f819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f81049c0 0x7fb5f819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5fd77a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8109140 0x7fb5f819ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56888/0 (socket says 172.21.15.2:56888) 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5fd77a640 1 -- 172.21.15.2:0/2639774653 learned_addr learned my addr 172.21.15.2:0/2639774653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.410+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104010 0x7fb5f819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f7fff640 1 -- 172.21.15.2:0/2639774653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104010 msgr2=0x7fb5f819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104010 0x7fb5f819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f7fff640 1 -- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8109140 msgr2=0x7fb5f819ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8109140 0x7fb5f819ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f7fff640 1 -- 172.21.15.2:0/2639774653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f819f550 con 0x7fb5f81049c0 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104010 0x7fb5f819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f81049c0 0x7fb5f819aae0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400e9f0 tx=0x7fb5e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f5ffb640 1 -- 172.21.15.2:0/2639774653 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400ccc0 con 0x7fb5f81049c0 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/2639774653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f819f840 con 0x7fb5f81049c0 2024-09-12T00:58:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f5ffb640 1 -- 172.21.15.2:0/2639774653 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e4010910 con 0x7fb5f81049c0 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.411+0000 7fb5f5ffb640 1 -- 172.21.15.2:0/2639774653 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4018960 con 0x7fb5f81049c0 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.412+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/2639774653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f81a7120 con 0x7fb5f81049c0 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.414+0000 7fb5f5ffb640 1 -- 172.21.15.2:0/2639774653 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fb5e4010ac0 con 0x7fb5f81049c0 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.414+0000 7fb6015b6740 1 Processor -- start 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.414+0000 7fb6015b6740 1 -- start start 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.414+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca265880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.414+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca270140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.414+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca270680 0x55a5ca272a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.414+0000 7fb6015b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5ca1cb2e0 con 0x55a5ca2654a0 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.414+0000 7fb6015b6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a5ca172ce0 con 0x55a5ca270680 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb6015b6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a5ca1c72a0 con 0x55a5ca265dc0 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fd77a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca265880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca270140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca270140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:50834/0 (socket says 172.21.15.2:50834) 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 -- 172.21.15.2:0/2904774190 learned_addr learned my addr 172.21.15.2:0/2904774190 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fd77a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca265880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56904/0 (socket says 172.21.15.2:56904) 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca270680 0x55a5ca272a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5f5ffb640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5e80a2d70 0x7fb5e80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fd77a640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5e80a2d70 0x7fb5e80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 -- 172.21.15.2:0/2904774190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca270680 msgr2=0x55a5ca272a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca270680 0x55a5ca272a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 -- 172.21.15.2:0/2904774190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 msgr2=0x55a5ca265880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca265880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 -- 172.21.15.2:0/2904774190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ca157440 con 0x55a5ca265dc0 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fd77a640 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca265880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5f5ffb640 1 -- 172.21.15.2:0/2639774653 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb5e40cf840 con 0x7fb5f81049c0 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.415+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca270140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec033000 tx=0x7fb5ec032cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f64a512d39134d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.416+0000 7fb5fd77a640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5e80a2d70 0x7fb5e80a5230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0005cc0 tx=0x7fb5f0004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.416+0000 7fb5e2ffd640 1 -- 172.21.15.2:0/2904774190 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec03f070 con 0x55a5ca265dc0 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.416+0000 7fb5e2ffd640 1 -- 172.21.15.2:0/2904774190 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5ec0317b0 con 0x55a5ca265dc0 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.416+0000 7fb5e2ffd640 1 -- 172.21.15.2:0/2904774190 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec035070 con 0x55a5ca265dc0 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.416+0000 7fb6015b6740 1 -- 172.21.15.2:0/2904774190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 msgr2=0x55a5ca270140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.416+0000 7fb6015b6740 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca270140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec033000 tx=0x7fb5ec032cb0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 -- 172.21.15.2:0/2904774190 shutdown_connections 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca270680 0x55a5ca272a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca270140 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 --2- 172.21.15.2:0/2904774190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca265880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 -- 172.21.15.2:0/2904774190 >> 172.21.15.2:0/2904774190 conn(0x55a5ca261a30 msgr2=0x55a5ca261e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 -- 172.21.15.2:0/2904774190 shutdown_connections 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 -- 172.21.15.2:0/2904774190 wait complete. 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 -- start start 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 Processor -- start 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca26ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca26d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.417+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb6015b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5ca273250 con 0x55a5ca270680 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb6015b6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a5ca186050 con 0x55a5ca2654a0 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb6015b6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a5ca2733d0 con 0x55a5ca265dc0 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb6015b6740 10 client.0 _ll_register_callbacks cb 0x55a5ca1c6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca26d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fcf79640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca26ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca26d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:50848/0 (socket says 172.21.15.2:50848) 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fd77a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5f7fff640 1 -- 172.21.15.2:0/488672835 learned_addr learned my addr 172.21.15.2:0/488672835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fcf79640 1 -- 172.21.15.2:0/488672835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 msgr2=0x55a5ca26d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca26d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fcf79640 1 -- 172.21.15.2:0/488672835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 msgr2=0x55a5ca26d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fcf79640 1 -- 172.21.15.2:0/488672835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5c9f3c3c0 con 0x55a5ca2654a0 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fd77a640 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca26d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca26ffd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec006010 tx=0x7fb5ec02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d78d68c7ab820f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:58:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5d7fff640 1 -- 172.21.15.2:0/488672835 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec04a020 con 0x55a5ca2654a0 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb5d7fff640 1 -- 172.21.15.2:0/488672835 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb5ec031960 con 0x55a5ca2654a0 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.418+0000 7fb6015b6740 1 -- 172.21.15.2:0/488672835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5ec0317b0 con 0x55a5ca2654a0 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb5d7fff640 1 -- 172.21.15.2:0/488672835 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb5ec055050 con 0x55a5ca2654a0 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb6015b6740 10 client.26036 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb6015b6740 1 -- 172.21.15.2:0/488672835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a5ca27ec20 con 0x55a5ca2654a0 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb5d7fff640 1 -- 172.21.15.2:0/488672835 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5ec0317b0 con 0x55a5ca2654a0 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb5d7fff640 1 -- 172.21.15.2:0/488672835 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fb5ec004920 con 0x55a5ca2654a0 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb6015b6740 10 client.26036 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb6015b6740 10 client.26036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb6015b6740 20 client.26036 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb6015b6740 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a5ca27ff70 0x55a5ca282360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb6015b6740 4 client.26036 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb6015b6740 1 -- 172.21.15.2:0/488672835 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5ca1d8850 con 0x55a5ca27ff70 2024-09-12T00:58:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.419+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a5ca27ff70 0x55a5ca282360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.421+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a5ca27ff70 0x55a5ca282360 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf0b392e17847629 server_cookie=1c432f7e8cba581 in_seq=0 out_seq=0 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.421+0000 7fb5d7fff640 10 client.26036 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.423+0000 7fb5d7fff640 1 -- 172.21.15.2:0/488672835 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5ca1d8850 con 0x55a5ca27ff70 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.423+0000 7fb5d7fff640 10 client.26036 handle_command_reply: tid=0 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.423+0000 7fb6015b6740 1 client.26036 shutdown 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 -- 172.21.15.2:0/488672835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 msgr2=0x55a5ca26ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca26ffd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec006010 tx=0x7fb5ec02a410 comp rx=0 tx=0).stop 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 -- 172.21.15.2:0/488672835 shutdown_connections 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a5ca27ff70 0x55a5ca282360 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca26d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 --2- 172.21.15.2:0/488672835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca26ffd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 -- 172.21.15.2:0/488672835 >> 172.21.15.2:0/488672835 conn(0x55a5ca261a30 msgr2=0x55a5ca267760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb5d7fff640 0 client.26036 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 -- 172.21.15.2:0/488672835 shutdown_connections 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 1 -- 172.21.15.2:0/488672835 wait complete. 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.424+0000 7fb6015b6740 20 client.26036 trim_cache size 0 max 16384 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.451+0000 7fb6015b6740 1 Processor -- start 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.451+0000 7fb6015b6740 1 -- start start 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.451+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca284fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.451+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca2854e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.451+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.451+0000 7fb6015b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81b2310 con 0x55a5ca270680 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.451+0000 7fb6015b6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81afbe0 con 0x55a5ca2654a0 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.451+0000 7fb6015b6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81ada30 con 0x55a5ca265dc0 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca284fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fd77a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca284fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38536/0 (socket says 172.21.15.2:38536) 2024-09-12T00:58:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 -- 172.21.15.2:0/1441647325 learned_addr learned my addr 172.21.15.2:0/1441647325 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca2854e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 -- 172.21.15.2:0/1441647325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 msgr2=0x55a5ca2854e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca2854e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 -- 172.21.15.2:0/1441647325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 msgr2=0x55a5ca26a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:16.495 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:58:16.495 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 -- 172.21.15.2:0/1441647325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ca265bf0 con 0x55a5ca2654a0 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fd77a640 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca2854e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca284fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec02a930 tx=0x7fb5ec005140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f96584fb0aac26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5e27fc640 1 -- 172.21.15.2:0/1441647325 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec04a070 con 0x55a5ca2654a0 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5e27fc640 1 -- 172.21.15.2:0/1441647325 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5ec004ad0 con 0x55a5ca2654a0 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.452+0000 7fb5e27fc640 1 -- 172.21.15.2:0/1441647325 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec03f070 con 0x55a5ca2654a0 2024-09-12T00:58:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 -- 172.21.15.2:0/1441647325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 msgr2=0x55a5ca284fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca284fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec02a930 tx=0x7fb5ec005140 comp rx=0 tx=0).stop 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 -- 172.21.15.2:0/1441647325 shutdown_connections 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca270680 0x55a5ca26a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca265dc0 0x55a5ca2854e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 --2- 172.21.15.2:0/1441647325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca2654a0 0x55a5ca284fa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 -- 172.21.15.2:0/1441647325 >> 172.21.15.2:0/1441647325 conn(0x55a5ca261a30 msgr2=0x55a5ca268900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 -- 172.21.15.2:0/1441647325 shutdown_connections 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.453+0000 7fb6015b6740 1 -- 172.21.15.2:0/1441647325 wait complete. 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.454+0000 7fb6015b6740 1 -- start start 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.454+0000 7fb6015b6740 1 Processor -- start 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.454+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca2824a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.454+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca265dc0 0x55a5ca2829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.454+0000 7fb6015b6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca270680 0x55a5ca2e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.454+0000 7fb6015b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81ae0a0 con 0x55a5ca2654a0 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.454+0000 7fb6015b6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81af510 con 0x55a5ca265dc0 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.454+0000 7fb6015b6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81ae770 con 0x55a5ca270680 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb6015b6740 10 client.0 _ll_register_callbacks cb 0x7fb5f0007920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca2824a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca2824a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56936/0 (socket says 172.21.15.2:56936) 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 -- 172.21.15.2:0/3597815923 learned_addr learned my addr 172.21.15.2:0/3597815923 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fd77a640 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca270680 0x55a5ca2e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca265dc0 0x55a5ca2829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 -- 172.21.15.2:0/3597815923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca270680 msgr2=0x55a5ca2e88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca270680 0x55a5ca2e88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 -- 172.21.15.2:0/3597815923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca265dc0 msgr2=0x55a5ca2829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca265dc0 0x55a5ca2829e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 -- 172.21.15.2:0/3597815923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ca26db50 con 0x55a5ca2654a0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5fcf79640 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca2824a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec004dc0 tx=0x7fb5ec052de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef12b6402eaf35dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.455+0000 7fb5d7fff640 1 -- 172.21.15.2:0/3597815923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec04a070 con 0x55a5ca2654a0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 1 -- 172.21.15.2:0/3597815923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5ec004ad0 con 0x55a5ca2654a0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb5d7fff640 1 -- 172.21.15.2:0/3597815923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb5ec0512e0 con 0x55a5ca2654a0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb5d7fff640 1 -- 172.21.15.2:0/3597815923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb5ec066050 con 0x55a5ca2654a0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 10 client.16440 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 1 -- 172.21.15.2:0/3597815923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a5ca2e9f20 con 0x55a5ca2654a0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb5d7fff640 1 -- 172.21.15.2:0/3597815923 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5ec004ad0 con 0x55a5ca2654a0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb5d7fff640 1 -- 172.21.15.2:0/3597815923 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fb5ec061030 con 0x55a5ca2654a0 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 10 client.16440 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 20 client.16440 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a5ca2ea570 0x55a5ca2ec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 4 client.16440 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.456+0000 7fb6015b6740 1 -- 172.21.15.2:0/3597815923 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5ca1d2d60 con 0x55a5ca2ea570 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a5ca2ea570 0x55a5ca2ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb5d7fff640 10 client.16440 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb5f7fff640 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a5ca2ea570 0x55a5ca2ec960 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f97e3b81b6f48ba2 server_cookie=20bdd7451c092dd4 in_seq=0 out_seq=0 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb5d7fff640 1 -- 172.21.15.2:0/3597815923 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a5ca1d2d60 con 0x55a5ca2ea570 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb5d7fff640 10 client.16440 handle_command_reply: tid=0 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 client.16440 shutdown 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 -- 172.21.15.2:0/3597815923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 msgr2=0x55a5ca2824a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca2824a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec004dc0 tx=0x7fb5ec052de0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 -- 172.21.15.2:0/3597815923 shutdown_connections 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a5ca2ea570 0x55a5ca2ec960 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb5d7fff640 0 client.16440 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5ca270680 0x55a5ca2e88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5ca265dc0 0x55a5ca2829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 --2- 172.21.15.2:0/3597815923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5ca2654a0 0x55a5ca2824a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.457+0000 7fb6015b6740 1 -- 172.21.15.2:0/3597815923 >> 172.21.15.2:0/3597815923 conn(0x55a5ca261a30 msgr2=0x55a5ca267ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb6015b6740 1 -- 172.21.15.2:0/3597815923 shutdown_connections 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb6015b6740 1 -- 172.21.15.2:0/3597815923 wait complete. 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb6015b6740 20 client.16440 trim_cache size 0 max 16384 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5e80a2d70 msgr2=0x7fb5e80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5e80a2d70 0x7fb5e80a5230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0005cc0 tx=0x7fb5f0004ab0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/2639774653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f81049c0 msgr2=0x7fb5f819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f81049c0 0x7fb5f819aae0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400e9f0 tx=0x7fb5e400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/2639774653 shutdown_connections 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5e80a2d70 0x7fb5e80a5230 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5f8109140 0x7fb5f819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f81049c0 0x7fb5f819aae0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 --2- 172.21.15.2:0/2639774653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104010 0x7fb5f819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/2639774653 >> 172.21.15.2:0/2639774653 conn(0x7fb5f80ffa50 msgr2=0x7fb5f8100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/2639774653 shutdown_connections 2024-09-12T00:58:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:16.458+0000 7fb5ff1dd640 1 -- 172.21.15.2:0/2639774653 wait complete. 2024-09-12T00:58:16.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:16 smithi071 ceph-mon[35276]: pgmap v163: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 932 op/s 2024-09-12T00:58:16.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:16 smithi002 ceph-mon[31210]: pgmap v163: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 932 op/s 2024-09-12T00:58:16.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:16 smithi167 ceph-mon[35234]: pgmap v163: 97 pgs: 97 active+clean; 204 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 932 op/s 2024-09-12T00:58:17.641 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:58:17.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:58:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 -- 172.21.15.2:0/1680726117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8112640 msgr2=0x7fd4c8112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/1680726117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8112640 0x7fd4c8112a20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009900 tx=0x7fd4c402a410 comp rx=0 tx=0).stop 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 -- 172.21.15.2:0/1680726117 shutdown_connections 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/1680726117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4c810cf30 0x7fd4c8119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/1680726117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c810c590 0x7fd4c810c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/1680726117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8112640 0x7fd4c8112a20 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 -- 172.21.15.2:0/1680726117 >> 172.21.15.2:0/1680726117 conn(0x7fd4c806cdc0 msgr2=0x7fd4c806d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 -- 172.21.15.2:0/1680726117 shutdown_connections 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 -- 172.21.15.2:0/1680726117 wait complete. 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.484+0000 7fd4cfc62640 1 Processor -- start 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cfc62640 1 -- start start 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cfc62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810c590 0x7fd4c81a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cfc62640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4c810cf30 0x7fd4c81a3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cfc62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8112640 0x7fd4c81a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cfc62640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c811c960 con 0x7fd4c810c590 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cfc62640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c811c7e0 con 0x7fd4c8112640 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cfc62640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c811cae0 con 0x7fd4c810cf30 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810c590 0x7fd4c81a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810c590 0x7fd4c81a2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56964/0 (socket says 172.21.15.2:56964) 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 -- 172.21.15.2:0/3440849893 learned_addr learned my addr 172.21.15.2:0/3440849893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4ce1ff640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8112640 0x7fd4c81a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd1fd640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4c810cf30 0x7fd4c81a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 -- 172.21.15.2:0/3440849893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4c810cf30 msgr2=0x7fd4c81a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4c810cf30 0x7fd4c81a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 -- 172.21.15.2:0/3440849893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8112640 msgr2=0x7fd4c81a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8112640 0x7fd4c81a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 -- 172.21.15.2:0/3440849893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c81a7cf0 con 0x7fd4c810c590 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.485+0000 7fd4cd9fe640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810c590 0x7fd4c81a2d40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4006010 tx=0x7fd4c4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.486+0000 7fd4beffd640 1 -- 172.21.15.2:0/3440849893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c403f070 con 0x7fd4c810c590 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.486+0000 7fd4beffd640 1 -- 172.21.15.2:0/3440849893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4c4031c30 con 0x7fd4c810c590 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.486+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c81a7f80 con 0x7fd4c810c590 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.486+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c81af8c0 con 0x7fd4c810c590 2024-09-12T00:58:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.486+0000 7fd4beffd640 1 -- 172.21.15.2:0/3440849893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4035030 con 0x7fd4c810c590 2024-09-12T00:58:18.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.487+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4ac005290 con 0x7fd4c810c590 2024-09-12T00:58:18.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.488+0000 7fd4beffd640 1 -- 172.21.15.2:0/3440849893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fd4c4042070 con 0x7fd4c810c590 2024-09-12T00:58:18.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.489+0000 7fd4beffd640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd4b40a2d70 0x7fd4b40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:18.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.489+0000 7fd4cd1fd640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd4b40a2d70 0x7fd4b40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:18.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.489+0000 7fd4beffd640 1 -- 172.21.15.2:0/3440849893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd4c40ef8b0 con 0x7fd4c810c590 2024-09-12T00:58:18.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.489+0000 7fd4cd1fd640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd4b40a2d70 0x7fd4b40a5230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8005e10 tx=0x7fd4b8005da0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:18.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.493+0000 7fd4beffd640 1 -- 172.21.15.2:0/3440849893 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4c4031de0 con 0x7fd4c810c590 2024-09-12T00:58:18.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:18 smithi071 ceph-mon[35276]: pgmap v164: 97 pgs: 97 active+clean; 219 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 4.1 MiB/s wr, 1.39k op/s 2024-09-12T00:58:18.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:18 smithi002 ceph-mon[31210]: pgmap v164: 97 pgs: 97 active+clean; 219 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 4.1 MiB/s wr, 1.39k op/s 2024-09-12T00:58:18.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.753+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4ac005850 con 0x7fd4c810c590 2024-09-12T00:58:18.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.754+0000 7fd4beffd640 1 -- 172.21.15.2:0/3440849893 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11899 (secure 0 0 0) 0x7fd4c40bc420 con 0x7fd4c810c590 2024-09-12T00:58:18.753 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:58:18.753 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"btime":"2024-09-12T00:57:16:338130+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:57:16.129856+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:58:18.754 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-09-12T00:58:18.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd4b40a2d70 msgr2=0x7fd4b40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd4b40a2d70 0x7fd4b40a5230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8005e10 tx=0x7fd4b8005da0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810c590 msgr2=0x7fd4c81a2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810c590 0x7fd4c81a2d40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4006010 tx=0x7fd4c4003c10 comp rx=0 tx=0).stop 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 shutdown_connections 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd4b40a2d70 0x7fd4b40a5230 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8112640 0x7fd4c81a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4c810cf30 0x7fd4c81a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.756+0000 7fd4cfc62640 1 --2- 172.21.15.2:0/3440849893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810c590 0x7fd4c81a2d40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.757+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 >> 172.21.15.2:0/3440849893 conn(0x7fd4c806cdc0 msgr2=0x7fd4c810ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.757+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 shutdown_connections 2024-09-12T00:58:18.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:18.757+0000 7fd4cfc62640 1 -- 172.21.15.2:0/3440849893 wait complete. 2024-09-12T00:58:18.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:18 smithi167 ceph-mon[35234]: pgmap v164: 97 pgs: 97 active+clean; 219 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 4.1 MiB/s wr, 1.39k op/s 2024-09-12T00:58:19.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:58:19.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:19 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3440849893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:19.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:19 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3440849893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:19.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:19 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3440849893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:19.858 INFO:tasks.workunit.client.0.smithi002.stdout:copying to largest ever: 0x63ef9ee 2024-09-12T00:58:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.556+0000 7f5af1437640 1 -- 172.21.15.2:0/3097505447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec100a70 msgr2=0x7f5aec100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.556+0000 7f5af1437640 1 --2- 172.21.15.2:0/3097505447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec100a70 0x7f5aec100ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009890 tx=0x7f5ae002a380 comp rx=0 tx=0).stop 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.557+0000 7f5af1437640 1 -- 172.21.15.2:0/3097505447 shutdown_connections 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.557+0000 7f5af1437640 1 --2- 172.21.15.2:0/3097505447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aec101410 0x7f5aec10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.557+0000 7f5af1437640 1 --2- 172.21.15.2:0/3097505447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec100a70 0x7f5aec100ed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.557+0000 7f5af1437640 1 --2- 172.21.15.2:0/3097505447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aec106a70 0x7f5aec106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.557+0000 7f5af1437640 1 -- 172.21.15.2:0/3097505447 >> 172.21.15.2:0/3097505447 conn(0x7f5aec0fc790 msgr2=0x7f5aec0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.557+0000 7f5af1437640 1 -- 172.21.15.2:0/3097505447 shutdown_connections 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.557+0000 7f5af1437640 1 -- 172.21.15.2:0/3097505447 wait complete. 2024-09-12T00:58:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.557+0000 7f5af1437640 1 Processor -- start 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5af1437640 1 -- start start 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5af1437640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aec100a70 0x7f5aec198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5af1437640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec101410 0x7f5aec198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5af1437640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aec106a70 0x7f5aec19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5af1437640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec110e30 con 0x7f5aec100a70 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5af1437640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec110cb0 con 0x7f5aec106a70 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5af1437640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec110fb0 con 0x7f5aec101410 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aec100a70 0x7f5aec198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aec100a70 0x7f5aec198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56984/0 (socket says 172.21.15.2:56984) 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aea7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec101410 0x7f5aec198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aeaffd640 1 -- 172.21.15.2:0/2558985042 learned_addr learned my addr 172.21.15.2:0/2558985042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aec106a70 0x7f5aec19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aea7fc640 1 -- 172.21.15.2:0/2558985042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aec106a70 msgr2=0x7f5aec19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aec106a70 0x7f5aec19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aea7fc640 1 -- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aec100a70 msgr2=0x7f5aec198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aec100a70 0x7f5aec198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aea7fc640 1 -- 172.21.15.2:0/2558985042 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec19d3f0 con 0x7f5aec101410 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aec106a70 0x7f5aec19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.558+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aec100a70 0x7f5aec198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.559+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec101410 0x7f5aec198980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00057c0 tx=0x7f5ae0033ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.559+0000 7f5ad3fff640 1 -- 172.21.15.2:0/2558985042 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0037040 con 0x7f5aec101410 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.559+0000 7f5ad3fff640 1 -- 172.21.15.2:0/2558985042 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae0033d90 con 0x7f5aec101410 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.559+0000 7f5af1437640 1 -- 172.21.15.2:0/2558985042 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec19d680 con 0x7f5aec101410 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.559+0000 7f5ad3fff640 1 -- 172.21.15.2:0/2558985042 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0003870 con 0x7f5aec101410 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.559+0000 7f5af1437640 1 -- 172.21.15.2:0/2558985042 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec1a4fc0 con 0x7f5aec101410 2024-09-12T00:58:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5ad3fff640 1 -- 172.21.15.2:0/2558985042 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f5ae0042020 con 0x7f5aec101410 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5af3810740 1 Processor -- start 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5af3810740 1 -- start start 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5af3810740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa49b40 0x558faaa48090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5af3810740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa48a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5af3810740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa55760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5af3810740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558faa9ae2f0 con 0x558faaa485d0 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5af3810740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558faa955cf0 con 0x558faaa49b40 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5af3810740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558faa9aa2b0 con 0x558faaa53370 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa48a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa48a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56986/0 (socket says 172.21.15.2:56986) 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5aeaffd640 1 -- 172.21.15.2:0/3912013164 learned_addr learned my addr 172.21.15.2:0/3912013164 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa49b40 0x558faaa48090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.562+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa55760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5aeb7fe640 1 -- 172.21.15.2:0/3912013164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 msgr2=0x558faaa55760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa55760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5aeb7fe640 1 -- 172.21.15.2:0/3912013164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 msgr2=0x558faaa48a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa48a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5aeb7fe640 1 -- 172.21.15.2:0/3912013164 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558faa93a3a0 con 0x558faaa49b40 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5ad3fff640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5ad40a2d70 0x7f5ad40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa48a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5ad40a2d70 0x7f5ad40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5ad3fff640 1 -- 172.21.15.2:0/2558985042 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5ae00ee9e0 con 0x7f5aec101410 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa49b40 0x558faaa48090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400e820 tx=0x7f5ae40095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebfaa1bc7739fa2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5ad17fa640 1 -- 172.21.15.2:0/3912013164 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400ddd0 con 0x558faaa49b40 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5ad17fa640 1 -- 172.21.15.2:0/3912013164 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae401a070 con 0x558faaa49b40 2024-09-12T00:58:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.563+0000 7f5ad17fa640 1 -- 172.21.15.2:0/3912013164 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4016540 con 0x558faaa49b40 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 -- 172.21.15.2:0/3912013164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa49b40 msgr2=0x558faaa48090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa49b40 0x558faaa48090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400e820 tx=0x7f5ae40095c0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5ad40a2d70 0x7f5ad40a5230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x558faaa45ac0 tx=0x7f5adc005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 -- 172.21.15.2:0/3912013164 shutdown_connections 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa55760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa48a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 --2- 172.21.15.2:0/3912013164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa49b40 0x558faaa48090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 -- 172.21.15.2:0/3912013164 >> 172.21.15.2:0/3912013164 conn(0x558faaa11310 msgr2=0x558faaa44c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 -- 172.21.15.2:0/3912013164 shutdown_connections 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 -- 172.21.15.2:0/3912013164 wait complete. 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.564+0000 7f5af3810740 1 -- start start 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5af3810740 1 Processor -- start 2024-09-12T00:58:20.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5af3810740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa52d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5af3810740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa50040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5af3810740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa50650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5af3810740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558faaa56070 con 0x558faaa49b40 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5af3810740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558faa969060 con 0x558faaa485d0 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5af3810740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558faaa561f0 con 0x558faaa53370 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5af3810740 10 client.0 _ll_register_callbacks cb 0x558faa6bc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5aea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa50040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa52d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5aea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa50040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56990/0 (socket says 172.21.15.2:56990) 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5aea7fc640 1 -- 172.21.15.2:0/3515338075 learned_addr learned my addr 172.21.15.2:0/3515338075 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa50650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.565+0000 7f5aeaffd640 1 -- 172.21.15.2:0/3515338075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 msgr2=0x558faaa50650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa50650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aeaffd640 1 -- 172.21.15.2:0/3515338075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 msgr2=0x558faaa50040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa50040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aeaffd640 1 -- 172.21.15.2:0/3515338075 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558faa71f3c0 con 0x558faaa485d0 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa50040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa50650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa52d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009fd0 tx=0x7f5adc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9095a2505d527c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aceff5640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aceff5640 1 -- 172.21.15.2:0/3515338075 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc004030 con 0x558faaa485d0 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5af3810740 1 -- 172.21.15.2:0/3515338075 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae401a070 con 0x558faaa485d0 2024-09-12T00:58:20.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aceff5640 1 -- 172.21.15.2:0/3515338075 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5adc0041d0 con 0x558faaa485d0 2024-09-12T00:58:20.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5aceff5640 1 -- 172.21.15.2:0/3515338075 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5adc0043d0 con 0x558faaa485d0 2024-09-12T00:58:20.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5af3810740 10 client.26057 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:20.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.566+0000 7f5af3810740 1 -- 172.21.15.2:0/3515338075 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558faaa61ba0 con 0x558faaa485d0 2024-09-12T00:58:20.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5aceff5640 1 -- 172.21.15.2:0/3515338075 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae401a070 con 0x558faaa485d0 2024-09-12T00:58:20.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5aceff5640 1 -- 172.21.15.2:0/3515338075 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f5adc01e470 con 0x558faaa485d0 2024-09-12T00:58:20.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5af3810740 10 client.26057 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:20.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5af3810740 10 client.26057 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5af3810740 20 client.26057 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5af3810740 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558faaa63060 0x558faaa65450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5af3810740 4 client.26057 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5af3810740 1 -- 172.21.15.2:0/3515338075 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558faa9bb860 con 0x558faaa63060 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558faaa63060 0x558faaa65450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558faaa63060 0x558faaa65450 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a2900d70b4aacd2 server_cookie=950bd83ba5155820 in_seq=0 out_seq=0 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.567+0000 7f5aceff5640 10 client.26057 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5aceff5640 1 -- 172.21.15.2:0/3515338075 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558faa9bb860 con 0x558faaa63060 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5aceff5640 10 client.26057 handle_command_reply: tid=0 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 client.26057 shutdown 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 -- 172.21.15.2:0/3515338075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 msgr2=0x558faaa52d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa52d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009fd0 tx=0x7f5adc004730 comp rx=0 tx=0).stop 2024-09-12T00:58:20.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 -- 172.21.15.2:0/3515338075 shutdown_connections 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558faaa63060 0x558faaa65450 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa50650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa50040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5aceff5640 0 client.26057 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 --2- 172.21.15.2:0/3515338075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa52d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.568+0000 7f5af3810740 1 -- 172.21.15.2:0/3515338075 >> 172.21.15.2:0/3515338075 conn(0x558faaa11310 msgr2=0x558faaa4a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.569+0000 7f5af3810740 1 -- 172.21.15.2:0/3515338075 shutdown_connections 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.569+0000 7f5af3810740 1 -- 172.21.15.2:0/3515338075 wait complete. 2024-09-12T00:58:20.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.569+0000 7f5af3810740 20 client.26057 trim_cache size 0 max 16384 2024-09-12T00:58:20.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5af3810740 1 Processor -- start 2024-09-12T00:58:20.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5af3810740 1 -- start start 2024-09-12T00:58:20.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5af3810740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa5f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5af3810740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa4a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5af3810740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa6ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5af3810740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1ae050 con 0x558faaa49b40 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5af3810740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1ab920 con 0x558faaa485d0 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5af3810740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1a9770 con 0x558faaa53370 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5aea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa4a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5aea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa4a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57006/0 (socket says 172.21.15.2:57006) 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa5f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5aea7fc640 1 -- 172.21.15.2:0/491322050 learned_addr learned my addr 172.21.15.2:0/491322050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.585+0000 7f5aeb7fe640 1 --2- 172.21.15.2:0/491322050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa6ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5aea7fc640 1 -- 172.21.15.2:0/491322050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 msgr2=0x558faaa6ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/491322050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa6ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5aea7fc640 1 -- 172.21.15.2:0/491322050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 msgr2=0x558faaa5f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:20.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/491322050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa5f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5aea7fc640 1 -- 172.21.15.2:0/491322050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558faaa509c0 con 0x558faaa49b40 2024-09-12T00:58:20.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/491322050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa4a820 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5ae002a970 tx=0x7f5ae00f0ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a2f549d8a23ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:20.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5ad0ff9640 1 -- 172.21.15.2:0/491322050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00bad90 con 0x558faaa49b40 2024-09-12T00:58:20.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5ad0ff9640 1 -- 172.21.15.2:0/491322050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae00db0b0 con 0x558faaa49b40 2024-09-12T00:58:20.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.586+0000 7f5ad0ff9640 1 -- 172.21.15.2:0/491322050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00ba920 con 0x558faaa49b40 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 -- 172.21.15.2:0/491322050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 msgr2=0x558faaa4a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 --2- 172.21.15.2:0/491322050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa4a820 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5ae002a970 tx=0x7f5ae00f0ef0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 -- 172.21.15.2:0/491322050 shutdown_connections 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 --2- 172.21.15.2:0/491322050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa53370 0x558faaa6ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 --2- 172.21.15.2:0/491322050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa49b40 0x558faaa4a820 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 --2- 172.21.15.2:0/491322050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa485d0 0x558faaa5f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 -- 172.21.15.2:0/491322050 >> 172.21.15.2:0/491322050 conn(0x558faaa11310 msgr2=0x558faaa4a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 -- 172.21.15.2:0/491322050 shutdown_connections 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 -- 172.21.15.2:0/491322050 wait complete. 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.587+0000 7f5af3810740 1 -- start start 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5af3810740 1 Processor -- start 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5af3810740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5af3810740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa49b40 0x558faaa57e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5af3810740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa53370 0x558faaacccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5af3810740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1a9de0 con 0x558faaa485d0 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5af3810740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1ab250 con 0x558faaa53370 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5af3810740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1aa4b0 con 0x558faaa49b40 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5af3810740 10 client.0 _ll_register_callbacks cb 0x7f5adc009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5aea7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa49b40 0x558faaa57e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5aeb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa53370 0x558faaacccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5aea7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa49b40 0x558faaa57e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:50932/0 (socket says 172.21.15.2:50932) 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5aea7fc640 1 -- 172.21.15.2:0/2964737729 learned_addr learned my addr 172.21.15.2:0/2964737729 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:20.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.588+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57022/0 (socket says 172.21.15.2:57022) 2024-09-12T00:58:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.589+0000 7f5aeaffd640 1 -- 172.21.15.2:0/2964737729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa49b40 msgr2=0x558faaa57e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.589+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa49b40 0x558faaa57e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.589+0000 7f5aeaffd640 1 -- 172.21.15.2:0/2964737729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa53370 msgr2=0x558faaacccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.589+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa53370 0x558faaacccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.589+0000 7f5aeaffd640 1 -- 172.21.15.2:0/2964737729 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558faaacd230 con 0x558faaa485d0 2024-09-12T00:58:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.590+0000 7f5aeaffd640 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa578e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009d50 tx=0x7f5adc011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fea228049567f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.590+0000 7f5aceff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:58:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.591+0000 7f5aceff5640 1 -- 172.21.15.2:0/2964737729 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc011e40 con 0x558faaa485d0 2024-09-12T00:58:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.591+0000 7f5aceff5640 1 -- 172.21.15.2:0/2964737729 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5adc01ed10 con 0x558faaa485d0 2024-09-12T00:58:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.591+0000 7f5af3810740 1 -- 172.21.15.2:0/2964737729 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae00db0b0 con 0x558faaa485d0 2024-09-12T00:58:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.591+0000 7f5aceff5640 1 -- 172.21.15.2:0/2964737729 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5adc029480 con 0x558faaa485d0 2024-09-12T00:58:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.591+0000 7f5af3810740 10 client.16464 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.591+0000 7f5af3810740 1 -- 172.21.15.2:0/2964737729 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558faaace490 con 0x558faaa485d0 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5aceff5640 1 -- 172.21.15.2:0/2964737729 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5adc029b00 con 0x558faaa485d0 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5aceff5640 1 -- 172.21.15.2:0/2964737729 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f5adc03a860 con 0x558faaa485d0 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5af3810740 10 client.16464 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5af3810740 10 client.16464 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5af3810740 20 client.16464 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5af3810740 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558faaacebb0 0x558faaad0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5af3810740 4 client.16464 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5af3810740 1 -- 172.21.15.2:0/2964737729 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5ae00db0b0 con 0x558faaacebb0 2024-09-12T00:58:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.592+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558faaacebb0 0x558faaad0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.593+0000 7f5aceff5640 10 client.16464 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.593+0000 7f5aea7fc640 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558faaacebb0 0x558faaad0fa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=80af4cc6e6f8146b server_cookie=31fc63c99a05ab51 in_seq=0 out_seq=0 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.593+0000 7f5aceff5640 1 -- 172.21.15.2:0/2964737729 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5ae00db0b0 con 0x558faaacebb0 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.593+0000 7f5aceff5640 10 client.16464 handle_command_reply: tid=0 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.593+0000 7f5af3810740 1 client.16464 shutdown 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.593+0000 7f5af3810740 1 -- 172.21.15.2:0/2964737729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 msgr2=0x558faaa578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.593+0000 7f5af3810740 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa578e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009d50 tx=0x7f5adc011d50 comp rx=0 tx=0).stop 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 1 -- 172.21.15.2:0/2964737729 shutdown_connections 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558faaacebb0 0x558faaad0fa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558faaa53370 0x558faaacccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558faaa49b40 0x558faaa57e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 1 --2- 172.21.15.2:0/2964737729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558faaa485d0 0x558faaa578e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 1 -- 172.21.15.2:0/2964737729 >> 172.21.15.2:0/2964737729 conn(0x558faaa11310 msgr2=0x558faaa4a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5aceff5640 0 client.16464 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:58:20.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 1 -- 172.21.15.2:0/2964737729 shutdown_connections 2024-09-12T00:58:20.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 1 -- 172.21.15.2:0/2964737729 wait complete. 2024-09-12T00:58:20.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.594+0000 7f5af3810740 20 client.16464 trim_cache size 0 max 16384 2024-09-12T00:58:20.595 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 -- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5ad40a2d70 msgr2=0x7f5ad40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5ad40a2d70 0x7f5ad40a5230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x558faaa45ac0 tx=0x7f5adc005f90 comp rx=0 tx=0).stop 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 -- 172.21.15.2:0/2558985042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec101410 msgr2=0x7f5aec198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec101410 0x7f5aec198980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00057c0 tx=0x7f5ae0033ae0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 -- 172.21.15.2:0/2558985042 shutdown_connections 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5ad40a2d70 0x7f5ad40a5230 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aec106a70 0x7f5aec19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec101410 0x7f5aec198980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 --2- 172.21.15.2:0/2558985042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aec100a70 0x7f5aec198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 -- 172.21.15.2:0/2558985042 >> 172.21.15.2:0/2558985042 conn(0x7f5aec0fc790 msgr2=0x7f5aec06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 -- 172.21.15.2:0/2558985042 shutdown_connections 2024-09-12T00:58:20.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:20.595+0000 7f5af1437640 1 -- 172.21.15.2:0/2558985042 wait complete. 2024-09-12T00:58:20.691 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:20 smithi071 ceph-mon[35276]: pgmap v165: 97 pgs: 97 active+clean; 219 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 908 op/s 2024-09-12T00:58:20.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:20 smithi002 ceph-mon[31210]: pgmap v165: 97 pgs: 97 active+clean; 219 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 908 op/s 2024-09-12T00:58:20.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:20 smithi167 ceph-mon[35234]: pgmap v165: 97 pgs: 97 active+clean; 219 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 908 op/s 2024-09-12T00:58:21.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:58:21.956 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:22.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 -- 172.21.15.2:0/255456576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f333810e4d0 msgr2=0x7f33381108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 --2- 172.21.15.2:0/255456576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f333810e4d0 0x7f33381108e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3330009ca0 tx=0x7f333002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 -- 172.21.15.2:0/255456576 shutdown_connections 2024-09-12T00:58:22.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 --2- 172.21.15.2:0/255456576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f333810e4d0 0x7f33381108e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 --2- 172.21.15.2:0/255456576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3338101360 0x7f333810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 --2- 172.21.15.2:0/255456576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33381009b0 0x7f3338100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 -- 172.21.15.2:0/255456576 >> 172.21.15.2:0/255456576 conn(0x7f33380fc7d0 msgr2=0x7f33380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 -- 172.21.15.2:0/255456576 shutdown_connections 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.472+0000 7f334076a640 1 -- 172.21.15.2:0/255456576 wait complete. 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.473+0000 7f334076a640 1 Processor -- start 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.473+0000 7f334076a640 1 -- start start 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.473+0000 7f334076a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33381009b0 0x7f333819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.473+0000 7f334076a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3338101360 0x7f333819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.473+0000 7f334076a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f333810e4d0 0x7f333819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.473+0000 7f334076a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3338114270 con 0x7f333810e4d0 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f334076a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f33381140f0 con 0x7f33381009b0 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f334076a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f33381143f0 con 0x7f3338101360 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33381009b0 0x7f333819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333dd05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3338101360 0x7f333819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33381009b0 0x7f333819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38656/0 (socket says 172.21.15.2:38656) 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 -- 172.21.15.2:0/174461924 learned_addr learned my addr 172.21.15.2:0/174461924 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333ed07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f333810e4d0 0x7f333819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 -- 172.21.15.2:0/174461924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3338101360 msgr2=0x7f333819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3338101360 0x7f333819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 -- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f333810e4d0 msgr2=0x7f333819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f333810e4d0 0x7f333819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 -- 172.21.15.2:0/174461924 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333819f6b0 con 0x7f33381009b0 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f333e506640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33381009b0 0x7f333819a700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f333400d770 tx=0x7f333400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.474+0000 7f332f7fe640 1 -- 172.21.15.2:0/174461924 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334017070 con 0x7f33381009b0 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.475+0000 7f332f7fe640 1 -- 172.21.15.2:0/174461924 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3334005500 con 0x7f33381009b0 2024-09-12T00:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.475+0000 7f334076a640 1 -- 172.21.15.2:0/174461924 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333819f9a0 con 0x7f33381009b0 2024-09-12T00:58:22.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.475+0000 7f332f7fe640 1 -- 172.21.15.2:0/174461924 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334004e00 con 0x7f33381009b0 2024-09-12T00:58:22.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.475+0000 7f334076a640 1 -- 172.21.15.2:0/174461924 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33381a7280 con 0x7f33381009b0 2024-09-12T00:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.478+0000 7f332f7fe640 1 -- 172.21.15.2:0/174461924 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f3334004fa0 con 0x7f33381009b0 2024-09-12T00:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.478+0000 7f3342b43740 1 Processor -- start 2024-09-12T00:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f3342b43740 1 -- start start 2024-09-12T00:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f3342b43740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d26090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f332f7fe640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33240a2cf0 0x7f33240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f3342b43740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d265d0 0x55c4c1d26a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f3342b43740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d33760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f3342b43740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4c1c8c2f0 con 0x55c4c1d31370 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f3342b43740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c4c1c33cf0 con 0x55c4c1d27b40 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f3342b43740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c4c1c882b0 con 0x55c4c1d265d0 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333dd05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d265d0 0x55c4c1d26a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333ed07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333dd05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d265d0 0x55c4c1d26a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:50958/0 (socket says 172.21.15.2:50958) 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333dd05640 1 -- 172.21.15.2:0/2758517023 learned_addr learned my addr 172.21.15.2:0/2758517023 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333ed07640 1 --2- 172.21.15.2:0/2758517023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d26090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f332f7fe640 1 -- 172.21.15.2:0/174461924 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f33340cee70 con 0x7f33381009b0 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333e506640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33240a2cf0 0x7f33240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333dd05640 1 -- 172.21.15.2:0/2758517023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 msgr2=0x55c4c1d26090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333dd05640 1 --2- 172.21.15.2:0/2758517023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d26090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333dd05640 1 -- 172.21.15.2:0/2758517023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 msgr2=0x55c4c1d33760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333dd05640 1 --2- 172.21.15.2:0/2758517023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d33760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.479+0000 7f333dd05640 1 -- 172.21.15.2:0/2758517023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c1c183a0 con 0x55c4c1d265d0 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.480+0000 7f333e506640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33240a2cf0 0x7f33240a51b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3334097dc0 tx=0x7f3334009c30 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.480+0000 7f333dd05640 1 --2- 172.21.15.2:0/2758517023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d265d0 0x55c4c1d26a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3328009c10 tx=0x7f3328011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b62c9ebd7f527f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.480+0000 7f332cff9640 1 -- 172.21.15.2:0/2758517023 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328004050 con 0x55c4c1d265d0 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.480+0000 7f332cff9640 1 -- 172.21.15.2:0/2758517023 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3328005500 con 0x55c4c1d265d0 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.480+0000 7f332cff9640 1 -- 172.21.15.2:0/2758517023 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33280035f0 con 0x55c4c1d265d0 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 -- 172.21.15.2:0/2758517023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d265d0 msgr2=0x55c4c1d26a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 --2- 172.21.15.2:0/2758517023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d265d0 0x55c4c1d26a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3328009c10 tx=0x7f3328011810 comp rx=0 tx=0).stop 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 -- 172.21.15.2:0/2758517023 shutdown_connections 2024-09-12T00:58:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 --2- 172.21.15.2:0/2758517023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d33760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 --2- 172.21.15.2:0/2758517023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d265d0 0x55c4c1d26a10 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3328009c10 tx=0x7f3328011810 comp rx=0 tx=0).stop 2024-09-12T00:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 --2- 172.21.15.2:0/2758517023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d26090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 -- 172.21.15.2:0/2758517023 >> 172.21.15.2:0/2758517023 conn(0x55c4c1cef310 msgr2=0x55c4c1d22c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 -- 172.21.15.2:0/2758517023 shutdown_connections 2024-09-12T00:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.481+0000 7f3342b43740 1 -- 172.21.15.2:0/2758517023 wait complete. 2024-09-12T00:58:22.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.482+0000 7f3342b43740 1 -- start start 2024-09-12T00:58:22.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.482+0000 7f3342b43740 1 Processor -- start 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.482+0000 7f3342b43740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d2e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.482+0000 7f3342b43740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f3342b43740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d3d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f3342b43740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4c1d34070 con 0x55c4c1d31370 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333ed07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d2e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333ed07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d2e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:50970/0 (socket says 172.21.15.2:50970) 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333ed07640 1 -- 172.21.15.2:0/1358799533 learned_addr learned my addr 172.21.15.2:0/1358799533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333dd05640 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c4c1c47060 con 0x55c4c1d2ec70 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c4c1d341f0 con 0x55c4c1d27b40 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f3342b43740 10 client.0 _ll_register_callbacks cb 0x55c4c199a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:22.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333ed07640 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d3d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333dd05640 1 -- 172.21.15.2:0/1358799533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 msgr2=0x55c4c1d2e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333dd05640 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d2e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333dd05640 1 -- 172.21.15.2:0/1358799533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d2ec70 msgr2=0x55c4c1d3d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333dd05640 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d3d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333dd05640 1 -- 172.21.15.2:0/1358799533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c19fd3c0 con 0x55c4c1d31370 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333ed07640 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d2e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f333dd05640 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2e730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55c4c1d270f0 tx=0x7f33280096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1440ed539436ab10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.483+0000 7f3321ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.484+0000 7f3321ffb640 1 -- 172.21.15.2:0/1358799533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328029070 con 0x55c4c1d31370 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.484+0000 7f3321ffb640 1 -- 172.21.15.2:0/1358799533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f3328004d90 con 0x55c4c1d31370 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.484+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3328005500 con 0x55c4c1d31370 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.484+0000 7f3321ffb640 1 -- 172.21.15.2:0/1358799533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3328035050 con 0x55c4c1d31370 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.484+0000 7f3342b43740 10 client.16476 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:22.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.484+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c4c1d400c0 con 0x55c4c1d31370 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.484+0000 7f3321ffb640 1 -- 172.21.15.2:0/1358799533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3328005500 con 0x55c4c1d31370 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.485+0000 7f3321ffb640 1 -- 172.21.15.2:0/1358799533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f3328003b60 con 0x55c4c1d31370 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.485+0000 7f3342b43740 10 client.16476 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.485+0000 7f3342b43740 10 client.16476 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.485+0000 7f3342b43740 20 client.16476 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.485+0000 7f3342b43740 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c4c1d417d0 0x55c4c1d43bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.485+0000 7f3342b43740 4 client.16476 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.485+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4c1c99860 con 0x55c4c1d417d0 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.485+0000 7f333ed07640 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c4c1d417d0 0x55c4c1d43bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.486+0000 7f333ed07640 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c4c1d417d0 0x55c4c1d43bc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=894f4ada443b8967 server_cookie=77324357acff41f3 in_seq=0 out_seq=0 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.486+0000 7f3321ffb640 10 client.16476 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3321ffb640 1 -- 172.21.15.2:0/1358799533 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4c1c99860 con 0x55c4c1d417d0 2024-09-12T00:58:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3321ffb640 10 client.16476 handle_command_reply: tid=0 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 client.16476 shutdown 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 msgr2=0x55c4c1d2e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2e730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55c4c1d270f0 tx=0x7f33280096a0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 shutdown_connections 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c4c1d417d0 0x55c4c1d43bc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d3d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2e730 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 --2- 172.21.15.2:0/1358799533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d2e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 >> 172.21.15.2:0/1358799533 conn(0x55c4c1cef310 msgr2=0x55c4c1d28960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3321ffb640 0 client.16476 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.487+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 shutdown_connections 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.488+0000 7f3342b43740 1 -- 172.21.15.2:0/1358799533 wait complete. 2024-09-12T00:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.488+0000 7f3342b43740 20 client.16476 trim_cache size 0 max 16384 2024-09-12T00:58:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.502+0000 7f3342b43740 1 Processor -- start 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.502+0000 7f3342b43740 1 -- start start 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.502+0000 7f3342b43740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d3d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.502+0000 7f3342b43740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d3d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.502+0000 7f3342b43740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f3342b43740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33381b24e0 con 0x55c4c1d31370 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f3342b43740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f33381afdb0 con 0x55c4c1d27b40 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f3342b43740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f33381adc00 con 0x55c4c1d2ec70 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d3d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d3d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38676/0 (socket says 172.21.15.2:38676) 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 -- 172.21.15.2:0/901331197 learned_addr learned my addr 172.21.15.2:0/901331197 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333dd05640 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d3d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 -- 172.21.15.2:0/901331197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d2ec70 msgr2=0x55c4c1d3d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d3d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 -- 172.21.15.2:0/901331197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 msgr2=0x55c4c1d2cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 -- 172.21.15.2:0/901331197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c1d23960 con 0x55c4c1d27b40 2024-09-12T00:58:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f333ed07640 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d3d490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f333002ade0 tx=0x7f33300095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=463185a1a1b393c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f3323fff640 1 -- 172.21.15.2:0/901331197 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330031760 con 0x55c4c1d27b40 2024-09-12T00:58:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.503+0000 7f3323fff640 1 -- 172.21.15.2:0/901331197 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3330052030 con 0x55c4c1d27b40 2024-09-12T00:58:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3323fff640 1 -- 172.21.15.2:0/901331197 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333004e630 con 0x55c4c1d27b40 2024-09-12T00:58:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 -- 172.21.15.2:0/901331197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 msgr2=0x55c4c1d3d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d3d490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f333002ade0 tx=0x7f33300095c0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 -- 172.21.15.2:0/901331197 shutdown_connections 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d31370 0x55c4c1d2cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d3d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 --2- 172.21.15.2:0/901331197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d27b40 0x55c4c1d3d490 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 -- 172.21.15.2:0/901331197 >> 172.21.15.2:0/901331197 conn(0x55c4c1cef310 msgr2=0x55c4c1d29310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 -- 172.21.15.2:0/901331197 shutdown_connections 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.504+0000 7f3342b43740 1 -- 172.21.15.2:0/901331197 wait complete. 2024-09-12T00:58:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 1 -- start start 2024-09-12T00:58:22.505 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:22 smithi002 ceph-mon[31210]: pgmap v166: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.9 MiB/s wr, 1.33k op/s 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 1 Processor -- start 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d46e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d43140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d31370 0x55c4c1d43680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33381ae270 con 0x55c4c1d2ec70 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f33381af6e0 con 0x55c4c1d31370 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f33381ae940 con 0x55c4c1d27b40 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.505+0000 7f3342b43740 10 client.0 _ll_register_callbacks cb 0x7f3330009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d46e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d46e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:50992/0 (socket says 172.21.15.2:50992) 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 -- 172.21.15.2:0/1360277098 learned_addr learned my addr 172.21.15.2:0/1360277098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:22.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d31370 0x55c4c1d43680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 -- 172.21.15.2:0/1360277098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d31370 msgr2=0x55c4c1d43680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d31370 0x55c4c1d43680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 -- 172.21.15.2:0/1360277098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d2ec70 msgr2=0x55c4c1d43140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d43140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.506+0000 7f333ed07640 1 -- 172.21.15.2:0/1360277098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c1d29120 con 0x55c4c1d27b40 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.507+0000 7f333ed07640 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d46e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3330033040 tx=0x7f333002fe30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3738c66c83f39cce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.507+0000 7f3321ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.508+0000 7f3321ffb640 1 -- 172.21.15.2:0/1360277098 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333006a9e0 con 0x55c4c1d27b40 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.508+0000 7f3321ffb640 1 -- 172.21.15.2:0/1360277098 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f333002f610 con 0x55c4c1d27b40 2024-09-12T00:58:22.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.508+0000 7f3342b43740 1 -- 172.21.15.2:0/1360277098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3330052030 con 0x55c4c1d27b40 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.508+0000 7f3321ffb640 1 -- 172.21.15.2:0/1360277098 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f333006ab80 con 0x55c4c1d27b40 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.508+0000 7f3342b43740 10 client.25990 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.508+0000 7f3342b43740 1 -- 172.21.15.2:0/1360277098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c4c1daae90 con 0x55c4c1d27b40 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.509+0000 7f3321ffb640 1 -- 172.21.15.2:0/1360277098 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3330036040 con 0x55c4c1d27b40 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.509+0000 7f3321ffb640 1 -- 172.21.15.2:0/1360277098 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f333004d040 con 0x55c4c1d27b40 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.509+0000 7f3342b43740 10 client.25990 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.509+0000 7f3342b43740 10 client.25990 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.509+0000 7f3342b43740 20 client.25990 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.509+0000 7f3342b43740 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c4c1dab500 0x55c4c1dad940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.510+0000 7f3342b43740 4 client.25990 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.510+0000 7f3342b43740 1 -- 172.21.15.2:0/1360277098 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3330052030 con 0x55c4c1dab500 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.510+0000 7f333dd05640 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c4c1dab500 0x55c4c1dad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.510+0000 7f3321ffb640 10 client.25990 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.510+0000 7f333dd05640 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c4c1dab500 0x55c4c1dad940 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3fb02c618fa64f8 server_cookie=be9e230705a5c763 in_seq=0 out_seq=0 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.510+0000 7f3321ffb640 1 -- 172.21.15.2:0/1360277098 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3330052030 con 0x55c4c1dab500 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.510+0000 7f3321ffb640 10 client.25990 handle_command_reply: tid=0 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 client.25990 shutdown 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 -- 172.21.15.2:0/1360277098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 msgr2=0x55c4c1d46e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d46e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3330033040 tx=0x7f333002fe30 comp rx=0 tx=0).stop 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 -- 172.21.15.2:0/1360277098 shutdown_connections 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c4c1dab500 0x55c4c1dad940 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3321ffb640 0 client.25990 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4c1d31370 0x55c4c1d43680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c1d2ec70 0x55c4c1d43140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 --2- 172.21.15.2:0/1360277098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c1d27b40 0x55c4c1d46e00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 -- 172.21.15.2:0/1360277098 >> 172.21.15.2:0/1360277098 conn(0x55c4c1cef310 msgr2=0x55c4c1d2ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 -- 172.21.15.2:0/1360277098 shutdown_connections 2024-09-12T00:58:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.511+0000 7f3342b43740 1 -- 172.21.15.2:0/1360277098 wait complete. 2024-09-12T00:58:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f3342b43740 20 client.25990 trim_cache size 0 max 16384 2024-09-12T00:58:22.513 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f334076a640 1 -- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33240a2cf0 msgr2=0x7f33240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f334076a640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33240a2cf0 0x7f33240a51b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3334097dc0 tx=0x7f3334009c30 comp rx=0 tx=0).stop 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f334076a640 1 -- 172.21.15.2:0/174461924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33381009b0 msgr2=0x7f333819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f334076a640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33381009b0 0x7f333819a700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f333400d770 tx=0x7f333400dc30 comp rx=0 tx=0).stop 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f334076a640 1 -- 172.21.15.2:0/174461924 shutdown_connections 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f334076a640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33240a2cf0 0x7f33240a51b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f334076a640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f333810e4d0 0x7f333819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.512+0000 7f334076a640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3338101360 0x7f333819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.513+0000 7f334076a640 1 --2- 172.21.15.2:0/174461924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33381009b0 0x7f333819a700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:22.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.513+0000 7f334076a640 1 -- 172.21.15.2:0/174461924 >> 172.21.15.2:0/174461924 conn(0x7f33380fc7d0 msgr2=0x7f33380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:22.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.513+0000 7f334076a640 1 -- 172.21.15.2:0/174461924 shutdown_connections 2024-09-12T00:58:22.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:22.513+0000 7f334076a640 1 -- 172.21.15.2:0/174461924 wait complete. 2024-09-12T00:58:22.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:22 smithi167 ceph-mon[35234]: pgmap v166: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.9 MiB/s wr, 1.33k op/s 2024-09-12T00:58:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:22 smithi071 ceph-mon[35276]: pgmap v166: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.9 MiB/s wr, 1.33k op/s 2024-09-12T00:58:23.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:58:23.792 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.319+0000 7fb5f0c99640 1 -- 172.21.15.2:0/1607983410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec101360 msgr2=0x7fb5ec10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.319+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/1607983410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec101360 0x7fb5ec10df90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009900 tx=0x7fb5e002a410 comp rx=0 tx=0).stop 2024-09-12T00:58:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.319+0000 7fb5f0c99640 1 -- 172.21.15.2:0/1607983410 shutdown_connections 2024-09-12T00:58:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.319+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/1607983410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5ec10e4d0 0x7fb5ec1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.319+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/1607983410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec101360 0x7fb5ec10df90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.319+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/1607983410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5ec1009b0 0x7fb5ec100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.319+0000 7fb5f0c99640 1 -- 172.21.15.2:0/1607983410 >> 172.21.15.2:0/1607983410 conn(0x7fb5ec0fc7d0 msgr2=0x7fb5ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.320+0000 7fb5f0c99640 1 -- 172.21.15.2:0/1607983410 shutdown_connections 2024-09-12T00:58:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.320+0000 7fb5f0c99640 1 -- 172.21.15.2:0/1607983410 wait complete. 2024-09-12T00:58:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.320+0000 7fb5f0c99640 1 Processor -- start 2024-09-12T00:58:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.320+0000 7fb5f0c99640 1 -- start start 2024-09-12T00:58:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5f0c99640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5ec1009b0 0x7fb5ec1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5f0c99640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5ec101360 0x7fb5ec1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5f0c99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec10e4d0 0x7fb5ec19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5ec1009b0 0x7fb5ec1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5f0c99640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec114220 con 0x7fb5ec10e4d0 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5f0c99640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1140a0 con 0x7fb5ec1009b0 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5ec1009b0 0x7fb5ec1a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38698/0 (socket says 172.21.15.2:38698) 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ea59c640 1 -- 172.21.15.2:0/136765255 learned_addr learned my addr 172.21.15.2:0/136765255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1143a0 con 0x7fb5ec101360 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ead9d640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec10e4d0 0x7fb5ec19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5ec101360 0x7fb5ec1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ea59c640 1 -- 172.21.15.2:0/136765255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5ec101360 msgr2=0x7fb5ec1a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5ec101360 0x7fb5ec1a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ea59c640 1 -- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec10e4d0 msgr2=0x7fb5ec19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec10e4d0 0x7fb5ec19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5ea59c640 1 -- 172.21.15.2:0/136765255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec19ad00 con 0x7fb5ec1009b0 2024-09-12T00:58:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.321+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5ec101360 0x7fb5ec1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:58:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.322+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5ec1009b0 0x7fb5ec1a0410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00e9f0 tx=0x7fb5dc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.322+0000 7fb5db7fe640 1 -- 172.21.15.2:0/136765255 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00cd80 con 0x7fb5ec1009b0 2024-09-12T00:58:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.322+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ec19aff0 con 0x7fb5ec1009b0 2024-09-12T00:58:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.322+0000 7fb5db7fe640 1 -- 172.21.15.2:0/136765255 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc010910 con 0x7fb5ec1009b0 2024-09-12T00:58:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.322+0000 7fb5db7fe640 1 -- 172.21.15.2:0/136765255 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0188f0 con 0x7fb5ec1009b0 2024-09-12T00:58:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.323+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ec1a72e0 con 0x7fb5ec1009b0 2024-09-12T00:58:24.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.329+0000 7fb5f3072740 1 Processor -- start 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.329+0000 7fb5f3072740 1 -- start start 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.329+0000 7fb5db7fe640 1 -- 172.21.15.2:0/136765255 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fb5dc010ac0 con 0x7fb5ec1009b0 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.329+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44aab40 0x5569f44a9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.329+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a95d0 0x5569f44a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.329+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 0x5569f44b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a95d0 0x5569f44a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44aab40 0x5569f44a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44aab40 0x5569f44a9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57110/0 (socket says 172.21.15.2:57110) 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a95d0 0x5569f44a9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:51020/0 (socket says 172.21.15.2:51020) 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5f3072740 1 -- 172.21.15.2:0/938625967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569f440f2f0 con 0x5569f44aab40 2024-09-12T00:58:24.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ead9d640 1 -- 172.21.15.2:0/938625967 learned_addr learned my addr 172.21.15.2:0/938625967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5f3072740 1 -- 172.21.15.2:0/938625967 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5569f43b6cf0 con 0x5569f44b4370 2024-09-12T00:58:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5f3072740 1 -- 172.21.15.2:0/938625967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5569f440b2b0 con 0x5569f44a95d0 2024-09-12T00:58:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/938625967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 0x5569f44b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ea59c640 1 -- 172.21.15.2:0/938625967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 msgr2=0x5569f44b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/938625967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 0x5569f44b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ea59c640 1 -- 172.21.15.2:0/938625967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44aab40 msgr2=0x5569f44a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.330+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/938625967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44aab40 0x5569f44a9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.331+0000 7fb5ea59c640 1 -- 172.21.15.2:0/938625967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569f439b3a0 con 0x5569f44a95d0 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.331+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/938625967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a95d0 0x5569f44a9a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0cd1d0 tx=0x7fb5dc0d8610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff5c92be3011086 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.331+0000 7fb5d8ff9640 1 -- 172.21.15.2:0/938625967 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0dc660 con 0x5569f44a95d0 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.331+0000 7fb5db7fe640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5d40a2d70 0x7fb5d40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.331+0000 7fb5d8ff9640 1 -- 172.21.15.2:0/938625967 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc0e1070 con 0x5569f44a95d0 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.331+0000 7fb5d8ff9640 1 -- 172.21.15.2:0/938625967 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc097cf0 con 0x5569f44a95d0 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.331+0000 7fb5ead9d640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5d40a2d70 0x7fb5d40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.331+0000 7fb5db7fe640 1 -- 172.21.15.2:0/136765255 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb5dc0cfad0 con 0x7fb5ec1009b0 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5f3072740 1 -- 172.21.15.2:0/938625967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a95d0 msgr2=0x5569f44a9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5ead9d640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5d40a2d70 0x7fb5d40a5230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4011630 tx=0x7fb5e4009500 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5f3072740 1 --2- 172.21.15.2:0/938625967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a95d0 0x5569f44a9a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0cd1d0 tx=0x7fb5dc0d8610 comp rx=0 tx=0).stop 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5f3072740 1 -- 172.21.15.2:0/938625967 shutdown_connections 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5f3072740 1 --2- 172.21.15.2:0/938625967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 0x5569f44b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5f3072740 1 --2- 172.21.15.2:0/938625967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a95d0 0x5569f44a9a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5f3072740 1 --2- 172.21.15.2:0/938625967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44aab40 0x5569f44a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5f3072740 1 -- 172.21.15.2:0/938625967 >> 172.21.15.2:0/938625967 conn(0x5569f4472310 msgr2=0x5569f44a5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.332+0000 7fb5f3072740 1 -- 172.21.15.2:0/938625967 shutdown_connections 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.333+0000 7fb5f3072740 1 -- 172.21.15.2:0/938625967 wait complete. 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.333+0000 7fb5f3072740 1 -- start start 2024-09-12T00:58:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.333+0000 7fb5f3072740 1 Processor -- start 2024-09-12T00:58:24.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.333+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.333+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44aab40 0x5569f44b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44b4370 0x5569f44b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5e9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44aab40 0x5569f44b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:38714/0 (socket says 172.21.15.2:38714) 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5ea59c640 1 -- 172.21.15.2:0/3135442743 learned_addr learned my addr 172.21.15.2:0/3135442743 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569f44b7010 con 0x5569f44b4370 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5569f43ca060 con 0x5569f44a95d0 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5569f44b7190 con 0x5569f44aab40 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5f3072740 10 client.0 _ll_register_callbacks cb 0x5569f411d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5ead9d640 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44b4370 0x5569f44b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5e9d9b640 1 -- 172.21.15.2:0/3135442743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 msgr2=0x5569f44b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5e9d9b640 1 -- 172.21.15.2:0/3135442743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44b4370 msgr2=0x5569f44b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44b4370 0x5569f44b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5e9d9b640 1 -- 172.21.15.2:0/3135442743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569f41803c0 con 0x5569f44aab40 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44aab40 0x5569f44b0f70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009230 tx=0x7fb5e0040d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6721201b4302cad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.334+0000 7fb5d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.335+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/3135442743 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0035050 con 0x5569f44aab40 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.335+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5dc0e1070 con 0x5569f44aab40 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.335+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/3135442743 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb5e00317c0 con 0x5569f44aab40 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.335+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/3135442743 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb5e00319c0 con 0x5569f44aab40 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.335+0000 7fb5f3072740 10 client.26002 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.335+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569f44c2a00 con 0x5569f44aab40 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.335+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/3135442743 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc0e1070 con 0x5569f44aab40 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/3135442743 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fb5e00046c0 con 0x5569f44aab40 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5f3072740 10 client.26002 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5f3072740 10 client.26002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5f3072740 20 client.26002 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5569f44c3ec0 0x5569f44c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5f3072740 4 client.26002 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569f441c860 con 0x5569f44c3ec0 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5569f44c3ec0 0x5569f44c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5d1ffb640 10 client.26002 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.336+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5569f44c3ec0 0x5569f44c6320 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=607cf43bd51bbd9 server_cookie=c955df64a4265f8f in_seq=0 out_seq=0 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/3135442743 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569f441c860 con 0x5569f44c3ec0 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5d1ffb640 10 client.26002 handle_command_reply: tid=0 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 client.26002 shutdown 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44aab40 msgr2=0x5569f44b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44aab40 0x5569f44b0f70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009230 tx=0x7fb5e0040d80 comp rx=0 tx=0).stop 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 shutdown_connections 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5569f44c3ec0 0x5569f44c6320 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44b4370 0x5569f44b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44aab40 0x5569f44b0f70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5d1ffb640 0 client.26002 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3135442743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 >> 172.21.15.2:0/3135442743 conn(0x5569f4472310 msgr2=0x5569f44ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 shutdown_connections 2024-09-12T00:58:24.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.337+0000 7fb5f3072740 1 -- 172.21.15.2:0/3135442743 wait complete. 2024-09-12T00:58:24.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.338+0000 7fb5f3072740 20 client.26002 trim_cache size 0 max 16384 2024-09-12T00:58:24.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5f3072740 1 Processor -- start 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5f3072740 1 -- start start 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44b4370 0x5569f44b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a5130 0x5569f44b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5f3072740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1ae170 con 0x5569f44a5130 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5f3072740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1aba40 con 0x5569f44a95d0 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5f3072740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1a9890 con 0x5569f44b4370 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5e9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44b4370 0x5569f44b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a5130 0x5569f44b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5e9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44b4370 0x5569f44b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:51040/0 (socket says 172.21.15.2:51040) 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.352+0000 7fb5e9d9b640 1 -- 172.21.15.2:0/3551599453 learned_addr learned my addr 172.21.15.2:0/3551599453 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5ea59c640 1 -- 172.21.15.2:0/3551599453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44b4370 msgr2=0x5569f44b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44b4370 0x5569f44b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5ea59c640 1 -- 172.21.15.2:0/3551599453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a5130 msgr2=0x5569f44b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a5130 0x5569f44b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5ea59c640 1 -- 172.21.15.2:0/3551599453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569f44b6ba0 con 0x5569f44a95d0 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44b4370 0x5569f44b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5ead9d640 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a5130 0x5569f44b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44a4bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0a46e0 tx=0x7fb5dc0bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45f51328a1a69190 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:24.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5d3fff640 1 -- 172.21.15.2:0/3551599453 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc09aca0 con 0x5569f44a95d0 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5d3fff640 1 -- 172.21.15.2:0/3551599453 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc0e1040 con 0x5569f44a95d0 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.353+0000 7fb5d3fff640 1 -- 172.21.15.2:0/3551599453 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc09b3f0 con 0x5569f44a95d0 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 -- 172.21.15.2:0/3551599453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 msgr2=0x5569f44a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44a4bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0a46e0 tx=0x7fb5dc0bc040 comp rx=0 tx=0).stop 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 -- 172.21.15.2:0/3551599453 shutdown_connections 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a5130 0x5569f44b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44b4370 0x5569f44b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 --2- 172.21.15.2:0/3551599453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44a95d0 0x5569f44a4bf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 -- 172.21.15.2:0/3551599453 >> 172.21.15.2:0/3551599453 conn(0x5569f4472310 msgr2=0x5569f44a44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 -- 172.21.15.2:0/3551599453 shutdown_connections 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 -- 172.21.15.2:0/3551599453 wait complete. 2024-09-12T00:58:24.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 -- start start 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.354+0000 7fb5f3072740 1 Processor -- start 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a5130 0x5569f44bc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a95d0 0x5569f44bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5f3072740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 0x5569f44b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5f3072740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1a9f00 con 0x5569f44a95d0 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5f3072740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1ab370 con 0x5569f44b4370 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5f3072740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1aa5d0 con 0x5569f44a5130 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5f3072740 10 client.0 _ll_register_callbacks cb 0x7fb5dc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5e9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a95d0 0x5569f44bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a5130 0x5569f44bc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a5130 0x5569f44bc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:51046/0 (socket says 172.21.15.2:51046) 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ea59c640 1 -- 172.21.15.2:0/2033508526 learned_addr learned my addr 172.21.15.2:0/2033508526 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:24.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ead9d640 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 0x5569f44b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ea59c640 1 -- 172.21.15.2:0/2033508526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 msgr2=0x5569f44b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 0x5569f44b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ea59c640 1 -- 172.21.15.2:0/2033508526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a95d0 msgr2=0x5569f44bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a95d0 0x5569f44bcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.355+0000 7fb5ea59c640 1 -- 172.21.15.2:0/2033508526 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569f44b7de0 con 0x5569f44a5130 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5ea59c640 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a5130 0x5569f44bc7e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc09bca0 tx=0x7fb5dc0cfdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42198572aaab74ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/2033508526 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0a4e60 con 0x5569f44a5130 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/2033508526 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fb5dc09a2a0 con 0x5569f44a5130 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 1 -- 172.21.15.2:0/2033508526 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5dc0e1040 con 0x5569f44a5130 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/2033508526 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb5dc09b720 con 0x5569f44a5130 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 10 client.26008 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:24.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 1 -- 172.21.15.2:0/2033508526 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569f44b7de0 con 0x5569f44a5130 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/2033508526 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc0e1040 con 0x5569f44a5130 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/2033508526 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fb5dc0b9030 con 0x5569f44a5130 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 10 client.26008 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 10 client.26008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 20 client.26008 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5569f452f9b0 0x5569f4531da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 4 client.26008 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.356+0000 7fb5f3072740 1 -- 172.21.15.2:0/2033508526 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569f4416d70 con 0x5569f452f9b0 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5569f452f9b0 0x5569f4531da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5e9d9b640 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5569f452f9b0 0x5569f4531da0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f938d7f8211842c server_cookie=f871129c2d3947b7 in_seq=0 out_seq=0 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5d1ffb640 10 client.26008 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:24.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5d1ffb640 1 -- 172.21.15.2:0/2033508526 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569f4416d70 con 0x5569f452f9b0 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5d1ffb640 10 client.26008 handle_command_reply: tid=0 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 client.26008 shutdown 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 -- 172.21.15.2:0/2033508526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a5130 msgr2=0x5569f44bc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a5130 0x5569f44bc7e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc09bca0 tx=0x7fb5dc0cfdd0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 -- 172.21.15.2:0/2033508526 shutdown_connections 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5569f452f9b0 0x5569f4531da0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569f44b4370 0x5569f44b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569f44a95d0 0x5569f44bcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 --2- 172.21.15.2:0/2033508526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569f44a5130 0x5569f44bc7e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5f3072740 1 -- 172.21.15.2:0/2033508526 >> 172.21.15.2:0/2033508526 conn(0x5569f4472310 msgr2=0x5569f44b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.357+0000 7fb5d1ffb640 0 client.26008 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.358+0000 7fb5f3072740 1 -- 172.21.15.2:0/2033508526 shutdown_connections 2024-09-12T00:58:24.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.358+0000 7fb5f3072740 1 -- 172.21.15.2:0/2033508526 wait complete. 2024-09-12T00:58:24.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.358+0000 7fb5f3072740 20 client.26008 trim_cache size 0 max 16384 2024-09-12T00:58:24.363 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.361+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5d40a2d70 msgr2=0x7fb5d40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5d40a2d70 0x7fb5d40a5230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4011630 tx=0x7fb5e4009500 comp rx=0 tx=0).stop 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5ec1009b0 msgr2=0x7fb5ec1a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5ec1009b0 0x7fb5ec1a0410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00e9f0 tx=0x7fb5dc00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 shutdown_connections 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb5d40a2d70 0x7fb5d40a5230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec10e4d0 0x7fb5ec19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5ec101360 0x7fb5ec1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 --2- 172.21.15.2:0/136765255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5ec1009b0 0x7fb5ec1a0410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 >> 172.21.15.2:0/136765255 conn(0x7fb5ec0fc7d0 msgr2=0x7fb5ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:24.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 shutdown_connections 2024-09-12T00:58:24.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:24.362+0000 7fb5f0c99640 1 -- 172.21.15.2:0/136765255 wait complete. 2024-09-12T00:58:24.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:24 smithi002 ceph-mon[31210]: pgmap v167: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 881 op/s 2024-09-12T00:58:24.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:24 smithi167 ceph-mon[35234]: pgmap v167: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 881 op/s 2024-09-12T00:58:24.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:24 smithi071 ceph-mon[35276]: pgmap v167: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 881 op/s 2024-09-12T00:58:26.603 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:58:26.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:58:26.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:26 smithi002 ceph-mon[31210]: pgmap v168: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 881 op/s 2024-09-12T00:58:26.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:26 smithi167 ceph-mon[35234]: pgmap v168: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 881 op/s 2024-09-12T00:58:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:26 smithi071 ceph-mon[35276]: pgmap v168: 97 pgs: 97 active+clean; 214 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 881 op/s 2024-09-12T00:58:27.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.441+0000 7fe260172640 1 -- 172.21.15.2:0/4294415404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258106f20 msgr2=0x7fe25810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.441+0000 7fe260172640 1 --2- 172.21.15.2:0/4294415404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258106f20 0x7fe25810eaa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe250009ca0 tx=0x7fe25002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.441+0000 7fe260172640 1 -- 172.21.15.2:0/4294415404 shutdown_connections 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.441+0000 7fe260172640 1 --2- 172.21.15.2:0/4294415404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258106f20 0x7fe25810eaa0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.441+0000 7fe260172640 1 --2- 172.21.15.2:0/4294415404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2581027a0 0x7fe2581067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.441+0000 7fe260172640 1 --2- 172.21.15.2:0/4294415404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe258101df0 0x7fe2581021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.441+0000 7fe260172640 1 -- 172.21.15.2:0/4294415404 >> 172.21.15.2:0/4294415404 conn(0x7fe2580fd8f0 msgr2=0x7fe2580ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.442+0000 7fe260172640 1 -- 172.21.15.2:0/4294415404 shutdown_connections 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.442+0000 7fe260172640 1 -- 172.21.15.2:0/4294415404 wait complete. 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.442+0000 7fe260172640 1 Processor -- start 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.442+0000 7fe260172640 1 -- start start 2024-09-12T00:58:27.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe260172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258101df0 0x7fe258198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe260172640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2581027a0 0x7fe258198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe260172640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe258106f20 0x7fe25819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe260172640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe258111fa0 con 0x7fe258101df0 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe260172640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe258111e20 con 0x7fe2581027a0 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe260172640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe258112120 con 0x7fe258106f20 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25df0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258101df0 0x7fe258198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25df0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258101df0 0x7fe258198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59488/0 (socket says 172.21.15.2:59488) 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25df0e640 1 -- 172.21.15.2:0/1432533174 learned_addr learned my addr 172.21.15.2:0/1432533174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25e70f640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe258106f20 0x7fe25819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25d70d640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2581027a0 0x7fe258198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25df0e640 1 -- 172.21.15.2:0/1432533174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe258106f20 msgr2=0x7fe25819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25df0e640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe258106f20 0x7fe25819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25df0e640 1 -- 172.21.15.2:0/1432533174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2581027a0 msgr2=0x7fe258198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25df0e640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2581027a0 0x7fe258198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25df0e640 1 -- 172.21.15.2:0/1432533174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25819d3f0 con 0x7fe258101df0 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.443+0000 7fe25d70d640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2581027a0 0x7fe258198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.444+0000 7fe25df0e640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258101df0 0x7fe258198440 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe25400e9f0 tx=0x7fe25400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.444+0000 7fe24effd640 1 -- 172.21.15.2:0/1432533174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25400cd80 con 0x7fe258101df0 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.444+0000 7fe260172640 1 -- 172.21.15.2:0/1432533174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25819d6e0 con 0x7fe258101df0 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.444+0000 7fe24effd640 1 -- 172.21.15.2:0/1432533174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe254010910 con 0x7fe258101df0 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.444+0000 7fe24effd640 1 -- 172.21.15.2:0/1432533174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2540188f0 con 0x7fe258101df0 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.444+0000 7fe260172640 1 -- 172.21.15.2:0/1432533174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2581a4fc0 con 0x7fe258101df0 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.446+0000 7fe24effd640 1 -- 172.21.15.2:0/1432533174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe254018af0 con 0x7fe258101df0 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe26254b740 1 Processor -- start 2024-09-12T00:58:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe26254b740 1 -- start start 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe26254b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca15fef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe26254b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1609800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe26254b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca160c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe26254b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556ca1564280 con 0x556ca15feb60 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe26254b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556ca150bb10 con 0x556ca15ff480 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe26254b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556ca1560240 con 0x556ca1609d40 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe24effd640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2440a2cf0 0x7fe2440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe25e70f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca15fef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe25e70f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca15fef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59492/0 (socket says 172.21.15.2:59492) 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe25d70d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca160c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.447+0000 7fe25e70f640 1 -- 172.21.15.2:0/2541894854 learned_addr learned my addr 172.21.15.2:0/2541894854 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25df0e640 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1609800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25e70f640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2440a2cf0 0x7fe2440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe24effd640 1 -- 172.21.15.2:0/1432533174 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe2540cf910 con 0x7fe258101df0 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25d70d640 1 -- 172.21.15.2:0/2541894854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 msgr2=0x556ca1609800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25d70d640 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1609800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25d70d640 1 -- 172.21.15.2:0/2541894854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 msgr2=0x556ca15fef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25d70d640 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca15fef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25d70d640 1 -- 172.21.15.2:0/2541894854 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca15181f0 con 0x556ca1609d40 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25e70f640 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca15fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25df0e640 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1609800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25d70d640 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca160c130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe24800a910 tx=0x7fe24800add0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cb5ed1f04ee191f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe25e70f640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2440a2cf0 0x7fe2440a51b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe250004af0 tx=0x7fe250004a80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe243fff640 1 -- 172.21.15.2:0/2541894854 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248015070 con 0x556ca1609d40 2024-09-12T00:58:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe243fff640 1 -- 172.21.15.2:0/2541894854 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe24800cc00 con 0x556ca1609d40 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.448+0000 7fe243fff640 1 -- 172.21.15.2:0/2541894854 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2480185c0 con 0x556ca1609d40 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.449+0000 7fe26254b740 1 -- 172.21.15.2:0/2541894854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 msgr2=0x556ca160c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.449+0000 7fe26254b740 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca160c130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe24800a910 tx=0x7fe24800add0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.449+0000 7fe26254b740 1 -- 172.21.15.2:0/2541894854 shutdown_connections 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.449+0000 7fe26254b740 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca160c130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.449+0000 7fe26254b740 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1609800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.449+0000 7fe26254b740 1 --2- 172.21.15.2:0/2541894854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca15fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.449+0000 7fe26254b740 1 -- 172.21.15.2:0/2541894854 >> 172.21.15.2:0/2541894854 conn(0x556ca15fb0f0 msgr2=0x556ca15fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.450+0000 7fe26254b740 1 -- 172.21.15.2:0/2541894854 shutdown_connections 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.450+0000 7fe26254b740 1 -- 172.21.15.2:0/2541894854 wait complete. 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.450+0000 7fe26254b740 1 -- start start 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.450+0000 7fe26254b740 1 Processor -- start 2024-09-12T00:58:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe26254b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1606b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe26254b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe26254b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1607610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe26254b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556ca160c910 con 0x556ca15ff480 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe26254b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556ca151ef10 con 0x556ca15feb60 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe26254b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556ca160ca90 con 0x556ca1609d40 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe26254b740 10 client.0 _ll_register_callbacks cb 0x556ca14e7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25df0e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1606b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25d70d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25e70f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1607610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25e70f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1607610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:40272/0 (socket says 172.21.15.2:40272) 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25d70d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59494/0 (socket says 172.21.15.2:59494) 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25e70f640 1 -- 172.21.15.2:0/2504568643 learned_addr learned my addr 172.21.15.2:0/2504568643 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25df0e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1606b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:41704/0 (socket says 172.21.15.2:41704) 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25df0e640 1 -- 172.21.15.2:0/2504568643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 msgr2=0x556ca1607610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25df0e640 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1607610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25df0e640 1 -- 172.21.15.2:0/2504568643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 msgr2=0x556ca16070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25df0e640 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25df0e640 1 -- 172.21.15.2:0/2504568643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca12d56a0 con 0x556ca15feb60 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe25df0e640 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1606b90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2540cd010 tx=0x7fe254007590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c05ecec81f4d671 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.451+0000 7fe2417fa640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.452+0000 7fe2417fa640 1 -- 172.21.15.2:0/2504568643 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2540cd490 con 0x556ca15feb60 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.452+0000 7fe26254b740 1 -- 172.21.15.2:0/2504568643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe24800cc00 con 0x556ca15feb60 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.452+0000 7fe2417fa640 1 -- 172.21.15.2:0/2504568643 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe2540a45c0 con 0x556ca15feb60 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe2417fa640 1 -- 172.21.15.2:0/2504568643 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe25409c4e0 con 0x556ca15feb60 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe26254b740 10 client.26108 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe26254b740 1 -- 172.21.15.2:0/2504568643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ca16184f0 con 0x556ca15feb60 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe2417fa640 1 -- 172.21.15.2:0/2504568643 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe24800cc00 con 0x556ca15feb60 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe2417fa640 1 -- 172.21.15.2:0/2504568643 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fe25409b230 con 0x556ca15feb60 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe26254b740 10 client.26108 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe26254b740 10 client.26108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe26254b740 20 client.26108 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe26254b740 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556ca1619900 0x556ca161bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe26254b740 4 client.26108 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe26254b740 1 -- 172.21.15.2:0/2504568643 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ca15717f0 con 0x556ca1619900 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.453+0000 7fe25d70d640 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556ca1619900 0x556ca161bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.454+0000 7fe25d70d640 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556ca1619900 0x556ca161bcf0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd1a207a483b106 server_cookie=5de4f26fcc3ecb49 in_seq=0 out_seq=0 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.454+0000 7fe2417fa640 10 client.26108 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.455+0000 7fe2417fa640 1 -- 172.21.15.2:0/2504568643 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ca15717f0 con 0x556ca1619900 2024-09-12T00:58:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.455+0000 7fe2417fa640 10 client.26108 handle_command_reply: tid=0 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.455+0000 7fe26254b740 1 client.26108 shutdown 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.455+0000 7fe26254b740 1 -- 172.21.15.2:0/2504568643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 msgr2=0x556ca1606b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.455+0000 7fe26254b740 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1606b90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2540cd010 tx=0x7fe254007590 comp rx=0 tx=0).stop 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.455+0000 7fe26254b740 1 -- 172.21.15.2:0/2504568643 shutdown_connections 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.455+0000 7fe26254b740 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556ca1619900 0x556ca161bcf0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.456+0000 7fe26254b740 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1607610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.456+0000 7fe26254b740 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.456+0000 7fe26254b740 1 --2- 172.21.15.2:0/2504568643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1606b90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.456+0000 7fe26254b740 1 -- 172.21.15.2:0/2504568643 >> 172.21.15.2:0/2504568643 conn(0x556ca15fb0f0 msgr2=0x556ca1600e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:27.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.457+0000 7fe2417fa640 0 client.26108 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:27.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.458+0000 7fe26254b740 1 -- 172.21.15.2:0/2504568643 shutdown_connections 2024-09-12T00:58:27.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.458+0000 7fe26254b740 1 -- 172.21.15.2:0/2504568643 wait complete. 2024-09-12T00:58:27.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.458+0000 7fe26254b740 20 client.26108 trim_cache size 0 max 16384 2024-09-12T00:58:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.476+0000 7fe26254b740 1 Processor -- start 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.476+0000 7fe26254b740 1 -- start start 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe26254b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca1600d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe26254b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1621570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe26254b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1621ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe26254b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581adfc0 con 0x556ca15feb60 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe26254b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581ab890 con 0x556ca15ff480 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe26254b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581a96e0 con 0x556ca1609d40 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25df0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca1600d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25df0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca1600d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59502/0 (socket says 172.21.15.2:59502) 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25df0e640 1 -- 172.21.15.2:0/2548582456 learned_addr learned my addr 172.21.15.2:0/2548582456 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25d70d640 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1621570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25e70f640 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1621ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25df0e640 1 -- 172.21.15.2:0/2548582456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 msgr2=0x556ca1621ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25df0e640 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1621ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25df0e640 1 -- 172.21.15.2:0/2548582456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 msgr2=0x556ca1621570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25df0e640 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1621570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25df0e640 1 -- 172.21.15.2:0/2548582456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca15f6830 con 0x556ca15feb60 2024-09-12T00:58:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.477+0000 7fe25d70d640 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1621570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.478+0000 7fe25df0e640 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca1600d10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe25400cfd0 tx=0x7fe254012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e729fad5cd818177 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.478+0000 7fe2437fe640 1 -- 172.21.15.2:0/2548582456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25409b740 con 0x556ca15feb60 2024-09-12T00:58:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.478+0000 7fe2437fe640 1 -- 172.21.15.2:0/2548582456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2540b9070 con 0x556ca15feb60 2024-09-12T00:58:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.478+0000 7fe2437fe640 1 -- 172.21.15.2:0/2548582456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2540cd290 con 0x556ca15feb60 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 -- 172.21.15.2:0/2548582456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 msgr2=0x556ca1600d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca1600d10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe25400cfd0 tx=0x7fe254012e40 comp rx=0 tx=0).stop 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 -- 172.21.15.2:0/2548582456 shutdown_connections 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca1621ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15ff480 0x556ca1621570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 --2- 172.21.15.2:0/2548582456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15feb60 0x556ca1600d10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 -- 172.21.15.2:0/2548582456 >> 172.21.15.2:0/2548582456 conn(0x556ca15fb0f0 msgr2=0x556ca1600600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 -- 172.21.15.2:0/2548582456 shutdown_connections 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.479+0000 7fe26254b740 1 -- 172.21.15.2:0/2548582456 wait complete. 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.480+0000 7fe26254b740 1 -- start start 2024-09-12T00:58:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.480+0000 7fe26254b740 1 Processor -- start 2024-09-12T00:58:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe26254b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1603c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe26254b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe26254b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca16046f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe26254b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581a9d50 con 0x556ca15ff480 2024-09-12T00:58:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe26254b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581ab1c0 con 0x556ca15feb60 2024-09-12T00:58:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe26254b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581aa420 con 0x556ca1609d40 2024-09-12T00:58:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe26254b740 10 client.0 _ll_register_callbacks cb 0x7fe25400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe25e70f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca16046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe25d70d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe25d70d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16041b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59506/0 (socket says 172.21.15.2:59506) 2024-09-12T00:58:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.481+0000 7fe25d70d640 1 -- 172.21.15.2:0/3258273513 learned_addr learned my addr 172.21.15.2:0/3258273513 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.482+0000 7fe25d70d640 1 -- 172.21.15.2:0/3258273513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 msgr2=0x556ca16046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.482+0000 7fe25d70d640 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca16046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.482+0000 7fe25d70d640 1 -- 172.21.15.2:0/3258273513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 msgr2=0x556ca1603c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.482+0000 7fe25d70d640 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1603c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.482+0000 7fe25d70d640 1 -- 172.21.15.2:0/3258273513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca1683610 con 0x556ca15ff480 2024-09-12T00:58:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.482+0000 7fe25e70f640 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca16046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:58:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe25d70d640 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16041b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe248017000 tx=0x7fe24800a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a28b71685772524 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe2417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:58:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe2417fa640 1 -- 172.21.15.2:0/3258273513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248015040 con 0x556ca15ff480 2024-09-12T00:58:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe2417fa640 1 -- 172.21.15.2:0/3258273513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe2480113f0 con 0x556ca15ff480 2024-09-12T00:58:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe26254b740 1 -- 172.21.15.2:0/3258273513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2540b9070 con 0x556ca15ff480 2024-09-12T00:58:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe2417fa640 1 -- 172.21.15.2:0/3258273513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe2480115f0 con 0x556ca15ff480 2024-09-12T00:58:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe26254b740 10 client.16515 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe26254b740 1 -- 172.21.15.2:0/3258273513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ca1684960 con 0x556ca15ff480 2024-09-12T00:58:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.483+0000 7fe2417fa640 1 -- 172.21.15.2:0/3258273513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe248011c70 con 0x556ca15ff480 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe2417fa640 1 -- 172.21.15.2:0/3258273513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fe248024070 con 0x556ca15ff480 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe26254b740 10 client.16515 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe26254b740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe26254b740 20 client.16515 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe26254b740 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556ca1684eb0 0x556ca16872d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe26254b740 4 client.16515 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe26254b740 1 -- 172.21.15.2:0/3258273513 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fe2540b9070 con 0x556ca1684eb0 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe25df0e640 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556ca1684eb0 0x556ca16872d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe25df0e640 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556ca1684eb0 0x556ca16872d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8858f9f0f1a0ea11 server_cookie=80668c911795242a in_seq=0 out_seq=0 2024-09-12T00:58:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.484+0000 7fe2417fa640 10 client.16515 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:27.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe2417fa640 1 -- 172.21.15.2:0/3258273513 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fe2540b9070 con 0x556ca1684eb0 2024-09-12T00:58:27.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe2417fa640 10 client.16515 handle_command_reply: tid=0 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 client.16515 shutdown 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 -- 172.21.15.2:0/3258273513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 msgr2=0x556ca16041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16041b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe248017000 tx=0x7fe24800a180 comp rx=0 tx=0).stop 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 -- 172.21.15.2:0/3258273513 shutdown_connections 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556ca1684eb0 0x556ca16872d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ca1609d40 0x556ca16046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ca15ff480 0x556ca16041b0 secure :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe248017000 tx=0x7fe24800a180 comp rx=0 tx=0).stop 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 --2- 172.21.15.2:0/3258273513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556ca15feb60 0x556ca1603c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe2417fa640 0 client.16515 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 -- 172.21.15.2:0/3258273513 >> 172.21.15.2:0/3258273513 conn(0x556ca15fb0f0 msgr2=0x556ca1607370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 -- 172.21.15.2:0/3258273513 shutdown_connections 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.486+0000 7fe26254b740 1 -- 172.21.15.2:0/3258273513 wait complete. 2024-09-12T00:58:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe26254b740 20 client.16515 trim_cache size 0 max 16384 2024-09-12T00:58:27.487 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:58:27.487 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:58:27.487 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "cb8d8ccc-9981-48ed-8c53-bf23e146390d", 2024-09-12T00:58:27.487 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:58:27.487 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:58:27.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 -- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2440a2cf0 msgr2=0x7fe2440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2440a2cf0 0x7fe2440a51b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe250004af0 tx=0x7fe250004a80 comp rx=0 tx=0).stop 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 -- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258101df0 msgr2=0x7fe258198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258101df0 0x7fe258198440 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe25400e9f0 tx=0x7fe25400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 -- 172.21.15.2:0/1432533174 shutdown_connections 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe2440a2cf0 0x7fe2440a51b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe258106f20 0x7fe25819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2581027a0 0x7fe258198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 --2- 172.21.15.2:0/1432533174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe258101df0 0x7fe258198440 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 -- 172.21.15.2:0/1432533174 >> 172.21.15.2:0/1432533174 conn(0x7fe2580fd8f0 msgr2=0x7fe2580fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 -- 172.21.15.2:0/1432533174 shutdown_connections 2024-09-12T00:58:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:27.487+0000 7fe260172640 1 -- 172.21.15.2:0/1432533174 wait complete. 2024-09-12T00:58:28.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:28.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: pgmap v169: 97 pgs: 97 active+clean; 221 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 1.31k op/s 2024-09-12T00:58:28.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:58:28.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:58:28.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:58:28.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:58:28.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:58:28.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:58:28.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:28 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: pgmap v169: 97 pgs: 97 active+clean; 221 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 1.31k op/s 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:58:28.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.788 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:28 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: pgmap v169: 97 pgs: 97 active+clean; 221 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 1.31k op/s 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:28.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:28 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:58:29.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 -- 172.21.15.2:0/1902448040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c10e4d0 msgr2=0x7fa46c1108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 --2- 172.21.15.2:0/1902448040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c10e4d0 0x7fa46c1108e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa464009ca0 tx=0x7fa46402a8f0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 -- 172.21.15.2:0/1902448040 shutdown_connections 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 --2- 172.21.15.2:0/1902448040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c10e4d0 0x7fa46c1108e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 --2- 172.21.15.2:0/1902448040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa46c101360 0x7fa46c10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 --2- 172.21.15.2:0/1902448040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c1009b0 0x7fa46c100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 -- 172.21.15.2:0/1902448040 >> 172.21.15.2:0/1902448040 conn(0x7fa46c0fc7d0 msgr2=0x7fa46c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 -- 172.21.15.2:0/1902448040 shutdown_connections 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.640+0000 7fa47446b640 1 -- 172.21.15.2:0/1902448040 wait complete. 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.641+0000 7fa47446b640 1 Processor -- start 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.641+0000 7fa47446b640 1 -- start start 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.641+0000 7fa47446b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c1009b0 0x7fa46c10cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.641+0000 7fa47446b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c101360 0x7fa46c10d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.641+0000 7fa47446b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa46c10e4d0 0x7fa46c1a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.641+0000 7fa47446b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c103e70 con 0x7fa46c1009b0 2024-09-12T00:58:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.641+0000 7fa47446b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c103cf0 con 0x7fa46c10e4d0 2024-09-12T00:58:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.641+0000 7fa47446b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c103ff0 con 0x7fa46c101360 2024-09-12T00:58:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa472207640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c1009b0 0x7fa46c10cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa472207640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c1009b0 0x7fa46c10cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59522/0 (socket says 172.21.15.2:59522) 2024-09-12T00:58:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa471a06640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c101360 0x7fa46c10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa472a08640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa46c10e4d0 0x7fa46c1a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa472207640 1 -- 172.21.15.2:0/3580835020 learned_addr learned my addr 172.21.15.2:0/3580835020 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa471a06640 1 -- 172.21.15.2:0/3580835020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa46c10e4d0 msgr2=0x7fa46c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa471a06640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa46c10e4d0 0x7fa46c1a3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa471a06640 1 -- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c1009b0 msgr2=0x7fa46c10cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa471a06640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c1009b0 0x7fa46c10cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa471a06640 1 -- 172.21.15.2:0/3580835020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c1a3b10 con 0x7fa46c101360 2024-09-12T00:58:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.642+0000 7fa471a06640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c101360 0x7fa46c10d110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d6d0 tx=0x7fa45c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.643+0000 7fa4637fe640 1 -- 172.21.15.2:0/3580835020 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c017070 con 0x7fa46c101360 2024-09-12T00:58:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.643+0000 7fa4637fe640 1 -- 172.21.15.2:0/3580835020 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45c0047a0 con 0x7fa46c101360 2024-09-12T00:58:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.643+0000 7fa4637fe640 1 -- 172.21.15.2:0/3580835020 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c009cd0 con 0x7fa46c101360 2024-09-12T00:58:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.643+0000 7fa47446b640 1 -- 172.21.15.2:0/3580835020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c1a3e00 con 0x7fa46c101360 2024-09-12T00:58:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.643+0000 7fa47446b640 1 -- 172.21.15.2:0/3580835020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c1ab6a0 con 0x7fa46c101360 2024-09-12T00:58:29.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.645+0000 7fa4637fe640 1 -- 172.21.15.2:0/3580835020 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fa45c004950 con 0x7fa46c101360 2024-09-12T00:58:29.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.646+0000 7fa476844740 1 Processor -- start 2024-09-12T00:58:29.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.646+0000 7fa476844740 1 -- start start 2024-09-12T00:58:29.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.646+0000 7fa4637fe640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa4580a2dc0 0x7fa4580a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa476844740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3347894a0 0x55d334789880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa476844740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d334794140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa476844740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334796a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa476844740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d3346ef2e0 con 0x55d3347894a0 2024-09-12T00:58:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa472a08640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa4580a2dc0 0x7fa4580a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa4637fe640 1 -- 172.21.15.2:0/3580835020 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fa45c0cedb0 con 0x7fa46c101360 2024-09-12T00:58:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa472207640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3347894a0 0x55d334789880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa476844740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d334696ce0 con 0x55d334794680 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa472a08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334796a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa476844740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d3346eb2a0 con 0x55d334789dc0 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa471a06640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d334794140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa471a06640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d334794140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:40338/0 (socket says 172.21.15.2:40338) 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa472a08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334796a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:41750/0 (socket says 172.21.15.2:41750) 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa471a06640 1 -- 172.21.15.2:0/277002984 learned_addr learned my addr 172.21.15.2:0/277002984 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa471a06640 1 -- 172.21.15.2:0/277002984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 msgr2=0x55d334796a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa471a06640 1 --2- 172.21.15.2:0/277002984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334796a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa471a06640 1 -- 172.21.15.2:0/277002984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3347894a0 msgr2=0x55d334789880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa471a06640 1 --2- 172.21.15.2:0/277002984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3347894a0 0x55d334789880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.647+0000 7fa471a06640 1 -- 172.21.15.2:0/277002984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d33467b440 con 0x55d334789dc0 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.648+0000 7fa472a08640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa4580a2dc0 0x7fa4580a5280 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa464006010 tx=0x7fa464031ae0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.648+0000 7fa471a06640 1 --2- 172.21.15.2:0/277002984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d334794140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa45c09b2c0 tx=0x7fa45c09ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1a7d53afca43b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.648+0000 7fa460dea640 1 -- 172.21.15.2:0/277002984 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c020070 con 0x55d334789dc0 2024-09-12T00:58:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.648+0000 7fa460dea640 1 -- 172.21.15.2:0/277002984 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45c09f630 con 0x55d334789dc0 2024-09-12T00:58:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.648+0000 7fa460dea640 1 -- 172.21.15.2:0/277002984 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0979a0 con 0x55d334789dc0 2024-09-12T00:58:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 -- 172.21.15.2:0/277002984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 msgr2=0x55d334794140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 --2- 172.21.15.2:0/277002984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d334794140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa45c09b2c0 tx=0x7fa45c09ac90 comp rx=0 tx=0).stop 2024-09-12T00:58:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 -- 172.21.15.2:0/277002984 shutdown_connections 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 --2- 172.21.15.2:0/277002984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334796a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 --2- 172.21.15.2:0/277002984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d334794140 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 --2- 172.21.15.2:0/277002984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3347894a0 0x55d334789880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 -- 172.21.15.2:0/277002984 >> 172.21.15.2:0/277002984 conn(0x55d334785a30 msgr2=0x55d334785e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 -- 172.21.15.2:0/277002984 shutdown_connections 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 -- 172.21.15.2:0/277002984 wait complete. 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.649+0000 7fa476844740 1 -- start start 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa476844740 1 Processor -- start 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa476844740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d3347940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa476844740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334789dc0 0x55d334791350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa476844740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334791960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa476844740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d334797250 con 0x55d334789dc0 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa476844740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d3346aa050 con 0x55d334794680 2024-09-12T00:58:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa476844740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d3347973d0 con 0x55d3347894a0 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa476844740 10 client.0 _ll_register_callbacks cb 0x55d3346ea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa471a06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334789dc0 0x55d334791350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472a08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334791960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472a08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334791960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:41756/0 (socket says 172.21.15.2:41756) 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472a08640 1 -- 172.21.15.2:0/469655348 learned_addr learned my addr 172.21.15.2:0/469655348 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472207640 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d3347940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472a08640 1 -- 172.21.15.2:0/469655348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 msgr2=0x55d3347940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472a08640 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d3347940a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472a08640 1 -- 172.21.15.2:0/469655348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334789dc0 msgr2=0x55d334791350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472a08640 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334789dc0 0x55d334791350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472a08640 1 -- 172.21.15.2:0/469655348 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3344603c0 con 0x55d334794680 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.650+0000 7fa472207640 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d3347940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa472a08640 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334791960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa464035000 tx=0x7fa46402a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1b7daad1428b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa455ffb640 1 -- 172.21.15.2:0/469655348 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4640318c0 con 0x55d334794680 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa455ffb640 1 -- 172.21.15.2:0/469655348 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fa464003e00 con 0x55d334794680 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa476844740 1 -- 172.21.15.2:0/469655348 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa45c09f630 con 0x55d334794680 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa455ffb640 1 -- 172.21.15.2:0/469655348 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa46405a050 con 0x55d334794680 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa476844740 10 client.26123 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa476844740 1 -- 172.21.15.2:0/469655348 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d3347a2ce0 con 0x55d334794680 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa455ffb640 1 -- 172.21.15.2:0/469655348 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45c09f630 con 0x55d334794680 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.651+0000 7fa455ffb640 1 -- 172.21.15.2:0/469655348 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa46404b050 con 0x55d334794680 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.652+0000 7fa476844740 10 client.26123 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.652+0000 7fa476844740 10 client.26123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.652+0000 7fa476844740 20 client.26123 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.652+0000 7fa476844740 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d3347a41a0 0x55d3347a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.652+0000 7fa476844740 4 client.26123 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.652+0000 7fa476844740 1 -- 172.21.15.2:0/469655348 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3346fc850 con 0x55d3347a41a0 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.652+0000 7fa472207640 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d3347a41a0 0x55d3347a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.653+0000 7fa455ffb640 10 client.26123 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.653+0000 7fa472207640 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d3347a41a0 0x55d3347a65e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd0ffdc8d5810cd1 server_cookie=a16664ea0d3f9c63 in_seq=0 out_seq=0 2024-09-12T00:58:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.653+0000 7fa455ffb640 1 -- 172.21.15.2:0/469655348 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3346fc850 con 0x55d3347a41a0 2024-09-12T00:58:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.653+0000 7fa455ffb640 10 client.26123 handle_command_reply: tid=0 2024-09-12T00:58:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.653+0000 7fa476844740 1 client.26123 shutdown 2024-09-12T00:58:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 -- 172.21.15.2:0/469655348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 msgr2=0x55d334791960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334791960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa464035000 tx=0x7fa46402a8f0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 -- 172.21.15.2:0/469655348 shutdown_connections 2024-09-12T00:58:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d3347a41a0 0x55d3347a65e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334794680 0x55d334791960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa455ffb640 0 client.26123 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334789dc0 0x55d334791350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 --2- 172.21.15.2:0/469655348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d3347940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 -- 172.21.15.2:0/469655348 >> 172.21.15.2:0/469655348 conn(0x55d334785a30 msgr2=0x55d33478b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 -- 172.21.15.2:0/469655348 shutdown_connections 2024-09-12T00:58:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 1 -- 172.21.15.2:0/469655348 wait complete. 2024-09-12T00:58:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.654+0000 7fa476844740 20 client.26123 trim_cache size 0 max 16384 2024-09-12T00:58:29.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.676+0000 7fa476844740 1 Processor -- start 2024-09-12T00:58:29.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa476844740 1 -- start start 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa476844740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d334790c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa476844740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334789dc0 0x55d3347933d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa476844740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d3347abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa476844740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1b6860 con 0x55d334794680 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa476844740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1b4130 con 0x55d334789dc0 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa476844740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1b1f80 con 0x55d3347894a0 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa472a08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d3347abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa472a08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d3347abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59554/0 (socket says 172.21.15.2:59554) 2024-09-12T00:58:29.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa471a06640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334789dc0 0x55d3347933d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa472a08640 1 -- 172.21.15.2:0/1649554873 learned_addr learned my addr 172.21.15.2:0/1649554873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa472207640 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d334790c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa471a06640 1 -- 172.21.15.2:0/1649554873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 msgr2=0x55d334790c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa471a06640 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d334790c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa471a06640 1 -- 172.21.15.2:0/1649554873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 msgr2=0x55d3347abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa471a06640 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d3347abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa471a06640 1 -- 172.21.15.2:0/1649554873 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d334786570 con 0x55d334789dc0 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.677+0000 7fa472a08640 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d3347abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.678+0000 7fa471a06640 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334789dc0 0x55d3347933d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa45c09b2c0 tx=0x7fa45c0860f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462be069bc862992 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.678+0000 7fa457fff640 1 -- 172.21.15.2:0/1649554873 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c020040 con 0x55d334789dc0 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.678+0000 7fa457fff640 1 -- 172.21.15.2:0/1649554873 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45c09f630 con 0x55d334789dc0 2024-09-12T00:58:29.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.678+0000 7fa457fff640 1 -- 172.21.15.2:0/1649554873 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0cc8c0 con 0x55d334789dc0 2024-09-12T00:58:29.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 -- 172.21.15.2:0/1649554873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334789dc0 msgr2=0x55d3347933d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334789dc0 0x55d3347933d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa45c09b2c0 tx=0x7fa45c0860f0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 -- 172.21.15.2:0/1649554873 shutdown_connections 2024-09-12T00:58:29.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d3347abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d334789dc0 0x55d3347933d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 --2- 172.21.15.2:0/1649554873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3347894a0 0x55d334790c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 -- 172.21.15.2:0/1649554873 >> 172.21.15.2:0/1649554873 conn(0x55d334785a30 msgr2=0x55d334785e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 -- 172.21.15.2:0/1649554873 shutdown_connections 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.679+0000 7fa476844740 1 -- 172.21.15.2:0/1649554873 wait complete. 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa476844740 1 -- start start 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa476844740 1 Processor -- start 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa476844740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3347894a0 0x55d33479ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa476844740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d33479a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa476844740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d33479a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa472a08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d33479a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa472207640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3347894a0 0x55d33479ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa476844740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1b25f0 con 0x55d334794680 2024-09-12T00:58:29.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa471a06640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d33479a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa476844740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1b3a60 con 0x55d3347894a0 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa476844740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1b2cc0 con 0x55d334789dc0 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa472a08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d33479a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59560/0 (socket says 172.21.15.2:59560) 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa472a08640 1 -- 172.21.15.2:0/1627621205 learned_addr learned my addr 172.21.15.2:0/1627621205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.680+0000 7fa472207640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3347894a0 0x55d33479ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:41770/0 (socket says 172.21.15.2:41770) 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa476844740 10 client.0 _ll_register_callbacks cb 0x7fa4640098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa472207640 1 -- 172.21.15.2:0/1627621205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 msgr2=0x55d33479a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa472207640 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d33479a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa472207640 1 -- 172.21.15.2:0/1627621205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 msgr2=0x55d33479a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa472207640 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d33479a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa472207640 1 -- 172.21.15.2:0/1627621205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3347892d0 con 0x55d3347894a0 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa472a08640 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d33479a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa472207640 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3347894a0 0x55d33479ccb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55d3347a6be0 tx=0x7fa468010b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77d1a2f8e92a9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa455ffb640 1 -- 172.21.15.2:0/1627621205 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46800f9d0 con 0x55d3347894a0 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa455ffb640 1 -- 172.21.15.2:0/1627621205 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fa46800fb70 con 0x55d3347894a0 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.681+0000 7fa476844740 1 -- 172.21.15.2:0/1627621205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa45c09f630 con 0x55d3347894a0 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa455ffb640 1 -- 172.21.15.2:0/1627621205 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa46800fd70 con 0x55d3347894a0 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa476844740 10 client.26129 fetch_fsmap learned FSMap version 29 2024-09-12T00:58:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa476844740 1 -- 172.21.15.2:0/1627621205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d33480ecc0 con 0x55d3347894a0 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa455ffb640 1 -- 172.21.15.2:0/1627621205 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45c09f630 con 0x55d3347894a0 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa455ffb640 1 -- 172.21.15.2:0/1627621205 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa468025030 con 0x55d3347894a0 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa476844740 10 client.26129 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa476844740 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa476844740 20 client.26129 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa476844740 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d33480f3e0 0x55d3348117d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa476844740 4 client.26129 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa476844740 1 -- 172.21.15.2:0/1627621205 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d3346f6d60 con 0x55d33480f3e0 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.682+0000 7fa471a06640 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d33480f3e0 0x55d3348117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa455ffb640 10 client.26129 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa471a06640 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d33480f3e0 0x55d3348117d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3453a0c5eba4441 server_cookie=87b0790d86f73d21 in_seq=0 out_seq=0 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa455ffb640 1 -- 172.21.15.2:0/1627621205 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d3346f6d60 con 0x55d33480f3e0 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa455ffb640 10 client.26129 handle_command_reply: tid=0 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 client.26129 shutdown 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 -- 172.21.15.2:0/1627621205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3347894a0 msgr2=0x55d33479ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3347894a0 0x55d33479ccb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55d3347a6be0 tx=0x7fa468010b00 comp rx=0 tx=0).stop 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 -- 172.21.15.2:0/1627621205 shutdown_connections 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d33480f3e0 0x55d3348117d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d334794680 0x55d33479a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa455ffb640 0 client.26129 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d334789dc0 0x55d33479a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 --2- 172.21.15.2:0/1627621205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3347894a0 0x55d33479ccb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 -- 172.21.15.2:0/1627621205 >> 172.21.15.2:0/1627621205 conn(0x55d334785a30 msgr2=0x55d3347933d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 -- 172.21.15.2:0/1627621205 shutdown_connections 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.683+0000 7fa476844740 1 -- 172.21.15.2:0/1627621205 wait complete. 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa476844740 20 client.26129 trim_cache size 0 max 16384 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "cb8d8ccc-9981-48ed-8c53-bf23e146390d": { 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "cb8d8ccc-9981-48ed-8c53-bf23e146390d", 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T00:58:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:58:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T00:58:29.688 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 -- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa4580a2dc0 msgr2=0x7fa4580a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa4580a2dc0 0x7fa4580a5280 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa464006010 tx=0x7fa464031ae0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 -- 172.21.15.2:0/3580835020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c101360 msgr2=0x7fa46c10d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c101360 0x7fa46c10d110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d6d0 tx=0x7fa45c00db90 comp rx=0 tx=0).stop 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 -- 172.21.15.2:0/3580835020 shutdown_connections 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa4580a2dc0 0x7fa4580a5280 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa46c10e4d0 0x7fa46c1a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c101360 0x7fa46c10d110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 --2- 172.21.15.2:0/3580835020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa46c1009b0 0x7fa46c10cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 -- 172.21.15.2:0/3580835020 >> 172.21.15.2:0/3580835020 conn(0x7fa46c0fc7d0 msgr2=0x7fa46c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.684+0000 7fa47446b640 1 -- 172.21.15.2:0/3580835020 shutdown_connections 2024-09-12T00:58:29.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:29.685+0000 7fa47446b640 1 -- 172.21.15.2:0/3580835020 wait complete. 2024-09-12T00:58:30.579 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:30 smithi002 ceph-mon[31210]: pgmap v170: 97 pgs: 97 active+clean; 221 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 859 op/s 2024-09-12T00:58:30.611 INFO:tasks.cephfs.filesystem:scrub status for tag:cb8d8ccc-9981-48ed-8c53-bf23e146390d - {'path': '/', 'tag': 'cb8d8ccc-9981-48ed-8c53-bf23e146390d', 'options': 'recursive,force'} 2024-09-12T00:58:30.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:30 smithi167 ceph-mon[35234]: pgmap v170: 97 pgs: 97 active+clean; 221 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 859 op/s 2024-09-12T00:58:30.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:30 smithi071 ceph-mon[35276]: pgmap v170: 97 pgs: 97 active+clean; 221 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 859 op/s 2024-09-12T00:58:32.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:32 smithi002 ceph-mon[31210]: pgmap v171: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 1.28k op/s 2024-09-12T00:58:32.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:32 smithi167 ceph-mon[35234]: pgmap v171: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 1.28k op/s 2024-09-12T00:58:32.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:32 smithi071 ceph-mon[35276]: pgmap v171: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 1.28k op/s 2024-09-12T00:58:34.743 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:34 smithi071 ceph-mon[35276]: pgmap v172: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 858 op/s 2024-09-12T00:58:34.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:34 smithi002 ceph-mon[31210]: pgmap v172: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 858 op/s 2024-09-12T00:58:34.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:34 smithi167 ceph-mon[35234]: pgmap v172: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 858 op/s 2024-09-12T00:58:36.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:36 smithi002 ceph-mon[31210]: pgmap v173: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 858 op/s 2024-09-12T00:58:36.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:36 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:58:36.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:36 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:58:36.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:36 smithi167 ceph-mon[35234]: pgmap v173: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 858 op/s 2024-09-12T00:58:36.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:36 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:58:36.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:36 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:58:36.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:36 smithi071 ceph-mon[35276]: pgmap v173: 97 pgs: 97 active+clean; 219 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 858 op/s 2024-09-12T00:58:36.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:36 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:58:36.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:36 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:58:37.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:37 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:58:37.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:37 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:58:37.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:37 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:58:38.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:38 smithi002 ceph-mon[31210]: pgmap v174: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 1.30k op/s 2024-09-12T00:58:38.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:38 smithi167 ceph-mon[35234]: pgmap v174: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 1.30k op/s 2024-09-12T00:58:38.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:38 smithi071 ceph-mon[35276]: pgmap v174: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 1.30k op/s 2024-09-12T00:58:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:40 smithi002 ceph-mon[31210]: pgmap v175: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:40.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:40 smithi167 ceph-mon[35234]: pgmap v175: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:40.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:40 smithi071 ceph-mon[35276]: pgmap v175: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:40.968 INFO:tasks.workunit.client.0.smithi002.stdout:All 50000 operations completed A-OK! 2024-09-12T00:58:40.969 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:58:40.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:58:42.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:42 smithi002 ceph-mon[31210]: pgmap v176: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.29k op/s 2024-09-12T00:58:42.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:42 smithi167 ceph-mon[35234]: pgmap v176: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.29k op/s 2024-09-12T00:58:42.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:42 smithi071 ceph-mon[35276]: pgmap v176: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.29k op/s 2024-09-12T00:58:44.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:44 smithi002 ceph-mon[31210]: pgmap v177: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:44.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:44 smithi167 ceph-mon[35234]: pgmap v177: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:44.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:44 smithi071 ceph-mon[35276]: pgmap v177: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:46.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:46 smithi002 ceph-mon[31210]: pgmap v178: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:46.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:46 smithi167 ceph-mon[35234]: pgmap v178: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:46.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:46 smithi071 ceph-mon[35276]: pgmap v178: 97 pgs: 97 active+clean; 218 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 865 op/s 2024-09-12T00:58:48.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:48 smithi002 ceph-mon[31210]: pgmap v179: 97 pgs: 97 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.5 MiB/s wr, 950 op/s 2024-09-12T00:58:48.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:48 smithi167 ceph-mon[35234]: pgmap v179: 97 pgs: 97 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.5 MiB/s wr, 950 op/s 2024-09-12T00:58:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:48 smithi071 ceph-mon[35276]: pgmap v179: 97 pgs: 97 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.5 MiB/s wr, 950 op/s 2024-09-12T00:58:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:50 smithi002 ceph-mon[31210]: pgmap v180: 97 pgs: 97 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.2 MiB/s wr, 510 op/s 2024-09-12T00:58:50.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:50 smithi167 ceph-mon[35234]: pgmap v180: 97 pgs: 97 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.2 MiB/s wr, 510 op/s 2024-09-12T00:58:50.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:50 smithi071 ceph-mon[35276]: pgmap v180: 97 pgs: 97 active+clean; 232 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.2 MiB/s wr, 510 op/s 2024-09-12T00:58:51.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:51 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:51.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:51 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:51.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:51 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:52.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:52 smithi002 ceph-mon[31210]: pgmap v181: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.2 MiB/s wr, 734 op/s 2024-09-12T00:58:52.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:52 smithi167 ceph-mon[35234]: pgmap v181: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.2 MiB/s wr, 734 op/s 2024-09-12T00:58:52.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:52 smithi071 ceph-mon[35276]: pgmap v181: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.2 MiB/s wr, 734 op/s 2024-09-12T00:58:53.997 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-12T00:58:53.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:58:54.353 DEBUG:teuthology.parallel:result is None 2024-09-12T00:58:54.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:58:54.393 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:58:54.393 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T00:58:54.405 INFO:tasks.quiescer:joining Quiescers 2024-09-12T00:58:54.406 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T00:58:54.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:58:54.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:54 smithi002 ceph-mon[31210]: pgmap v182: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-09-12T00:58:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:54.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:54 smithi167 ceph-mon[35234]: pgmap v182: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-09-12T00:58:54.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:54 smithi071 ceph-mon[35276]: pgmap v182: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-09-12T00:58:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 -- 172.21.15.2:0/3372490761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 msgr2=0x7f15101031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 --2- 172.21.15.2:0/3372490761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 0x7f15101031b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f150c009930 tx=0x7f150c02a420 comp rx=0 tx=0).stop 2024-09-12T00:58:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 -- 172.21.15.2:0/3372490761 shutdown_connections 2024-09-12T00:58:55.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 --2- 172.21.15.2:0/3372490761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1510108300 0x7f151010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 --2- 172.21.15.2:0/3372490761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1510103780 0x7f1510107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 --2- 172.21.15.2:0/3372490761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 0x7f15101031b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 -- 172.21.15.2:0/3372490761 >> 172.21.15.2:0/3372490761 conn(0x7f15100fc7d0 msgr2=0x7f15100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 -- 172.21.15.2:0/3372490761 shutdown_connections 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.362+0000 7f151748e640 1 -- 172.21.15.2:0/3372490761 wait complete. 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151748e640 1 Processor -- start 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151748e640 1 -- start start 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151748e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 0x7f1510100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151748e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1510103780 0x7f1510100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151748e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1510108300 0x7f15101014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151748e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15101120e0 con 0x7f1510102dd0 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151748e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1510111f60 con 0x7f1510108300 2024-09-12T00:58:55.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151748e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1510112260 con 0x7f1510103780 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151522a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 0x7f1510100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151522a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 0x7f1510100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53776/0 (socket says 172.21.15.2:53776) 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.364+0000 7f151522a640 1 -- 172.21.15.2:0/91818916 learned_addr learned my addr 172.21.15.2:0/91818916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f1514a29640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1510103780 0x7f1510100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f1515a2b640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1510108300 0x7f15101014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f151522a640 1 -- 172.21.15.2:0/91818916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1510103780 msgr2=0x7f1510100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f151522a640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1510103780 0x7f1510100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f151522a640 1 -- 172.21.15.2:0/91818916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1510108300 msgr2=0x7f15101014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f151522a640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1510108300 0x7f15101014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f151522a640 1 -- 172.21.15.2:0/91818916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15101a6a60 con 0x7f1510102dd0 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f151522a640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 0x7f1510100a30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f150c02a940 tx=0x7f150c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:55.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f15067fc640 1 -- 172.21.15.2:0/91818916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c03f070 con 0x7f1510102dd0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f15067fc640 1 -- 172.21.15.2:0/91818916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f150c031c90 con 0x7f1510102dd0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f15067fc640 1 -- 172.21.15.2:0/91818916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c035030 con 0x7f1510102dd0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15101a6cf0 con 0x7f1510102dd0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.365+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15101a7180 con 0x7f1510102dd0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.366+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15101031b0 con 0x7f1510102dd0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.367+0000 7f15067fc640 1 -- 172.21.15.2:0/91818916 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f150c042070 con 0x7f1510102dd0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.368+0000 7f15067fc640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14fc0a2cf0 0x7f14fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.368+0000 7f1514a29640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14fc0a2cf0 0x7f14fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.368+0000 7f15067fc640 1 -- 172.21.15.2:0/91818916 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f150c0efbf0 con 0x7f1510102dd0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.369+0000 7f1514a29640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14fc0a2cf0 0x7f14fc0a51b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f15101024c0 tx=0x7f150000b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.377+0000 7f15067fc640 1 -- 172.21.15.2:0/91818916 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f150c0bc110 con 0x7f1510102dd0 2024-09-12T00:58:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.589+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f151010a290 con 0x7f1510102dd0 2024-09-12T00:58:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.590+0000 7f15067fc640 1 -- 172.21.15.2:0/91818916 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11902 (secure 0 0 0) 0x7f150c0c0410 con 0x7f1510102dd0 2024-09-12T00:58:55.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:58:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"btime":"2024-09-12T00:58:55:498777+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:55.216390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T00:58:55.590 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-09-12T00:58:55.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.592+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14fc0a2cf0 msgr2=0x7f14fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:55.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.592+0000 7f151748e640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14fc0a2cf0 0x7f14fc0a51b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f15101024c0 tx=0x7f150000b390 comp rx=0 tx=0).stop 2024-09-12T00:58:55.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.592+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 msgr2=0x7f1510100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:55.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.592+0000 7f151748e640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 0x7f1510100a30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f150c02a940 tx=0x7f150c003b90 comp rx=0 tx=0).stop 2024-09-12T00:58:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.593+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 shutdown_connections 2024-09-12T00:58:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.593+0000 7f151748e640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f14fc0a2cf0 0x7f14fc0a51b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.593+0000 7f151748e640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1510108300 0x7f15101014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.593+0000 7f151748e640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1510103780 0x7f1510100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.593+0000 7f151748e640 1 --2- 172.21.15.2:0/91818916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1510102dd0 0x7f1510100a30 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.593+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 >> 172.21.15.2:0/91818916 conn(0x7f15100fc7d0 msgr2=0x7f1510105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.593+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 shutdown_connections 2024-09-12T00:58:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:55.593+0000 7f151748e640 1 -- 172.21.15.2:0/91818916 wait complete. 2024-09-12T00:58:56.527 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --cancel --all' 2024-09-12T00:58:56.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --cancel --all 2024-09-12T00:58:56.593 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.1 2024-09-12T00:58:56.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:58:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:56 smithi002 ceph-mon[31210]: pgmap v183: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-09-12T00:58:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:56 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:56.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:56 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/91818916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:56 smithi167 ceph-mon[35234]: pgmap v183: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-09-12T00:58:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:56 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:56.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:56 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/91818916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:56.797 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:56.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:56 smithi071 ceph-mon[35276]: pgmap v183: 97 pgs: 97 active+clean; 244 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-09-12T00:58:56.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:56 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:56.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:56 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/91818916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:56.970 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:58:57.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 -- 172.21.15.2:0/514435237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c101df0 msgr2=0x7f7f5c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 --2- 172.21.15.2:0/514435237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c101df0 0x7f7f5c1021d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009900 tx=0x7f7f4c02a410 comp rx=0 tx=0).stop 2024-09-12T00:58:57.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 -- 172.21.15.2:0/514435237 shutdown_connections 2024-09-12T00:58:57.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 --2- 172.21.15.2:0/514435237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f5c106f20 0x7f7f5c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 --2- 172.21.15.2:0/514435237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f5c1027a0 0x7f7f5c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 --2- 172.21.15.2:0/514435237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c101df0 0x7f7f5c1021d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 -- 172.21.15.2:0/514435237 >> 172.21.15.2:0/514435237 conn(0x7f7f5c0fd8f0 msgr2=0x7f7f5c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 -- 172.21.15.2:0/514435237 shutdown_connections 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.745+0000 7f7f627db640 1 -- 172.21.15.2:0/514435237 wait complete. 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.746+0000 7f7f627db640 1 Processor -- start 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.746+0000 7f7f627db640 1 -- start start 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.746+0000 7f7f627db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f5c101df0 0x7f7f5c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.746+0000 7f7f627db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1027a0 0x7f7f5c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.746+0000 7f7f627db640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f5c106f20 0x7f7f5c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.746+0000 7f7f627db640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c111f80 con 0x7f7f5c1027a0 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.746+0000 7f7f627db640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c111e00 con 0x7f7f5c106f20 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.746+0000 7f7f627db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c112100 con 0x7f7f5c101df0 2024-09-12T00:58:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1027a0 0x7f7f5c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1027a0 0x7f7f5c198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50526/0 (socket says 172.21.15.2:50526) 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/424737866 learned_addr learned my addr 172.21.15.2:0/424737866 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f5c101df0 0x7f7f5c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f60d78640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f5c106f20 0x7f7f5c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/424737866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f5c101df0 msgr2=0x7f7f5c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f5c101df0 0x7f7f5c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/424737866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f5c106f20 msgr2=0x7f7f5c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f5c106f20 0x7f7f5c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/424737866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c19d370 con 0x7f7f5c1027a0 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f60d78640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f5c106f20 0x7f7f5c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1027a0 0x7f7f5c198900 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000d950 tx=0x7f7f5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f597fa640 1 -- 172.21.15.2:0/424737866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50017070 con 0x7f7f5c1027a0 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f627db640 1 -- 172.21.15.2:0/424737866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c19d660 con 0x7f7f5c1027a0 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f597fa640 1 -- 172.21.15.2:0/424737866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f50009c30 con 0x7f7f5c1027a0 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f597fa640 1 -- 172.21.15.2:0/424737866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000f6b0 con 0x7f7f5c1027a0 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.747+0000 7f7f627db640 1 -- 172.21.15.2:0/424737866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c1a4f40 con 0x7f7f5c1027a0 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.750+0000 7f7f597fa640 1 -- 172.21.15.2:0/424737866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f7f500109d0 con 0x7f7f5c1027a0 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.750+0000 7f7f64bb4740 1 Processor -- start 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.750+0000 7f7f64bb4740 1 -- start start 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 0x56417efaccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efad200 0x56417efbbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efbbff0 0x56417efbe3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56417ef11200 con 0x56417efad200 2024-09-12T00:58:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56417eeb7dc0 con 0x56417efac8e0 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56417ef0d1c0 con 0x56417efbbff0 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f597fa640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7f440a2cf0 0x7f7f440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efad200 0x56417efbbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efad200 0x56417efbbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50532/0 (socket says 172.21.15.2:50532) 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 -- 172.21.15.2:0/1121499250 learned_addr learned my addr 172.21.15.2:0/1121499250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f60d78640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7f440a2cf0 0x7f7f440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efbbff0 0x56417efbe3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f60d78640 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 0x56417efaccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f597fa640 1 -- 172.21.15.2:0/424737866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f7f500cf130 con 0x7f7f5c1027a0 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 -- 172.21.15.2:0/1121499250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efbbff0 msgr2=0x56417efbe3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efbbff0 0x56417efbe3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 -- 172.21.15.2:0/1121499250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 msgr2=0x56417efaccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 0x56417efaccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 -- 172.21.15.2:0/1121499250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417ec82620 con 0x56417efad200 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efad200 0x56417efbbab0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009900 tx=0x7f7f4c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea4e1b57b29e285 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.751+0000 7f7f60d78640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7f440a2cf0 0x7f7f440a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f54007fd0 tx=0x7f7f54007450 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f427fc640 1 -- 172.21.15.2:0/1121499250 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c040070 con 0x56417efad200 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f427fc640 1 -- 172.21.15.2:0/1121499250 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f4c005020 con 0x56417efad200 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f427fc640 1 -- 172.21.15.2:0/1121499250 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c035040 con 0x56417efad200 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1121499250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efad200 msgr2=0x56417efbbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efad200 0x56417efbbab0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009900 tx=0x7f7f4c031630 comp rx=0 tx=0).stop 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1121499250 shutdown_connections 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efbbff0 0x56417efbe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efad200 0x56417efbbab0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1121499250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 0x56417efaccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1121499250 >> 172.21.15.2:0/1121499250 conn(0x56417efa8f90 msgr2=0x56417efa9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1121499250 shutdown_connections 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.752+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1121499250 wait complete. 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.753+0000 7f7f64bb4740 1 -- start start 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.753+0000 7f7f64bb4740 1 Processor -- start 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.753+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efbb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.753+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efb8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.753+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efb9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.753+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56417efbebc0 con 0x56417efbbff0 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.753+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56417eeabc50 con 0x56417efad200 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.753+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56417efbed40 con 0x56417efac8e0 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f64bb4740 10 client.0 _ll_register_callbacks cb 0x56417eebdba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efb9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efb9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50546/0 (socket says 172.21.15.2:50546) 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 -- 172.21.15.2:0/1297308166 learned_addr learned my addr 172.21.15.2:0/1297308166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efbb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efb8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 -- 172.21.15.2:0/1297308166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 msgr2=0x56417efbb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efbb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 -- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 msgr2=0x56417efb8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efb8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 -- 172.21.15.2:0/1297308166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417efb9880 con 0x56417efbbff0 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efbb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efb8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f60d78640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efb9080 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400eb10 tx=0x7f7f54004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe952a5f6bd0f561 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/1297308166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54023030 con 0x56417efbbff0 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/1297308166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f7f54011d50 con 0x56417efbbff0 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.754+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1297308166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f4c005020 con 0x56417efbbff0 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/1297308166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7f5401f480 con 0x56417efbbff0 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f64bb4740 10 client.16551 fetch_fsmap learned FSMap version 31 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1297308166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56417efca750 con 0x56417efbbff0 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/1297308166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f4c005020 con 0x56417efbbff0 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/1297308166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7f5401c050 con 0x56417efbbff0 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f64bb4740 10 client.16551 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f64bb4740 10 client.16551 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f64bb4740 20 client.16551 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56417efcbc10 0x56417efce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f64bb4740 4 client.16551 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:58:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.755+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1297308166 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56417ef1e770 con 0x56417efcbc10 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.756+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56417efcbc10 0x56417efce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.756+0000 7f7f3b7fe640 10 client.16551 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.756+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56417efcbc10 0x56417efce080 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da34ff4731f6d17c server_cookie=679c1bbbd552a938 in_seq=0 out_seq=0 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/1297308166 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56417ef1e770 con 0x56417efcbc10 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f3b7fe640 10 client.16551 handle_command_reply: tid=0 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 client.16551 shutdown 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1297308166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 msgr2=0x56417efb9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efb9080 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400eb10 tx=0x7f7f54004ab0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1297308166 shutdown_connections 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56417efcbc10 0x56417efce080 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efb9080 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efb8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/1297308166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efbb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1297308166 >> 172.21.15.2:0/1297308166 conn(0x56417efa8f90 msgr2=0x56417efa81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f3b7fe640 0 client.16551 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1297308166 shutdown_connections 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 1 -- 172.21.15.2:0/1297308166 wait complete. 2024-09-12T00:58:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.757+0000 7f7f64bb4740 20 client.16551 trim_cache size 0 max 16384 2024-09-12T00:58:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.774+0000 7f7f64bb4740 1 Processor -- start 2024-09-12T00:58:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.774+0000 7f7f64bb4740 1 -- start start 2024-09-12T00:58:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efb4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efc7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efa80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1ae100 con 0x56417efbbff0 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1ab970 con 0x56417efad200 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1a97c0 con 0x56417efac8e0 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efa80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efa80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50550/0 (socket says 172.21.15.2:50550) 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 -- 172.21.15.2:0/2005338407 learned_addr learned my addr 172.21.15.2:0/2005338407 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efc7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efb4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 -- 172.21.15.2:0/2005338407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 msgr2=0x56417efb4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efb4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 -- 172.21.15.2:0/2005338407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 msgr2=0x56417efc7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efc7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 -- 172.21.15.2:0/2005338407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417efce3f0 con 0x56417efbbff0 2024-09-12T00:58:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f60d78640 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efa80c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400e790 tx=0x7f7f54011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbf644adfa81d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.775+0000 7f7f41ffb640 1 -- 172.21.15.2:0/2005338407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54034030 con 0x56417efbbff0 2024-09-12T00:58:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f41ffb640 1 -- 172.21.15.2:0/2005338407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f54011d50 con 0x56417efbbff0 2024-09-12T00:58:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f41ffb640 1 -- 172.21.15.2:0/2005338407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54023070 con 0x56417efbbff0 2024-09-12T00:58:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 -- 172.21.15.2:0/2005338407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 msgr2=0x56417efa80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efa80c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400e790 tx=0x7f7f54011890 comp rx=0 tx=0).stop 2024-09-12T00:58:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 -- 172.21.15.2:0/2005338407 shutdown_connections 2024-09-12T00:58:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efa80c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efad200 0x56417efc7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/2005338407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efac8e0 0x56417efb4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 -- 172.21.15.2:0/2005338407 >> 172.21.15.2:0/2005338407 conn(0x56417efa8f90 msgr2=0x56417efa79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 -- 172.21.15.2:0/2005338407 shutdown_connections 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.776+0000 7f7f64bb4740 1 -- 172.21.15.2:0/2005338407 wait complete. 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 1 -- start start 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 1 Processor -- start 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 0x56417efc43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efad200 0x56417efc48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efbf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1a9e30 con 0x56417efbbff0 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1ab2a0 con 0x56417efac8e0 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1aa500 con 0x56417efad200 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f64bb4740 10 client.0 _ll_register_callbacks cb 0x7f7f5400e7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f60d78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efbf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f60d78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efbf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50558/0 (socket says 172.21.15.2:50558) 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f60d78640 1 -- 172.21.15.2:0/612975437 learned_addr learned my addr 172.21.15.2:0/612975437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efad200 0x56417efc48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.777+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 0x56417efc43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f60d78640 1 -- 172.21.15.2:0/612975437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efad200 msgr2=0x56417efc48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f60d78640 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efad200 0x56417efc48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f60d78640 1 -- 172.21.15.2:0/612975437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 msgr2=0x56417efc43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:58:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f60d78640 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 0x56417efc43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f60d78640 1 -- 172.21.15.2:0/612975437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417efc0160 con 0x56417efbbff0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f60d78640 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efbf930 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7f540106f0 tx=0x7f7f54010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549ec1e3331cd3a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/612975437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54034070 con 0x56417efbbff0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/612975437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f7f5401f620 con 0x56417efbbff0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f64bb4740 1 -- 172.21.15.2:0/612975437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f54011d50 con 0x56417efbbff0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/612975437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7f54023070 con 0x56417efbbff0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f64bb4740 10 client.16557 fetch_fsmap learned FSMap version 31 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.778+0000 7f7f64bb4740 1 -- 172.21.15.2:0/612975437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56417f036600 con 0x56417efbbff0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/612975437 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f54011d50 con 0x56417efbbff0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/612975437 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7f5401c070 con 0x56417efbbff0 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f64bb4740 10 client.16557 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:58:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f64bb4740 10 client.16557 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f64bb4740 20 client.16557 populate_metadata read hostname 'smithi002' 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56417f036d20 0x56417f039110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f64bb4740 4 client.16557 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f64bb4740 1 -- 172.21.15.2:0/612975437 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x56417ef18c80 con 0x56417f036d20 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56417f036d20 0x56417f039110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f3b7fe640 10 client.16557 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.779+0000 7f7f5bfff640 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56417f036d20 0x56417f039110 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afced060a66c5eeb server_cookie=1912edf56f3dc4d6 in_seq=0 out_seq=0 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f3b7fe640 1 -- 172.21.15.2:0/612975437 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x56417ef18c80 con 0x56417f036d20 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f3b7fe640 10 client.16557 handle_command_reply: tid=0 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 client.16557 shutdown 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 -- 172.21.15.2:0/612975437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 msgr2=0x56417efbf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efbf930 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7f540106f0 tx=0x7f7f54010d00 comp rx=0 tx=0).stop 2024-09-12T00:58:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 -- 172.21.15.2:0/612975437 shutdown_connections 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56417f036d20 0x56417f039110 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417efbbff0 0x56417efbf930 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56417efad200 0x56417efc48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f3b7fe640 0 client.16557 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 --2- 172.21.15.2:0/612975437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56417efac8e0 0x56417efc43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 -- 172.21.15.2:0/612975437 >> 172.21.15.2:0/612975437 conn(0x56417efa8f90 msgr2=0x56417efb4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 -- 172.21.15.2:0/612975437 shutdown_connections 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 1 -- 172.21.15.2:0/612975437 wait complete. 2024-09-12T00:58:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.780+0000 7f7f64bb4740 20 client.16557 trim_cache size 0 max 16384 2024-09-12T00:58:57.785 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:58:57.785 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 31, 2024-09-12T00:58:57.785 INFO:teuthology.orchestra.run.smithi002.stdout: "leader": 24494, 2024-09-12T00:58:57.785 INFO:teuthology.orchestra.run.smithi002.stdout: "set_version": 20, 2024-09-12T00:58:57.785 INFO:teuthology.orchestra.run.smithi002.stdout: "sets": {} 2024-09-12T00:58:57.785 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 -- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7f440a2cf0 msgr2=0x7f7f440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7f440a2cf0 0x7f7f440a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f54007fd0 tx=0x7f7f54007450 comp rx=0 tx=0).stop 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 -- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1027a0 msgr2=0x7f7f5c198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1027a0 0x7f7f5c198900 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000d950 tx=0x7f7f5000de10 comp rx=0 tx=0).stop 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 -- 172.21.15.2:0/424737866 shutdown_connections 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7f440a2cf0 0x7f7f440a51b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f5c106f20 0x7f7f5c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c1027a0 0x7f7f5c198900 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 --2- 172.21.15.2:0/424737866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f5c101df0 0x7f7f5c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 -- 172.21.15.2:0/424737866 >> 172.21.15.2:0/424737866 conn(0x7f7f5c0fd8f0 msgr2=0x7f7f5c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 -- 172.21.15.2:0/424737866 shutdown_connections 2024-09-12T00:58:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:57.781+0000 7f7f627db640 1 -- 172.21.15.2:0/424737866 wait complete. 2024-09-12T00:58:58.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:58 smithi002 ceph-mon[31210]: pgmap v184: 97 pgs: 97 active+clean; 261 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 417 op/s 2024-09-12T00:58:58.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:58 smithi167 ceph-mon[35234]: pgmap v184: 97 pgs: 97 active+clean; 261 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 417 op/s 2024-09-12T00:58:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:58 smithi071 ceph-mon[35276]: pgmap v184: 97 pgs: 97 active+clean; 261 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 417 op/s 2024-09-12T00:58:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4051204677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74100a80 msgr2=0x7f0c74100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4051204677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74100a80 0x7f0c74100ee0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009930 tx=0x7f0c6802a420 comp rx=0 tx=0).stop 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4051204677 shutdown_connections 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4051204677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c74101420 0x7f0c7410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4051204677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74100a80 0x7f0c74100ee0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4051204677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c74106a80 0x7f0c74106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4051204677 >> 172.21.15.2:0/4051204677 conn(0x7f0c740fc7a0 msgr2=0x7f0c740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4051204677 shutdown_connections 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4051204677 wait complete. 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.050+0000 7f0c79bb9640 1 Processor -- start 2024-09-12T00:58:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c79bb9640 1 -- start start 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c79bb9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c74100a80 0x7f0c741992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c79bb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74101420 0x7f0c741997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c79bb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c74106a80 0x7f0c741a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c79bb9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74110e80 con 0x7f0c74101420 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c79bb9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74110d00 con 0x7f0c74100a80 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c79bb9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74111000 con 0x7f0c74106a80 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c72ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74101420 0x7f0c741997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c72ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74101420 0x7f0c741997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50572/0 (socket says 172.21.15.2:50572) 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c72ffd640 1 -- 172.21.15.2:0/4146687799 learned_addr learned my addr 172.21.15.2:0/4146687799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c737fe640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c74100a80 0x7f0c741992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c73fff640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c74106a80 0x7f0c741a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c72ffd640 1 -- 172.21.15.2:0/4146687799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c74106a80 msgr2=0x7f0c741a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c72ffd640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c74106a80 0x7f0c741a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c72ffd640 1 -- 172.21.15.2:0/4146687799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c74100a80 msgr2=0x7f0c741992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c72ffd640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c74100a80 0x7f0c741992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c72ffd640 1 -- 172.21.15.2:0/4146687799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c741a4860 con 0x7f0c74101420 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.051+0000 7f0c737fe640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c74100a80 0x7f0c741992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.052+0000 7f0c72ffd640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74101420 0x7f0c741997e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009230 tx=0x7f0c68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.052+0000 7f0c70ff9640 1 -- 172.21.15.2:0/4146687799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6803f030 con 0x7f0c74101420 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.052+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c741a4a30 con 0x7f0c74101420 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.052+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c741a4ee0 con 0x7f0c74101420 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.052+0000 7f0c70ff9640 1 -- 172.21.15.2:0/4146687799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c68003ad0 con 0x7f0c74101420 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.052+0000 7f0c70ff9640 1 -- 172.21.15.2:0/4146687799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68049060 con 0x7f0c74101420 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.053+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c60005290 con 0x7f0c74101420 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.054+0000 7f0c70ff9640 1 -- 172.21.15.2:0/4146687799 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f0c68042030 con 0x7f0c74101420 2024-09-12T00:58:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.055+0000 7f0c70ff9640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0c5c0a2cf0 0x7f0c5c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:58:59.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.055+0000 7f0c737fe640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0c5c0a2cf0 0x7f0c5c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:58:59.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.055+0000 7f0c70ff9640 1 -- 172.21.15.2:0/4146687799 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f0c680ef8c0 con 0x7f0c74101420 2024-09-12T00:58:59.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.055+0000 7f0c737fe640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0c5c0a2cf0 0x7f0c5c0a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0c64005fd0 tx=0x7f0c64005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:58:59.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.058+0000 7f0c70ff9640 1 -- 172.21.15.2:0/4146687799 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c680bc490 con 0x7f0c74101420 2024-09-12T00:58:59.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.270+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c60005580 con 0x7f0c74101420 2024-09-12T00:58:59.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.270+0000 7f0c70ff9640 1 -- 172.21.15.2:0/4146687799 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7f0c680bbd90 con 0x7f0c74101420 2024-09-12T00:58:59.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:58:59.270 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:58:59.270 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0c5c0a2cf0 msgr2=0x7f0c5c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0c5c0a2cf0 0x7f0c5c0a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0c64005fd0 tx=0x7f0c64005850 comp rx=0 tx=0).stop 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74101420 msgr2=0x7f0c741997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74101420 0x7f0c741997e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009230 tx=0x7f0c68004270 comp rx=0 tx=0).stop 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 shutdown_connections 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0c5c0a2cf0 0x7f0c5c0a51b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c74106a80 0x7f0c741a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74101420 0x7f0c741997e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 --2- 172.21.15.2:0/4146687799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c74100a80 0x7f0c741992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:58:59.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 >> 172.21.15.2:0/4146687799 conn(0x7f0c740fc7a0 msgr2=0x7f0c740fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:58:59.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 shutdown_connections 2024-09-12T00:58:59.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:58:59.273+0000 7f0c79bb9640 1 -- 172.21.15.2:0/4146687799 wait complete. 2024-09-12T00:58:59.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:59 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:59.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:58:59 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4146687799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:59.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:59 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:59.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:58:59 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4146687799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:59.930 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T00:58:59.930 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-12T00:58:59.940 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-12T00:58:59.940 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T00:58:59.941 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T00:58:59.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-12T00:58:59.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:59 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T00:58:59.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:58:59 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4146687799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:58:59.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-12T00:59:00.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:59:00.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:00 smithi167 ceph-mon[35234]: pgmap v185: 97 pgs: 97 active+clean; 261 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 331 op/s 2024-09-12T00:59:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:00 smithi071 ceph-mon[35276]: pgmap v185: 97 pgs: 97 active+clean; 261 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 331 op/s 2024-09-12T00:59:00.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:00 smithi002 ceph-mon[31210]: pgmap v185: 97 pgs: 97 active+clean; 261 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 331 op/s 2024-09-12T00:59:01.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 -- 172.21.15.2:0/1883047615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 msgr2=0x7fc32c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 --2- 172.21.15.2:0/1883047615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 0x7fc32c10ea90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc324009ca0 tx=0x7fc32402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 -- 172.21.15.2:0/1883047615 shutdown_connections 2024-09-12T00:59:01.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 --2- 172.21.15.2:0/1883047615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 0x7fc32c10ea90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 --2- 172.21.15.2:0/1883047615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc32c102790 0x7fc32c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 --2- 172.21.15.2:0/1883047615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32c101de0 0x7fc32c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 -- 172.21.15.2:0/1883047615 >> 172.21.15.2:0/1883047615 conn(0x7fc32c0fd8c0 msgr2=0x7fc32c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 -- 172.21.15.2:0/1883047615 shutdown_connections 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.432+0000 7fc33129c640 1 -- 172.21.15.2:0/1883047615 wait complete. 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc33129c640 1 Processor -- start 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc33129c640 1 -- start start 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc33129c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32c101de0 0x7fc32c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc33129c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc32c102790 0x7fc32c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc33129c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 0x7fc32c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc33129c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c111f70 con 0x7fc32c106f10 2024-09-12T00:59:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc33129c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c111df0 con 0x7fc32c101de0 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc33129c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1120f0 con 0x7fc32c102790 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc32b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 0x7fc32c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc32b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 0x7fc32c19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50580/0 (socket says 172.21.15.2:50580) 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc32b7fe640 1 -- 172.21.15.2:0/2233846821 learned_addr learned my addr 172.21.15.2:0/2233846821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc32affd640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32c101de0 0x7fc32c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.433+0000 7fc3227fc640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc32c102790 0x7fc32c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc32b7fe640 1 -- 172.21.15.2:0/2233846821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc32c102790 msgr2=0x7fc32c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc32b7fe640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc32c102790 0x7fc32c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc32b7fe640 1 -- 172.21.15.2:0/2233846821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32c101de0 msgr2=0x7fc32c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc32b7fe640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32c101de0 0x7fc32c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc32b7fe640 1 -- 172.21.15.2:0/2233846821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32c19d290 con 0x7fc32c106f10 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc3227fc640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc32c102790 0x7fc32c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc32b7fe640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 0x7fc32c19cbb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc324031a60 tx=0x7fc324031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:01.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc328ff9640 1 -- 172.21.15.2:0/2233846821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324003b70 con 0x7fc32c106f10 2024-09-12T00:59:01.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc328ff9640 1 -- 172.21.15.2:0/2233846821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc324003d10 con 0x7fc32c106f10 2024-09-12T00:59:01.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc328ff9640 1 -- 172.21.15.2:0/2233846821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324004770 con 0x7fc32c106f10 2024-09-12T00:59:01.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc33129c640 1 -- 172.21.15.2:0/2233846821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32c19d520 con 0x7fc32c106f10 2024-09-12T00:59:01.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.434+0000 7fc33129c640 1 -- 172.21.15.2:0/2233846821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32c1a4e60 con 0x7fc32c106f10 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.437+0000 7fc333675740 1 Processor -- start 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.437+0000 7fc328ff9640 1 -- 172.21.15.2:0/2233846821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc32402f790 con 0x7fc32c106f10 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.437+0000 7fc333675740 1 -- start start 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc333675740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 0x55a4dc208780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc333675740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc217550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc333675740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc217a90 0x55a4dc219e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc333675740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4dc16e2e0 con 0x55a4dc217a90 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc333675740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a4dc115ce0 con 0x55a4dc2083a0 2024-09-12T00:59:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc333675740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a4dc16a2a0 con 0x55a4dc208cc0 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc3227fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc217a90 0x55a4dc219e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc3227fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc217a90 0x55a4dc219e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50592/0 (socket says 172.21.15.2:50592) 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc3227fc640 1 -- 172.21.15.2:0/3920927250 learned_addr learned my addr 172.21.15.2:0/3920927250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc3227fc640 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 0x55a4dc208780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc32affd640 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc217550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc328ff9640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3180a2d70 0x7fc3180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc3227fc640 1 -- 172.21.15.2:0/3920927250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 msgr2=0x55a4dc217550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc3227fc640 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc217550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc3227fc640 1 -- 172.21.15.2:0/3920927250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 msgr2=0x55a4dc208780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.438+0000 7fc3227fc640 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 0x55a4dc208780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.439+0000 7fc3227fc640 1 -- 172.21.15.2:0/3920927250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4dc0fa440 con 0x55a4dc217a90 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.439+0000 7fc32b7fe640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3180a2d70 0x7fc3180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.439+0000 7fc3227fc640 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc217a90 0x55a4dc219e80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc31400bf90 tx=0x7fc31400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2103f53b91a2fadd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.439+0000 7fc328ff9640 1 -- 172.21.15.2:0/2233846821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc3240f0680 con 0x7fc32c106f10 2024-09-12T00:59:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.439+0000 7fc3217fa640 1 -- 172.21.15.2:0/3920927250 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314004030 con 0x55a4dc217a90 2024-09-12T00:59:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.439+0000 7fc3217fa640 1 -- 172.21.15.2:0/3920927250 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc314005500 con 0x55a4dc217a90 2024-09-12T00:59:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.439+0000 7fc3217fa640 1 -- 172.21.15.2:0/3920927250 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314004d30 con 0x55a4dc217a90 2024-09-12T00:59:01.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 -- 172.21.15.2:0/3920927250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc217a90 msgr2=0x55a4dc219e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc32b7fe640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3180a2d70 0x7fc3180a5230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc3240edf40 tx=0x7fc3240b90e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc217a90 0x55a4dc219e80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc31400bf90 tx=0x7fc31400b480 comp rx=0 tx=0).stop 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 -- 172.21.15.2:0/3920927250 shutdown_connections 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc217a90 0x55a4dc219e80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc217550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 --2- 172.21.15.2:0/3920927250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 0x55a4dc208780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 -- 172.21.15.2:0/3920927250 >> 172.21.15.2:0/3920927250 conn(0x55a4dc204a30 msgr2=0x55a4dc204e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 -- 172.21.15.2:0/3920927250 shutdown_connections 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 -- 172.21.15.2:0/3920927250 wait complete. 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 -- start start 2024-09-12T00:59:01.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.440+0000 7fc333675740 1 Processor -- start 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc333675740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 0x55a4dc217470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc333675740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc214770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc333675740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc217a90 0x55a4dc214dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc333675740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4dc21a6c0 con 0x55a4dc208cc0 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc333675740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a4dc129050 con 0x55a4dc2083a0 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc333675740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a4dc21a840 con 0x55a4dc217a90 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc214770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc333675740 10 client.0 _ll_register_callbacks cb 0x55a4dc169160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc214770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50602/0 (socket says 172.21.15.2:50602) 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 -- 172.21.15.2:0/4283570639 learned_addr learned my addr 172.21.15.2:0/4283570639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc3227fc640 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc217a90 0x55a4dc214dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc3227fc640 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 0x55a4dc217470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 -- 172.21.15.2:0/4283570639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc217a90 msgr2=0x55a4dc214dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc217a90 0x55a4dc214dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 -- 172.21.15.2:0/4283570639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 msgr2=0x55a4dc217470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 0x55a4dc217470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 -- 172.21.15.2:0/4283570639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4dbedf3c0 con 0x55a4dc208cc0 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc3227fc640 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc217a90 0x55a4dc214dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc32affd640 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc214770 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0127d0 tx=0x7fc31c012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe36cc8a068594c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc3127fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.441+0000 7fc3127fc640 1 -- 172.21.15.2:0/4283570639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c01f060 con 0x55a4dc208cc0 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.442+0000 7fc3127fc640 1 -- 172.21.15.2:0/4283570639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc31c010dc0 con 0x55a4dc208cc0 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.442+0000 7fc333675740 1 -- 172.21.15.2:0/4283570639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc314005500 con 0x55a4dc208cc0 2024-09-12T00:59:01.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.442+0000 7fc3127fc640 1 -- 172.21.15.2:0/4283570639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc31c01a430 con 0x55a4dc208cc0 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.442+0000 7fc333675740 10 client.16575 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.442+0000 7fc333675740 1 -- 172.21.15.2:0/4283570639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a4dc2261f0 con 0x55a4dc208cc0 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.442+0000 7fc3127fc640 1 -- 172.21.15.2:0/4283570639 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc314005500 con 0x55a4dc208cc0 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.442+0000 7fc3127fc640 1 -- 172.21.15.2:0/4283570639 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc31c00e650 con 0x55a4dc208cc0 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc333675740 10 client.16575 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc333675740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc333675740 20 client.16575 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc333675740 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a4dc2276b0 0x55a4dc229ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc333675740 4 client.16575 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc333675740 1 -- 172.21.15.2:0/4283570639 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4dc17b850 con 0x55a4dc2276b0 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc3227fc640 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a4dc2276b0 0x55a4dc229ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc3127fc640 10 client.16575 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.443+0000 7fc3227fc640 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a4dc2276b0 0x55a4dc229ac0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c515e7212daa5c5 server_cookie=35297c8718b7cdda in_seq=0 out_seq=0 2024-09-12T00:59:01.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc3127fc640 1 -- 172.21.15.2:0/4283570639 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4dc17b850 con 0x55a4dc2276b0 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc3127fc640 10 client.16575 handle_command_reply: tid=0 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 client.16575 shutdown 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 -- 172.21.15.2:0/4283570639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 msgr2=0x55a4dc214770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc214770 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0127d0 tx=0x7fc31c012c90 comp rx=0 tx=0).stop 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 -- 172.21.15.2:0/4283570639 shutdown_connections 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a4dc2276b0 0x55a4dc229ac0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc217a90 0x55a4dc214dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc214770 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 --2- 172.21.15.2:0/4283570639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc2083a0 0x55a4dc217470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc333675740 1 -- 172.21.15.2:0/4283570639 >> 172.21.15.2:0/4283570639 conn(0x55a4dc204a30 msgr2=0x55a4dc20a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.444+0000 7fc3127fc640 0 client.16575 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.445+0000 7fc333675740 1 -- 172.21.15.2:0/4283570639 shutdown_connections 2024-09-12T00:59:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.445+0000 7fc333675740 1 -- 172.21.15.2:0/4283570639 wait complete. 2024-09-12T00:59:01.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.445+0000 7fc333675740 20 client.16575 trim_cache size 0 max 16384 2024-09-12T00:59:01.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc333675740 1 Processor -- start 2024-09-12T00:59:01.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc333675740 1 -- start start 2024-09-12T00:59:01.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc333675740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc2083a0 0x55a4dc223960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc333675740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc20fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc333675740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 0x55a4dc22f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc333675740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1ae050 con 0x55a4dc2083a0 2024-09-12T00:59:01.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc333675740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1ab890 con 0x55a4dc217a90 2024-09-12T00:59:01.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc333675740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1a9700 con 0x55a4dc208cc0 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc3227fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc2083a0 0x55a4dc223960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc3227fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc2083a0 0x55a4dc223960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50616/0 (socket says 172.21.15.2:50616) 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc3227fc640 1 -- 172.21.15.2:0/3349995896 learned_addr learned my addr 172.21.15.2:0/3349995896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc32affd640 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc20fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc3227fc640 1 -- 172.21.15.2:0/3349995896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 msgr2=0x55a4dc20fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc3227fc640 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc20fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc3227fc640 1 -- 172.21.15.2:0/3349995896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 msgr2=0x55a4dc22f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc3227fc640 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 0x55a4dc22f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc3227fc640 1 -- 172.21.15.2:0/3349995896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4dc215140 con 0x55a4dc2083a0 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.462+0000 7fc32affd640 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc20fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.463+0000 7fc3227fc640 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc2083a0 0x55a4dc223960 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55a4dc209f40 tx=0x7fc31400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfea2cc7ee9eaf92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.463+0000 7fc320ff9640 1 -- 172.21.15.2:0/3349995896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314004040 con 0x55a4dc2083a0 2024-09-12T00:59:01.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.463+0000 7fc320ff9640 1 -- 172.21.15.2:0/3349995896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3140046c0 con 0x55a4dc2083a0 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.463+0000 7fc320ff9640 1 -- 172.21.15.2:0/3349995896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3140035f0 con 0x55a4dc2083a0 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.463+0000 7fc333675740 1 -- 172.21.15.2:0/3349995896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc2083a0 msgr2=0x55a4dc223960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.463+0000 7fc333675740 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc2083a0 0x55a4dc223960 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55a4dc209f40 tx=0x7fc31400b830 comp rx=0 tx=0).stop 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 -- 172.21.15.2:0/3349995896 shutdown_connections 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 0x55a4dc22f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc208cc0 0x55a4dc20fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 --2- 172.21.15.2:0/3349995896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc2083a0 0x55a4dc223960 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 -- 172.21.15.2:0/3349995896 >> 172.21.15.2:0/3349995896 conn(0x55a4dc204a30 msgr2=0x55a4dc20f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 -- 172.21.15.2:0/3349995896 shutdown_connections 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 -- 172.21.15.2:0/3349995896 wait complete. 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 -- start start 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 Processor -- start 2024-09-12T00:59:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc2083a0 0x55a4dc21b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc21b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 0x55a4dc28a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1a9d50 con 0x55a4dc208cc0 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1ab1c0 con 0x55a4dc217a90 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1aa420 con 0x55a4dc2083a0 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc333675740 10 client.0 _ll_register_callbacks cb 0x7fc31c00a690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc32affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc21b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc32affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc21b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50624/0 (socket says 172.21.15.2:50624) 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.464+0000 7fc32affd640 1 -- 172.21.15.2:0/2227929414 learned_addr learned my addr 172.21.15.2:0/2227929414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc3227fc640 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc2083a0 0x55a4dc21b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc3227fc640 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 0x55a4dc28a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc32affd640 1 -- 172.21.15.2:0/2227929414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc2083a0 msgr2=0x55a4dc21b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc32affd640 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc2083a0 0x55a4dc21b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc32affd640 1 -- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 msgr2=0x55a4dc28a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc32affd640 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 0x55a4dc28a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc32affd640 1 -- 172.21.15.2:0/2227929414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4dc28a960 con 0x55a4dc208cc0 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc3227fc640 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 0x55a4dc28a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc32affd640 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc21b7a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00ec60 tx=0x7fc31c010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a089cec2ecc2749 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc3127fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc3127fc640 1 -- 172.21.15.2:0/2227929414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c02f070 con 0x55a4dc208cc0 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc3127fc640 1 -- 172.21.15.2:0/2227929414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc31c00e3b0 con 0x55a4dc208cc0 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc333675740 1 -- 172.21.15.2:0/2227929414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3140046c0 con 0x55a4dc208cc0 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc3127fc640 1 -- 172.21.15.2:0/2227929414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc31c038050 con 0x55a4dc208cc0 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc333675740 10 client.16581 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.465+0000 7fc333675740 1 -- 172.21.15.2:0/2227929414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a4dc291c90 con 0x55a4dc208cc0 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc3127fc640 1 -- 172.21.15.2:0/2227929414 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3140046c0 con 0x55a4dc208cc0 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc3127fc640 1 -- 172.21.15.2:0/2227929414 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc31c032020 con 0x55a4dc208cc0 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc333675740 10 client.16581 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc333675740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc333675740 20 client.16581 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc333675740 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a4dc292490 0x55a4dc2948b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc333675740 4 client.16581 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc333675740 1 -- 172.21.15.2:0/2227929414 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a4dc175d60 con 0x55a4dc292490 2024-09-12T00:59:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.466+0000 7fc3227fc640 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a4dc292490 0x55a4dc2948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc3227fc640 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a4dc292490 0x55a4dc2948b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73eb0e84ca989fc server_cookie=5d3955c5497841d0 in_seq=0 out_seq=0 2024-09-12T00:59:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc3127fc640 10 client.16581 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc3127fc640 1 -- 172.21.15.2:0/2227929414 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a4dc175d60 con 0x55a4dc292490 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc3127fc640 10 client.16581 handle_command_reply: tid=0 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 client.16581 shutdown 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 -- 172.21.15.2:0/2227929414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 msgr2=0x55a4dc21b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc21b7a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00ec60 tx=0x7fc31c010e70 comp rx=0 tx=0).stop 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 -- 172.21.15.2:0/2227929414 shutdown_connections 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a4dc292490 0x55a4dc2948b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4dc217a90 0x55a4dc28a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4dc208cc0 0x55a4dc21b7a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 --2- 172.21.15.2:0/2227929414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a4dc2083a0 0x55a4dc21b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 -- 172.21.15.2:0/2227929414 >> 172.21.15.2:0/2227929414 conn(0x55a4dc204a30 msgr2=0x55a4dc20f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc3127fc640 0 client.16581 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 -- 172.21.15.2:0/2227929414 shutdown_connections 2024-09-12T00:59:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 1 -- 172.21.15.2:0/2227929414 wait complete. 2024-09-12T00:59:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.467+0000 7fc333675740 20 client.16581 trim_cache size 0 max 16384 2024-09-12T00:59:01.473 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:01.473 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:59:01.473 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:59:01.473 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 -- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3180a2d70 msgr2=0x7fc3180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3180a2d70 0x7fc3180a5230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc3240edf40 tx=0x7fc3240b90e0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 -- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 msgr2=0x7fc32c19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 0x7fc32c19cbb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc324031a60 tx=0x7fc324031a90 comp rx=0 tx=0).stop 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 -- 172.21.15.2:0/2233846821 shutdown_connections 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3180a2d70 0x7fc3180a5230 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c106f10 0x7fc32c19cbb0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc32c102790 0x7fc32c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 --2- 172.21.15.2:0/2233846821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32c101de0 0x7fc32c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 -- 172.21.15.2:0/2233846821 >> 172.21.15.2:0/2233846821 conn(0x7fc32c0fd8c0 msgr2=0x7fc32c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 -- 172.21.15.2:0/2233846821 shutdown_connections 2024-09-12T00:59:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:01.468+0000 7fc33129c640 1 -- 172.21.15.2:0/2233846821 wait complete. 2024-09-12T00:59:02.323 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:59:02.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:59:02.585 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:02.706 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:02 smithi002 ceph-mon[31210]: pgmap v186: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 361 op/s 2024-09-12T00:59:02.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:02 smithi167 ceph-mon[35234]: pgmap v186: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 361 op/s 2024-09-12T00:59:02.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:02 smithi071 ceph-mon[35276]: pgmap v186: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 361 op/s 2024-09-12T00:59:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.030+0000 7f97288bb640 1 -- 172.21.15.2:0/2705485694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724102a50 msgr2=0x7f9724102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.030+0000 7f97288bb640 1 --2- 172.21.15.2:0/2705485694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724102a50 0x7f9724102e30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9714009900 tx=0x7f971402a410 comp rx=0 tx=0).stop 2024-09-12T00:59:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.031+0000 7f97288bb640 1 -- 172.21.15.2:0/2705485694 shutdown_connections 2024-09-12T00:59:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.031+0000 7f97288bb640 1 --2- 172.21.15.2:0/2705485694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9724100c80 0x7f9724110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.031+0000 7f97288bb640 1 --2- 172.21.15.2:0/2705485694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9724100100 0x7f9724100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.031+0000 7f97288bb640 1 --2- 172.21.15.2:0/2705485694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724102a50 0x7f9724102e30 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.031+0000 7f97288bb640 1 -- 172.21.15.2:0/2705485694 >> 172.21.15.2:0/2705485694 conn(0x7f9724077230 msgr2=0x7f97240fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.031+0000 7f97288bb640 1 -- 172.21.15.2:0/2705485694 shutdown_connections 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.031+0000 7f97288bb640 1 -- 172.21.15.2:0/2705485694 wait complete. 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f97288bb640 1 Processor -- start 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f97288bb640 1 -- start start 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f97288bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724100100 0x7f972419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f97288bb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9724100c80 0x7f972419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f97288bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9724102a50 0x7f972419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f97288bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9724114120 con 0x7f9724100100 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f97288bb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9724113fa0 con 0x7f9724100c80 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f97288bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f97241142a0 con 0x7f9724102a50 2024-09-12T00:59:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f972259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724100100 0x7f972419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f971bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9724100c80 0x7f972419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f971bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9724100c80 0x7f972419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:58020/0 (socket says 172.21.15.2:58020) 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f971bfff640 1 -- 172.21.15.2:0/3095939581 learned_addr learned my addr 172.21.15.2:0/3095939581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f9722d9d640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9724102a50 0x7f972419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f972259c640 1 -- 172.21.15.2:0/3095939581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9724102a50 msgr2=0x7f972419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f972259c640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9724102a50 0x7f972419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f972259c640 1 -- 172.21.15.2:0/3095939581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9724100c80 msgr2=0x7f972419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.032+0000 7f972259c640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9724100c80 0x7f972419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.033+0000 7f972259c640 1 -- 172.21.15.2:0/3095939581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972419f5c0 con 0x7f9724100100 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.033+0000 7f971bfff640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9724100c80 0x7f972419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.033+0000 7f972259c640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724100100 0x7f972419a610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9714005940 tx=0x7f97140040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.033+0000 7f971b7fe640 1 -- 172.21.15.2:0/3095939581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971403f030 con 0x7f9724100100 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.033+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f972419f850 con 0x7f9724100100 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.033+0000 7f971b7fe640 1 -- 172.21.15.2:0/3095939581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97140044c0 con 0x7f9724100100 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.033+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97241a7190 con 0x7f9724100100 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.033+0000 7f971b7fe640 1 -- 172.21.15.2:0/3095939581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714049060 con 0x7f9724100100 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.034+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972419b970 con 0x7f9724100100 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.036+0000 7f971b7fe640 1 -- 172.21.15.2:0/3095939581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f9714042030 con 0x7f9724100100 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.036+0000 7f971b7fe640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f97100a2cf0 0x7f97100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.037+0000 7f971bfff640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f97100a2cf0 0x7f97100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.037+0000 7f971b7fe640 1 -- 172.21.15.2:0/3095939581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f97140efcc0 con 0x7f9724100100 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.037+0000 7f971bfff640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f97100a2cf0 0x7f97100a51b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97240ff840 tx=0x7f970c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.039+0000 7f971b7fe640 1 -- 172.21.15.2:0/3095939581 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97140bc240 con 0x7f9724100100 2024-09-12T00:59:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.252+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f972410bf60 con 0x7f9724100100 2024-09-12T00:59:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.253+0000 7f971b7fe640 1 -- 172.21.15.2:0/3095939581 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7f972410bf60 con 0x7f9724100100 2024-09-12T00:59:03.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:59:03.252 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:59:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T00:59:03.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f97100a2cf0 msgr2=0x7f97100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:03.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f97100a2cf0 0x7f97100a51b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97240ff840 tx=0x7f970c005f90 comp rx=0 tx=0).stop 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724100100 msgr2=0x7f972419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724100100 0x7f972419a610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9714005940 tx=0x7f97140040c0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 shutdown_connections 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f97100a2cf0 0x7f97100a51b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9724102a50 0x7f972419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9724100c80 0x7f972419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 --2- 172.21.15.2:0/3095939581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9724100100 0x7f972419a610 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 >> 172.21.15.2:0/3095939581 conn(0x7f9724077230 msgr2=0x7f97240fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.255+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 shutdown_connections 2024-09-12T00:59:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:03.256+0000 7f97288bb640 1 -- 172.21.15.2:0/3095939581 wait complete. 2024-09-12T00:59:03.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:03 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3095939581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:03.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:03 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3095939581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:03.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:03 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3095939581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:04.000 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:59:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:04.707 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:04 smithi002 ceph-mon[31210]: pgmap v187: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 679 KiB/s wr, 136 op/s 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 -- 172.21.15.2:0/152299100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34106a80 msgr2=0x7fab34106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 --2- 172.21.15.2:0/152299100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34106a80 0x7fab34106e60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fab28009930 tx=0x7fab2802a420 comp rx=0 tx=0).stop 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 -- 172.21.15.2:0/152299100 shutdown_connections 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 --2- 172.21.15.2:0/152299100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab34101420 0x7fab3410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 --2- 172.21.15.2:0/152299100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab34100a80 0x7fab34100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 --2- 172.21.15.2:0/152299100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34106a80 0x7fab34106e60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 -- 172.21.15.2:0/152299100 >> 172.21.15.2:0/152299100 conn(0x7fab340fc7a0 msgr2=0x7fab340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 -- 172.21.15.2:0/152299100 shutdown_connections 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 -- 172.21.15.2:0/152299100 wait complete. 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.708+0000 7fab3c052640 1 Processor -- start 2024-09-12T00:59:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab3c052640 1 -- start start 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab3c052640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34100a80 0x7fab3419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab3c052640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab34101420 0x7fab3419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab3c052640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab34106a80 0x7fab3419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab3c052640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab34110e40 con 0x7fab34100a80 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab3c052640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab34110cc0 con 0x7fab34106a80 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab3c052640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab34110fc0 con 0x7fab34101420 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab39dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34100a80 0x7fab3419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab39dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34100a80 0x7fab3419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50650/0 (socket says 172.21.15.2:50650) 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab39dee640 1 -- 172.21.15.2:0/2606733852 learned_addr learned my addr 172.21.15.2:0/2606733852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab3a5ef640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab34106a80 0x7fab3419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab395ed640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab34101420 0x7fab3419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab39dee640 1 -- 172.21.15.2:0/2606733852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab34101420 msgr2=0x7fab3419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab39dee640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab34101420 0x7fab3419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab39dee640 1 -- 172.21.15.2:0/2606733852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab34106a80 msgr2=0x7fab3419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab39dee640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab34106a80 0x7fab3419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.709+0000 7fab39dee640 1 -- 172.21.15.2:0/2606733852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3419f660 con 0x7fab34100a80 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.710+0000 7fab39dee640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34100a80 0x7fab3419a6b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fab28009230 tx=0x7fab28004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.710+0000 7fab26ffd640 1 -- 172.21.15.2:0/2606733852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2803f030 con 0x7fab34100a80 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.710+0000 7fab26ffd640 1 -- 172.21.15.2:0/2606733852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab28003ad0 con 0x7fab34100a80 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.710+0000 7fab3c052640 1 -- 172.21.15.2:0/2606733852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3419f8f0 con 0x7fab34100a80 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.710+0000 7fab26ffd640 1 -- 172.21.15.2:0/2606733852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28035070 con 0x7fab34100a80 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.710+0000 7fab3c052640 1 -- 172.21.15.2:0/2606733852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab341a7230 con 0x7fab34100a80 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.712+0000 7fab26ffd640 1 -- 172.21.15.2:0/2606733852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fab28042030 con 0x7fab34100a80 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.712+0000 7fab3e42b740 1 Processor -- start 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3e42b740 1 -- start start 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3c9dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3e42b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea3c9352f0 con 0x55ea3c9d0b40 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3e42b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ea3c8dccf0 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3e42b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea3c9312b0 con 0x55ea3c9da370 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3a5ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3a5ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50666/0 (socket says 172.21.15.2:50666) 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3a5ef640 1 -- 172.21.15.2:0/2944962760 learned_addr learned my addr 172.21.15.2:0/2944962760 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab26ffd640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab200a2d70 0x7fab200a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab39dee640 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab395ed640 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3c9dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3a5ef640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab200a2d70 0x7fab200a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3a5ef640 1 -- 172.21.15.2:0/2944962760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 msgr2=0x55ea3c9dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3a5ef640 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3c9dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3a5ef640 1 -- 172.21.15.2:0/2944962760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 msgr2=0x55ea3c9cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.713+0000 7fab3a5ef640 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.714+0000 7fab3a5ef640 1 -- 172.21.15.2:0/2944962760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea3c8c13a0 con 0x55ea3c9d0b40 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.714+0000 7fab26ffd640 1 -- 172.21.15.2:0/2606733852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fab280ef990 con 0x7fab34100a80 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.714+0000 7fab3a5ef640 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9cf090 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fab2c014a60 tx=0x7fab2c014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583a5d08de7be0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.714+0000 7fab1ffff640 1 -- 172.21.15.2:0/2944962760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c01ec50 con 0x55ea3c9d0b40 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.714+0000 7fab1ffff640 1 -- 172.21.15.2:0/2944962760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2c023070 con 0x55ea3c9d0b40 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.714+0000 7fab3a5ef640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab200a2d70 0x7fab200a5230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fab2c022000 tx=0x7fab2c01e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.714+0000 7fab1ffff640 1 -- 172.21.15.2:0/2944962760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c01de00 con 0x55ea3c9d0b40 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 -- 172.21.15.2:0/2944962760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 msgr2=0x55ea3c9cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9cf090 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fab2c014a60 tx=0x7fab2c014f20 comp rx=0 tx=0).stop 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 -- 172.21.15.2:0/2944962760 shutdown_connections 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3c9dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 --2- 172.21.15.2:0/2944962760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9cf090 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 -- 172.21.15.2:0/2944962760 >> 172.21.15.2:0/2944962760 conn(0x55ea3c998310 msgr2=0x55ea3c9cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 -- 172.21.15.2:0/2944962760 shutdown_connections 2024-09-12T00:59:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 -- 172.21.15.2:0/2944962760 wait complete. 2024-09-12T00:59:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 -- start start 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.715+0000 7fab3e42b740 1 Processor -- start 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9d7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3c9d7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab3e42b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea3c9dd070 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab3e42b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ea3c8f0060 con 0x55ea3c9d0b40 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab3e42b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea3c9dd1f0 con 0x55ea3c9da370 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab3e42b740 10 client.0 _ll_register_callbacks cb 0x55ea3c6438c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab39dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab39dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50672/0 (socket says 172.21.15.2:50672) 2024-09-12T00:59:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab39dee640 1 -- 172.21.15.2:0/3839903658 learned_addr learned my addr 172.21.15.2:0/3839903658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab395ed640 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9d7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab3a5ef640 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3c9d7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab39dee640 1 -- 172.21.15.2:0/3839903658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 msgr2=0x55ea3c9d7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab39dee640 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3c9d7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab39dee640 1 -- 172.21.15.2:0/3839903658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9d0b40 msgr2=0x55ea3c9d7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.716+0000 7fab39dee640 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9d7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab39dee640 1 -- 172.21.15.2:0/3839903658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea3c6a63c0 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab39dee640 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d9d90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fab28009a50 tx=0x7fab2802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dab4169360ec90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab1d7fa640 1 -- 172.21.15.2:0/3839903658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28049070 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab3e42b740 1 -- 172.21.15.2:0/3839903658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab2c023070 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab1d7fa640 1 -- 172.21.15.2:0/3839903658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fab280b8470 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab1d7fa640 1 -- 172.21.15.2:0/3839903658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fab280c01b0 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab3e42b740 10 client.16599 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab3e42b740 1 -- 172.21.15.2:0/3839903658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ea3c9e8b40 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.717+0000 7fab1d7fa640 1 -- 172.21.15.2:0/3839903658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2c023070 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab1d7fa640 1 -- 172.21.15.2:0/3839903658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fab28031bd0 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab3e42b740 10 client.16599 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab3e42b740 10 client.16599 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab3e42b740 20 client.16599 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ea3c9ea030 0x55ea3c9ec490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab3e42b740 4 client.16599 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab3e42b740 1 -- 172.21.15.2:0/3839903658 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea3c942860 con 0x55ea3c9ea030 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab395ed640 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ea3c9ea030 0x55ea3c9ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab395ed640 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ea3c9ea030 0x55ea3c9ec490 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2dbe4a199916f6d server_cookie=5d8329d2265234de in_seq=0 out_seq=0 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.718+0000 7fab1d7fa640 10 client.16599 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab1d7fa640 1 -- 172.21.15.2:0/3839903658 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea3c942860 con 0x55ea3c9ea030 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab1d7fa640 10 client.16599 handle_command_reply: tid=0 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 client.16599 shutdown 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 -- 172.21.15.2:0/3839903658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 msgr2=0x55ea3c9d9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d9d90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fab28009a50 tx=0x7fab2802a420 comp rx=0 tx=0).stop 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 -- 172.21.15.2:0/3839903658 shutdown_connections 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ea3c9ea030 0x55ea3c9ec490 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3c9d7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9d7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab1d7fa640 0 client.16599 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3839903658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d9d90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.719+0000 7fab3e42b740 1 -- 172.21.15.2:0/3839903658 >> 172.21.15.2:0/3839903658 conn(0x55ea3c998310 msgr2=0x55ea3c9d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.720+0000 7fab3e42b740 1 -- 172.21.15.2:0/3839903658 shutdown_connections 2024-09-12T00:59:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.720+0000 7fab3e42b740 1 -- 172.21.15.2:0/3839903658 wait complete. 2024-09-12T00:59:04.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.720+0000 7fab3e42b740 20 client.16599 trim_cache size 0 max 16384 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.735+0000 7fab3e42b740 1 Processor -- start 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.735+0000 7fab3e42b740 1 -- start start 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9da370 0x55ea3c9f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab3e42b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab341b2450 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab3e42b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab341afc90 con 0x55ea3c9da370 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab3e42b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab341adae0 con 0x55ea3c9d0b40 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50678/0 (socket says 172.21.15.2:50678) 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 -- 172.21.15.2:0/3031687337 learned_addr learned my addr 172.21.15.2:0/3031687337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab395ed640 1 --2- 172.21.15.2:0/3031687337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 -- 172.21.15.2:0/3031687337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9d0b40 msgr2=0x55ea3c9d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:04.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 --2- 172.21.15.2:0/3031687337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 -- 172.21.15.2:0/3031687337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9da370 msgr2=0x55ea3c9f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:04.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 --2- 172.21.15.2:0/3031687337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9da370 0x55ea3c9f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 -- 172.21.15.2:0/3031687337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea3c9ecb10 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab39dee640 1 --2- 172.21.15.2:0/3031687337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d2120 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fab28046040 tx=0x7fab28005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd36c26c5790dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab1f7fe640 1 -- 172.21.15.2:0/3031687337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab280d9020 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab1f7fe640 1 -- 172.21.15.2:0/3031687337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab280bf060 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.736+0000 7fab1f7fe640 1 -- 172.21.15.2:0/3031687337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28049070 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 -- 172.21.15.2:0/3031687337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 msgr2=0x55ea3c9d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3031687337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d2120 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fab28046040 tx=0x7fab28005e50 comp rx=0 tx=0).stop 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 -- 172.21.15.2:0/3031687337 shutdown_connections 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3031687337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9da370 0x55ea3c9f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3031687337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 --2- 172.21.15.2:0/3031687337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9d2120 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 -- 172.21.15.2:0/3031687337 >> 172.21.15.2:0/3031687337 conn(0x55ea3c998310 msgr2=0x55ea3c9cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 -- 172.21.15.2:0/3031687337 shutdown_connections 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 -- 172.21.15.2:0/3031687337 wait complete. 2024-09-12T00:59:04.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 -- start start 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.737+0000 7fab3e42b740 1 Processor -- start 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9de8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9dede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab3e42b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3ca53d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab3e42b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab341ae150 con 0x55ea3c9d0b40 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab3e42b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab341af5c0 con 0x55ea3c9cf5d0 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab3e42b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab341ae820 con 0x55ea3c9da370 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab3e42b740 10 client.0 _ll_register_callbacks cb 0x7fab280b7a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab395ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab395ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9dede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50688/0 (socket says 172.21.15.2:50688) 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab395ed640 1 -- 172.21.15.2:0/1799031300 learned_addr learned my addr 172.21.15.2:0/1799031300 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab39dee640 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9de8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab3a5ef640 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3ca53d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab395ed640 1 -- 172.21.15.2:0/1799031300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 msgr2=0x55ea3ca53d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab395ed640 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3ca53d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab395ed640 1 -- 172.21.15.2:0/1799031300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 msgr2=0x55ea3c9de8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab395ed640 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9de8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.738+0000 7fab395ed640 1 -- 172.21.15.2:0/1799031300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea3c9d7fe0 con 0x55ea3c9d0b40 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab395ed640 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9dede0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fab30004700 tx=0x7fab3001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47ff3b6e6b6825c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab1d7fa640 1 -- 172.21.15.2:0/1799031300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30004230 con 0x55ea3c9d0b40 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab1d7fa640 1 -- 172.21.15.2:0/1799031300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fab300043d0 con 0x55ea3c9d0b40 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 1 -- 172.21.15.2:0/1799031300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab280bf060 con 0x55ea3c9d0b40 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab1d7fa640 1 -- 172.21.15.2:0/1799031300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fab30012660 con 0x55ea3c9d0b40 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 10 client.16605 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:04.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 1 -- 172.21.15.2:0/1799031300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ea3ca553c0 con 0x55ea3c9d0b40 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab1d7fa640 1 -- 172.21.15.2:0/1799031300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab280bf060 con 0x55ea3c9d0b40 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab1d7fa640 1 -- 172.21.15.2:0/1799031300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fab30003b10 con 0x55ea3c9d0b40 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 10 client.16605 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 10 client.16605 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 20 client.16605 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ea3ca55b80 0x55ea3ca57fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 4 client.16605 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.739+0000 7fab3e42b740 1 -- 172.21.15.2:0/1799031300 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea3c93cd70 con 0x55ea3ca55b80 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab39dee640 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ea3ca55b80 0x55ea3ca57fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab39dee640 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ea3ca55b80 0x55ea3ca57fa0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b03d750e64b5fd6 server_cookie=1d94a4cb9d4e329 in_seq=0 out_seq=0 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab1d7fa640 10 client.16605 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab1d7fa640 1 -- 172.21.15.2:0/1799031300 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea3c93cd70 con 0x55ea3ca55b80 2024-09-12T00:59:04.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab1d7fa640 10 client.16605 handle_command_reply: tid=0 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab3e42b740 1 client.16605 shutdown 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab3e42b740 1 -- 172.21.15.2:0/1799031300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 msgr2=0x55ea3c9dede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab3e42b740 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9dede0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fab30004700 tx=0x7fab3001c6e0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.740+0000 7fab3e42b740 1 -- 172.21.15.2:0/1799031300 shutdown_connections 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3e42b740 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55ea3ca55b80 0x55ea3ca57fa0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3e42b740 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3c9da370 0x55ea3ca53d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3e42b740 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3c9d0b40 0x55ea3c9dede0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3e42b740 1 --2- 172.21.15.2:0/1799031300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3c9cf5d0 0x55ea3c9de8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab1d7fa640 0 client.16605 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3e42b740 1 -- 172.21.15.2:0/1799031300 >> 172.21.15.2:0/1799031300 conn(0x55ea3c998310 msgr2=0x55ea3c9cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3e42b740 1 -- 172.21.15.2:0/1799031300 shutdown_connections 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3e42b740 1 -- 172.21.15.2:0/1799031300 wait complete. 2024-09-12T00:59:04.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3e42b740 20 client.16605 trim_cache size 0 max 16384 2024-09-12T00:59:04.745 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:04.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 -- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab200a2d70 msgr2=0x7fab200a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab200a2d70 0x7fab200a5230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fab2c022000 tx=0x7fab2c01e000 comp rx=0 tx=0).stop 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 -- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34100a80 msgr2=0x7fab3419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34100a80 0x7fab3419a6b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fab28009230 tx=0x7fab28004270 comp rx=0 tx=0).stop 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 -- 172.21.15.2:0/2606733852 shutdown_connections 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fab200a2d70 0x7fab200a5230 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab34106a80 0x7fab3419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab34101420 0x7fab3419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 --2- 172.21.15.2:0/2606733852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34100a80 0x7fab3419a6b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 -- 172.21.15.2:0/2606733852 >> 172.21.15.2:0/2606733852 conn(0x7fab340fc7a0 msgr2=0x7fab3406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 -- 172.21.15.2:0/2606733852 shutdown_connections 2024-09-12T00:59:04.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:04.741+0000 7fab3c052640 1 -- 172.21.15.2:0/2606733852 wait complete. 2024-09-12T00:59:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:04 smithi167 ceph-mon[35234]: pgmap v187: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 679 KiB/s wr, 136 op/s 2024-09-12T00:59:04.843 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:04 smithi071 ceph-mon[35276]: pgmap v187: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 679 KiB/s wr, 136 op/s 2024-09-12T00:59:05.518 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:59:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:06.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 -- 172.21.15.2:0/3681908799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760102d40 msgr2=0x7fd760103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 --2- 172.21.15.2:0/3681908799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760102d40 0x7fd760103120 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd750009900 tx=0x7fd75002a480 comp rx=0 tx=0).stop 2024-09-12T00:59:06.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 -- 172.21.15.2:0/3681908799 shutdown_connections 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 --2- 172.21.15.2:0/3681908799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd76010c170 0x7fd76010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 --2- 172.21.15.2:0/3681908799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd760103660 0x7fd76010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 --2- 172.21.15.2:0/3681908799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760102d40 0x7fd760103120 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 -- 172.21.15.2:0/3681908799 >> 172.21.15.2:0/3681908799 conn(0x7fd7600fc7a0 msgr2=0x7fd7600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 -- 172.21.15.2:0/3681908799 shutdown_connections 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.241+0000 7fd766194640 1 -- 172.21.15.2:0/3681908799 wait complete. 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.242+0000 7fd766194640 1 Processor -- start 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.242+0000 7fd766194640 1 -- start start 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.242+0000 7fd766194640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd760102d40 0x7fd760198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd766194640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd760103660 0x7fd7601989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd766194640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76010c170 0x7fd76019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd766194640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd760111fb0 con 0x7fd76010c170 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd766194640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd760111e30 con 0x7fd760103660 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd766194640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd760112130 con 0x7fd760102d40 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76010c170 0x7fd76019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd760102d40 0x7fd760198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76010c170 0x7fd76019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58482/0 (socket says 172.21.15.2:58482) 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 -- 172.21.15.2:0/154373108 learned_addr learned my addr 172.21.15.2:0/154373108 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75effd640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd760103660 0x7fd7601989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 -- 172.21.15.2:0/154373108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd760102d40 msgr2=0x7fd760198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd760102d40 0x7fd760198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 -- 172.21.15.2:0/154373108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd760103660 msgr2=0x7fd7601989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd760103660 0x7fd7601989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 -- 172.21.15.2:0/154373108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76019d420 con 0x7fd76010c170 2024-09-12T00:59:06.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75ffff640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76010c170 0x7fd76019cd40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd75800b970 tx=0x7fd75800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.243+0000 7fd75cff9640 1 -- 172.21.15.2:0/154373108 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758019070 con 0x7fd76010c170 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.244+0000 7fd766194640 1 -- 172.21.15.2:0/154373108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76019d710 con 0x7fd76010c170 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.244+0000 7fd75cff9640 1 -- 172.21.15.2:0/154373108 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd75800cb40 con 0x7fd76010c170 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.244+0000 7fd75cff9640 1 -- 172.21.15.2:0/154373108 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758007610 con 0x7fd76010c170 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.244+0000 7fd766194640 1 -- 172.21.15.2:0/154373108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7601a4ff0 con 0x7fd76010c170 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.246+0000 7fd75cff9640 1 -- 172.21.15.2:0/154373108 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fd75801c070 con 0x7fd76010c170 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.246+0000 7fd76856d740 1 Processor -- start 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.246+0000 7fd76856d740 1 -- start start 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.246+0000 7fd76856d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd790090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.246+0000 7fd76856d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd790a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.246+0000 7fd76856d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd79d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.246+0000 7fd76856d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bcdd6f62f0 con 0x55bcdd79b370 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd76856d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bcdd69dcf0 con 0x55bcdd7905d0 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd76856d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bcdd6f22b0 con 0x55bcdd791b40 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd79d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd79d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58494/0 (socket says 172.21.15.2:58494) 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 -- 172.21.15.2:0/1363931361 learned_addr learned my addr 172.21.15.2:0/1363931361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd790090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75cff9640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7480a2cf0 0x7fd7480a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd790a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75ffff640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7480a2cf0 0x7fd7480a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 -- 172.21.15.2:0/1363931361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 msgr2=0x55bcdd790090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd790090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 -- 172.21.15.2:0/1363931361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 msgr2=0x55bcdd790a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd790a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 -- 172.21.15.2:0/1363931361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcdd6823a0 con 0x55bcdd79b370 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75cff9640 1 -- 172.21.15.2:0/154373108 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd7580ce980 con 0x7fd76010c170 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.247+0000 7fd75effd640 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd79d760 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd754012790 tx=0x7fd75400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7c2e2e9b8829fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd75ffff640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7480a2cf0 0x7fd7480a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd758097410 tx=0x7fd7580bb040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd745ffb640 1 -- 172.21.15.2:0/1363931361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754012d10 con 0x55bcdd79b370 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd745ffb640 1 -- 172.21.15.2:0/1363931361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754010c50 con 0x55bcdd79b370 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd745ffb640 1 -- 172.21.15.2:0/1363931361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75401ea20 con 0x55bcdd79b370 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 -- 172.21.15.2:0/1363931361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 msgr2=0x55bcdd79d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd79d760 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd754012790 tx=0x7fd75400b7b0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 -- 172.21.15.2:0/1363931361 shutdown_connections 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd79d760 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd790a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 --2- 172.21.15.2:0/1363931361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd790090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 -- 172.21.15.2:0/1363931361 >> 172.21.15.2:0/1363931361 conn(0x55bcdd759310 msgr2=0x55bcdd78cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 -- 172.21.15.2:0/1363931361 shutdown_connections 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.248+0000 7fd76856d740 1 -- 172.21.15.2:0/1363931361 wait complete. 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 1 -- start start 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 1 Processor -- start 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd79ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd797ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7985e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bcdd79e070 con 0x55bcdd79b370 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bcdd6b1060 con 0x55bcdd7905d0 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bcdd79e1f0 con 0x55bcdd791b40 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd76856d740 10 client.0 _ll_register_callbacks cb 0x55bcdd4048c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:06.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd75effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd75effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58508/0 (socket says 172.21.15.2:58508) 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd75effd640 1 -- 172.21.15.2:0/1411854514 learned_addr learned my addr 172.21.15.2:0/1411854514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd75effd640 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd79ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.249+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd797ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd75effd640 1 -- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 msgr2=0x55bcdd797ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd75effd640 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd797ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd75effd640 1 -- 172.21.15.2:0/1411854514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 msgr2=0x55bcdd79ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd75effd640 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd79ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd75effd640 1 -- 172.21.15.2:0/1411854514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcdd4673c0 con 0x55bcdd79b370 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd797ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd75effd640 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7985e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd754001eb0 tx=0x7fd754014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953e7dff9e8c8efc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd73effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd73effd640 1 -- 172.21.15.2:0/1411854514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754024040 con 0x55bcdd79b370 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd73effd640 1 -- 172.21.15.2:0/1411854514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd754005050 con 0x55bcdd79b370 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd76856d740 1 -- 172.21.15.2:0/1411854514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd754010c50 con 0x55bcdd79b370 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd73effd640 1 -- 172.21.15.2:0/1411854514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd754005250 con 0x55bcdd79b370 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd76856d740 10 client.16617 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd76856d740 1 -- 172.21.15.2:0/1411854514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bcdd7a9ae0 con 0x55bcdd79b370 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.250+0000 7fd73effd640 1 -- 172.21.15.2:0/1411854514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754010c50 con 0x55bcdd79b370 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd73effd640 1 -- 172.21.15.2:0/1411854514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fd75402a070 con 0x55bcdd79b370 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd76856d740 10 client.16617 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd76856d740 10 client.16617 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd76856d740 20 client.16617 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd76856d740 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55bcdd7aaee0 0x55bcdd7ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd76856d740 4 client.16617 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd76856d740 1 -- 172.21.15.2:0/1411854514 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcdd703860 con 0x55bcdd7aaee0 2024-09-12T00:59:06.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55bcdd7aaee0 0x55bcdd7ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd73effd640 10 client.16617 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.251+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55bcdd7aaee0 0x55bcdd7ad2d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83c3f10e5b002abf server_cookie=80d81082cee9dced in_seq=0 out_seq=0 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd73effd640 1 -- 172.21.15.2:0/1411854514 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcdd703860 con 0x55bcdd7aaee0 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd73effd640 10 client.16617 handle_command_reply: tid=0 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 client.16617 shutdown 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 -- 172.21.15.2:0/1411854514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 msgr2=0x55bcdd7985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7985e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd754001eb0 tx=0x7fd754014040 comp rx=0 tx=0).stop 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 -- 172.21.15.2:0/1411854514 shutdown_connections 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55bcdd7aaee0 0x55bcdd7ad2d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7985e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd73effd640 0 client.16617 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd797ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 --2- 172.21.15.2:0/1411854514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd79ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.252+0000 7fd76856d740 1 -- 172.21.15.2:0/1411854514 >> 172.21.15.2:0/1411854514 conn(0x55bcdd759310 msgr2=0x55bcdd792960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:06.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.253+0000 7fd76856d740 1 -- 172.21.15.2:0/1411854514 shutdown_connections 2024-09-12T00:59:06.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.253+0000 7fd76856d740 1 -- 172.21.15.2:0/1411854514 wait complete. 2024-09-12T00:59:06.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.253+0000 7fd76856d740 20 client.16617 trim_cache size 0 max 16384 2024-09-12T00:59:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd76856d740 1 Processor -- start 2024-09-12T00:59:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd76856d740 1 -- start start 2024-09-12T00:59:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd76856d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd76856d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd796fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd76856d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7b2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd76856d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601b02c0 con 0x55bcdd79b370 2024-09-12T00:59:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd76856d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601adb00 con 0x55bcdd7905d0 2024-09-12T00:59:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd76856d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601ab950 con 0x55bcdd791b40 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd75effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd75effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58524/0 (socket says 172.21.15.2:58524) 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.266+0000 7fd75effd640 1 -- 172.21.15.2:0/355312859 learned_addr learned my addr 172.21.15.2:0/355312859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd75effd640 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd796fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd75effd640 1 -- 172.21.15.2:0/355312859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 msgr2=0x55bcdd796fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd75effd640 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd796fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd75effd640 1 -- 172.21.15.2:0/355312859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 msgr2=0x55bcdd7a7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd75effd640 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd75effd640 1 -- 172.21.15.2:0/355312859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcdd79df50 con 0x55bcdd79b370 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd75effd640 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7b2980 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd754005d00 tx=0x7fd75400bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e0a9e6e7e62332 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd7457fa640 1 -- 172.21.15.2:0/355312859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75401e440 con 0x55bcdd79b370 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd7457fa640 1 -- 172.21.15.2:0/355312859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754016040 con 0x55bcdd79b370 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.267+0000 7fd7457fa640 1 -- 172.21.15.2:0/355312859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754010950 con 0x55bcdd79b370 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 -- 172.21.15.2:0/355312859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 msgr2=0x55bcdd7b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7b2980 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd754005d00 tx=0x7fd75400bfb0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 -- 172.21.15.2:0/355312859 shutdown_connections 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd79b370 0x55bcdd7b2980 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd791b40 0x55bcdd796fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 --2- 172.21.15.2:0/355312859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 -- 172.21.15.2:0/355312859 >> 172.21.15.2:0/355312859 conn(0x55bcdd759310 msgr2=0x55bcdd7968c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 -- 172.21.15.2:0/355312859 shutdown_connections 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 -- 172.21.15.2:0/355312859 wait complete. 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.268+0000 7fd76856d740 1 -- start start 2024-09-12T00:59:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd76856d740 1 Processor -- start 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd76856d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd76856d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd791b40 0x55bcdd7a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd76856d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd79b370 0x55bcdd794b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd76856d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601abfc0 con 0x55bcdd7905d0 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd76856d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601ad430 con 0x55bcdd791b40 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd76856d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601ac690 con 0x55bcdd79b370 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd76856d740 10 client.0 _ll_register_callbacks cb 0x7fd750009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58534/0 (socket says 172.21.15.2:58534) 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75effd640 1 -- 172.21.15.2:0/1082944905 learned_addr learned my addr 172.21.15.2:0/1082944905 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd791b40 0x55bcdd7a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75effd640 1 -- 172.21.15.2:0/1082944905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd79b370 msgr2=0x55bcdd794b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75effd640 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd79b370 0x55bcdd794b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75effd640 1 -- 172.21.15.2:0/1082944905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd791b40 msgr2=0x55bcdd7a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75effd640 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd791b40 0x55bcdd7a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75effd640 1 -- 172.21.15.2:0/1082944905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcdd795390 con 0x55bcdd7905d0 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.269+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd791b40 0x55bcdd7a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd75effd640 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a37f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd754000c00 tx=0x7fd754004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50419ed8c7424ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd73effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd73effd640 1 -- 172.21.15.2:0/1082944905 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754043020 con 0x55bcdd7905d0 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd73effd640 1 -- 172.21.15.2:0/1082944905 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fd754004d50 con 0x55bcdd7905d0 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd76856d740 1 -- 172.21.15.2:0/1082944905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd754016040 con 0x55bcdd7905d0 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd73effd640 1 -- 172.21.15.2:0/1082944905 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd75400baa0 con 0x55bcdd7905d0 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd76856d740 10 client.16623 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:06.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd76856d740 1 -- 172.21.15.2:0/1082944905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bcdd8155b0 con 0x55bcdd7905d0 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd73effd640 1 -- 172.21.15.2:0/1082944905 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754016040 con 0x55bcdd7905d0 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd73effd640 1 -- 172.21.15.2:0/1082944905 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fd75402a070 con 0x55bcdd7905d0 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd76856d740 10 client.16623 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd76856d740 10 client.16623 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.270+0000 7fd76856d740 20 client.16623 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.271+0000 7fd76856d740 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55bcdd815c00 0x55bcdd817ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.271+0000 7fd76856d740 4 client.16623 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.271+0000 7fd76856d740 1 -- 172.21.15.2:0/1082944905 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bcdd6fdd70 con 0x55bcdd815c00 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.271+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55bcdd815c00 0x55bcdd817ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.271+0000 7fd73effd640 10 client.16623 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.271+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55bcdd815c00 0x55bcdd817ff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9e21a2afebfb849f server_cookie=1364f8dec68a6302 in_seq=0 out_seq=0 2024-09-12T00:59:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd73effd640 1 -- 172.21.15.2:0/1082944905 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bcdd6fdd70 con 0x55bcdd815c00 2024-09-12T00:59:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd73effd640 10 client.16623 handle_command_reply: tid=0 2024-09-12T00:59:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 client.16623 shutdown 2024-09-12T00:59:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 -- 172.21.15.2:0/1082944905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd7905d0 msgr2=0x55bcdd7a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a37f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd754000c00 tx=0x7fd754004600 comp rx=0 tx=0).stop 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 -- 172.21.15.2:0/1082944905 shutdown_connections 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55bcdd815c00 0x55bcdd817ff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bcdd79b370 0x55bcdd794b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bcdd791b40 0x55bcdd7a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 --2- 172.21.15.2:0/1082944905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bcdd7905d0 0x55bcdd7a37f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 -- 172.21.15.2:0/1082944905 >> 172.21.15.2:0/1082944905 conn(0x55bcdd759310 msgr2=0x55bcdd7970e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd73effd640 0 client.16623 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 -- 172.21.15.2:0/1082944905 shutdown_connections 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 1 -- 172.21.15.2:0/1082944905 wait complete. 2024-09-12T00:59:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.272+0000 7fd76856d740 20 client.16623 trim_cache size 0 max 16384 2024-09-12T00:59:06.278 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 -- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7480a2cf0 msgr2=0x7fd7480a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7480a2cf0 0x7fd7480a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd758097410 tx=0x7fd7580bb040 comp rx=0 tx=0).stop 2024-09-12T00:59:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 -- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76010c170 msgr2=0x7fd76019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76010c170 0x7fd76019cd40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd75800b970 tx=0x7fd75800be30 comp rx=0 tx=0).stop 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 -- 172.21.15.2:0/154373108 shutdown_connections 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7480a2cf0 0x7fd7480a51b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76010c170 0x7fd76019cd40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd760103660 0x7fd7601989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 --2- 172.21.15.2:0/154373108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd760102d40 0x7fd760198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 -- 172.21.15.2:0/154373108 >> 172.21.15.2:0/154373108 conn(0x7fd7600fc7a0 msgr2=0x7fd7600fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 -- 172.21.15.2:0/154373108 shutdown_connections 2024-09-12T00:59:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:06.273+0000 7fd766194640 1 -- 172.21.15.2:0/154373108 wait complete. 2024-09-12T00:59:06.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:06 smithi167 ceph-mon[35234]: pgmap v188: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 679 KiB/s wr, 136 op/s 2024-09-12T00:59:06.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:06 smithi071 ceph-mon[35276]: pgmap v188: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 679 KiB/s wr, 136 op/s 2024-09-12T00:59:06.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:06 smithi002 ceph-mon[31210]: pgmap v188: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 679 KiB/s wr, 136 op/s 2024-09-12T00:59:07.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:59:07.321 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.731+0000 7f2b8e304640 1 -- 172.21.15.2:0/3370099542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 msgr2=0x7f2b8810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.731+0000 7f2b8e304640 1 --2- 172.21.15.2:0/3370099542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 0x7f2b8810ea90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009ca0 tx=0x7f2b8002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.731+0000 7f2b8e304640 1 -- 172.21.15.2:0/3370099542 shutdown_connections 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.731+0000 7f2b8e304640 1 --2- 172.21.15.2:0/3370099542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 0x7f2b8810ea90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.731+0000 7f2b8e304640 1 --2- 172.21.15.2:0/3370099542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b88102790 0x7f2b881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.731+0000 7f2b8e304640 1 --2- 172.21.15.2:0/3370099542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b88101de0 0x7f2b881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.731+0000 7f2b8e304640 1 -- 172.21.15.2:0/3370099542 >> 172.21.15.2:0/3370099542 conn(0x7f2b880fd8c0 msgr2=0x7f2b880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.732+0000 7f2b8e304640 1 -- 172.21.15.2:0/3370099542 shutdown_connections 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.732+0000 7f2b8e304640 1 -- 172.21.15.2:0/3370099542 wait complete. 2024-09-12T00:59:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.732+0000 7f2b8e304640 1 Processor -- start 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.732+0000 7f2b8e304640 1 -- start start 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8e304640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b88101de0 0x7f2b8819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8e304640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b88102790 0x7f2b8819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8e304640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 0x7f2b8819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8e304640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88111f70 con 0x7f2b88106f10 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8e304640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88111df0 con 0x7f2b88101de0 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8e304640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881120f0 con 0x7f2b88102790 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 0x7f2b8819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 0x7f2b8819ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58550/0 (socket says 172.21.15.2:58550) 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 -- 172.21.15.2:0/2566200125 learned_addr learned my addr 172.21.15.2:0/2566200125 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b87fff640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b88101de0 0x7f2b8819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b877fe640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b88102790 0x7f2b8819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 -- 172.21.15.2:0/2566200125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b88102790 msgr2=0x7f2b8819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b88102790 0x7f2b8819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 -- 172.21.15.2:0/2566200125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b88101de0 msgr2=0x7f2b8819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b88101de0 0x7f2b8819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 -- 172.21.15.2:0/2566200125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8819f4f0 con 0x7f2b88106f10 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.733+0000 7f2b8c8a1640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 0x7f2b8819ee10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2b80031a20 tx=0x7f2b80031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.734+0000 7f2b857fa640 1 -- 172.21.15.2:0/2566200125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80003c30 con 0x7f2b88106f10 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.734+0000 7f2b8e304640 1 -- 172.21.15.2:0/2566200125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8819f780 con 0x7f2b88106f10 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.734+0000 7f2b857fa640 1 -- 172.21.15.2:0/2566200125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b80003dd0 con 0x7f2b88106f10 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.734+0000 7f2b857fa640 1 -- 172.21.15.2:0/2566200125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8002fcf0 con 0x7f2b88106f10 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.734+0000 7f2b8e304640 1 -- 172.21.15.2:0/2566200125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b881a70c0 con 0x7f2b88106f10 2024-09-12T00:59:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b857fa640 1 -- 172.21.15.2:0/2566200125 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f2b80004050 con 0x7f2b88106f10 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b906dd740 1 Processor -- start 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b906dd740 1 -- start start 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7bfb40 0x556bdd7be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7bea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7c9370 0x556bdd7cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b906dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556bdd7242f0 con 0x556bdd7bfb40 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b906dd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556bdd6cbcf0 con 0x556bdd7be5d0 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b906dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556bdd7202b0 con 0x556bdd7c9370 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7bfb40 0x556bdd7be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7bfb40 0x556bdd7be090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58566/0 (socket says 172.21.15.2:58566) 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.736+0000 7f2b877fe640 1 -- 172.21.15.2:0/209338054 learned_addr learned my addr 172.21.15.2:0/209338054 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b877fe640 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7c9370 0x556bdd7cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b87fff640 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b857fa640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2b700a2cf0 0x7f2b700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b877fe640 1 -- 172.21.15.2:0/209338054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7c9370 msgr2=0x556bdd7cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b877fe640 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7c9370 0x556bdd7cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b877fe640 1 -- 172.21.15.2:0/209338054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 msgr2=0x556bdd7bea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b877fe640 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7bea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b877fe640 1 -- 172.21.15.2:0/209338054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bdd6b03a0 con 0x556bdd7bfb40 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b87fff640 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7bea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b8c8a1640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2b700a2cf0 0x7f2b700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b857fa640 1 -- 172.21.15.2:0/2566200125 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2b800f0a30 con 0x7f2b88106f10 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b877fe640 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7bfb40 0x556bdd7be090 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c012440 tx=0x7f2b7c00c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f42bdb6909d173 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b6e7fc640 1 -- 172.21.15.2:0/209338054 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c018020 con 0x556bdd7bfb40 2024-09-12T00:59:07.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b6e7fc640 1 -- 172.21.15.2:0/209338054 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b7c00dc30 con 0x556bdd7bfb40 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.737+0000 7f2b6e7fc640 1 -- 172.21.15.2:0/209338054 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00fdf0 con 0x556bdd7bfb40 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 -- 172.21.15.2:0/209338054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7bfb40 msgr2=0x556bdd7be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7bfb40 0x556bdd7be090 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c012440 tx=0x7f2b7c00c5c0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b8c8a1640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2b700a2cf0 0x7f2b700a51b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b800b94a0 tx=0x7f2b800900b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 -- 172.21.15.2:0/209338054 shutdown_connections 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7c9370 0x556bdd7cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7bea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 --2- 172.21.15.2:0/209338054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7bfb40 0x556bdd7be090 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 -- 172.21.15.2:0/209338054 >> 172.21.15.2:0/209338054 conn(0x556bdd787310 msgr2=0x556bdd7bac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 -- 172.21.15.2:0/209338054 shutdown_connections 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 -- 172.21.15.2:0/209338054 wait complete. 2024-09-12T00:59:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.738+0000 7f2b906dd740 1 -- start start 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b906dd740 1 Processor -- start 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 0x556bdd7c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b906dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556bdd7cc070 con 0x556bdd7be5d0 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b906dd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556bdd6df060 con 0x556bdd7c9370 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b906dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556bdd7cc1f0 con 0x556bdd7bfb40 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b906dd740 10 client.0 _ll_register_callbacks cb 0x556bdd4328c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58572/0 (socket says 172.21.15.2:58572) 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 -- 172.21.15.2:0/390954261 learned_addr learned my addr 172.21.15.2:0/390954261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b87fff640 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 0x556bdd7c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 -- 172.21.15.2:0/390954261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 msgr2=0x556bdd7c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 -- 172.21.15.2:0/390954261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 msgr2=0x556bdd7c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 0x556bdd7c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.739+0000 7f2b877fe640 1 -- 172.21.15.2:0/390954261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bdd4953c0 con 0x556bdd7be5d0 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b87fff640 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b877fe640 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7c8de0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00fad0 tx=0x7f2b7c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e8a0543f4ba92e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b677fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b677fe640 1 -- 172.21.15.2:0/390954261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c018040 con 0x556bdd7be5d0 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b677fe640 1 -- 172.21.15.2:0/390954261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2b7c004230 con 0x556bdd7be5d0 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 1 -- 172.21.15.2:0/390954261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b7c00dc30 con 0x556bdd7be5d0 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b677fe640 1 -- 172.21.15.2:0/390954261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2b7c030050 con 0x556bdd7be5d0 2024-09-12T00:59:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 10 client.16635 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 1 -- 172.21.15.2:0/390954261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556bdd7d7b10 con 0x556bdd7be5d0 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b677fe640 1 -- 172.21.15.2:0/390954261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b7c00dc30 con 0x556bdd7be5d0 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b677fe640 1 -- 172.21.15.2:0/390954261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f2b7c005350 con 0x556bdd7be5d0 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 10 client.16635 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 20 client.16635 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556bdd7d8e60 0x556bdd7db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 4 client.16635 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.740+0000 7f2b906dd740 1 -- 172.21.15.2:0/390954261 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bdd731860 con 0x556bdd7d8e60 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.741+0000 7f2b87fff640 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556bdd7d8e60 0x556bdd7db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.741+0000 7f2b87fff640 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556bdd7d8e60 0x556bdd7db250 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35913ff54fb7d7b6 server_cookie=543d459cb456d364 in_seq=0 out_seq=0 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.741+0000 7f2b677fe640 10 client.16635 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b677fe640 1 -- 172.21.15.2:0/390954261 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556bdd731860 con 0x556bdd7d8e60 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b677fe640 10 client.16635 handle_command_reply: tid=0 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 client.16635 shutdown 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 -- 172.21.15.2:0/390954261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 msgr2=0x556bdd7c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7c8de0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00fad0 tx=0x7f2b7c0058b0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 -- 172.21.15.2:0/390954261 shutdown_connections 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556bdd7d8e60 0x556bdd7db250 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b677fe640 0 client.16635 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 0x556bdd7c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 --2- 172.21.15.2:0/390954261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7c8de0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 -- 172.21.15.2:0/390954261 >> 172.21.15.2:0/390954261 conn(0x556bdd787310 msgr2=0x556bdd7c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 -- 172.21.15.2:0/390954261 shutdown_connections 2024-09-12T00:59:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 1 -- 172.21.15.2:0/390954261 wait complete. 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.742+0000 7f2b906dd740 20 client.16635 trim_cache size 0 max 16384 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.756+0000 7f2b906dd740 1 Processor -- start 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.756+0000 7f2b906dd740 1 -- start start 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7d5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7ba510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 0x556bdd7baa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b906dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881b24e0 con 0x556bdd7be5d0 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b906dd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881afd20 con 0x556bdd7c9370 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b906dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881adb70 con 0x556bdd7bfb40 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7d5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58588/0 (socket says 172.21.15.2:58588) 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 -- 172.21.15.2:0/2318445150 learned_addr learned my addr 172.21.15.2:0/2318445150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b87fff640 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7ba510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 -- 172.21.15.2:0/2318445150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 msgr2=0x556bdd7ba510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7ba510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 -- 172.21.15.2:0/2318445150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 msgr2=0x556bdd7baa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 0x556bdd7baa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 -- 172.21.15.2:0/2318445150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bdd7c6b40 con 0x556bdd7be5d0 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b87fff640 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7ba510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b877fe640 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7d5310 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c010e00 tx=0x7f2b7c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a6d63755d8bcde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b6dffb640 1 -- 172.21.15.2:0/2318445150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c018040 con 0x556bdd7be5d0 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b6dffb640 1 -- 172.21.15.2:0/2318445150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b7c00c330 con 0x556bdd7be5d0 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.757+0000 7f2b6dffb640 1 -- 172.21.15.2:0/2318445150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c004df0 con 0x556bdd7be5d0 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 -- 172.21.15.2:0/2318445150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 msgr2=0x556bdd7d5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7d5310 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c010e00 tx=0x7f2b7c00cd50 comp rx=0 tx=0).stop 2024-09-12T00:59:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 -- 172.21.15.2:0/2318445150 shutdown_connections 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7c9370 0x556bdd7baa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7ba510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 --2- 172.21.15.2:0/2318445150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7be5d0 0x556bdd7d5310 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 -- 172.21.15.2:0/2318445150 >> 172.21.15.2:0/2318445150 conn(0x556bdd787310 msgr2=0x556bdd7c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 -- 172.21.15.2:0/2318445150 shutdown_connections 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 -- 172.21.15.2:0/2318445150 wait complete. 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.758+0000 7f2b906dd740 1 -- start start 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b906dd740 1 Processor -- start 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b906dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7c9370 0x556bdd7ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b906dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881ae1e0 con 0x556bdd7c9370 2024-09-12T00:59:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b906dd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881af650 con 0x556bdd7be5d0 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b906dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881ae8b0 con 0x556bdd7bfb40 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b906dd740 10 client.0 _ll_register_callbacks cb 0x7f2b7c00cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7c9370 0x556bdd7ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7c9370 0x556bdd7ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58596/0 (socket says 172.21.15.2:58596) 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 -- 172.21.15.2:0/3576921177 learned_addr learned my addr 172.21.15.2:0/3576921177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b87fff640 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 -- 172.21.15.2:0/3576921177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 msgr2=0x556bdd7d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 -- 172.21.15.2:0/3576921177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 msgr2=0x556bdd7d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b877fe640 1 -- 172.21.15.2:0/3576921177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bdd7cd5e0 con 0x556bdd7c9370 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.759+0000 7f2b87fff640 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b877fe640 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7c9370 0x556bdd7ccdb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c036040 tx=0x7f2b7c00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138f1107dd4fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b677fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b677fe640 1 -- 172.21.15.2:0/3576921177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c005000 con 0x556bdd7c9370 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b677fe640 1 -- 172.21.15.2:0/3576921177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2b7c0051a0 con 0x556bdd7c9370 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 1 -- 172.21.15.2:0/3576921177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b7c00c330 con 0x556bdd7c9370 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b677fe640 1 -- 172.21.15.2:0/3576921177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2b7c0053a0 con 0x556bdd7c9370 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 10 client.16641 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 1 -- 172.21.15.2:0/3576921177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556bdd843640 con 0x556bdd7c9370 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b677fe640 1 -- 172.21.15.2:0/3576921177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b7c00c330 con 0x556bdd7c9370 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b677fe640 1 -- 172.21.15.2:0/3576921177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f2b7c00d630 con 0x556bdd7c9370 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 10 client.16641 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 20 client.16641 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556bdd7d8e60 0x556bdd845c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 4 client.16641 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.760+0000 7f2b906dd740 1 -- 172.21.15.2:0/3576921177 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556bdd72bd70 con 0x556bdd7d8e60 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b87fff640 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556bdd7d8e60 0x556bdd845c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b677fe640 10 client.16641 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b87fff640 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556bdd7d8e60 0x556bdd845c50 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d34290da21667a8 server_cookie=b706ad53d2a2df36 in_seq=0 out_seq=0 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b677fe640 1 -- 172.21.15.2:0/3576921177 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556bdd72bd70 con 0x556bdd7d8e60 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b677fe640 10 client.16641 handle_command_reply: tid=0 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 client.16641 shutdown 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 -- 172.21.15.2:0/3576921177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7c9370 msgr2=0x556bdd7ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7c9370 0x556bdd7ccdb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c036040 tx=0x7f2b7c00ca50 comp rx=0 tx=0).stop 2024-09-12T00:59:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 -- 172.21.15.2:0/3576921177 shutdown_connections 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x556bdd7d8e60 0x556bdd845c50 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bdd7c9370 0x556bdd7ccdb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bdd7bfb40 0x556bdd7d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b677fe640 0 client.16641 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 --2- 172.21.15.2:0/3576921177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bdd7be5d0 0x556bdd7d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 -- 172.21.15.2:0/3576921177 >> 172.21.15.2:0/3576921177 conn(0x556bdd787310 msgr2=0x556bdd7c0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.761+0000 7f2b906dd740 1 -- 172.21.15.2:0/3576921177 shutdown_connections 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b906dd740 1 -- 172.21.15.2:0/3576921177 wait complete. 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b906dd740 20 client.16641 trim_cache size 0 max 16384 2024-09-12T00:59:07.784 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 -- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2b700a2cf0 msgr2=0x7f2b700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2b700a2cf0 0x7f2b700a51b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b800b94a0 tx=0x7f2b800900b0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 -- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 msgr2=0x7f2b8819ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 0x7f2b8819ee10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2b80031a20 tx=0x7f2b80031a50 comp rx=0 tx=0).stop 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 -- 172.21.15.2:0/2566200125 shutdown_connections 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2b700a2cf0 0x7f2b700a51b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b88106f10 0x7f2b8819ee10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b88102790 0x7f2b8819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 --2- 172.21.15.2:0/2566200125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b88101de0 0x7f2b8819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 -- 172.21.15.2:0/2566200125 >> 172.21.15.2:0/2566200125 conn(0x7f2b880fd8c0 msgr2=0x7f2b880ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 -- 172.21.15.2:0/2566200125 shutdown_connections 2024-09-12T00:59:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:07.762+0000 7f2b8e304640 1 -- 172.21.15.2:0/2566200125 wait complete. 2024-09-12T00:59:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:08 smithi002 ceph-mon[31210]: pgmap v189: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 684 KiB/s wr, 140 op/s 2024-09-12T00:59:08.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:08 smithi167 ceph-mon[35234]: pgmap v189: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 684 KiB/s wr, 140 op/s 2024-09-12T00:59:08.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:08 smithi071 ceph-mon[35276]: pgmap v189: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 684 KiB/s wr, 140 op/s 2024-09-12T00:59:09.459 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:59:09.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:59:09.722 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:09.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:59:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:59:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:59:09.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:59:09.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:59:09.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:59:09.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:59:09.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:59:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:59:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:59:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:59:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T00:59:10.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 -- 172.21.15.2:0/792909817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 msgr2=0x7f06d810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/792909817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 0x7f06d810e600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009ca0 tx=0x7f06d002a950 comp rx=0 tx=0).stop 2024-09-12T00:59:10.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 -- 172.21.15.2:0/792909817 shutdown_connections 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/792909817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 0x7f06d810e600 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/792909817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d81036c0 0x7f06d810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/792909817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06d8102da0 0x7f06d8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 -- 172.21.15.2:0/792909817 >> 172.21.15.2:0/792909817 conn(0x7f06d80fc7a0 msgr2=0x7f06d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 -- 172.21.15.2:0/792909817 shutdown_connections 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.219+0000 7f06dd6c2640 1 -- 172.21.15.2:0/792909817 wait complete. 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.220+0000 7f06dd6c2640 1 Processor -- start 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.220+0000 7f06dd6c2640 1 -- start start 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.220+0000 7f06dd6c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d8102da0 0x7f06d8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.220+0000 7f06dd6c2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06d81036c0 0x7f06d8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.220+0000 7f06dd6c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 0x7f06d819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.220+0000 7f06dd6c2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8111fa0 con 0x7f06d810c180 2024-09-12T00:59:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.220+0000 7f06dd6c2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8111e20 con 0x7f06d81036c0 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.220+0000 7f06dd6c2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8112120 con 0x7f06d8102da0 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 0x7f06d819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 0x7f06d819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58624/0 (socket says 172.21.15.2:58624) 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 -- 172.21.15.2:0/4274103459 learned_addr learned my addr 172.21.15.2:0/4274103459 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d8102da0 0x7f06d8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d67fc640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06d81036c0 0x7f06d8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 -- 172.21.15.2:0/4274103459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d8102da0 msgr2=0x7f06d8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d8102da0 0x7f06d8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 -- 172.21.15.2:0/4274103459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06d81036c0 msgr2=0x7f06d8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06d81036c0 0x7f06d8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 -- 172.21.15.2:0/4274103459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d819d3f0 con 0x7f06d810c180 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d67fc640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06d81036c0 0x7f06d8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06d77fe640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 0x7f06d819cd10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f06d0006010 tx=0x7f06d002f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06bffff640 1 -- 172.21.15.2:0/4274103459 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0034040 con 0x7f06d810c180 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06dd6c2640 1 -- 172.21.15.2:0/4274103459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d819d680 con 0x7f06d810c180 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06bffff640 1 -- 172.21.15.2:0/4274103459 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d0003e00 con 0x7f06d810c180 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06bffff640 1 -- 172.21.15.2:0/4274103459 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00456e0 con 0x7f06d810c180 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.221+0000 7f06dd6c2640 1 -- 172.21.15.2:0/4274103459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d81a4fc0 con 0x7f06d810c180 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.224+0000 7f06bffff640 1 -- 172.21.15.2:0/4274103459 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f06d0037020 con 0x7f06d810c180 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.224+0000 7f06dfa9b740 1 Processor -- start 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.224+0000 7f06dfa9b740 1 -- start start 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e5360 0x5655258f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 0x5655258f6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56552584a280 con 0x5655258e4a40 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5655257f1b10 con 0x5655258e5360 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x565525846240 con 0x5655258f4150 2024-09-12T00:59:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58630/0 (socket says 172.21.15.2:58630) 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 -- 172.21.15.2:0/3408618870 learned_addr learned my addr 172.21.15.2:0/3408618870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/3408618870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e5360 0x5655258f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 -- 172.21.15.2:0/3408618870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 msgr2=0x5655258f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 --2- 172.21.15.2:0/3408618870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 0x5655258f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06bffff640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f06c00a2cf0 0x7f06c00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 -- 172.21.15.2:0/3408618870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e5360 msgr2=0x5655258f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 --2- 172.21.15.2:0/3408618870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e5360 0x5655258f3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 -- 172.21.15.2:0/3408618870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655257fe1f0 con 0x5655258e4a40 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d77fe640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f06c00a2cf0 0x7f06c00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.225+0000 7f06d67fc640 1 --2- 172.21.15.2:0/3408618870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258e4e20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f06cc006fd0 tx=0x7f06cc007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d26c8db46320b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06bffff640 1 -- 172.21.15.2:0/4274103459 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f06d00f0460 con 0x7f06d810c180 2024-09-12T00:59:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06bd7fa640 1 -- 172.21.15.2:0/3408618870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00fc60 con 0x5655258e4a40 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06bd7fa640 1 -- 172.21.15.2:0/3408618870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc010040 con 0x5655258e4a40 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06bd7fa640 1 -- 172.21.15.2:0/3408618870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0136c0 con 0x5655258e4a40 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06dfa9b740 1 -- 172.21.15.2:0/3408618870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 msgr2=0x5655258e4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/3408618870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258e4e20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f06cc006fd0 tx=0x7f06cc007ea0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06d77fe640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f06c00a2cf0 0x7f06c00a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ee160 tx=0x7f06d004e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06dfa9b740 1 -- 172.21.15.2:0/3408618870 shutdown_connections 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/3408618870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 0x5655258f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/3408618870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e5360 0x5655258f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/3408618870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258e4e20 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06dfa9b740 1 -- 172.21.15.2:0/3408618870 >> 172.21.15.2:0/3408618870 conn(0x5655258e10f0 msgr2=0x5655258e14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.226+0000 7f06dfa9b740 1 -- 172.21.15.2:0/3408618870 shutdown_connections 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 -- 172.21.15.2:0/3408618870 wait complete. 2024-09-12T00:59:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 -- start start 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 Processor -- start 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 0x5655258f1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e5360 0x5655258f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 0x5655258f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5655258f6d20 con 0x5655258e5360 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x565525804f10 con 0x5655258e4a40 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5655258f6ea0 con 0x5655258f4150 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06dfa9b740 10 client.0 _ll_register_callbacks cb 0x5655257cda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e5360 0x5655258f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e5360 0x5655258f15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58634/0 (socket says 172.21.15.2:58634) 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06d6ffd640 1 -- 172.21.15.2:0/4188380945 learned_addr learned my addr 172.21.15.2:0/4188380945 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.227+0000 7f06d67fc640 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 0x5655258f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06d67fc640 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 0x5655258f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06d6ffd640 1 -- 172.21.15.2:0/4188380945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 msgr2=0x5655258f1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 0x5655258f1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06d6ffd640 1 -- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 msgr2=0x5655258f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 0x5655258f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06d6ffd640 1 -- 172.21.15.2:0/4188380945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655255bb6a0 con 0x5655258e5360 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06d67fc640 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 0x5655258f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e5360 0x5655258f15d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f06c80127c0 tx=0x7f06c8012c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f143d7d9779825 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06baff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06baff5640 1 -- 172.21.15.2:0/4188380945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8010dc0 con 0x5655258e5360 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06baff5640 1 -- 172.21.15.2:0/4188380945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f06c8005020 con 0x5655258e5360 2024-09-12T00:59:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06dfa9b740 1 -- 172.21.15.2:0/4188380945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc010040 con 0x5655258e5360 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06baff5640 1 -- 172.21.15.2:0/4188380945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f06c8005260 con 0x5655258e5360 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06dfa9b740 10 client.16653 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06dfa9b740 1 -- 172.21.15.2:0/4188380945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x565525902a20 con 0x5655258e5360 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.228+0000 7f06baff5640 1 -- 172.21.15.2:0/4188380945 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc010040 con 0x5655258e5360 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06baff5640 1 -- 172.21.15.2:0/4188380945 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f06c801a4c0 con 0x5655258e5360 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06dfa9b740 10 client.16653 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06dfa9b740 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06dfa9b740 20 client.16653 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x565525903ee0 0x565525906340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06dfa9b740 4 client.16653 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06dfa9b740 1 -- 172.21.15.2:0/4188380945 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5655258577f0 con 0x565525903ee0 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06d67fc640 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x565525903ee0 0x565525906340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06baff5640 10 client.16653 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.229+0000 7f06d67fc640 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x565525903ee0 0x565525906340 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb7de829c035b9b7 server_cookie=5553b44b7f761e72 in_seq=0 out_seq=0 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06baff5640 1 -- 172.21.15.2:0/4188380945 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5655258577f0 con 0x565525903ee0 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06baff5640 10 client.16653 handle_command_reply: tid=0 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 client.16653 shutdown 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 -- 172.21.15.2:0/4188380945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e5360 msgr2=0x5655258f15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e5360 0x5655258f15d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f06c80127c0 tx=0x7f06c8012c80 comp rx=0 tx=0).stop 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 -- 172.21.15.2:0/4188380945 shutdown_connections 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x565525903ee0 0x565525906340 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258f4150 0x5655258f1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e5360 0x5655258f15d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/4188380945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 0x5655258f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 -- 172.21.15.2:0/4188380945 >> 172.21.15.2:0/4188380945 conn(0x5655258e10f0 msgr2=0x5655258e6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06baff5640 0 client.16653 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 -- 172.21.15.2:0/4188380945 shutdown_connections 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 1 -- 172.21.15.2:0/4188380945 wait complete. 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.230+0000 7f06dfa9b740 20 client.16653 trim_cache size 0 max 16384 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06dfa9b740 1 Processor -- start 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06dfa9b740 1 -- start start 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 0x56552590bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 0x56552590c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258f4150 0x5655258ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81ae0f0 con 0x5655258f4150 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81ab930 con 0x5655258e4a40 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81a9780 con 0x5655258e5360 2024-09-12T00:59:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258f4150 0x5655258ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258f4150 0x5655258ee2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58648/0 (socket says 172.21.15.2:58648) 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d67fc640 1 -- 172.21.15.2:0/656941267 learned_addr learned my addr 172.21.15.2:0/656941267 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/656941267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 0x56552590c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d67fc640 1 -- 172.21.15.2:0/656941267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 msgr2=0x56552590c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d67fc640 1 --2- 172.21.15.2:0/656941267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 0x56552590c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d67fc640 1 -- 172.21.15.2:0/656941267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 msgr2=0x56552590bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d67fc640 1 --2- 172.21.15.2:0/656941267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 0x56552590bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.248+0000 7f06d67fc640 1 -- 172.21.15.2:0/656941267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655258dc830 con 0x5655258f4150 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06d67fc640 1 --2- 172.21.15.2:0/656941267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258f4150 0x5655258ee2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f06cc014e60 tx=0x7f06cc014df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ba6dd2ce1826f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06bcff9640 1 -- 172.21.15.2:0/656941267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc014630 con 0x5655258f4150 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06bcff9640 1 -- 172.21.15.2:0/656941267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc02b3c0 con 0x5655258f4150 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06bcff9640 1 -- 172.21.15.2:0/656941267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc021680 con 0x5655258f4150 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06dfa9b740 1 -- 172.21.15.2:0/656941267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258f4150 msgr2=0x5655258ee2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/656941267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258f4150 0x5655258ee2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f06cc014e60 tx=0x7f06cc014df0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06dfa9b740 1 -- 172.21.15.2:0/656941267 shutdown_connections 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/656941267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258f4150 0x5655258ee2f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/656941267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 0x56552590c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/656941267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258e4a40 0x56552590bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.249+0000 7f06dfa9b740 1 -- 172.21.15.2:0/656941267 >> 172.21.15.2:0/656941267 conn(0x5655258e10f0 msgr2=0x5655258f3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 -- 172.21.15.2:0/656941267 shutdown_connections 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 -- 172.21.15.2:0/656941267 wait complete. 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 -- start start 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 Processor -- start 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 0x5655258f8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258f4150 0x5655258f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81a9df0 con 0x5655258e4a40 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81ab260 con 0x5655258f4150 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81aa4c0 con 0x5655258e5360 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06dfa9b740 10 client.0 _ll_register_callbacks cb 0x7f06c800a650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258f7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58658/0 (socket says 172.21.15.2:58658) 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06d67fc640 1 -- 172.21.15.2:0/2536428192 learned_addr learned my addr 172.21.15.2:0/2536428192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.250+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 0x5655258f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06d67fc640 1 -- 172.21.15.2:0/2536428192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 msgr2=0x5655258f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06d67fc640 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 0x5655258f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06d67fc640 1 -- 172.21.15.2:0/2536428192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258f4150 msgr2=0x5655258f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06d67fc640 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258f4150 0x5655258f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06d67fc640 1 -- 172.21.15.2:0/2536428192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552596db90 con 0x5655258e4a40 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06d67fc640 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258f7f30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f06cc001e90 tx=0x7f06cc007250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6dbf969ec5c3ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06baff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06baff5640 1 -- 172.21.15.2:0/2536428192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc03a070 con 0x5655258e4a40 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06baff5640 1 -- 172.21.15.2:0/2536428192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f06cc02b770 con 0x5655258e4a40 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06dfa9b740 1 -- 172.21.15.2:0/2536428192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc02b3c0 con 0x5655258e4a40 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06baff5640 1 -- 172.21.15.2:0/2536428192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f06cc046050 con 0x5655258e4a40 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06dfa9b740 10 client.16659 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06dfa9b740 1 -- 172.21.15.2:0/2536428192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56552596eeb0 con 0x5655258e4a40 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06baff5640 1 -- 172.21.15.2:0/2536428192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc02b3c0 con 0x5655258e4a40 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06baff5640 1 -- 172.21.15.2:0/2536428192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f06cc021740 con 0x5655258e4a40 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06dfa9b740 10 client.16659 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.251+0000 7f06dfa9b740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.252+0000 7f06dfa9b740 20 client.16659 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.252+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56552596f2d0 0x5655259716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.252+0000 7f06dfa9b740 4 client.16659 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.252+0000 7f06dfa9b740 1 -- 172.21.15.2:0/2536428192 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x565525851d00 con 0x56552596f2d0 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.252+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56552596f2d0 0x5655259716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.252+0000 7f06d6ffd640 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56552596f2d0 0x5655259716c0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85507cd63927ec26 server_cookie=c4f79fcaa65c2a90 in_seq=0 out_seq=0 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.252+0000 7f06baff5640 10 client.16659 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06baff5640 1 -- 172.21.15.2:0/2536428192 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x565525851d00 con 0x56552596f2d0 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06baff5640 10 client.16659 handle_command_reply: tid=0 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 client.16659 shutdown 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 -- 172.21.15.2:0/2536428192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 msgr2=0x5655258f7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258f7f30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f06cc001e90 tx=0x7f06cc007250 comp rx=0 tx=0).stop 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 -- 172.21.15.2:0/2536428192 shutdown_connections 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56552596f2d0 0x5655259716c0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5655258f4150 0x5655258f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655258e5360 0x5655258f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 --2- 172.21.15.2:0/2536428192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5655258e4a40 0x5655258f7f30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06baff5640 0 client.16659 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 -- 172.21.15.2:0/2536428192 >> 172.21.15.2:0/2536428192 conn(0x5655258e10f0 msgr2=0x5655258dfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.253+0000 7f06dfa9b740 1 -- 172.21.15.2:0/2536428192 shutdown_connections 2024-09-12T00:59:10.288 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:10.288 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:59:10.288 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "4132e626-c7e0-4567-9fc6-6253b3554042", 2024-09-12T00:59:10.288 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:59:10.288 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dfa9b740 1 -- 172.21.15.2:0/2536428192 wait complete. 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dfa9b740 20 client.16659 trim_cache size 0 max 16384 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 -- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f06c00a2cf0 msgr2=0x7f06c00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f06c00a2cf0 0x7f06c00a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ee160 tx=0x7f06d004e000 comp rx=0 tx=0).stop 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 -- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 msgr2=0x7f06d819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 0x7f06d819cd10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f06d0006010 tx=0x7f06d002f710 comp rx=0 tx=0).stop 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 -- 172.21.15.2:0/4274103459 shutdown_connections 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f06c00a2cf0 0x7f06c00a51b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06d810c180 0x7f06d819cd10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06d81036c0 0x7f06d8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 --2- 172.21.15.2:0/4274103459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d8102da0 0x7f06d8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 -- 172.21.15.2:0/4274103459 >> 172.21.15.2:0/4274103459 conn(0x7f06d80fc7a0 msgr2=0x7f06d80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 -- 172.21.15.2:0/4274103459 shutdown_connections 2024-09-12T00:59:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:10.254+0000 7f06dd6c2640 1 -- 172.21.15.2:0/4274103459 wait complete. 2024-09-12T00:59:10.863 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:10 smithi002 ceph-mon[31210]: pgmap v190: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 43 KiB/s wr, 33 op/s 2024-09-12T00:59:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:10 smithi071 ceph-mon[35276]: pgmap v190: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 43 KiB/s wr, 33 op/s 2024-09-12T00:59:10.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:59:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:10 smithi167 ceph-mon[35234]: pgmap v190: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 43 KiB/s wr, 33 op/s 2024-09-12T00:59:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:11.663 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:11 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:59:11.663 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:11 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:11.663 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:11 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:59:11.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:11 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:11.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:11 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:59:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 -- 172.21.15.2:0/524537643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100500 msgr2=0x7fca081008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 --2- 172.21.15.2:0/524537643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100500 0x7fca081008e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009900 tx=0x7fc9f802a410 comp rx=0 tx=0).stop 2024-09-12T00:59:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 -- 172.21.15.2:0/524537643 shutdown_connections 2024-09-12T00:59:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 --2- 172.21.15.2:0/524537643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca08106f70 0x7fca0810eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 --2- 172.21.15.2:0/524537643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca08100eb0 0x7fca08106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 --2- 172.21.15.2:0/524537643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100500 0x7fca081008e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 -- 172.21.15.2:0/524537643 >> 172.21.15.2:0/524537643 conn(0x7fca080fc5c0 msgr2=0x7fca080fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 -- 172.21.15.2:0/524537643 shutdown_connections 2024-09-12T00:59:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 -- 172.21.15.2:0/524537643 wait complete. 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.666+0000 7fca0d539640 1 Processor -- start 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca0d539640 1 -- start start 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca0d539640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca08100500 0x7fca08101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca0d539640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100eb0 0x7fca081019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca0d539640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca08106f70 0x7fca08101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca0d539640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca08111f90 con 0x7fca08100eb0 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca0d539640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca08111e10 con 0x7fca08100500 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca0d539640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca08112110 con 0x7fca08106f70 2024-09-12T00:59:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca067fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100eb0 0x7fca081019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca067fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100eb0 0x7fca081019c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58664/0 (socket says 172.21.15.2:58664) 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca067fc640 1 -- 172.21.15.2:0/496557648 learned_addr learned my addr 172.21.15.2:0/496557648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca06ffd640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca08100500 0x7fca08101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca077fe640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca08106f70 0x7fca08101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca067fc640 1 -- 172.21.15.2:0/496557648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca08106f70 msgr2=0x7fca08101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca067fc640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca08106f70 0x7fca08101f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca067fc640 1 -- 172.21.15.2:0/496557648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca08100500 msgr2=0x7fca08101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca067fc640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca08100500 0x7fca08101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca067fc640 1 -- 172.21.15.2:0/496557648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca081a6930 con 0x7fca08100eb0 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.667+0000 7fca06ffd640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca08100500 0x7fca08101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.668+0000 7fca067fc640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100eb0 0x7fca081019c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00c970 tx=0x7fc9fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.668+0000 7fc9effff640 1 -- 172.21.15.2:0/496557648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc007bb0 con 0x7fca08100eb0 2024-09-12T00:59:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.668+0000 7fc9effff640 1 -- 172.21.15.2:0/496557648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc007d50 con 0x7fca08100eb0 2024-09-12T00:59:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.668+0000 7fc9effff640 1 -- 172.21.15.2:0/496557648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00f450 con 0x7fca08100eb0 2024-09-12T00:59:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.668+0000 7fca0d539640 1 -- 172.21.15.2:0/496557648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca081a6c20 con 0x7fca08100eb0 2024-09-12T00:59:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.668+0000 7fca0d539640 1 -- 172.21.15.2:0/496557648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca081a71b0 con 0x7fca08100eb0 2024-09-12T00:59:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.670+0000 7fc9effff640 1 -- 172.21.15.2:0/496557648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc9fc004f60 con 0x7fca08100eb0 2024-09-12T00:59:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fca0f912740 1 Processor -- start 2024-09-12T00:59:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fca0f912740 1 -- start start 2024-09-12T00:59:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fc9effff640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9f00a2d70 0x7fc9f00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fca0f912740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2ac4a0 0x55847e2ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fca0f912740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 0x55847e2b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fca0f912740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fca0f912740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55847e2122e0 con 0x55847e2b7680 2024-09-12T00:59:11.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fca0f912740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55847e1b9ce0 con 0x55847e2acdc0 2024-09-12T00:59:11.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.671+0000 7fca0f912740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55847e20e2a0 con 0x55847e2ac4a0 2024-09-12T00:59:11.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca077fe640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9f00a2d70 0x7fc9f00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fc9effff640 1 -- 172.21.15.2:0/496557648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc9fc0cf230 con 0x7fca08100eb0 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58666/0 (socket says 172.21.15.2:58666) 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca077fe640 1 -- 172.21.15.2:0/1848393384 learned_addr learned my addr 172.21.15.2:0/1848393384 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca06ffd640 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2ac4a0 0x55847e2ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca067fc640 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 0x55847e2b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca06ffd640 1 -- 172.21.15.2:0/1848393384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 msgr2=0x55847e2b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca06ffd640 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 0x55847e2b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca06ffd640 1 -- 172.21.15.2:0/1848393384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 msgr2=0x55847e2b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca06ffd640 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca06ffd640 1 -- 172.21.15.2:0/1848393384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847e19e440 con 0x55847e2ac4a0 2024-09-12T00:59:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca077fe640 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca077fe640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9f00a2d70 0x7fc9f00a5230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca00014a40 tx=0x7fca00009c70 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.672+0000 7fca06ffd640 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2ac4a0 0x55847e2ac880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8006010 tx=0x7fc9f8032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcd53c71b3949dd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fc9ed7fa640 1 -- 172.21.15.2:0/1848393384 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f803f070 con 0x55847e2ac4a0 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fc9ed7fa640 1 -- 172.21.15.2:0/1848393384 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9f80317b0 con 0x55847e2ac4a0 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fc9ed7fa640 1 -- 172.21.15.2:0/1848393384 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8035070 con 0x55847e2ac4a0 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 -- 172.21.15.2:0/1848393384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2ac4a0 msgr2=0x55847e2ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2ac4a0 0x55847e2ac880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8006010 tx=0x7fc9f8032ce0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 -- 172.21.15.2:0/1848393384 shutdown_connections 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 0x55847e2b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 --2- 172.21.15.2:0/1848393384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2ac4a0 0x55847e2ac880 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 -- 172.21.15.2:0/1848393384 >> 172.21.15.2:0/1848393384 conn(0x55847e2a8a30 msgr2=0x55847e2a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 -- 172.21.15.2:0/1848393384 shutdown_connections 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.673+0000 7fca0f912740 1 -- 172.21.15.2:0/1848393384 wait complete. 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 1 -- start start 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 1 Processor -- start 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2acdc0 0x55847e2b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55847e2ba250 con 0x55847e2b7680 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55847e1cd050 con 0x55847e2ac4a0 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55847e2ba3d0 con 0x55847e2acdc0 2024-09-12T00:59:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca0f912740 10 client.0 _ll_register_callbacks cb 0x55847e20d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58676/0 (socket says 172.21.15.2:58676) 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca077fe640 1 -- 172.21.15.2:0/4089742074 learned_addr learned my addr 172.21.15.2:0/4089742074 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca067fc640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2acdc0 0x55847e2b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.674+0000 7fca06ffd640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca067fc640 1 -- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 msgr2=0x55847e2b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca067fc640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca067fc640 1 -- 172.21.15.2:0/4089742074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 msgr2=0x55847e2b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca067fc640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca067fc640 1 -- 172.21.15.2:0/4089742074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55847df833c0 con 0x55847e2acdc0 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca06ffd640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca077fe640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca067fc640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2acdc0 0x55847e2b4280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0cc930 tx=0x7fc9fc09b5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ec67ce77761007 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fc9eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fc9eaff5640 1 -- 172.21.15.2:0/4089742074 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc01d040 con 0x55847e2acdc0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fc9eaff5640 1 -- 172.21.15.2:0/4089742074 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc9fc097d70 con 0x55847e2acdc0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca0f912740 1 -- 172.21.15.2:0/4089742074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9f80317b0 con 0x55847e2acdc0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fc9eaff5640 1 -- 172.21.15.2:0/4089742074 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9fc06fb30 con 0x55847e2acdc0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca0f912740 10 client.26152 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fca0f912740 1 -- 172.21.15.2:0/4089742074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55847e2c5c20 con 0x55847e2acdc0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.675+0000 7fc9eaff5640 1 -- 172.21.15.2:0/4089742074 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9f80317b0 con 0x55847e2acdc0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fc9eaff5640 1 -- 172.21.15.2:0/4089742074 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc9fc07a0d0 con 0x55847e2acdc0 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fca0f912740 10 client.26152 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fca0f912740 10 client.26152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fca0f912740 20 client.26152 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fca0f912740 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55847e2c7080 0x55847e2c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fca0f912740 4 client.26152 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fca0f912740 1 -- 172.21.15.2:0/4089742074 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55847e21f850 con 0x55847e2c7080 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fca06ffd640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55847e2c7080 0x55847e2c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fca06ffd640 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55847e2c7080 0x55847e2c94b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c686d37a6149f93 server_cookie=f76ebcb9b0998bb5 in_seq=0 out_seq=0 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.676+0000 7fc9eaff5640 10 client.26152 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fc9eaff5640 1 -- 172.21.15.2:0/4089742074 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55847e21f850 con 0x55847e2c7080 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fc9eaff5640 10 client.26152 handle_command_reply: tid=0 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 client.26152 shutdown 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 -- 172.21.15.2:0/4089742074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2acdc0 msgr2=0x55847e2b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2acdc0 0x55847e2b4280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0cc930 tx=0x7fc9fc09b5f0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 -- 172.21.15.2:0/4089742074 shutdown_connections 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55847e2c7080 0x55847e2c94b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2b7680 0x55847e2b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2acdc0 0x55847e2b4280 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fc9eaff5640 0 client.26152 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 --2- 172.21.15.2:0/4089742074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 -- 172.21.15.2:0/4089742074 >> 172.21.15.2:0/4089742074 conn(0x55847e2a8a30 msgr2=0x55847e2ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.677+0000 7fca0f912740 1 -- 172.21.15.2:0/4089742074 shutdown_connections 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.678+0000 7fca0f912740 1 -- 172.21.15.2:0/4089742074 wait complete. 2024-09-12T00:59:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.678+0000 7fca0f912740 20 client.26152 trim_cache size 0 max 16384 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca0f912740 1 Processor -- start 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca0f912740 1 -- start start 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca0f912740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca0f912740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2acdc0 0x55847e2b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca0f912740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca0f912740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca081b24d0 con 0x55847e2acdc0 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca0f912740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca081afd10 con 0x55847e2ac4a0 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca0f912740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca081adb60 con 0x55847e2b7680 2024-09-12T00:59:11.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2acdc0 0x55847e2b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2acdc0 0x55847e2b6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58678/0 (socket says 172.21.15.2:58678) 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 -- 172.21.15.2:0/2545355668 learned_addr learned my addr 172.21.15.2:0/2545355668 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 -- 172.21.15.2:0/2545355668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 msgr2=0x55847e2ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca077fe640 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca06ffd640 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 -- 172.21.15.2:0/2545355668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 msgr2=0x55847e2b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 -- 172.21.15.2:0/2545355668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847e2b4b50 con 0x55847e2acdc0 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca06ffd640 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:11.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca077fe640 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.695+0000 7fca067fc640 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2acdc0 0x55847e2b6300 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0a3e40 tx=0x7fc9fc099c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ac2f5ed804b93f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fc9ecff9640 1 -- 172.21.15.2:0/2545355668 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc01d040 con 0x55847e2acdc0 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fc9ecff9640 1 -- 172.21.15.2:0/2545355668 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc09b700 con 0x55847e2acdc0 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fc9ecff9640 1 -- 172.21.15.2:0/2545355668 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc005250 con 0x55847e2acdc0 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 -- 172.21.15.2:0/2545355668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2acdc0 msgr2=0x55847e2b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2acdc0 0x55847e2b6300 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0a3e40 tx=0x7fc9fc099c10 comp rx=0 tx=0).stop 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 -- 172.21.15.2:0/2545355668 shutdown_connections 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2acdc0 0x55847e2b6300 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 --2- 172.21.15.2:0/2545355668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2ac4a0 0x55847e2b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 -- 172.21.15.2:0/2545355668 >> 172.21.15.2:0/2545355668 conn(0x55847e2a8a30 msgr2=0x55847e2a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 -- 172.21.15.2:0/2545355668 shutdown_connections 2024-09-12T00:59:11.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.696+0000 7fca0f912740 1 -- 172.21.15.2:0/2545355668 wait complete. 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 1 -- start start 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 1 Processor -- start 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2ac4a0 0x55847e2bd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 0x55847e2bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2bde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca081ae1d0 con 0x55847e2ac4a0 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca081af640 con 0x55847e2acdc0 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca081ae8a0 con 0x55847e2b7680 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca0f912740 10 client.0 _ll_register_callbacks cb 0x7fc9fc00c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca06ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2ac4a0 0x55847e2bd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca06ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2ac4a0 0x55847e2bd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58682/0 (socket says 172.21.15.2:58682) 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca06ffd640 1 -- 172.21.15.2:0/1139044379 learned_addr learned my addr 172.21.15.2:0/1139044379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca067fc640 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 0x55847e2bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca077fe640 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2bde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca06ffd640 1 -- 172.21.15.2:0/1139044379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 msgr2=0x55847e2bde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca06ffd640 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2bde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca06ffd640 1 -- 172.21.15.2:0/1139044379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 msgr2=0x55847e2bd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.697+0000 7fca06ffd640 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 0x55847e2bd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fca06ffd640 1 -- 172.21.15.2:0/1139044379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55847e330d40 con 0x55847e2ac4a0 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fca06ffd640 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2ac4a0 0x55847e2bd3b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8006010 tx=0x7fc9f80058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a30840965986a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fc9eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fc9eaff5640 1 -- 172.21.15.2:0/1139044379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8053060 con 0x55847e2ac4a0 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fc9eaff5640 1 -- 172.21.15.2:0/1139044379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc9f8005580 con 0x55847e2ac4a0 2024-09-12T00:59:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fca0f912740 1 -- 172.21.15.2:0/1139044379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9fc09b700 con 0x55847e2ac4a0 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fc9eaff5640 1 -- 172.21.15.2:0/1139044379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9f8035040 con 0x55847e2ac4a0 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fca0f912740 10 client.16677 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fca0f912740 1 -- 172.21.15.2:0/1139044379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55847e331f80 con 0x55847e2ac4a0 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fc9eaff5640 1 -- 172.21.15.2:0/1139044379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc09b700 con 0x55847e2ac4a0 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fc9eaff5640 1 -- 172.21.15.2:0/1139044379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc9f804ea40 con 0x55847e2ac4a0 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fca0f912740 10 client.16677 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fca0f912740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.698+0000 7fca0f912740 20 client.16677 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.699+0000 7fca0f912740 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55847e3322e0 0x55847e334700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.699+0000 7fca0f912740 4 client.16677 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.699+0000 7fca0f912740 1 -- 172.21.15.2:0/1139044379 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55847e219d60 con 0x55847e3322e0 2024-09-12T00:59:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.699+0000 7fca067fc640 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55847e3322e0 0x55847e334700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.699+0000 7fca067fc640 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55847e3322e0 0x55847e334700 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2eda0ccf1fc790c server_cookie=db89444fb3a620ce in_seq=0 out_seq=0 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.699+0000 7fc9eaff5640 10 client.16677 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fc9eaff5640 1 -- 172.21.15.2:0/1139044379 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55847e219d60 con 0x55847e3322e0 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fc9eaff5640 10 client.16677 handle_command_reply: tid=0 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 client.16677 shutdown 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 -- 172.21.15.2:0/1139044379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2ac4a0 msgr2=0x55847e2bd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2ac4a0 0x55847e2bd3b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8006010 tx=0x7fc9f80058b0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 -- 172.21.15.2:0/1139044379 shutdown_connections 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55847e3322e0 0x55847e334700 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55847e2b7680 0x55847e2bde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55847e2acdc0 0x55847e2bd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 --2- 172.21.15.2:0/1139044379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847e2ac4a0 0x55847e2bd3b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 -- 172.21.15.2:0/1139044379 >> 172.21.15.2:0/1139044379 conn(0x55847e2a8a30 msgr2=0x55847e2a7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fc9eaff5640 0 client.16677 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 -- 172.21.15.2:0/1139044379 shutdown_connections 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 1 -- 172.21.15.2:0/1139044379 wait complete. 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.700+0000 7fca0f912740 20 client.16677 trim_cache size 0 max 16384 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:59:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:59:11.706 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 -- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9f00a2d70 msgr2=0x7fc9f00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9f00a2d70 0x7fc9f00a5230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca00014a40 tx=0x7fca00009c70 comp rx=0 tx=0).stop 2024-09-12T00:59:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 -- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100eb0 msgr2=0x7fca081019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100eb0 0x7fca081019c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00c970 tx=0x7fc9fc00ce30 comp rx=0 tx=0).stop 2024-09-12T00:59:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 -- 172.21.15.2:0/496557648 shutdown_connections 2024-09-12T00:59:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc9f00a2d70 0x7fc9f00a5230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca08106f70 0x7fca08101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca08100eb0 0x7fca081019c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 --2- 172.21.15.2:0/496557648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca08100500 0x7fca08101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 -- 172.21.15.2:0/496557648 >> 172.21.15.2:0/496557648 conn(0x7fca080fc5c0 msgr2=0x7fca08105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 -- 172.21.15.2:0/496557648 shutdown_connections 2024-09-12T00:59:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:11.701+0000 7fca0d539640 1 -- 172.21.15.2:0/496557648 wait complete. 2024-09-12T00:59:11.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:11 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:59:11.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:11 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:11.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:11 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:59:11.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:11 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:11.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:11 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:59:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:11 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:59:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:11 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:11 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:59:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:11 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:11 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:59:12.414 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:59:12.414 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:59:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:12.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:12 smithi002 ceph-mon[31210]: pgmap v191: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 46 KiB/s wr, 37 op/s 2024-09-12T00:59:12.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:12 smithi071 ceph-mon[35276]: pgmap v191: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 46 KiB/s wr, 37 op/s 2024-09-12T00:59:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:12 smithi167 ceph-mon[35234]: pgmap v191: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 46 KiB/s wr, 37 op/s 2024-09-12T00:59:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 -- 172.21.15.2:0/1858440214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 msgr2=0x7f9894106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 --2- 172.21.15.2:0/1858440214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 0x7f9894106e60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9890009930 tx=0x7f989002a420 comp rx=0 tx=0).stop 2024-09-12T00:59:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 -- 172.21.15.2:0/1858440214 shutdown_connections 2024-09-12T00:59:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 --2- 172.21.15.2:0/1858440214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9894101420 0x7f989410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 --2- 172.21.15.2:0/1858440214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9894100a80 0x7f9894100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 --2- 172.21.15.2:0/1858440214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 0x7f9894106e60 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 -- 172.21.15.2:0/1858440214 >> 172.21.15.2:0/1858440214 conn(0x7f98940fc7a0 msgr2=0x7f98940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 -- 172.21.15.2:0/1858440214 shutdown_connections 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.163+0000 7f989c423640 1 -- 172.21.15.2:0/1858440214 wait complete. 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989c423640 1 Processor -- start 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989c423640 1 -- start start 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989c423640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9894100a80 0x7f9894102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989c423640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9894101420 0x7f9894102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989c423640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 0x7f98941030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989c423640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9894110e80 con 0x7f9894106a80 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989c423640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9894110d00 con 0x7f9894101420 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989c423640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9894111000 con 0x7f9894100a80 2024-09-12T00:59:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a9c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 0x7f98941030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a9c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 0x7f98941030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58704/0 (socket says 172.21.15.2:58704) 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a9c0640 1 -- 172.21.15.2:0/2412962618 learned_addr learned my addr 172.21.15.2:0/2412962618 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f98999be640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9894101420 0x7f9894102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a1bf640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9894100a80 0x7f9894102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a9c0640 1 -- 172.21.15.2:0/2412962618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9894100a80 msgr2=0x7f9894102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a9c0640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9894100a80 0x7f9894102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a9c0640 1 -- 172.21.15.2:0/2412962618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9894101420 msgr2=0x7f9894102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a9c0640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9894101420 0x7f9894102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.164+0000 7f989a9c0640 1 -- 172.21.15.2:0/2412962618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98941a6890 con 0x7f9894106a80 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.165+0000 7f989a1bf640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9894100a80 0x7f9894102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.165+0000 7f989a9c0640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 0x7f98941030d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f988c00cce0 tx=0x7f988c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.165+0000 7f988b7fe640 1 -- 172.21.15.2:0/2412962618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c00f450 con 0x7f9894106a80 2024-09-12T00:59:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.165+0000 7f988b7fe640 1 -- 172.21.15.2:0/2412962618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f988c00fad0 con 0x7f9894106a80 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.165+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98941a6b80 con 0x7f9894106a80 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.165+0000 7f988b7fe640 1 -- 172.21.15.2:0/2412962618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c018c10 con 0x7f9894106a80 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.165+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98941a70c0 con 0x7f9894106a80 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.166+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9894100ee0 con 0x7f9894106a80 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.167+0000 7f988b7fe640 1 -- 172.21.15.2:0/2412962618 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f988c00f5f0 con 0x7f9894106a80 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.168+0000 7f988b7fe640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2d70 0x7f98800a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.168+0000 7f989a1bf640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2d70 0x7f98800a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.168+0000 7f988b7fe640 1 -- 172.21.15.2:0/2412962618 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f988c0cfbe0 con 0x7f9894106a80 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.168+0000 7f989a1bf640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2d70 0x7f98800a5230 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9890000c00 tx=0x7f9890032d50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.171+0000 7f988b7fe640 1 -- 172.21.15.2:0/2412962618 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f988c014030 con 0x7f9894106a80 2024-09-12T00:59:13.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.383+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9894103b80 con 0x7f9894106a80 2024-09-12T00:59:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.383+0000 7f988b7fe640 1 -- 172.21.15.2:0/2412962618 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7f9894103b80 con 0x7f9894106a80 2024-09-12T00:59:13.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:59:13.383 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:59:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T00:59:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.385+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2d70 msgr2=0x7f98800a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.385+0000 7f989c423640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2d70 0x7f98800a5230 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9890000c00 tx=0x7f9890032d50 comp rx=0 tx=0).stop 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.385+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 msgr2=0x7f98941030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.385+0000 7f989c423640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 0x7f98941030d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f988c00cce0 tx=0x7f988c00a620 comp rx=0 tx=0).stop 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.385+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 shutdown_connections 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.385+0000 7f989c423640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2d70 0x7f98800a5230 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.385+0000 7f989c423640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9894106a80 0x7f98941030d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.386+0000 7f989c423640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9894101420 0x7f9894102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.386+0000 7f989c423640 1 --2- 172.21.15.2:0/2412962618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9894100a80 0x7f9894102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.386+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 >> 172.21.15.2:0/2412962618 conn(0x7f98940fc7a0 msgr2=0x7f989406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.386+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 shutdown_connections 2024-09-12T00:59:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:13.386+0000 7f989c423640 1 -- 172.21.15.2:0/2412962618 wait complete. 2024-09-12T00:59:13.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:13 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2412962618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:13.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:13 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2412962618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:13.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:59:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:13 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2412962618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:14.662 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:14 smithi002 ceph-mon[31210]: pgmap v192: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 8 op/s 2024-09-12T00:59:14.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 -- 172.21.15.2:0/268164975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 msgr2=0x7f2154106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 --2- 172.21.15.2:0/268164975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 0x7f2154106e60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2144009cd0 tx=0x7f214402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 -- 172.21.15.2:0/268164975 shutdown_connections 2024-09-12T00:59:14.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 --2- 172.21.15.2:0/268164975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2154101420 0x7f215410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 --2- 172.21.15.2:0/268164975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2154100a80 0x7f2154100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 --2- 172.21.15.2:0/268164975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 0x7f2154106e60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 -- 172.21.15.2:0/268164975 >> 172.21.15.2:0/268164975 conn(0x7f21540fc7a0 msgr2=0x7f21540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 -- 172.21.15.2:0/268164975 shutdown_connections 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.663+0000 7f2158b94640 1 -- 172.21.15.2:0/268164975 wait complete. 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.664+0000 7f2158b94640 1 Processor -- start 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2158b94640 1 -- start start 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2158b94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2154100a80 0x7f21541984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2158b94640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2154101420 0x7f2154198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2158b94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 0x7f215419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2158b94640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2154110ec0 con 0x7f2154106a80 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2158b94640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2154110d40 con 0x7f2154101420 2024-09-12T00:59:14.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2158b94640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2154111040 con 0x7f2154100a80 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 0x7f215419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 0x7f215419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58722/0 (socket says 172.21.15.2:58722) 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 -- 172.21.15.2:0/1627413627 learned_addr learned my addr 172.21.15.2:0/1627413627 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f215259c640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2154100a80 0x7f21541984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f214bfff640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2154101420 0x7f2154198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 -- 172.21.15.2:0/1627413627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2154100a80 msgr2=0x7f21541984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2154100a80 0x7f21541984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 -- 172.21.15.2:0/1627413627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2154101420 msgr2=0x7f2154198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2154101420 0x7f2154198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 -- 172.21.15.2:0/1627413627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215419d490 con 0x7f2154106a80 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.665+0000 7f2152d9d640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 0x7f215419cdb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f214c00d750 tx=0x7f214c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.666+0000 7f214b7fe640 1 -- 172.21.15.2:0/1627413627 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c017070 con 0x7f2154106a80 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.666+0000 7f214b7fe640 1 -- 172.21.15.2:0/1627413627 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f214c005500 con 0x7f2154106a80 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.666+0000 7f2158b94640 1 -- 172.21.15.2:0/1627413627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215419d780 con 0x7f2154106a80 2024-09-12T00:59:14.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.666+0000 7f214b7fe640 1 -- 172.21.15.2:0/1627413627 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c004d90 con 0x7f2154106a80 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.666+0000 7f2158b94640 1 -- 172.21.15.2:0/1627413627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21541a5060 con 0x7f2154106a80 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.668+0000 7f214b7fe640 1 -- 172.21.15.2:0/1627413627 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f214c004f30 con 0x7f2154106a80 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.668+0000 7f215af6d740 1 Processor -- start 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215af6d740 1 -- start start 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215af6d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc2b40 0x55e234bc1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215af6d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc15d0 0x55e234bc1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215af6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215af6d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e234b272f0 con 0x55e234bc15d0 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215af6d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e234acecf0 con 0x55e234bc2b40 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215af6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e234b232b0 con 0x55e234bcc370 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc15d0 0x55e234bc1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc15d0 0x55e234bc1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58730/0 (socket says 172.21.15.2:58730) 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215259c640 1 -- 172.21.15.2:0/3637482979 learned_addr learned my addr 172.21.15.2:0/3637482979 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f214bfff640 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc2b40 0x55e234bc1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f214bfff640 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f214b7fe640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f21400a2cf0 0x7f21400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215259c640 1 -- 172.21.15.2:0/3637482979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 msgr2=0x55e234bce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215259c640 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215259c640 1 -- 172.21.15.2:0/3637482979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc2b40 msgr2=0x55e234bc1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215259c640 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc2b40 0x55e234bc1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.669+0000 7f215259c640 1 -- 172.21.15.2:0/3637482979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e234ab33a0 con 0x55e234bc15d0 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.670+0000 7f2152d9d640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f21400a2cf0 0x7f21400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.670+0000 7f214b7fe640 1 -- 172.21.15.2:0/1627413627 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f214c0ceed0 con 0x7f2154106a80 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.670+0000 7f215259c640 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc15d0 0x55e234bc1a10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2144009cd0 tx=0x7f21440314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bede2e88e172bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.670+0000 7f2148ff9640 1 -- 172.21.15.2:0/3637482979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144048070 con 0x55e234bc15d0 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.670+0000 7f2148ff9640 1 -- 172.21.15.2:0/3637482979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2144036070 con 0x55e234bc15d0 2024-09-12T00:59:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.670+0000 7f2148ff9640 1 -- 172.21.15.2:0/3637482979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440045a0 con 0x55e234bc15d0 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 -- 172.21.15.2:0/3637482979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc15d0 msgr2=0x55e234bc1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc15d0 0x55e234bc1a10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2144009cd0 tx=0x7f21440314e0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f2152d9d640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f21400a2cf0 0x7f21400a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f214c009610 tx=0x7f214c01e7b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 -- 172.21.15.2:0/3637482979 shutdown_connections 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc15d0 0x55e234bc1a10 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 --2- 172.21.15.2:0/3637482979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc2b40 0x55e234bc1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 -- 172.21.15.2:0/3637482979 >> 172.21.15.2:0/3637482979 conn(0x55e234b8a310 msgr2=0x55e234bbdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 -- 172.21.15.2:0/3637482979 shutdown_connections 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 -- 172.21.15.2:0/3637482979 wait complete. 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 -- start start 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.671+0000 7f215af6d740 1 Processor -- start 2024-09-12T00:59:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215af6d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 0x55e234bcbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215af6d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bc8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215af6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bc95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215af6d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e234bcf010 con 0x55e234bc2b40 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215af6d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e234ae2060 con 0x55e234bc15d0 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215af6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e234bcf190 con 0x55e234bcc370 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215af6d740 10 client.0 _ll_register_callbacks cb 0x55e2348358c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bc8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bc8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58734/0 (socket says 172.21.15.2:58734) 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 -- 172.21.15.2:0/556156222 learned_addr learned my addr 172.21.15.2:0/556156222 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f214bfff640 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 0x55e234bcbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f214bfff640 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bc95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 -- 172.21.15.2:0/556156222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 msgr2=0x55e234bc95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bc95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 -- 172.21.15.2:0/556156222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 msgr2=0x55e234bcbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 0x55e234bcbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 -- 172.21.15.2:0/556156222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2348983c0 con 0x55e234bc2b40 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f214bfff640 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bc95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f215259c640 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bc8ff0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2144046040 tx=0x7f214402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc7c18589c8b40b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.672+0000 7f2139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f2139ffb640 1 -- 172.21.15.2:0/556156222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144052020 con 0x55e234bc2b40 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f2139ffb640 1 -- 172.21.15.2:0/556156222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2144004750 con 0x55e234bc2b40 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 1 -- 172.21.15.2:0/556156222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2144036070 con 0x55e234bc2b40 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f2139ffb640 1 -- 172.21.15.2:0/556156222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f214405d050 con 0x55e234bc2b40 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 10 client.16695 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 1 -- 172.21.15.2:0/556156222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e234bcf010 con 0x55e234bc2b40 2024-09-12T00:59:14.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f2139ffb640 1 -- 172.21.15.2:0/556156222 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2144036070 con 0x55e234bc2b40 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f2139ffb640 1 -- 172.21.15.2:0/556156222 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f214404b030 con 0x55e234bc2b40 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 10 client.16695 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 10 client.16695 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 20 client.16695 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e234bdbc00 0x55e234bddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 4 client.16695 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.673+0000 7f215af6d740 1 -- 172.21.15.2:0/556156222 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e234b34860 con 0x55e234bdbc00 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.674+0000 7f214bfff640 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e234bdbc00 0x55e234bddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.674+0000 7f214bfff640 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e234bdbc00 0x55e234bddff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad76b4e4e2e43851 server_cookie=8d8c5621baa666eb in_seq=0 out_seq=0 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.674+0000 7f2139ffb640 10 client.16695 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f2139ffb640 1 -- 172.21.15.2:0/556156222 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e234b34860 con 0x55e234bdbc00 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f2139ffb640 10 client.16695 handle_command_reply: tid=0 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 client.16695 shutdown 2024-09-12T00:59:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 -- 172.21.15.2:0/556156222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 msgr2=0x55e234bc8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bc8ff0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2144046040 tx=0x7f214402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 -- 172.21.15.2:0/556156222 shutdown_connections 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e234bdbc00 0x55e234bddff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bcc370 0x55e234bc95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bc8ff0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 --2- 172.21.15.2:0/556156222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 0x55e234bcbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 -- 172.21.15.2:0/556156222 >> 172.21.15.2:0/556156222 conn(0x55e234b8a310 msgr2=0x55e234bc3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f2139ffb640 0 client.16695 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 -- 172.21.15.2:0/556156222 shutdown_connections 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 1 -- 172.21.15.2:0/556156222 wait complete. 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.675+0000 7f215af6d740 20 client.16695 trim_cache size 0 max 16384 2024-09-12T00:59:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f215af6d740 1 Processor -- start 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f215af6d740 1 -- start start 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f215af6d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 0x55e234bd82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f215af6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc2b40 0x55e234bc4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f215af6d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bcc370 0x55e234bc4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f215af6d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21541b02b0 con 0x55e234bcc370 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f215af6d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21541adaf0 con 0x55e234bc15d0 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f215af6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f21541ab940 con 0x55e234bc2b40 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f214bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bcc370 0x55e234bc4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f214bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bcc370 0x55e234bc4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58746/0 (socket says 172.21.15.2:58746) 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f214bfff640 1 -- 172.21.15.2:0/2922003525 learned_addr learned my addr 172.21.15.2:0/2922003525 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.688+0000 7f214bfff640 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 0x55e234bd82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f215259c640 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc2b40 0x55e234bc4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f214bfff640 1 -- 172.21.15.2:0/2922003525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc2b40 msgr2=0x55e234bc4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f214bfff640 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc2b40 0x55e234bc4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f214bfff640 1 -- 172.21.15.2:0/2922003525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 msgr2=0x55e234bd82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f214bfff640 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 0x55e234bd82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f214bfff640 1 -- 172.21.15.2:0/2922003525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e234bbc310 con 0x55e234bcc370 2024-09-12T00:59:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f214bfff640 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bcc370 0x55e234bc4660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f213c00ad10 tx=0x7f213c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664870ed22bb9cab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f213bfff640 1 -- 172.21.15.2:0/2922003525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c0190d0 con 0x55e234bcc370 2024-09-12T00:59:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f213bfff640 1 -- 172.21.15.2:0/2922003525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f213c019270 con 0x55e234bcc370 2024-09-12T00:59:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.689+0000 7f213bfff640 1 -- 172.21.15.2:0/2922003525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c016890 con 0x55e234bcc370 2024-09-12T00:59:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 -- 172.21.15.2:0/2922003525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bcc370 msgr2=0x55e234bc4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bcc370 0x55e234bc4660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f213c00ad10 tx=0x7f213c0046c0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 -- 172.21.15.2:0/2922003525 shutdown_connections 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bcc370 0x55e234bc4660 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc2b40 0x55e234bc4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 --2- 172.21.15.2:0/2922003525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bc15d0 0x55e234bd82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 -- 172.21.15.2:0/2922003525 >> 172.21.15.2:0/2922003525 conn(0x55e234b8a310 msgr2=0x55e234bc8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 -- 172.21.15.2:0/2922003525 shutdown_connections 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 -- 172.21.15.2:0/2922003525 wait complete. 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.690+0000 7f215af6d740 1 -- start start 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215af6d740 1 Processor -- start 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215af6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc15d0 0x55e234bd4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215af6d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bd4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215af6d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bcc370 0x55e234bc5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215af6d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21541abfb0 con 0x55e234bc2b40 2024-09-12T00:59:14.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215af6d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21541ad420 con 0x55e234bcc370 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215af6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f21541ac680 con 0x55e234bc15d0 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215af6d740 10 client.0 _ll_register_callbacks cb 0x7f2144046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bd4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bd4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58760/0 (socket says 172.21.15.2:58760) 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215259c640 1 -- 172.21.15.2:0/1397988847 learned_addr learned my addr 172.21.15.2:0/1397988847 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f214bfff640 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bcc370 0x55e234bc5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f214bfff640 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc15d0 0x55e234bd4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215259c640 1 -- 172.21.15.2:0/1397988847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc15d0 msgr2=0x55e234bd4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215259c640 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc15d0 0x55e234bd4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215259c640 1 -- 172.21.15.2:0/1397988847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bcc370 msgr2=0x55e234bc5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215259c640 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bcc370 0x55e234bc5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f215259c640 1 -- 172.21.15.2:0/1397988847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e234bc5f00 con 0x55e234bc2b40 2024-09-12T00:59:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.691+0000 7f214bfff640 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc15d0 0x55e234bd4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f215259c640 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bd4b40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2144002230 tx=0x7f2144030620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c5aa8ac96bd4d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f2139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f2139ffb640 1 -- 172.21.15.2:0/1397988847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144052040 con 0x55e234bc2b40 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f2139ffb640 1 -- 172.21.15.2:0/1397988847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2144004b40 con 0x55e234bc2b40 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f215af6d740 1 -- 172.21.15.2:0/1397988847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f213c019270 con 0x55e234bc2b40 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f2139ffb640 1 -- 172.21.15.2:0/1397988847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2144048040 con 0x55e234bc2b40 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f215af6d740 10 client.16701 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f215af6d740 1 -- 172.21.15.2:0/1397988847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e234c461e0 con 0x55e234bc2b40 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f2139ffb640 1 -- 172.21.15.2:0/1397988847 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f213c019270 con 0x55e234bc2b40 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.692+0000 7f2139ffb640 1 -- 172.21.15.2:0/1397988847 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f214404b070 con 0x55e234bc2b40 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f215af6d740 10 client.16701 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f215af6d740 10 client.16701 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f215af6d740 20 client.16701 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f215af6d740 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e234c46900 0x55e234c48d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f215af6d740 4 client.16701 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f215af6d740 1 -- 172.21.15.2:0/1397988847 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e234b2ed70 con 0x55e234c46900 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f214bfff640 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e234c46900 0x55e234c48d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f214bfff640 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e234c46900 0x55e234c48d20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b7c63f6291c083ab server_cookie=e53d3fba1b54570b in_seq=0 out_seq=0 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f2139ffb640 10 client.16701 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f2139ffb640 1 -- 172.21.15.2:0/1397988847 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e234b2ed70 con 0x55e234c46900 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f2139ffb640 10 client.16701 handle_command_reply: tid=0 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.693+0000 7f215af6d740 1 client.16701 shutdown 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 -- 172.21.15.2:0/1397988847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 msgr2=0x55e234bd4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bd4b40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2144002230 tx=0x7f2144030620 comp rx=0 tx=0).stop 2024-09-12T00:59:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 -- 172.21.15.2:0/1397988847 shutdown_connections 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55e234c46900 0x55e234c48d20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e234bcc370 0x55e234bc5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e234bc2b40 0x55e234bd4b40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 --2- 172.21.15.2:0/1397988847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e234bc15d0 0x55e234bd4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 -- 172.21.15.2:0/1397988847 >> 172.21.15.2:0/1397988847 conn(0x55e234b8a310 msgr2=0x55e234bca850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f2139ffb640 0 client.16701 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 -- 172.21.15.2:0/1397988847 shutdown_connections 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 1 -- 172.21.15.2:0/1397988847 wait complete. 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f215af6d740 20 client.16701 trim_cache size 0 max 16384 2024-09-12T00:59:14.708 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f2158b94640 1 -- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f21400a2cf0 msgr2=0x7f21400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f2158b94640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f21400a2cf0 0x7f21400a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f214c009610 tx=0x7f214c01e7b0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f2158b94640 1 -- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 msgr2=0x7f215419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.694+0000 7f2158b94640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 0x7f215419cdb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f214c00d750 tx=0x7f214c00dc10 comp rx=0 tx=0).stop 2024-09-12T00:59:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.695+0000 7f2158b94640 1 -- 172.21.15.2:0/1627413627 shutdown_connections 2024-09-12T00:59:14.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.695+0000 7f2158b94640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f21400a2cf0 0x7f21400a51b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.695+0000 7f2158b94640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154106a80 0x7f215419cdb0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.695+0000 7f2158b94640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2154101420 0x7f2154198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.695+0000 7f2158b94640 1 --2- 172.21.15.2:0/1627413627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2154100a80 0x7f21541984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:14.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.695+0000 7f2158b94640 1 -- 172.21.15.2:0/1627413627 >> 172.21.15.2:0/1627413627 conn(0x7f21540fc7a0 msgr2=0x7f215406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:14.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.695+0000 7f2158b94640 1 -- 172.21.15.2:0/1627413627 shutdown_connections 2024-09-12T00:59:14.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:14.695+0000 7f2158b94640 1 -- 172.21.15.2:0/1627413627 wait complete. 2024-09-12T00:59:14.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:14 smithi071 ceph-mon[35276]: pgmap v192: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 8 op/s 2024-09-12T00:59:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:14 smithi167 ceph-mon[35234]: pgmap v192: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 8 op/s 2024-09-12T00:59:15.481 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:59:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:16.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 -- 172.21.15.2:0/75020526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180074eb0 msgr2=0x7f2180112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 --2- 172.21.15.2:0/75020526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180074eb0 0x7f2180112650 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2170009900 tx=0x7f217002a480 comp rx=0 tx=0).stop 2024-09-12T00:59:16.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 -- 172.21.15.2:0/75020526 shutdown_connections 2024-09-12T00:59:16.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 --2- 172.21.15.2:0/75020526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2180112b90 0x7f2180114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 --2- 172.21.15.2:0/75020526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180074eb0 0x7f2180112650 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 --2- 172.21.15.2:0/75020526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2180074590 0x7f2180074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 -- 172.21.15.2:0/75020526 >> 172.21.15.2:0/75020526 conn(0x7f21800fd8c0 msgr2=0x7f21800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 -- 172.21.15.2:0/75020526 shutdown_connections 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.222+0000 7f2187ee1640 1 -- 172.21.15.2:0/75020526 wait complete. 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.223+0000 7f2187ee1640 1 Processor -- start 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.223+0000 7f2187ee1640 1 -- start start 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.223+0000 7f2187ee1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2180074590 0x7f21801a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.223+0000 7f2187ee1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2180074eb0 0x7f21801a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.223+0000 7f2187ee1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180112b90 0x7f218019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.223+0000 7f2187ee1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2180118540 con 0x7f2180112b90 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.223+0000 7f2187ee1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21801183c0 con 0x7f2180074590 2024-09-12T00:59:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.223+0000 7f2187ee1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f21801186c0 con 0x7f2180074eb0 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180112b90 0x7f218019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180112b90 0x7f218019e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34010/0 (socket says 172.21.15.2:34010) 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 -- 172.21.15.2:0/2021736147 learned_addr learned my addr 172.21.15.2:0/2021736147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218547c640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2180074eb0 0x7f21801a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f2185c7d640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2180074590 0x7f21801a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 -- 172.21.15.2:0/2021736147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2180074eb0 msgr2=0x7f21801a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2180074eb0 0x7f21801a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 -- 172.21.15.2:0/2021736147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2180074590 msgr2=0x7f21801a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2180074590 0x7f21801a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 -- 172.21.15.2:0/2021736147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218019f000 con 0x7f2180112b90 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f218647e640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180112b90 0x7f218019e8d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f217800e9d0 tx=0x7f217800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f2176ffd640 1 -- 172.21.15.2:0/2021736147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217800cd80 con 0x7f2180112b90 2024-09-12T00:59:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f2176ffd640 1 -- 172.21.15.2:0/2021736147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2178005020 con 0x7f2180112b90 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f2187ee1640 1 -- 172.21.15.2:0/2021736147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218019f2f0 con 0x7f2180112b90 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f2176ffd640 1 -- 172.21.15.2:0/2021736147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780116d0 con 0x7f2180112b90 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.224+0000 7f2187ee1640 1 -- 172.21.15.2:0/2021736147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21801ab5e0 con 0x7f2180112b90 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.227+0000 7f2176ffd640 1 -- 172.21.15.2:0/2021736147 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f21780051d0 con 0x7f2180112b90 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.227+0000 7f218a2ba740 1 Processor -- start 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.227+0000 7f218a2ba740 1 -- start start 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.227+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 0x555a808da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218a2ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555a808332f0 con 0x555a808cd5d0 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218a2ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555a807dacf0 con 0x555a808d8370 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218a2ba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555a8082f2b0 con 0x555a808ceb40 2024-09-12T00:59:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34022/0 (socket says 172.21.15.2:34022) 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 -- 172.21.15.2:0/832399885 learned_addr learned my addr 172.21.15.2:0/832399885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218547c640 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2176ffd640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f216c0a2cf0 0x7f216c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218547c640 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 0x555a808da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 -- 172.21.15.2:0/832399885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 msgr2=0x555a808cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218647e640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f216c0a2cf0 0x7f216c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 -- 172.21.15.2:0/832399885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 msgr2=0x555a808da760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 0x555a808da760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 -- 172.21.15.2:0/832399885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a807bf3a0 con 0x555a808cd5d0 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f218547c640 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2176ffd640 1 -- 172.21.15.2:0/2021736147 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f21780cfa30 con 0x7f2180112b90 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f2185c7d640 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808cda10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f217c00bc90 tx=0x7f217c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8eb8589796dc7b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.228+0000 7f216bfff640 1 -- 172.21.15.2:0/832399885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c015070 con 0x555a808cd5d0 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218647e640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f216c0a2cf0 0x7f216c0a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2178098360 tx=0x7f2178086a30 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f216bfff640 1 -- 172.21.15.2:0/832399885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c01a940 con 0x555a808cd5d0 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f216bfff640 1 -- 172.21.15.2:0/832399885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c0119a0 con 0x555a808cd5d0 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 -- 172.21.15.2:0/832399885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 msgr2=0x555a808cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808cda10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f217c00bc90 tx=0x7f217c00f730 comp rx=0 tx=0).stop 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 -- 172.21.15.2:0/832399885 shutdown_connections 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 0x555a808da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808cda10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 --2- 172.21.15.2:0/832399885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 -- 172.21.15.2:0/832399885 >> 172.21.15.2:0/832399885 conn(0x555a80896310 msgr2=0x555a808c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 -- 172.21.15.2:0/832399885 shutdown_connections 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.229+0000 7f218a2ba740 1 -- 172.21.15.2:0/832399885 wait complete. 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 1 -- start start 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 1 Processor -- start 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808d8370 0x555a808d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555a808db070 con 0x555a808cd5d0 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555a807ee060 con 0x555a808ceb40 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555a808db1f0 con 0x555a808d8370 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218a2ba740 10 client.0 _ll_register_callbacks cb 0x555a805418c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218547c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218547c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808d7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34032/0 (socket says 172.21.15.2:34032) 2024-09-12T00:59:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.230+0000 7f218547c640 1 -- 172.21.15.2:0/4271076675 learned_addr learned my addr 172.21.15.2:0/4271076675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f218547c640 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808d8370 0x555a808d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f2185c7d640 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f218547c640 1 -- 172.21.15.2:0/4271076675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808d8370 msgr2=0x555a808d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f218547c640 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808d8370 0x555a808d55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f218547c640 1 -- 172.21.15.2:0/4271076675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 msgr2=0x555a808d4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f218547c640 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f218547c640 1 -- 172.21.15.2:0/4271076675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a805a43c0 con 0x555a808cd5d0 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f218547c640 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808d7d40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f217002a9a0 tx=0x7f2170009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a1dce9f2d90857 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f21697fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f21697fa640 1 -- 172.21.15.2:0/4271076675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170035040 con 0x555a808cd5d0 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.231+0000 7f21697fa640 1 -- 172.21.15.2:0/4271076675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2170005020 con 0x555a808cd5d0 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 1 -- 172.21.15.2:0/4271076675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f217c01a940 con 0x555a808cd5d0 2024-09-12T00:59:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f21697fa640 1 -- 172.21.15.2:0/4271076675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2170051050 con 0x555a808cd5d0 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 10 client.16713 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 1 -- 172.21.15.2:0/4271076675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555a808e6ae0 con 0x555a808cd5d0 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f21697fa640 1 -- 172.21.15.2:0/4271076675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c01a940 con 0x555a808cd5d0 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f21697fa640 1 -- 172.21.15.2:0/4271076675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f2170049020 con 0x555a808cd5d0 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 10 client.16713 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 10 client.16713 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 20 client.16713 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x555a808e7ff0 0x555a808ea450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 4 client.16713 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f218a2ba740 1 -- 172.21.15.2:0/4271076675 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a80840860 con 0x555a808e7ff0 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.232+0000 7f2185c7d640 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x555a808e7ff0 0x555a808ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.233+0000 7f21697fa640 10 client.16713 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.233+0000 7f2185c7d640 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x555a808e7ff0 0x555a808ea450 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2af1f38839c586e server_cookie=ce392ea0df674190 in_seq=0 out_seq=0 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f21697fa640 1 -- 172.21.15.2:0/4271076675 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a80840860 con 0x555a808e7ff0 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f21697fa640 10 client.16713 handle_command_reply: tid=0 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 client.16713 shutdown 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 -- 172.21.15.2:0/4271076675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 msgr2=0x555a808d7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808d7d40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f217002a9a0 tx=0x7f2170009260 comp rx=0 tx=0).stop 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 -- 172.21.15.2:0/4271076675 shutdown_connections 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x555a808e7ff0 0x555a808ea450 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808d8370 0x555a808d55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f21697fa640 0 client.16713 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 --2- 172.21.15.2:0/4271076675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808d7d40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 -- 172.21.15.2:0/4271076675 >> 172.21.15.2:0/4271076675 conn(0x555a80896310 msgr2=0x555a808cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:16.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 -- 172.21.15.2:0/4271076675 shutdown_connections 2024-09-12T00:59:16.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 1 -- 172.21.15.2:0/4271076675 wait complete. 2024-09-12T00:59:16.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.234+0000 7f218a2ba740 20 client.16713 trim_cache size 0 max 16384 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218a2ba740 1 Processor -- start 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218a2ba740 1 -- start start 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808cd5d0 0x555a808c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808d8370 0x555a808d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218a2ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21801b6930 con 0x555a808d8370 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218a2ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21801b4170 con 0x555a808ceb40 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218a2ba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f21801b1fc0 con 0x555a808cd5d0 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218547c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808d8370 0x555a808d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.247+0000 7f218547c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808d8370 0x555a808d0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34038/0 (socket says 172.21.15.2:34038) 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f218547c640 1 -- 172.21.15.2:0/237608182 learned_addr learned my addr 172.21.15.2:0/237608182 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f218547c640 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808cd5d0 0x555a808c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f2185c7d640 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f218547c640 1 -- 172.21.15.2:0/237608182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808cd5d0 msgr2=0x555a808c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f218547c640 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808cd5d0 0x555a808c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f218547c640 1 -- 172.21.15.2:0/237608182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 msgr2=0x555a808d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f218547c640 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f218547c640 1 -- 172.21.15.2:0/237608182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a808d3540 con 0x555a808d8370 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f2185c7d640 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f218547c640 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808d8370 0x555a808d0660 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f217002ac70 tx=0x7f217002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf2073f41ae66e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f216b7fe640 1 -- 172.21.15.2:0/237608182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170035070 con 0x555a808d8370 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f216b7fe640 1 -- 172.21.15.2:0/237608182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2170005500 con 0x555a808d8370 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.248+0000 7f216b7fe640 1 -- 172.21.15.2:0/237608182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170041070 con 0x555a808d8370 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 -- 172.21.15.2:0/237608182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808d8370 msgr2=0x555a808d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808d8370 0x555a808d0660 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f217002ac70 tx=0x7f217002a480 comp rx=0 tx=0).stop 2024-09-12T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 -- 172.21.15.2:0/237608182 shutdown_connections 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808d8370 0x555a808d0660 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808ceb40 0x555a808d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 --2- 172.21.15.2:0/237608182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808cd5d0 0x555a808c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 -- 172.21.15.2:0/237608182 >> 172.21.15.2:0/237608182 conn(0x555a80896310 msgr2=0x555a808c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 -- 172.21.15.2:0/237608182 shutdown_connections 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 -- 172.21.15.2:0/237608182 wait complete. 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 -- start start 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.249+0000 7f218a2ba740 1 Processor -- start 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808e08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218a2ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 0x555a808d2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218a2ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21801b2630 con 0x555a808cd5d0 2024-09-12T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218a2ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21801b3aa0 con 0x555a808d8370 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218a2ba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f21801b2d00 con 0x555a808ceb40 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218a2ba740 10 client.0 _ll_register_callbacks cb 0x7f21700318b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808e08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808e08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34052/0 (socket says 172.21.15.2:34052) 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 -- 172.21.15.2:0/2107319811 learned_addr learned my addr 172.21.15.2:0/2107319811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f2185c7d640 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 0x555a808d2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 -- 172.21.15.2:0/2107319811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 msgr2=0x555a808d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 -- 172.21.15.2:0/2107319811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 msgr2=0x555a808d2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 0x555a808d2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.250+0000 7f218547c640 1 -- 172.21.15.2:0/2107319811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a808d25b0 con 0x555a808cd5d0 2024-09-12T00:59:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218547c640 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808e08e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2170009850 tx=0x7f2170003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f671454cb3383e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f21697fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f21697fa640 1 -- 172.21.15.2:0/2107319811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170035070 con 0x555a808cd5d0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f21697fa640 1 -- 172.21.15.2:0/2107319811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f2170005220 con 0x555a808cd5d0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 1 -- 172.21.15.2:0/2107319811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2170005500 con 0x555a808cd5d0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f21697fa640 1 -- 172.21.15.2:0/2107319811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2170041040 con 0x555a808cd5d0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 10 client.16719 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 1 -- 172.21.15.2:0/2107319811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555a80952a90 con 0x555a808cd5d0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f21697fa640 1 -- 172.21.15.2:0/2107319811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2170005500 con 0x555a808cd5d0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f21697fa640 1 -- 172.21.15.2:0/2107319811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f2170049040 con 0x555a808cd5d0 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 10 client.16719 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 10 client.16719 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 20 client.16719 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x555a809531a0 0x555a809555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:16.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 4 client.16719 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:16.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.251+0000 7f218a2ba740 1 -- 172.21.15.2:0/2107319811 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a8083ad70 con 0x555a809531a0 2024-09-12T00:59:16.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.252+0000 7f2185c7d640 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x555a809531a0 0x555a809555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:16.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.252+0000 7f2185c7d640 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x555a809531a0 0x555a809555c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dcfd5e2c08712fe3 server_cookie=6e4ce1ebb9d689f5 in_seq=0 out_seq=0 2024-09-12T00:59:16.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.252+0000 7f21697fa640 10 client.16719 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.252+0000 7f21697fa640 1 -- 172.21.15.2:0/2107319811 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a8083ad70 con 0x555a809531a0 2024-09-12T00:59:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.252+0000 7f21697fa640 10 client.16719 handle_command_reply: tid=0 2024-09-12T00:59:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.252+0000 7f218a2ba740 1 client.16719 shutdown 2024-09-12T00:59:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.252+0000 7f218a2ba740 1 -- 172.21.15.2:0/2107319811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 msgr2=0x555a808e08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.252+0000 7f218a2ba740 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808e08e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2170009850 tx=0x7f2170003fd0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 1 -- 172.21.15.2:0/2107319811 shutdown_connections 2024-09-12T00:59:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x555a809531a0 0x555a809555c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a808d8370 0x555a808d2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a808ceb40 0x555a808d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 1 --2- 172.21.15.2:0/2107319811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a808cd5d0 0x555a808e08e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f21697fa640 0 client.16719 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 1 -- 172.21.15.2:0/2107319811 >> 172.21.15.2:0/2107319811 conn(0x555a80896310 msgr2=0x555a808c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 1 -- 172.21.15.2:0/2107319811 shutdown_connections 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 1 -- 172.21.15.2:0/2107319811 wait complete. 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f218a2ba740 20 client.16719 trim_cache size 0 max 16384 2024-09-12T00:59:16.258 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 -- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f216c0a2cf0 msgr2=0x7f216c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f216c0a2cf0 0x7f216c0a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2178098360 tx=0x7f2178086a30 comp rx=0 tx=0).stop 2024-09-12T00:59:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 -- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180112b90 msgr2=0x7f218019e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180112b90 0x7f218019e8d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f217800e9d0 tx=0x7f217800ee90 comp rx=0 tx=0).stop 2024-09-12T00:59:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 -- 172.21.15.2:0/2021736147 shutdown_connections 2024-09-12T00:59:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f216c0a2cf0 0x7f216c0a51b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2180112b90 0x7f218019e8d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2180074eb0 0x7f21801a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 --2- 172.21.15.2:0/2021736147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2180074590 0x7f21801a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:16.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 -- 172.21.15.2:0/2021736147 >> 172.21.15.2:0/2021736147 conn(0x7f21800fd8c0 msgr2=0x7f21800ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:16.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.253+0000 7f2187ee1640 1 -- 172.21.15.2:0/2021736147 shutdown_connections 2024-09-12T00:59:16.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:16.254+0000 7f2187ee1640 1 -- 172.21.15.2:0/2021736147 wait complete. 2024-09-12T00:59:16.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:16 smithi002 ceph-mon[31210]: pgmap v193: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 8 op/s 2024-09-12T00:59:16.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:59:16.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:16 smithi071 ceph-mon[35276]: pgmap v193: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 8 op/s 2024-09-12T00:59:17.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:16 smithi167 ceph-mon[35234]: pgmap v193: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 8 op/s 2024-09-12T00:59:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 -- 172.21.15.2:0/3841341259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c100a80 msgr2=0x7f6d3c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/3841341259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c100a80 0x7f6d3c100ee0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009930 tx=0x7f6d3002a420 comp rx=0 tx=0).stop 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 -- 172.21.15.2:0/3841341259 shutdown_connections 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/3841341259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c101420 0x7f6d3c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/3841341259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c100a80 0x7f6d3c100ee0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/3841341259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c106a80 0x7f6d3c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 -- 172.21.15.2:0/3841341259 >> 172.21.15.2:0/3841341259 conn(0x7f6d3c0fc7a0 msgr2=0x7f6d3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 -- 172.21.15.2:0/3841341259 shutdown_connections 2024-09-12T00:59:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.671+0000 7f6d40ee1640 1 -- 172.21.15.2:0/3841341259 wait complete. 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.672+0000 7f6d40ee1640 1 Processor -- start 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.672+0000 7f6d40ee1640 1 -- start start 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.672+0000 7f6d40ee1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c100a80 0x7f6d3c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.672+0000 7f6d40ee1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101420 0x7f6d3c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.672+0000 7f6d40ee1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106a80 0x7f6d3c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.672+0000 7f6d40ee1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c111fb0 con 0x7f6d3c101420 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.672+0000 7f6d40ee1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c111e30 con 0x7f6d3c106a80 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.672+0000 7f6d40ee1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c112130 con 0x7f6d3c100a80 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101420 0x7f6d3c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101420 0x7f6d3c198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34064/0 (socket says 172.21.15.2:34064) 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 -- 172.21.15.2:0/1289576203 learned_addr learned my addr 172.21.15.2:0/1289576203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:17.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c100a80 0x7f6d3c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106a80 0x7f6d3c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 -- 172.21.15.2:0/1289576203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c100a80 msgr2=0x7f6d3c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c100a80 0x7f6d3c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 -- 172.21.15.2:0/1289576203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106a80 msgr2=0x7f6d3c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106a80 0x7f6d3c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 -- 172.21.15.2:0/1289576203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c19d4a0 con 0x7f6d3c101420 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101420 0x7f6d3c198a30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009230 tx=0x7f6d30004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d2b7fe640 1 -- 172.21.15.2:0/1289576203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3003f030 con 0x7f6d3c101420 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d2b7fe640 1 -- 172.21.15.2:0/1289576203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d30003ad0 con 0x7f6d3c101420 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d40ee1640 1 -- 172.21.15.2:0/1289576203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c19d730 con 0x7f6d3c101420 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d2b7fe640 1 -- 172.21.15.2:0/1289576203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30035070 con 0x7f6d3c101420 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.673+0000 7f6d40ee1640 1 -- 172.21.15.2:0/1289576203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c1a5070 con 0x7f6d3c101420 2024-09-12T00:59:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.676+0000 7f6d2b7fe640 1 -- 172.21.15.2:0/1289576203 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f6d30042030 con 0x7f6d3c101420 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.676+0000 7f6d432ba740 1 Processor -- start 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.676+0000 7f6d432ba740 1 -- start start 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c8ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 0x55ece6c98760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d432ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ece6bf12f0 con 0x55ece6c8cb40 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d432ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ece6b98cf0 con 0x55ece6c96370 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d432ba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ece6bed2b0 con 0x55ece6c8b5d0 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d2b7fe640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6d240a2cf0 0x7f6d240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34076/0 (socket says 172.21.15.2:34076) 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 -- 172.21.15.2:0/2621273498 learned_addr learned my addr 172.21.15.2:0/2621273498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c8ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6d240a2cf0 0x7f6d240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d2b7fe640 1 -- 172.21.15.2:0/1289576203 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6d300efad0 con 0x7f6d3c101420 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 0x55ece6c98760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 -- 172.21.15.2:0/2621273498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 msgr2=0x55ece6c8ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c8ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 -- 172.21.15.2:0/2621273498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 msgr2=0x55ece6c98760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 0x55ece6c98760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3ad9d640 1 -- 172.21.15.2:0/2621273498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ece6b7d3a0 con 0x55ece6c8cb40 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.677+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c8ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.678+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8b090 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400a990 tx=0x7f6d3400ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b29a4dec9683363 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.678+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6d240a2cf0 0x7f6d240a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d340155c0 tx=0x7f6d3401c000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.678+0000 7f6d28ff9640 1 -- 172.21.15.2:0/2621273498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3401d040 con 0x55ece6c8cb40 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.678+0000 7f6d28ff9640 1 -- 172.21.15.2:0/2621273498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d34022470 con 0x55ece6c8cb40 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.678+0000 7f6d28ff9640 1 -- 172.21.15.2:0/2621273498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d340205d0 con 0x55ece6c8cb40 2024-09-12T00:59:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 -- 172.21.15.2:0/2621273498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 msgr2=0x55ece6c8b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8b090 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400a990 tx=0x7f6d3400ae50 comp rx=0 tx=0).stop 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 -- 172.21.15.2:0/2621273498 shutdown_connections 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 0x55ece6c98760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c8ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 --2- 172.21.15.2:0/2621273498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8b090 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 -- 172.21.15.2:0/2621273498 >> 172.21.15.2:0/2621273498 conn(0x55ece6c54310 msgr2=0x55ece6c87c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 -- 172.21.15.2:0/2621273498 shutdown_connections 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 -- 172.21.15.2:0/2621273498 wait complete. 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 -- start start 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 Processor -- start 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c95d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8cb40 0x55ece6c93000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.679+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c96370 0x55ece6c935d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d432ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ece6c99010 con 0x55ece6c96370 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d432ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ece6bac060 con 0x55ece6c8cb40 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d432ba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ece6c99190 con 0x55ece6c8b5d0 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d432ba740 10 client.0 _ll_register_callbacks cb 0x55ece68ff8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c96370 0x55ece6c935d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c96370 0x55ece6c935d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34090/0 (socket says 172.21.15.2:34090) 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 -- 172.21.15.2:0/1087445233 learned_addr learned my addr 172.21.15.2:0/1087445233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c95d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8cb40 0x55ece6c93000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 -- 172.21.15.2:0/1087445233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 msgr2=0x55ece6c95d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c95d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 -- 172.21.15.2:0/1087445233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8cb40 msgr2=0x55ece6c93000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8cb40 0x55ece6c93000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 -- 172.21.15.2:0/1087445233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ece69623c0 con 0x55ece6c96370 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c96370 0x55ece6c935d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6d340071a0 tx=0x7f6d34019a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e201b4b8341e3a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1087445233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34030070 con 0x55ece6c96370 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d432ba740 1 -- 172.21.15.2:0/1087445233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d34022470 con 0x55ece6c96370 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.680+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1087445233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6d3402b670 con 0x55ece6c96370 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1087445233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6d3403c050 con 0x55ece6c96370 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d432ba740 10 client.16731 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d432ba740 1 -- 172.21.15.2:0/1087445233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ece6ca4a90 con 0x55ece6c96370 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1087445233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d34022470 con 0x55ece6c96370 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1087445233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f6d3402c400 con 0x55ece6c96370 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d432ba740 10 client.16731 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d432ba740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d432ba740 20 client.16731 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ece6ca5e40 0x55ece6ca8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d432ba740 4 client.16731 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d432ba740 1 -- 172.21.15.2:0/1087445233 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ece6bfe860 con 0x55ece6ca5e40 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.681+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ece6ca5e40 0x55ece6ca8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.682+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ece6ca5e40 0x55ece6ca8230 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad704ff21b62b10c server_cookie=6fe901ff1561cbbf in_seq=0 out_seq=0 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.682+0000 7f6d21ffb640 10 client.16731 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1087445233 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ece6bfe860 con 0x55ece6ca5e40 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d21ffb640 10 client.16731 handle_command_reply: tid=0 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 client.16731 shutdown 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 -- 172.21.15.2:0/1087445233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c96370 msgr2=0x55ece6c935d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c96370 0x55ece6c935d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6d340071a0 tx=0x7f6d34019a90 comp rx=0 tx=0).stop 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 -- 172.21.15.2:0/1087445233 shutdown_connections 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ece6ca5e40 0x55ece6ca8230 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c96370 0x55ece6c935d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8cb40 0x55ece6c93000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1087445233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6c95d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d21ffb640 0 client.16731 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 -- 172.21.15.2:0/1087445233 >> 172.21.15.2:0/1087445233 conn(0x55ece6c54310 msgr2=0x55ece6c8d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 -- 172.21.15.2:0/1087445233 shutdown_connections 2024-09-12T00:59:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 1 -- 172.21.15.2:0/1087445233 wait complete. 2024-09-12T00:59:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.683+0000 7f6d432ba740 20 client.16731 trim_cache size 0 max 16384 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d432ba740 1 Processor -- start 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d432ba740 1 -- start start 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8b5d0 0x55ece6c94f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c96370 0x55ece6c8e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d432ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1b03a0 con 0x55ece6c8cb40 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d432ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1adbe0 con 0x55ece6c8b5d0 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d432ba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1aba30 con 0x55ece6c96370 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34098/0 (socket says 172.21.15.2:34098) 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d39d9b640 1 -- 172.21.15.2:0/3924631145 learned_addr learned my addr 172.21.15.2:0/3924631145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8b5d0 0x55ece6c94f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c96370 0x55ece6c8e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d39d9b640 1 -- 172.21.15.2:0/3924631145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c96370 msgr2=0x55ece6c8e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c96370 0x55ece6c8e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d39d9b640 1 -- 172.21.15.2:0/3924631145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8b5d0 msgr2=0x55ece6c94f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8b5d0 0x55ece6c94f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.697+0000 7f6d39d9b640 1 -- 172.21.15.2:0/3924631145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ece6c98cf0 con 0x55ece6c8cb40 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.698+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c96370 0x55ece6c8e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.698+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8e120 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6d300bbf80 tx=0x7f6d30009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534454b4091afab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.698+0000 7f6d23fff640 1 -- 172.21.15.2:0/3924631145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30049050 con 0x55ece6c8cb40 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.698+0000 7f6d23fff640 1 -- 172.21.15.2:0/3924631145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d300c4bb0 con 0x55ece6c8cb40 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.698+0000 7f6d23fff640 1 -- 172.21.15.2:0/3924631145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300b8660 con 0x55ece6c8cb40 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- 172.21.15.2:0/3924631145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 msgr2=0x55ece6c8e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8e120 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6d300bbf80 tx=0x7f6d30009260 comp rx=0 tx=0).stop 2024-09-12T00:59:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- 172.21.15.2:0/3924631145 shutdown_connections 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c96370 0x55ece6c8e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6c8e120 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 --2- 172.21.15.2:0/3924631145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c8b5d0 0x55ece6c94f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- 172.21.15.2:0/3924631145 >> 172.21.15.2:0/3924631145 conn(0x55ece6c54310 msgr2=0x55ece6c94860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- 172.21.15.2:0/3924631145 shutdown_connections 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- 172.21.15.2:0/3924631145 wait complete. 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- start start 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 Processor -- start 2024-09-12T00:59:17.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6d08b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6d090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 0x55ece6d13a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1ac0a0 con 0x55ece6c8cb40 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1ad510 con 0x55ece6c96370 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1ac770 con 0x55ece6c8b5d0 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d432ba740 10 client.0 _ll_register_callbacks cb 0x7f6d3400a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6d090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.699+0000 7f6d39d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6d090a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34104/0 (socket says 172.21.15.2:34104) 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d39d9b640 1 -- 172.21.15.2:0/1175900206 learned_addr learned my addr 172.21.15.2:0/1175900206 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6d08b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d3ad9d640 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 0x55ece6d13a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d39d9b640 1 -- 172.21.15.2:0/1175900206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 msgr2=0x55ece6d08b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6d08b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d39d9b640 1 -- 172.21.15.2:0/1175900206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 msgr2=0x55ece6d13a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 0x55ece6d13a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d39d9b640 1 -- 172.21.15.2:0/1175900206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ece6c874f0 con 0x55ece6c8cb40 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d39d9b640 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6d090a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6d300b8450 tx=0x7f6d300c0470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c12479298079ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1175900206 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300035f0 con 0x55ece6c8cb40 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1175900206 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f6d30003c80 con 0x55ece6c8cb40 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d432ba740 1 -- 172.21.15.2:0/1175900206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d300c4bb0 con 0x55ece6c8cb40 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1175900206 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6d30049030 con 0x55ece6c8cb40 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d432ba740 10 client.16737 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.700+0000 7f6d432ba740 1 -- 172.21.15.2:0/1175900206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ece6d15170 con 0x55ece6c8cb40 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1175900206 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d300c4bb0 con 0x55ece6c8cb40 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1175900206 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f6d300ed3f0 con 0x55ece6c8cb40 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d432ba740 10 client.16737 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d432ba740 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d432ba740 20 client.16737 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ece6d15860 0x55ece6d17c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d432ba740 4 client.16737 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d432ba740 1 -- 172.21.15.2:0/1175900206 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ece6bf8d70 con 0x55ece6d15860 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ece6d15860 0x55ece6d17c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d3a59c640 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ece6d15860 0x55ece6d17c80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3661057b5e0d8b6 server_cookie=c401ce53151d7689 in_seq=0 out_seq=0 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.701+0000 7f6d21ffb640 10 client.16737 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d21ffb640 1 -- 172.21.15.2:0/1175900206 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ece6bf8d70 con 0x55ece6d15860 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d21ffb640 10 client.16737 handle_command_reply: tid=0 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 client.16737 shutdown 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 -- 172.21.15.2:0/1175900206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 msgr2=0x55ece6d090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6d090a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6d300b8450 tx=0x7f6d300c0470 comp rx=0 tx=0).stop 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 -- 172.21.15.2:0/1175900206 shutdown_connections 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ece6d15860 0x55ece6d17c80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ece6c96370 0x55ece6d13a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ece6c8cb40 0x55ece6d090a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 --2- 172.21.15.2:0/1175900206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ece6c8b5d0 0x55ece6d08b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 -- 172.21.15.2:0/1175900206 >> 172.21.15.2:0/1175900206 conn(0x55ece6c54310 msgr2=0x55ece6c95080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d21ffb640 0 client.16737 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 -- 172.21.15.2:0/1175900206 shutdown_connections 2024-09-12T00:59:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 1 -- 172.21.15.2:0/1175900206 wait complete. 2024-09-12T00:59:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.702+0000 7f6d432ba740 20 client.16737 trim_cache size 0 max 16384 2024-09-12T00:59:17.708 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:17.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 -- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6d240a2cf0 msgr2=0x7f6d240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6d240a2cf0 0x7f6d240a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d340155c0 tx=0x7f6d3401c000 comp rx=0 tx=0).stop 2024-09-12T00:59:17.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 -- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101420 msgr2=0x7f6d3c198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:17.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101420 0x7f6d3c198a30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009230 tx=0x7f6d30004270 comp rx=0 tx=0).stop 2024-09-12T00:59:17.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 -- 172.21.15.2:0/1289576203 shutdown_connections 2024-09-12T00:59:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f6d240a2cf0 0x7f6d240a51b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d3c106a80 0x7f6d3c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d3c101420 0x7f6d3c198a30 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 --2- 172.21.15.2:0/1289576203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c100a80 0x7f6d3c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 -- 172.21.15.2:0/1289576203 >> 172.21.15.2:0/1289576203 conn(0x7f6d3c0fc7a0 msgr2=0x7f6d3c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 -- 172.21.15.2:0/1289576203 shutdown_connections 2024-09-12T00:59:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:17.703+0000 7f6d40ee1640 1 -- 172.21.15.2:0/1289576203 wait complete. 2024-09-12T00:59:18.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:18 smithi002 ceph-mon[31210]: pgmap v194: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-12T00:59:18.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:18 smithi071 ceph-mon[35276]: pgmap v194: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-12T00:59:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:18 smithi167 ceph-mon[35234]: pgmap v194: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-12T00:59:19.428 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:59:19.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:59:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:20.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 -- 172.21.15.2:0/26660970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504102790 msgr2=0x7f35041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 --2- 172.21.15.2:0/26660970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504102790 0x7f35041067e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009900 tx=0x7f34f802a410 comp rx=0 tx=0).stop 2024-09-12T00:59:20.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 -- 172.21.15.2:0/26660970 shutdown_connections 2024-09-12T00:59:20.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 --2- 172.21.15.2:0/26660970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3504106f10 0x7f350410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 --2- 172.21.15.2:0/26660970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504102790 0x7f35041067e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 --2- 172.21.15.2:0/26660970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3504101de0 0x7f35041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 -- 172.21.15.2:0/26660970 >> 172.21.15.2:0/26660970 conn(0x7f35040fd8c0 msgr2=0x7f35040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:20.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 -- 172.21.15.2:0/26660970 shutdown_connections 2024-09-12T00:59:20.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.197+0000 7f3508ffe640 1 -- 172.21.15.2:0/26660970 wait complete. 2024-09-12T00:59:20.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3508ffe640 1 Processor -- start 2024-09-12T00:59:20.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3508ffe640 1 -- start start 2024-09-12T00:59:20.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3508ffe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3504101de0 0x7f35040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3508ffe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3504102790 0x7f3504074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3508ffe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504106f10 0x7f3504074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3508ffe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3504111f30 con 0x7f3504106f10 2024-09-12T00:59:20.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3508ffe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3504111db0 con 0x7f3504102790 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3508ffe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35041120b0 con 0x7f3504101de0 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3502d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504106f10 0x7f3504074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3502d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504106f10 0x7f3504074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34116/0 (socket says 172.21.15.2:34116) 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3502d9d640 1 -- 172.21.15.2:0/875431665 learned_addr learned my addr 172.21.15.2:0/875431665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3501d9b640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3504102790 0x7f3504074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f350259c640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3504101de0 0x7f35040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3502d9d640 1 -- 172.21.15.2:0/875431665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3504101de0 msgr2=0x7f35040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3502d9d640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3504101de0 0x7f35040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3502d9d640 1 -- 172.21.15.2:0/875431665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3504102790 msgr2=0x7f3504074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3502d9d640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3504102790 0x7f3504074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.198+0000 7f3502d9d640 1 -- 172.21.15.2:0/875431665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35041a6840 con 0x7f3504106f10 2024-09-12T00:59:20.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.199+0000 7f3502d9d640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504106f10 0x7f3504074f70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00eaa0 tx=0x7f34fc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:20.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.199+0000 7f34f37fe640 1 -- 172.21.15.2:0/875431665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00cdb0 con 0x7f3504106f10 2024-09-12T00:59:20.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.199+0000 7f34f37fe640 1 -- 172.21.15.2:0/875431665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34fc005020 con 0x7f3504106f10 2024-09-12T00:59:20.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.199+0000 7f3508ffe640 1 -- 172.21.15.2:0/875431665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35041a6b30 con 0x7f3504106f10 2024-09-12T00:59:20.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.199+0000 7f34f37fe640 1 -- 172.21.15.2:0/875431665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0116b0 con 0x7f3504106f10 2024-09-12T00:59:20.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.199+0000 7f3508ffe640 1 -- 172.21.15.2:0/875431665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35041a6ff0 con 0x7f3504106f10 2024-09-12T00:59:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.201+0000 7f34f37fe640 1 -- 172.21.15.2:0/875431665 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f34fc005560 con 0x7f3504106f10 2024-09-12T00:59:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.201+0000 7f350b3d7740 1 Processor -- start 2024-09-12T00:59:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350b3d7740 1 -- start start 2024-09-12T00:59:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f2f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f2ff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f302130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350b3d7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557d2f25a280 con 0x557d2f2f5480 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350b3d7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557d2f201b10 con 0x557d2f2ffd40 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350b3d7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557d2f256240 con 0x557d2f2f4b60 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f34f37fe640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f34ec0a2cf0 0x7f34ec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f2ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f2ff800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34132/0 (socket says 172.21.15.2:34132) 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350259c640 1 -- 172.21.15.2:0/894531618 learned_addr learned my addr 172.21.15.2:0/894531618 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f3501d9b640 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f302130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f3502d9d640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f34ec0a2cf0 0x7f34ec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f3501d9b640 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f2f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350259c640 1 -- 172.21.15.2:0/894531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 msgr2=0x557d2f2f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:20.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350259c640 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f2f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350259c640 1 -- 172.21.15.2:0/894531618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 msgr2=0x557d2f302130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350259c640 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f302130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f350259c640 1 -- 172.21.15.2:0/894531618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2f20e1f0 con 0x557d2f2f5480 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.202+0000 7f3501d9b640 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f2f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.203+0000 7f34f37fe640 1 -- 172.21.15.2:0/875431665 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f34fc0cf6f0 con 0x7f3504106f10 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.203+0000 7f350259c640 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f2ff800 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f34f400cc60 tx=0x7f34f400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60952ac14000ca1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.203+0000 7f3502d9d640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f34ec0a2cf0 0x7f34ec0a51b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f34fc098530 tx=0x7f34fc097ef0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.203+0000 7f34f0ff9640 1 -- 172.21.15.2:0/894531618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4014070 con 0x557d2f2f5480 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.203+0000 7f34f0ff9640 1 -- 172.21.15.2:0/894531618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34f40047a0 con 0x557d2f2f5480 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.203+0000 7f34f0ff9640 1 -- 172.21.15.2:0/894531618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4010730 con 0x557d2f2f5480 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 -- 172.21.15.2:0/894531618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 msgr2=0x557d2f2ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f2ff800 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f34f400cc60 tx=0x7f34f400e720 comp rx=0 tx=0).stop 2024-09-12T00:59:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 -- 172.21.15.2:0/894531618 shutdown_connections 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f302130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f2ff800 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 --2- 172.21.15.2:0/894531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f2f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 -- 172.21.15.2:0/894531618 >> 172.21.15.2:0/894531618 conn(0x557d2f2f10f0 msgr2=0x557d2f2f14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 -- 172.21.15.2:0/894531618 shutdown_connections 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 -- 172.21.15.2:0/894531618 wait complete. 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 -- start start 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.204+0000 7f350b3d7740 1 Processor -- start 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f4b60 0x557d2f2fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f5480 0x557d2f2fd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f2fd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350b3d7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557d2f302910 con 0x557d2f2f4b60 2024-09-12T00:59:20.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350b3d7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557d2f214f10 con 0x557d2f2ffd40 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350b3d7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557d2f302a90 con 0x557d2f2f5480 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350b3d7740 10 client.0 _ll_register_callbacks cb 0x557d2f1dda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f4b60 0x557d2f2fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f4b60 0x557d2f2fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34144/0 (socket says 172.21.15.2:34144) 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 -- 172.21.15.2:0/355877593 learned_addr learned my addr 172.21.15.2:0/355877593 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350259c640 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f5480 0x557d2f2fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 -- 172.21.15.2:0/355877593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f5480 msgr2=0x557d2f2fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f5480 0x557d2f2fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 -- 172.21.15.2:0/355877593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 msgr2=0x557d2f2fd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f2fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 -- 172.21.15.2:0/355877593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2efcb6a0 con 0x557d2f2f4b60 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350259c640 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f5480 0x557d2f2fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f3501d9b640 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f4b60 0x557d2f2fcbd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009900 tx=0x7f34f8031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b04498000dc298d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f34e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f34e9ffb640 1 -- 172.21.15.2:0/355877593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8035070 con 0x557d2f2f4b60 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f34e9ffb640 1 -- 172.21.15.2:0/355877593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f34f8005020 con 0x557d2f2f4b60 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.205+0000 7f350b3d7740 1 -- 172.21.15.2:0/355877593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f40047a0 con 0x557d2f2f4b60 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f34e9ffb640 1 -- 172.21.15.2:0/355877593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f34f80044d0 con 0x557d2f2f4b60 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f350b3d7740 10 client.16749 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f350b3d7740 1 -- 172.21.15.2:0/355877593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557d2f30e430 con 0x557d2f2f4b60 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f34e9ffb640 1 -- 172.21.15.2:0/355877593 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34f40047a0 con 0x557d2f2f4b60 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f34e9ffb640 1 -- 172.21.15.2:0/355877593 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f34f8044030 con 0x557d2f2f4b60 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f350b3d7740 10 client.16749 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f350b3d7740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f350b3d7740 20 client.16749 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f350b3d7740 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557d2f30f940 0x557d2f311da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f350b3d7740 4 client.16749 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:20.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.206+0000 7f350b3d7740 1 -- 172.21.15.2:0/355877593 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d2f2677f0 con 0x557d2f30f940 2024-09-12T00:59:20.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.207+0000 7f350259c640 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557d2f30f940 0x557d2f311da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.207+0000 7f350259c640 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557d2f30f940 0x557d2f311da0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e31ba0f6c967a13 server_cookie=312da69d937577c5 in_seq=0 out_seq=0 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.207+0000 7f34e9ffb640 10 client.16749 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f34e9ffb640 1 -- 172.21.15.2:0/355877593 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d2f2677f0 con 0x557d2f30f940 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f34e9ffb640 10 client.16749 handle_command_reply: tid=0 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 client.16749 shutdown 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 -- 172.21.15.2:0/355877593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f4b60 msgr2=0x557d2f2fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f4b60 0x557d2f2fcbd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009900 tx=0x7f34f8031a40 comp rx=0 tx=0).stop 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 -- 172.21.15.2:0/355877593 shutdown_connections 2024-09-12T00:59:20.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557d2f30f940 0x557d2f311da0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f2fd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f5480 0x557d2f2fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 --2- 172.21.15.2:0/355877593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f4b60 0x557d2f2fcbd0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 -- 172.21.15.2:0/355877593 >> 172.21.15.2:0/355877593 conn(0x557d2f2f10f0 msgr2=0x557d2f2f0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f34e9ffb640 0 client.16749 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 -- 172.21.15.2:0/355877593 shutdown_connections 2024-09-12T00:59:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 1 -- 172.21.15.2:0/355877593 wait complete. 2024-09-12T00:59:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.208+0000 7f350b3d7740 20 client.16749 trim_cache size 0 max 16384 2024-09-12T00:59:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.225+0000 7f350b3d7740 1 Processor -- start 2024-09-12T00:59:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.225+0000 7f350b3d7740 1 -- start start 2024-09-12T00:59:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2f4b60 0x557d2f2f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f317670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2ffd40 0x557d2f317bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350b3d7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35041b24a0 con 0x557d2f2f5480 2024-09-12T00:59:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350b3d7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35041afce0 con 0x557d2f2f4b60 2024-09-12T00:59:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350b3d7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35041adb80 con 0x557d2f2ffd40 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f317670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f317670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34156/0 (socket says 172.21.15.2:34156) 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 -- 172.21.15.2:0/1578347826 learned_addr learned my addr 172.21.15.2:0/1578347826 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f3501d9b640 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2ffd40 0x557d2f317bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 -- 172.21.15.2:0/1578347826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2ffd40 msgr2=0x557d2f317bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2ffd40 0x557d2f317bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 -- 172.21.15.2:0/1578347826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2f4b60 msgr2=0x557d2f2f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2f4b60 0x557d2f2f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 -- 172.21.15.2:0/1578347826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2f2f52b0 con 0x557d2f2f5480 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f3501d9b640 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2ffd40 0x557d2f317bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.226+0000 7f350259c640 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f317670 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f34f400cc60 tx=0x7f34f4010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274c9f3911a0dd16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f34ebfff640 1 -- 172.21.15.2:0/1578347826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4014040 con 0x557d2f2f5480 2024-09-12T00:59:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f34ebfff640 1 -- 172.21.15.2:0/1578347826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34f4004220 con 0x557d2f2f5480 2024-09-12T00:59:20.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f34ebfff640 1 -- 172.21.15.2:0/1578347826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4010700 con 0x557d2f2f5480 2024-09-12T00:59:20.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 -- 172.21.15.2:0/1578347826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 msgr2=0x557d2f317670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f317670 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f34f400cc60 tx=0x7f34f4010430 comp rx=0 tx=0).stop 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 -- 172.21.15.2:0/1578347826 shutdown_connections 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2ffd40 0x557d2f317bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f317670 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 --2- 172.21.15.2:0/1578347826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2f4b60 0x557d2f2f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 -- 172.21.15.2:0/1578347826 >> 172.21.15.2:0/1578347826 conn(0x557d2f2f10f0 msgr2=0x557d2f2feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 -- 172.21.15.2:0/1578347826 shutdown_connections 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.227+0000 7f350b3d7740 1 -- 172.21.15.2:0/1578347826 wait complete. 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 1 -- start start 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 1 Processor -- start 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f303e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f3043a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f379640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35041ae1a0 con 0x557d2f2f5480 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35041af610 con 0x557d2f2ffd40 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35041ae870 con 0x557d2f2f4b60 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350b3d7740 10 client.0 _ll_register_callbacks cb 0x7f34f80316d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f3043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f3043a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34158/0 (socket says 172.21.15.2:34158) 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350259c640 1 -- 172.21.15.2:0/143727463 learned_addr learned my addr 172.21.15.2:0/143727463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f3501d9b640 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f379640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f3501d9b640 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f303e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350259c640 1 -- 172.21.15.2:0/143727463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 msgr2=0x557d2f303e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350259c640 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f303e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350259c640 1 -- 172.21.15.2:0/143727463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 msgr2=0x557d2f379640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:20.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350259c640 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f379640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.228+0000 7f350259c640 1 -- 172.21.15.2:0/143727463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2f379b80 con 0x557d2f2f5480 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350259c640 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f3043a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f34f400f010 tx=0x7f34f400c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6aa6e1883d06ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f34e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f34e9ffb640 1 -- 172.21.15.2:0/143727463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4032020 con 0x557d2f2f5480 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f34e9ffb640 1 -- 172.21.15.2:0/143727463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f34f40045d0 con 0x557d2f2f5480 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 1 -- 172.21.15.2:0/143727463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f4004220 con 0x557d2f2f5480 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f34e9ffb640 1 -- 172.21.15.2:0/143727463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f34f403d050 con 0x557d2f2f5480 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 10 client.16755 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 1 -- 172.21.15.2:0/143727463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557d2f37acf0 con 0x557d2f2f5480 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f34e9ffb640 1 -- 172.21.15.2:0/143727463 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34f4004220 con 0x557d2f2f5480 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f34e9ffb640 1 -- 172.21.15.2:0/143727463 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f34f40394b0 con 0x557d2f2f5480 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 10 client.16755 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 20 client.16755 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557d2f37b1c0 0x557d2f37d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 4 client.16755 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.229+0000 7f350b3d7740 1 -- 172.21.15.2:0/143727463 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557d2f261d00 con 0x557d2f37b1c0 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.230+0000 7f3501d9b640 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557d2f37b1c0 0x557d2f37d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.230+0000 7f34e9ffb640 10 client.16755 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.230+0000 7f3501d9b640 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557d2f37b1c0 0x557d2f37d5e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79be46ac8f2c787c server_cookie=8c1b08f9d56ae186 in_seq=0 out_seq=0 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f34e9ffb640 1 -- 172.21.15.2:0/143727463 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557d2f261d00 con 0x557d2f37b1c0 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f34e9ffb640 10 client.16755 handle_command_reply: tid=0 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 client.16755 shutdown 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 -- 172.21.15.2:0/143727463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 msgr2=0x557d2f3043a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f3043a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f34f400f010 tx=0x7f34f400c3d0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 -- 172.21.15.2:0/143727463 shutdown_connections 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557d2f37b1c0 0x557d2f37d5e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d2f2ffd40 0x557d2f379640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d2f2f5480 0x557d2f3043a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 --2- 172.21.15.2:0/143727463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2f2f4b60 0x557d2f303e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f34e9ffb640 0 client.16755 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 -- 172.21.15.2:0/143727463 >> 172.21.15.2:0/143727463 conn(0x557d2f2f10f0 msgr2=0x557d2f2fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 -- 172.21.15.2:0/143727463 shutdown_connections 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.231+0000 7f350b3d7740 1 -- 172.21.15.2:0/143727463 wait complete. 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f350b3d7740 20 client.16755 trim_cache size 0 max 16384 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "a93933df-c6aa-4b48-b411-35cc8937631c", 2024-09-12T00:59:20.236 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:59:20.237 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:20.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 -- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f34ec0a2cf0 msgr2=0x7f34ec0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f34ec0a2cf0 0x7f34ec0a51b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f34fc098530 tx=0x7f34fc097ef0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 -- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504106f10 msgr2=0x7f3504074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504106f10 0x7f3504074f70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00eaa0 tx=0x7f34fc00ef60 comp rx=0 tx=0).stop 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 -- 172.21.15.2:0/875431665 shutdown_connections 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f34ec0a2cf0 0x7f34ec0a51b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504106f10 0x7f3504074f70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3504102790 0x7f3504074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 --2- 172.21.15.2:0/875431665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3504101de0 0x7f35040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 -- 172.21.15.2:0/875431665 >> 172.21.15.2:0/875431665 conn(0x7f35040fd8c0 msgr2=0x7f35040fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 -- 172.21.15.2:0/875431665 shutdown_connections 2024-09-12T00:59:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:20.232+0000 7f3508ffe640 1 -- 172.21.15.2:0/875431665 wait complete. 2024-09-12T00:59:20.839 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:20 smithi167 ceph-mon[35234]: pgmap v195: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-12T00:59:20.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:20 smithi002 ceph-mon[31210]: pgmap v195: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-12T00:59:20.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:20 smithi071 ceph-mon[35276]: pgmap v195: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-12T00:59:20.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:59:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:21.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:21 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:59:21.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:21 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:21.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:21 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:59:21.662 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:21 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:21.662 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:21 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 -- 172.21.15.2:0/2092501797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98981034b0 msgr2=0x7f989810b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 --2- 172.21.15.2:0/2092501797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98981034b0 0x7f989810b9a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f988c009900 tx=0x7f988c02a480 comp rx=0 tx=0).stop 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 -- 172.21.15.2:0/2092501797 shutdown_connections 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 --2- 172.21.15.2:0/2092501797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f989810bfc0 0x7f989810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 --2- 172.21.15.2:0/2092501797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98981034b0 0x7f989810b9a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 --2- 172.21.15.2:0/2092501797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9898102b90 0x7f9898102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 -- 172.21.15.2:0/2092501797 >> 172.21.15.2:0/2092501797 conn(0x7f98980fc630 msgr2=0x7f98980fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 -- 172.21.15.2:0/2092501797 shutdown_connections 2024-09-12T00:59:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.661+0000 7f989cf9e640 1 -- 172.21.15.2:0/2092501797 wait complete. 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f989cf9e640 1 Processor -- start 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f989cf9e640 1 -- start start 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f989cf9e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9898102b90 0x7f9898198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f989cf9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98981034b0 0x7f98981986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f989cf9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f989810bfc0 0x7f989819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f989cf9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9898111dc0 con 0x7f989810bfc0 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f989cf9e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9898111c40 con 0x7f9898102b90 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f989cf9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9898111f40 con 0x7f98981034b0 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f9897fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f989810bfc0 0x7f989819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f9897fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f989810bfc0 0x7f989819ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34178/0 (socket says 172.21.15.2:34178) 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f9897fff640 1 -- 172.21.15.2:0/534841641 learned_addr learned my addr 172.21.15.2:0/534841641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.662+0000 7f98977fe640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9898102b90 0x7f9898198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9896ffd640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98981034b0 0x7f98981986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9897fff640 1 -- 172.21.15.2:0/534841641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98981034b0 msgr2=0x7f98981986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9897fff640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98981034b0 0x7f98981986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9897fff640 1 -- 172.21.15.2:0/534841641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9898102b90 msgr2=0x7f9898198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9897fff640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9898102b90 0x7f9898198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9897fff640 1 -- 172.21.15.2:0/534841641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989819d130 con 0x7f989810bfc0 2024-09-12T00:59:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9897fff640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f989810bfc0 0x7f989819ca50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f989000cce0 tx=0x7f989000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9894ff9640 1 -- 172.21.15.2:0/534841641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989000f450 con 0x7f989810bfc0 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9894ff9640 1 -- 172.21.15.2:0/534841641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f989000fad0 con 0x7f989810bfc0 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f989cf9e640 1 -- 172.21.15.2:0/534841641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989819d420 con 0x7f989810bfc0 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f9894ff9640 1 -- 172.21.15.2:0/534841641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890018b60 con 0x7f989810bfc0 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.663+0000 7f989cf9e640 1 -- 172.21.15.2:0/534841641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98981a4d00 con 0x7f989810bfc0 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f9894ff9640 1 -- 172.21.15.2:0/534841641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f989000fc80 con 0x7f989810bfc0 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f98a05d9740 1 Processor -- start 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f98a05d9740 1 -- start start 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 0x55994f386a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f391310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f391850 0x55994f393c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f98a05d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55994f2ec2e0 con 0x55994f391850 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f98a05d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55994f293ce0 con 0x55994f386f90 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f98a05d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55994f2e82a0 con 0x55994f386670 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f391850 0x55994f393c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f9894ff9640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2cf0 0x7f98800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f391850 0x55994f393c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34188/0 (socket says 172.21.15.2:34188) 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.666+0000 7f9896ffd640 1 -- 172.21.15.2:0/1499191399 learned_addr learned my addr 172.21.15.2:0/1499191399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 0x55994f386a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f98977fe640 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f391310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f9897fff640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2cf0 0x7f98800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f9894ff9640 1 -- 172.21.15.2:0/534841641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f98900cf8c0 con 0x7f989810bfc0 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f98977fe640 1 -- 172.21.15.2:0/1499191399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 msgr2=0x55994f386a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f98977fe640 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 0x55994f386a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f98977fe640 1 -- 172.21.15.2:0/1499191399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f391850 msgr2=0x55994f393c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f98977fe640 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f391850 0x55994f393c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f98977fe640 1 -- 172.21.15.2:0/1499191399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994f278440 con 0x55994f386f90 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f391850 0x55994f393c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f9897fff640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2cf0 0x7f98800a51b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f989009ba90 tx=0x7f989000cf10 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f98977fe640 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f391310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f988800abf0 tx=0x7f988800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41e006c4ae618c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f987dffb640 1 -- 172.21.15.2:0/1499191399 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888005220 con 0x55994f386f90 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f987dffb640 1 -- 172.21.15.2:0/1499191399 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9888004c80 con 0x55994f386f90 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.667+0000 7f987dffb640 1 -- 172.21.15.2:0/1499191399 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888018860 con 0x55994f386f90 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 -- 172.21.15.2:0/1499191399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 msgr2=0x55994f391310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f391310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f988800abf0 tx=0x7f988800f790 comp rx=0 tx=0).stop 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 -- 172.21.15.2:0/1499191399 shutdown_connections 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f391850 0x55994f393c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f391310 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1499191399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 0x55994f386a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 -- 172.21.15.2:0/1499191399 >> 172.21.15.2:0/1499191399 conn(0x55994f382c00 msgr2=0x55994f382fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 -- 172.21.15.2:0/1499191399 shutdown_connections 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 -- 172.21.15.2:0/1499191399 wait complete. 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.668+0000 7f98a05d9740 1 -- start start 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98a05d9740 1 Processor -- start 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 0x55994f3910e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386f90 0x55994f38e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 0x55994f38e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98a05d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55994f394420 con 0x55994f386f90 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98a05d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55994f2a7050 con 0x55994f391850 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98a05d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55994f3945a0 con 0x55994f386670 2024-09-12T00:59:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98a05d9740 10 client.0 _ll_register_callbacks cb 0x55994f2e7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386f90 0x55994f38e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386f90 0x55994f38e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34194/0 (socket says 172.21.15.2:34194) 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98977fe640 1 -- 172.21.15.2:0/2733681649 learned_addr learned my addr 172.21.15.2:0/2733681649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f9896ffd640 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 0x55994f38e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f9896ffd640 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 0x55994f3910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.669+0000 7f98977fe640 1 -- 172.21.15.2:0/2733681649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 msgr2=0x55994f3910e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f98977fe640 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 0x55994f3910e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f98977fe640 1 -- 172.21.15.2:0/2733681649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 msgr2=0x55994f38e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f98977fe640 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 0x55994f38e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f98977fe640 1 -- 172.21.15.2:0/2733681649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994f05d3c0 con 0x55994f386f90 2024-09-12T00:59:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f98977fe640 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386f90 0x55994f38e390 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f98880057c0 tx=0x7f9888005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176231e801ec7eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f9876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f9876ffd640 1 -- 172.21.15.2:0/2733681649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888027070 con 0x55994f386f90 2024-09-12T00:59:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f9876ffd640 1 -- 172.21.15.2:0/2733681649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9888005460 con 0x55994f386f90 2024-09-12T00:59:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f98a05d9740 1 -- 172.21.15.2:0/2733681649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9888004c80 con 0x55994f386f90 2024-09-12T00:59:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f9876ffd640 1 -- 172.21.15.2:0/2733681649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9888033050 con 0x55994f386f90 2024-09-12T00:59:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f98a05d9740 10 client.16767 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.670+0000 7f98a05d9740 1 -- 172.21.15.2:0/2733681649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55994f39fd30 con 0x55994f386f90 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f9876ffd640 1 -- 172.21.15.2:0/2733681649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9888004c80 con 0x55994f386f90 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f9876ffd640 1 -- 172.21.15.2:0/2733681649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f9888023430 con 0x55994f386f90 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f98a05d9740 10 client.16767 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f98a05d9740 10 client.16767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f98a05d9740 20 client.16767 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f98a05d9740 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55994f3a10e0 0x55994f3a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f98a05d9740 4 client.16767 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f98a05d9740 1 -- 172.21.15.2:0/2733681649 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55994f2f9850 con 0x55994f3a10e0 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.671+0000 7f9896ffd640 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55994f3a10e0 0x55994f3a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.672+0000 7f9876ffd640 10 client.16767 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.672+0000 7f9896ffd640 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55994f3a10e0 0x55994f3a34d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7cc61e937329a50 server_cookie=12520f37c98262a2 in_seq=0 out_seq=0 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.672+0000 7f9876ffd640 1 -- 172.21.15.2:0/2733681649 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55994f2f9850 con 0x55994f3a10e0 2024-09-12T00:59:21.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.672+0000 7f9876ffd640 10 client.16767 handle_command_reply: tid=0 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.672+0000 7f98a05d9740 1 client.16767 shutdown 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.672+0000 7f98a05d9740 1 -- 172.21.15.2:0/2733681649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386f90 msgr2=0x55994f38e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.672+0000 7f98a05d9740 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386f90 0x55994f38e390 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f98880057c0 tx=0x7f9888005060 comp rx=0 tx=0).stop 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 1 -- 172.21.15.2:0/2733681649 shutdown_connections 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55994f3a10e0 0x55994f3a34d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 0x55994f38e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386f90 0x55994f38e390 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f9876ffd640 0 client.16767 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 1 --2- 172.21.15.2:0/2733681649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386670 0x55994f3910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 1 -- 172.21.15.2:0/2733681649 >> 172.21.15.2:0/2733681649 conn(0x55994f382c00 msgr2=0x55994f3888e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 1 -- 172.21.15.2:0/2733681649 shutdown_connections 2024-09-12T00:59:21.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 1 -- 172.21.15.2:0/2733681649 wait complete. 2024-09-12T00:59:21.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.673+0000 7f98a05d9740 20 client.16767 trim_cache size 0 max 16384 2024-09-12T00:59:21.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f98a05d9740 1 Processor -- start 2024-09-12T00:59:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f98a05d9740 1 -- start start 2024-09-12T00:59:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f39d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386f90 0x55994f3a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 0x55994f3a9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f98a05d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98981b0020 con 0x55994f386670 2024-09-12T00:59:21.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f98a05d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98981ad860 con 0x55994f391850 2024-09-12T00:59:21.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f98a05d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f98981ab6b0 con 0x55994f386f90 2024-09-12T00:59:21.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f39d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f39d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34206/0 (socket says 172.21.15.2:34206) 2024-09-12T00:59:21.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f9896ffd640 1 -- 172.21.15.2:0/1081841144 learned_addr learned my addr 172.21.15.2:0/1081841144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:21.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f9896ffd640 1 -- 172.21.15.2:0/1081841144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386f90 msgr2=0x55994f3a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:21.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1081841144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386f90 0x55994f3a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f9896ffd640 1 -- 172.21.15.2:0/1081841144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 msgr2=0x55994f3a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:21.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1081841144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 0x55994f3a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.690+0000 7f9896ffd640 1 -- 172.21.15.2:0/1081841144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994f38f150 con 0x55994f386670 2024-09-12T00:59:21.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.691+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1081841144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f39d680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f988c009230 tx=0x7f988c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ee033de0790884 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:21.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.691+0000 7f987d7fa640 1 -- 172.21.15.2:0/1081841144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c035040 con 0x55994f386670 2024-09-12T00:59:21.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.691+0000 7f987d7fa640 1 -- 172.21.15.2:0/1081841144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f988c003ad0 con 0x55994f386670 2024-09-12T00:59:21.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.691+0000 7f987d7fa640 1 -- 172.21.15.2:0/1081841144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c04da50 con 0x55994f386670 2024-09-12T00:59:21.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.691+0000 7f98a05d9740 1 -- 172.21.15.2:0/1081841144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 msgr2=0x55994f39d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.691+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1081841144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f39d680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f988c009230 tx=0x7f988c009260 comp rx=0 tx=0).stop 2024-09-12T00:59:21.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.691+0000 7f98a05d9740 1 -- 172.21.15.2:0/1081841144 shutdown_connections 2024-09-12T00:59:21.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1081841144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f391850 0x55994f3a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1081841144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f386f90 0x55994f3a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1081841144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f39d680 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 -- 172.21.15.2:0/1081841144 >> 172.21.15.2:0/1081841144 conn(0x55994f382c00 msgr2=0x55994f390410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:21.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 -- 172.21.15.2:0/1081841144 shutdown_connections 2024-09-12T00:59:21.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 -- 172.21.15.2:0/1081841144 wait complete. 2024-09-12T00:59:21.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 -- start start 2024-09-12T00:59:21.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 Processor -- start 2024-09-12T00:59:21.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f395560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f395aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f391850 0x55994f395fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98981abd20 con 0x55994f386670 2024-09-12T00:59:21.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98981ad190 con 0x55994f386f90 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f98981ac3f0 con 0x55994f391850 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.692+0000 7f98a05d9740 10 client.0 _ll_register_callbacks cb 0x7f988c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f395560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f395560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34212/0 (socket says 172.21.15.2:34212) 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 -- 172.21.15.2:0/1331246842 learned_addr learned my addr 172.21.15.2:0/1331246842 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f98977fe640 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f395aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f391850 0x55994f395fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 -- 172.21.15.2:0/1331246842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f391850 msgr2=0x55994f395fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f391850 0x55994f395fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 -- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 msgr2=0x55994f395aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f395aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 -- 172.21.15.2:0/1331246842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994f40ab30 con 0x55994f386670 2024-09-12T00:59:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f98977fe640 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f395aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9896ffd640 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f395560 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f988c0044c0 tx=0x7f988c04d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4a6da5039fe1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9876ffd640 1 -- 172.21.15.2:0/1331246842 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c035040 con 0x55994f386670 2024-09-12T00:59:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9876ffd640 1 -- 172.21.15.2:0/1331246842 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f988c0037f0 con 0x55994f386670 2024-09-12T00:59:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f98a05d9740 1 -- 172.21.15.2:0/1331246842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f988c003ad0 con 0x55994f386670 2024-09-12T00:59:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.693+0000 7f9876ffd640 1 -- 172.21.15.2:0/1331246842 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f988c005020 con 0x55994f386670 2024-09-12T00:59:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98a05d9740 10 client.16773 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98a05d9740 1 -- 172.21.15.2:0/1331246842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55994f40be00 con 0x55994f386670 2024-09-12T00:59:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f9876ffd640 1 -- 172.21.15.2:0/1331246842 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f988c003ad0 con 0x55994f386670 2024-09-12T00:59:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f9876ffd640 1 -- 172.21.15.2:0/1331246842 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f988c04d6d0 con 0x55994f386670 2024-09-12T00:59:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98a05d9740 10 client.16773 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98a05d9740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98a05d9740 20 client.16773 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55994f3a10e0 0x55994f40e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98a05d9740 4 client.16773 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98a05d9740 1 -- 172.21.15.2:0/1331246842 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55994f2f3d60 con 0x55994f3a10e0 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.694+0000 7f98977fe640 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55994f3a10e0 0x55994f40e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98977fe640 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55994f3a10e0 0x55994f40e470 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa33778789171c7 server_cookie=89043259c0fcb275 in_seq=0 out_seq=0 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f9876ffd640 10 client.16773 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f9876ffd640 1 -- 172.21.15.2:0/1331246842 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55994f2f3d60 con 0x55994f3a10e0 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f9876ffd640 10 client.16773 handle_command_reply: tid=0 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 client.16773 shutdown 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 -- 172.21.15.2:0/1331246842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 msgr2=0x55994f395560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f395560 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f988c0044c0 tx=0x7f988c04d630 comp rx=0 tx=0).stop 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 -- 172.21.15.2:0/1331246842 shutdown_connections 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55994f3a10e0 0x55994f40e470 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994f391850 0x55994f395fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994f386f90 0x55994f395aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f9876ffd640 0 client.16773 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 --2- 172.21.15.2:0/1331246842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55994f386670 0x55994f395560 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 -- 172.21.15.2:0/1331246842 >> 172.21.15.2:0/1331246842 conn(0x55994f382c00 msgr2=0x55994f381500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 -- 172.21.15.2:0/1331246842 shutdown_connections 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 1 -- 172.21.15.2:0/1331246842 wait complete. 2024-09-12T00:59:21.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.695+0000 7f98a05d9740 20 client.16773 trim_cache size 0 max 16384 2024-09-12T00:59:21.708 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:21.708 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:59:21.708 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:59:21.708 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:21.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 -- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2cf0 msgr2=0x7f98800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2cf0 0x7f98800a51b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f989009ba90 tx=0x7f989000cf10 comp rx=0 tx=0).stop 2024-09-12T00:59:21.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 -- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f989810bfc0 msgr2=0x7f989819ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:21.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f989810bfc0 0x7f989819ca50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f989000cce0 tx=0x7f989000a620 comp rx=0 tx=0).stop 2024-09-12T00:59:21.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 -- 172.21.15.2:0/534841641 shutdown_connections 2024-09-12T00:59:21.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f98800a2cf0 0x7f98800a51b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f989810bfc0 0x7f989819ca50 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98981034b0 0x7f98981986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 --2- 172.21.15.2:0/534841641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9898102b90 0x7f9898198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 -- 172.21.15.2:0/534841641 >> 172.21.15.2:0/534841641 conn(0x7f98980fc630 msgr2=0x7f98980fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 -- 172.21.15.2:0/534841641 shutdown_connections 2024-09-12T00:59:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:21.696+0000 7f989cf9e640 1 -- 172.21.15.2:0/534841641 wait complete. 2024-09-12T00:59:21.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:21 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:59:21.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:21 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:21.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:21 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:59:21.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:21 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:21.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:21 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:59:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:21 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:59:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:21 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:21 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:59:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:21 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:21 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:59:22.360 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:59:22.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:59:22.617 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:22.740 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:22 smithi002 ceph-mon[31210]: pgmap v196: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-12T00:59:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:22 smithi071 ceph-mon[35276]: pgmap v196: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-12T00:59:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:22 smithi167 ceph-mon[35234]: pgmap v196: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-12T00:59:23.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 -- 172.21.15.2:0/397703914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0102790 msgr2=0x7fbea01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:23.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 --2- 172.21.15.2:0/397703914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0102790 0x7fbea01067e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009900 tx=0x7fbe9402a410 comp rx=0 tx=0).stop 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 -- 172.21.15.2:0/397703914 shutdown_connections 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 --2- 172.21.15.2:0/397703914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea0106f10 0x7fbea010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 --2- 172.21.15.2:0/397703914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0102790 0x7fbea01067e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 --2- 172.21.15.2:0/397703914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea0101de0 0x7fbea01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 -- 172.21.15.2:0/397703914 >> 172.21.15.2:0/397703914 conn(0x7fbea00fd8c0 msgr2=0x7fbea00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 -- 172.21.15.2:0/397703914 shutdown_connections 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.068+0000 7fbea6876640 1 -- 172.21.15.2:0/397703914 wait complete. 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea6876640 1 Processor -- start 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea6876640 1 -- start start 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea6876640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0101de0 0x7fbea00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea6876640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea0102790 0x7fbea0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea6876640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea0106f10 0x7fbea0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:23.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea6876640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0111f70 con 0x7fbea0101de0 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea6876640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0111df0 con 0x7fbea0106f10 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea6876640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01120f0 con 0x7fbea0102790 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0101de0 0x7fbea00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0101de0 0x7fbea00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34234/0 (socket says 172.21.15.2:34234) 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbe9ffff640 1 -- 172.21.15.2:0/3312630656 learned_addr learned my addr 172.21.15.2:0/3312630656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbea4e13640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea0106f10 0x7fbea0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbe9ffff640 1 -- 172.21.15.2:0/3312630656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea0102790 msgr2=0x7fbea0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbe9ffff640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea0102790 0x7fbea0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.069+0000 7fbe9ffff640 1 -- 172.21.15.2:0/3312630656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea0106f10 msgr2=0x7fbea0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbe9ffff640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea0106f10 0x7fbea0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbe9ffff640 1 -- 172.21.15.2:0/3312630656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea01a69d0 con 0x7fbea0101de0 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbea4e13640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea0106f10 0x7fbea0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbe9ffff640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0101de0 0x7fbea00744f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000d770 tx=0x7fbe9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbe9d7fa640 1 -- 172.21.15.2:0/3312630656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90017070 con 0x7fbea0101de0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea01a6cc0 con 0x7fbea0101de0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbe9d7fa640 1 -- 172.21.15.2:0/3312630656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe90005500 con 0x7fbea0101de0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbe9d7fa640 1 -- 172.21.15.2:0/3312630656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90004e00 con 0x7fbea0101de0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.070+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea01a71b0 con 0x7fbea0101de0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.071+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea01021c0 con 0x7fbea0101de0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.072+0000 7fbe9d7fa640 1 -- 172.21.15.2:0/3312630656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fbe90004fa0 con 0x7fbea0101de0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.073+0000 7fbe9d7fa640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbe880a2cf0 0x7fbe880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.073+0000 7fbe9f7fe640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbe880a2cf0 0x7fbe880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.073+0000 7fbe9d7fa640 1 -- 172.21.15.2:0/3312630656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fbe900cefd0 con 0x7fbea0101de0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.073+0000 7fbe9f7fe640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbe880a2cf0 0x7fbe880a51b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe9402a930 tx=0x7fbe94000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.077+0000 7fbe9d7fa640 1 -- 172.21.15.2:0/3312630656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe9009bba0 con 0x7fbea0101de0 2024-09-12T00:59:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.289+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbea010a150 con 0x7fbea0101de0 2024-09-12T00:59:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.290+0000 7fbe9d7fa640 1 -- 172.21.15.2:0/3312630656 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7fbe9009b4a0 con 0x7fbea0101de0 2024-09-12T00:59:23.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:59:23.290 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:59:23.290 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbe880a2cf0 msgr2=0x7fbe880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbe880a2cf0 0x7fbe880a51b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe9402a930 tx=0x7fbe94000bc0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0101de0 msgr2=0x7fbea00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0101de0 0x7fbea00744f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000d770 tx=0x7fbe9000dc30 comp rx=0 tx=0).stop 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 shutdown_connections 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbe880a2cf0 0x7fbe880a51b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea0106f10 0x7fbea0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea0102790 0x7fbea0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 --2- 172.21.15.2:0/3312630656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea0101de0 0x7fbea00744f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 >> 172.21.15.2:0/3312630656 conn(0x7fbea00fd8c0 msgr2=0x7fbea00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:23.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 shutdown_connections 2024-09-12T00:59:23.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:23.292+0000 7fbea6876640 1 -- 172.21.15.2:0/3312630656 wait complete. 2024-09-12T00:59:23.915 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:23 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3312630656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:23.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:23 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3312630656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:24.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:59:24.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:23 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3312630656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:24.295 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.753+0000 7fc44f7f7640 1 -- 172.21.15.2:0/890228693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 msgr2=0x7fc44810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.753+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/890228693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 0x7fc44810d950 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc440009cd0 tx=0x7fc44002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.754+0000 7fc44f7f7640 1 -- 172.21.15.2:0/890228693 shutdown_connections 2024-09-12T00:59:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.754+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/890228693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 0x7fc44810d950 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.754+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/890228693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448100a80 0x7fc448100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.754+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/890228693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448106a80 0x7fc448106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.754+0000 7fc44f7f7640 1 -- 172.21.15.2:0/890228693 >> 172.21.15.2:0/890228693 conn(0x7fc4480fc7a0 msgr2=0x7fc4480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.754+0000 7fc44f7f7640 1 -- 172.21.15.2:0/890228693 shutdown_connections 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.754+0000 7fc44f7f7640 1 -- 172.21.15.2:0/890228693 wait complete. 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.754+0000 7fc44f7f7640 1 Processor -- start 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44f7f7640 1 -- start start 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44f7f7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448100a80 0x7fc4481972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44f7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 0x7fc4481977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44f7f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448106a80 0x7fc44819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44f7f7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc448110e80 con 0x7fc448101420 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44f7f7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc448110d00 con 0x7fc448100a80 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44f7f7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc448111000 con 0x7fc448106a80 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44cd92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 0x7fc4481977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44cd92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 0x7fc4481977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34246/0 (socket says 172.21.15.2:34246) 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44cd92640 1 -- 172.21.15.2:0/1911942660 learned_addr learned my addr 172.21.15.2:0/1911942660 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44d593640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448100a80 0x7fc4481972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44dd94640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448106a80 0x7fc44819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44cd92640 1 -- 172.21.15.2:0/1911942660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448106a80 msgr2=0x7fc44819bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44cd92640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448106a80 0x7fc44819bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44cd92640 1 -- 172.21.15.2:0/1911942660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448100a80 msgr2=0x7fc4481972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44cd92640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448100a80 0x7fc4481972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.755+0000 7fc44cd92640 1 -- 172.21.15.2:0/1911942660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44819c250 con 0x7fc448101420 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.756+0000 7fc44cd92640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 0x7fc4481977e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00c920 tx=0x7fc43c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.756+0000 7fc43a7fc640 1 -- 172.21.15.2:0/1911942660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c007c70 con 0x7fc448101420 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.756+0000 7fc43a7fc640 1 -- 172.21.15.2:0/1911942660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc43c007e10 con 0x7fc448101420 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.756+0000 7fc44f7f7640 1 -- 172.21.15.2:0/1911942660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44819c540 con 0x7fc448101420 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.756+0000 7fc43a7fc640 1 -- 172.21.15.2:0/1911942660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c018890 con 0x7fc448101420 2024-09-12T00:59:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.756+0000 7fc44f7f7640 1 -- 172.21.15.2:0/1911942660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481a3e20 con 0x7fc448101420 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.758+0000 7fc43a7fc640 1 -- 172.21.15.2:0/1911942660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc43c018a50 con 0x7fc448101420 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc451bd0740 1 Processor -- start 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc451bd0740 1 -- start start 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8e070 0x563b03c8e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8ede0 0x563b03c8f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8f760 0x563b03c95f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc451bd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563b03bea2f0 con 0x563b03c8e070 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc451bd0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563b03b91cf0 con 0x563b03c8f760 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc451bd0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563b03be62b0 con 0x563b03c8ede0 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44dd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8e070 0x563b03c8e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc43a7fc640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4340a2cf0 0x7fc4340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44dd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8e070 0x563b03c8e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34260/0 (socket says 172.21.15.2:34260) 2024-09-12T00:59:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44dd94640 1 -- 172.21.15.2:0/3775818163 learned_addr learned my addr 172.21.15.2:0/3775818163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44cd92640 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8f760 0x563b03c95f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44d593640 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8ede0 0x563b03c8f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44dd94640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4340a2cf0 0x7fc4340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc43a7fc640 1 -- 172.21.15.2:0/1911942660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc43c0cf610 con 0x7fc448101420 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44dd94640 1 -- 172.21.15.2:0/3775818163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8ede0 msgr2=0x563b03c8f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44dd94640 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8ede0 0x563b03c8f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44dd94640 1 -- 172.21.15.2:0/3775818163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8f760 msgr2=0x563b03c95f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.759+0000 7fc44dd94640 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8f760 0x563b03c95f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.760+0000 7fc44dd94640 1 -- 172.21.15.2:0/3775818163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b03b763a0 con 0x563b03c8e070 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.760+0000 7fc44d593640 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8ede0 0x563b03c8f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.760+0000 7fc44dd94640 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8e070 0x563b03c8e450 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc440009430 tx=0x7fc440031c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce563cad45fd7525 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.761+0000 7fc44dd94640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4340a2cf0 0x7fc4340a51b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc440005fe0 tx=0x7fc440049000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.761+0000 7fc4337fe640 1 -- 172.21.15.2:0/3775818163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440004040 con 0x563b03c8e070 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.761+0000 7fc4337fe640 1 -- 172.21.15.2:0/3775818163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc440036040 con 0x563b03c8e070 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.761+0000 7fc4337fe640 1 -- 172.21.15.2:0/3775818163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440030ca0 con 0x563b03c8e070 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 -- 172.21.15.2:0/3775818163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8e070 msgr2=0x563b03c8e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8e070 0x563b03c8e450 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc440009430 tx=0x7fc440031c00 comp rx=0 tx=0).stop 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 -- 172.21.15.2:0/3775818163 shutdown_connections 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8f760 0x563b03c95f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8ede0 0x563b03c8f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 --2- 172.21.15.2:0/3775818163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8e070 0x563b03c8e450 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 -- 172.21.15.2:0/3775818163 >> 172.21.15.2:0/3775818163 conn(0x563b03c4d310 msgr2=0x563b03c80720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 -- 172.21.15.2:0/3775818163 shutdown_connections 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 -- 172.21.15.2:0/3775818163 wait complete. 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 -- start start 2024-09-12T00:59:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.762+0000 7fc451bd0740 1 Processor -- start 2024-09-12T00:59:24.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c95e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c930c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c93620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc451bd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563b03c964a0 con 0x563b03c8f760 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc451bd0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563b03ba5060 con 0x563b03c8ede0 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc451bd0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563b03c96620 con 0x563b03c8e070 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc451bd0740 10 client.0 _ll_register_callbacks cb 0x563b038f88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44dd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c93620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44dd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c93620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34272/0 (socket says 172.21.15.2:34272) 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44dd94640 1 -- 172.21.15.2:0/2822300831 learned_addr learned my addr 172.21.15.2:0/2822300831 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44cd92640 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44d593640 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c95e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44dd94640 1 -- 172.21.15.2:0/2822300831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 msgr2=0x563b03c95e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44dd94640 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c95e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44dd94640 1 -- 172.21.15.2:0/2822300831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 msgr2=0x563b03c930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44dd94640 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c930c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.763+0000 7fc44dd94640 1 -- 172.21.15.2:0/2822300831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b0395b3c0 con 0x563b03c8f760 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc44dd94640 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c93620 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc44004c040 tx=0x7fc44002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3468e90dd596411b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc430ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc430ff9640 1 -- 172.21.15.2:0/2822300831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440004170 con 0x563b03c8f760 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc430ff9640 1 -- 172.21.15.2:0/2822300831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc440004310 con 0x563b03c8f760 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 1 -- 172.21.15.2:0/2822300831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc440036040 con 0x563b03c8f760 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc430ff9640 1 -- 172.21.15.2:0/2822300831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc440004510 con 0x563b03c8f760 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 10 client.16791 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 1 -- 172.21.15.2:0/2822300831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563b03ca1de0 con 0x563b03c8f760 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc430ff9640 1 -- 172.21.15.2:0/2822300831 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc440036040 con 0x563b03c8f760 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc430ff9640 1 -- 172.21.15.2:0/2822300831 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc440030070 con 0x563b03c8f760 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 10 client.16791 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 10 client.16791 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 20 client.16791 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x563b03ca3130 0x563b03ca5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 4 client.16791 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.764+0000 7fc451bd0740 1 -- 172.21.15.2:0/2822300831 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b03bf7860 con 0x563b03ca3130 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.765+0000 7fc44d593640 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x563b03ca3130 0x563b03ca5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.765+0000 7fc44d593640 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x563b03ca3130 0x563b03ca5520 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e0142971170c85a6 server_cookie=46db164217b9845b in_seq=0 out_seq=0 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.765+0000 7fc430ff9640 10 client.16791 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc430ff9640 1 -- 172.21.15.2:0/2822300831 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b03bf7860 con 0x563b03ca3130 2024-09-12T00:59:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc430ff9640 10 client.16791 handle_command_reply: tid=0 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 client.16791 shutdown 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 -- 172.21.15.2:0/2822300831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 msgr2=0x563b03c93620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c93620 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc44004c040 tx=0x7fc44002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 -- 172.21.15.2:0/2822300831 shutdown_connections 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x563b03ca3130 0x563b03ca5520 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c93620 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c930c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc430ff9640 0 client.16791 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2822300831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c95e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 -- 172.21.15.2:0/2822300831 >> 172.21.15.2:0/2822300831 conn(0x563b03c4d310 msgr2=0x563b03c7fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 -- 172.21.15.2:0/2822300831 shutdown_connections 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 1 -- 172.21.15.2:0/2822300831 wait complete. 2024-09-12T00:59:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.766+0000 7fc451bd0740 20 client.16791 trim_cache size 0 max 16384 2024-09-12T00:59:24.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.779+0000 7fc451bd0740 1 Processor -- start 2024-09-12T00:59:24.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.779+0000 7fc451bd0740 1 -- start start 2024-09-12T00:59:24.779 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:24 smithi002 ceph-mon[31210]: pgmap v197: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-12T00:59:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8e070 0x563b03caaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8ede0 0x563b03cab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8f760 0x563b03c866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc451bd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ae000 con 0x563b03c8ede0 2024-09-12T00:59:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc451bd0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ab840 con 0x563b03c8e070 2024-09-12T00:59:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc451bd0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481a9690 con 0x563b03c8f760 2024-09-12T00:59:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8ede0 0x563b03cab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8ede0 0x563b03cab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34282/0 (socket says 172.21.15.2:34282) 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 -- 172.21.15.2:0/344865504 learned_addr learned my addr 172.21.15.2:0/344865504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 -- 172.21.15.2:0/344865504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8f760 msgr2=0x563b03c866c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 --2- 172.21.15.2:0/344865504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8f760 0x563b03c866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44d593640 1 --2- 172.21.15.2:0/344865504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8e070 0x563b03caaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 -- 172.21.15.2:0/344865504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8e070 msgr2=0x563b03caaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 --2- 172.21.15.2:0/344865504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8e070 0x563b03caaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 -- 172.21.15.2:0/344865504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b03c8e780 con 0x563b03c8ede0 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc44cd92640 1 --2- 172.21.15.2:0/344865504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8ede0 0x563b03cab000 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc43c09ba70 tx=0x7fc43c0d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e341765a307fff42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc432ffd640 1 -- 172.21.15.2:0/344865504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c09bae0 con 0x563b03c8ede0 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc432ffd640 1 -- 172.21.15.2:0/344865504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc43c09fe90 con 0x563b03c8ede0 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.780+0000 7fc432ffd640 1 -- 172.21.15.2:0/344865504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c098150 con 0x563b03c8ede0 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 -- 172.21.15.2:0/344865504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8ede0 msgr2=0x563b03cab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 --2- 172.21.15.2:0/344865504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8ede0 0x563b03cab000 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc43c09ba70 tx=0x7fc43c0d1040 comp rx=0 tx=0).stop 2024-09-12T00:59:24.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 -- 172.21.15.2:0/344865504 shutdown_connections 2024-09-12T00:59:24.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 --2- 172.21.15.2:0/344865504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8f760 0x563b03c866c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 --2- 172.21.15.2:0/344865504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8ede0 0x563b03cab000 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 --2- 172.21.15.2:0/344865504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8e070 0x563b03caaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 -- 172.21.15.2:0/344865504 >> 172.21.15.2:0/344865504 conn(0x563b03c4d310 msgr2=0x563b03c7fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:24.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 -- 172.21.15.2:0/344865504 shutdown_connections 2024-09-12T00:59:24.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.781+0000 7fc451bd0740 1 -- 172.21.15.2:0/344865504 wait complete. 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 1 -- start start 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 1 Processor -- start 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c86c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c87160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c876a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481a9d00 con 0x563b03c8f760 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ab170 con 0x563b03c8ede0 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481aa3d0 con 0x563b03c8e070 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc451bd0740 10 client.0 _ll_register_callbacks cb 0x7fc43c00a580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc44dd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c876a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc44d593640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c86c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc44d593640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c86c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:58190/0 (socket says 172.21.15.2:58190) 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc44dd94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c876a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34296/0 (socket says 172.21.15.2:34296) 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc44d593640 1 -- 172.21.15.2:0/2254708072 learned_addr learned my addr 172.21.15.2:0/2254708072 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.782+0000 7fc44cd92640 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c87160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc44cd92640 1 -- 172.21.15.2:0/2254708072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 msgr2=0x563b03c86c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc44cd92640 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c86c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc44cd92640 1 -- 172.21.15.2:0/2254708072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 msgr2=0x563b03c876a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc44cd92640 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c876a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc44cd92640 1 -- 172.21.15.2:0/2254708072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b03c8beb0 con 0x563b03c8ede0 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc44cd92640 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c87160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x563b03c2f660 tx=0x7fc43c09bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f14af9fd2166a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc430ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T00:59:24.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc430ff9640 1 -- 172.21.15.2:0/2254708072 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0b4070 con 0x563b03c8ede0 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc451bd0740 1 -- 172.21.15.2:0/2254708072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc43c09fe90 con 0x563b03c8ede0 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.783+0000 7fc430ff9640 1 -- 172.21.15.2:0/2254708072 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc43c00fb30 con 0x563b03c8ede0 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc430ff9640 1 -- 172.21.15.2:0/2254708072 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc43c098150 con 0x563b03c8ede0 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc451bd0740 10 client.26309 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc451bd0740 1 -- 172.21.15.2:0/2254708072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563b03d12720 con 0x563b03c8ede0 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc430ff9640 1 -- 172.21.15.2:0/2254708072 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc43c09fe90 con 0x563b03c8ede0 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc430ff9640 1 -- 172.21.15.2:0/2254708072 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc43c0b4ce0 con 0x563b03c8ede0 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc451bd0740 10 client.26309 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc451bd0740 10 client.26309 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc451bd0740 20 client.26309 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x563b03d12de0 0x563b03d15200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc451bd0740 4 client.26309 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc451bd0740 1 -- 172.21.15.2:0/2254708072 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b03bf1d70 con 0x563b03d12de0 2024-09-12T00:59:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.784+0000 7fc44d593640 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x563b03d12de0 0x563b03d15200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc44d593640 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x563b03d12de0 0x563b03d15200 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ae6b695d620ed33 server_cookie=d0efd3c99eb6bb8d in_seq=0 out_seq=0 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc430ff9640 10 client.26309 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc430ff9640 1 -- 172.21.15.2:0/2254708072 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b03bf1d70 con 0x563b03d12de0 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc430ff9640 10 client.26309 handle_command_reply: tid=0 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 client.26309 shutdown 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 -- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 msgr2=0x563b03c87160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c87160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x563b03c2f660 tx=0x7fc43c09bbb0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 -- 172.21.15.2:0/2254708072 shutdown_connections 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x563b03d12de0 0x563b03d15200 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b03c8f760 0x563b03c876a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b03c8ede0 0x563b03c87160 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc430ff9640 0 client.26309 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 --2- 172.21.15.2:0/2254708072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b03c8e070 0x563b03c86c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 -- 172.21.15.2:0/2254708072 >> 172.21.15.2:0/2254708072 conn(0x563b03c4d310 msgr2=0x563b03c94920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:24.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 -- 172.21.15.2:0/2254708072 shutdown_connections 2024-09-12T00:59:24.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.785+0000 7fc451bd0740 1 -- 172.21.15.2:0/2254708072 wait complete. 2024-09-12T00:59:24.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc451bd0740 20 client.26309 trim_cache size 0 max 16384 2024-09-12T00:59:24.790 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 -- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4340a2cf0 msgr2=0x7fc4340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4340a2cf0 0x7fc4340a51b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc440005fe0 tx=0x7fc440049000 comp rx=0 tx=0).stop 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 -- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 msgr2=0x7fc4481977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 0x7fc4481977e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00c920 tx=0x7fc43c00cde0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 -- 172.21.15.2:0/1911942660 shutdown_connections 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc4340a2cf0 0x7fc4340a51b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448106a80 0x7fc44819bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc448101420 0x7fc4481977e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 --2- 172.21.15.2:0/1911942660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448100a80 0x7fc4481972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 -- 172.21.15.2:0/1911942660 >> 172.21.15.2:0/1911942660 conn(0x7fc4480fc7a0 msgr2=0x7fc4480fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 -- 172.21.15.2:0/1911942660 shutdown_connections 2024-09-12T00:59:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:24.786+0000 7fc44f7f7640 1 -- 172.21.15.2:0/1911942660 wait complete. 2024-09-12T00:59:24.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:24 smithi071 ceph-mon[35276]: pgmap v197: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-12T00:59:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:24 smithi167 ceph-mon[35234]: pgmap v197: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-12T00:59:25.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:59:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.245+0000 7f5d5ac96640 1 -- 172.21.15.2:0/1582235971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 msgr2=0x7f5d54107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.245+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/1582235971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 0x7f5d54107b90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009930 tx=0x7f5d4002a420 comp rx=0 tx=0).stop 2024-09-12T00:59:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.245+0000 7f5d5ac96640 1 -- 172.21.15.2:0/1582235971 shutdown_connections 2024-09-12T00:59:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.245+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/1582235971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d541082a0 0x7f5d5410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.245+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/1582235971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 0x7f5d54107b90 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.245+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/1582235971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d54102d30 0x7f5d54103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.245+0000 7f5d5ac96640 1 -- 172.21.15.2:0/1582235971 >> 172.21.15.2:0/1582235971 conn(0x7f5d540fc7d0 msgr2=0x7f5d540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.246+0000 7f5d5ac96640 1 -- 172.21.15.2:0/1582235971 shutdown_connections 2024-09-12T00:59:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.246+0000 7f5d5ac96640 1 -- 172.21.15.2:0/1582235971 wait complete. 2024-09-12T00:59:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.246+0000 7f5d5ac96640 1 Processor -- start 2024-09-12T00:59:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.246+0000 7f5d5ac96640 1 -- start start 2024-09-12T00:59:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d5ac96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d54102d30 0x7f5d54198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d5ac96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 0x7f5d54198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d5ac96640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d541082a0 0x7f5d5419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d5ac96640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5d541120a0 con 0x7f5d541036e0 2024-09-12T00:59:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d5ac96640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d54111f20 con 0x7f5d541082a0 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d5ac96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d54112220 con 0x7f5d54102d30 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 0x7f5d54198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 0x7f5d54198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54904/0 (socket says 172.21.15.2:54904) 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 -- 172.21.15.2:0/2983306371 learned_addr learned my addr 172.21.15.2:0/2983306371 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d58a32640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d54102d30 0x7f5d54198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d59233640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d541082a0 0x7f5d5419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 -- 172.21.15.2:0/2983306371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d54102d30 msgr2=0x7f5d54198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d54102d30 0x7f5d54198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 -- 172.21.15.2:0/2983306371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d541082a0 msgr2=0x7f5d5419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d541082a0 0x7f5d5419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 -- 172.21.15.2:0/2983306371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5419d5b0 con 0x7f5d541036e0 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d58a32640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d54102d30 0x7f5d54198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.247+0000 7f5d53fff640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 0x7f5d54198b40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5d40005940 tx=0x7f5d400040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.248+0000 7f5d51ffb640 1 -- 172.21.15.2:0/2983306371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4003f030 con 0x7f5d541036e0 2024-09-12T00:59:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.248+0000 7f5d51ffb640 1 -- 172.21.15.2:0/2983306371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d400044c0 con 0x7f5d541036e0 2024-09-12T00:59:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.248+0000 7f5d5ac96640 1 -- 172.21.15.2:0/2983306371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5419d840 con 0x7f5d541036e0 2024-09-12T00:59:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.248+0000 7f5d51ffb640 1 -- 172.21.15.2:0/2983306371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40035070 con 0x7f5d541036e0 2024-09-12T00:59:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.248+0000 7f5d5ac96640 1 -- 172.21.15.2:0/2983306371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d541a5180 con 0x7f5d541036e0 2024-09-12T00:59:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d51ffb640 1 -- 172.21.15.2:0/2983306371 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f5d40042030 con 0x7f5d541036e0 2024-09-12T00:59:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d5d06f740 1 Processor -- start 2024-09-12T00:59:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d5d06f740 1 -- start start 2024-09-12T00:59:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f38090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 0x5649c1f45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649c1e9e2f0 con 0x5649c1f385d0 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5649c1e45cf0 con 0x5649c1f39b40 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5649c1e9a2b0 con 0x5649c1f43370 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d58a32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d58a32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f38a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54914/0 (socket says 172.21.15.2:54914) 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d58a32640 1 -- 172.21.15.2:0/1427034633 learned_addr learned my addr 172.21.15.2:0/1427034633 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d59233640 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f38090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.251+0000 7f5d53fff640 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 0x5649c1f45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d51ffb640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5d440a2d70 0x7f5d440a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d58a32640 1 -- 172.21.15.2:0/1427034633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 msgr2=0x5649c1f45760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d58a32640 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 0x5649c1f45760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d58a32640 1 -- 172.21.15.2:0/1427034633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 msgr2=0x5649c1f38090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d58a32640 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f38090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d58a32640 1 -- 172.21.15.2:0/1427034633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c1e2a3a0 con 0x5649c1f385d0 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d59233640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5d440a2d70 0x7f5d440a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d58a32640 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f38a10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800bd40 tx=0x7f5d4800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e5741d3ec007bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d51ffb640 1 -- 172.21.15.2:0/2983306371 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5d400ef8e0 con 0x7f5d541036e0 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d3effd640 1 -- 172.21.15.2:0/1427034633 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48015070 con 0x5649c1f385d0 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d3effd640 1 -- 172.21.15.2:0/1427034633 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d4800be30 con 0x5649c1f385d0 2024-09-12T00:59:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.252+0000 7f5d3effd640 1 -- 172.21.15.2:0/1427034633 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48011a10 con 0x5649c1f385d0 2024-09-12T00:59:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 -- 172.21.15.2:0/1427034633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 msgr2=0x5649c1f38a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f38a10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800bd40 tx=0x7f5d4800f730 comp rx=0 tx=0).stop 2024-09-12T00:59:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d59233640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5d440a2d70 0x7f5d440a5230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c005fd0 tx=0x7f5d4c004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 -- 172.21.15.2:0/1427034633 shutdown_connections 2024-09-12T00:59:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 0x5649c1f45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f38a10 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/1427034633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f38090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 -- 172.21.15.2:0/1427034633 >> 172.21.15.2:0/1427034633 conn(0x5649c1f01310 msgr2=0x5649c1f34c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 -- 172.21.15.2:0/1427034633 shutdown_connections 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.253+0000 7f5d5d06f740 1 -- 172.21.15.2:0/1427034633 wait complete. 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 1 -- start start 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 1 Processor -- start 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f42d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f405e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649c1f460c0 con 0x5649c1f43370 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5649c1e59060 con 0x5649c1f39b40 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5649c1f46240 con 0x5649c1f385d0 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d5d06f740 10 client.0 _ll_register_callbacks cb 0x5649c1bac8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d59233640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d59233640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54920/0 (socket says 172.21.15.2:54920) 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d59233640 1 -- 172.21.15.2:0/2412462112 learned_addr learned my addr 172.21.15.2:0/2412462112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d58a32640 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f42d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.254+0000 7f5d53fff640 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d59233640 1 -- 172.21.15.2:0/2412462112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 msgr2=0x5649c1f42d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d59233640 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f42d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d59233640 1 -- 172.21.15.2:0/2412462112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 msgr2=0x5649c1f3fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d59233640 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d59233640 1 -- 172.21.15.2:0/2412462112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c1c0f3c0 con 0x5649c1f43370 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d59233640 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f405e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c003ed0 tx=0x7f5d4c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace7c7819619ae7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d33fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d33fff640 1 -- 172.21.15.2:0/2412462112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c010760 con 0x5649c1f43370 2024-09-12T00:59:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d33fff640 1 -- 172.21.15.2:0/2412462112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5d4c010900 con 0x5649c1f43370 2024-09-12T00:59:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d5d06f740 1 -- 172.21.15.2:0/2412462112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d4800be30 con 0x5649c1f43370 2024-09-12T00:59:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d33fff640 1 -- 172.21.15.2:0/2412462112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5d4c024020 con 0x5649c1f43370 2024-09-12T00:59:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d5d06f740 10 client.16809 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d5d06f740 1 -- 172.21.15.2:0/2412462112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5649c1f51b90 con 0x5649c1f43370 2024-09-12T00:59:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.255+0000 7f5d33fff640 1 -- 172.21.15.2:0/2412462112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d4800be30 con 0x5649c1f43370 2024-09-12T00:59:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.256+0000 7f5d33fff640 1 -- 172.21.15.2:0/2412462112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f5d4c020400 con 0x5649c1f43370 2024-09-12T00:59:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.256+0000 7f5d5d06f740 10 client.16809 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.256+0000 7f5d5d06f740 10 client.16809 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.256+0000 7f5d5d06f740 20 client.16809 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.256+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5649c1f530a0 0x5649c1f55510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.256+0000 7f5d5d06f740 4 client.16809 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.256+0000 7f5d5d06f740 1 -- 172.21.15.2:0/2412462112 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649c1eab860 con 0x5649c1f530a0 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.256+0000 7f5d58a32640 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5649c1f530a0 0x5649c1f55510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.257+0000 7f5d58a32640 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5649c1f530a0 0x5649c1f55510 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fdb1568d94918569 server_cookie=7b715b0ab05cb90c in_seq=0 out_seq=0 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.257+0000 7f5d33fff640 10 client.16809 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.257+0000 7f5d33fff640 1 -- 172.21.15.2:0/2412462112 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649c1eab860 con 0x5649c1f530a0 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.257+0000 7f5d33fff640 10 client.16809 handle_command_reply: tid=0 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.257+0000 7f5d5d06f740 1 client.16809 shutdown 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 -- 172.21.15.2:0/2412462112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 msgr2=0x5649c1f405e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f405e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c003ed0 tx=0x7f5d4c004ab0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 -- 172.21.15.2:0/2412462112 shutdown_connections 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5649c1f530a0 0x5649c1f55510 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f405e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d33fff640 0 client.16809 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:26.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/2412462112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f42d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 -- 172.21.15.2:0/2412462112 >> 172.21.15.2:0/2412462112 conn(0x5649c1f01310 msgr2=0x5649c1f3a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:26.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 -- 172.21.15.2:0/2412462112 shutdown_connections 2024-09-12T00:59:26.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 1 -- 172.21.15.2:0/2412462112 wait complete. 2024-09-12T00:59:26.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.258+0000 7f5d5d06f740 20 client.16809 trim_cache size 0 max 16384 2024-09-12T00:59:26.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d5d06f740 1 Processor -- start 2024-09-12T00:59:26.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d5d06f740 1 -- start start 2024-09-12T00:59:26.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f41f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f3b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5d541b0410 con 0x5649c1f43370 2024-09-12T00:59:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d541adc50 con 0x5649c1f39b40 2024-09-12T00:59:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d541abaa0 con 0x5649c1f385d0 2024-09-12T00:59:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d59233640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f3b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d53fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d59233640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f3b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54922/0 (socket says 172.21.15.2:54922) 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d53fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:41900/0 (socket says 172.21.15.2:41900) 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.271+0000 7f5d59233640 1 -- 172.21.15.2:0/3664106823 learned_addr learned my addr 172.21.15.2:0/3664106823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d58a32640 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f41f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d53fff640 1 -- 172.21.15.2:0/3664106823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 msgr2=0x5649c1f41f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d53fff640 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f41f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d53fff640 1 -- 172.21.15.2:0/3664106823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 msgr2=0x5649c1f3b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d53fff640 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f3b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d53fff640 1 -- 172.21.15.2:0/3664106823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c1f40be0 con 0x5649c1f39b40 2024-09-12T00:59:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d58a32640 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f41f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d59233640 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f3b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d53fff640 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3b120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d400ecfe0 tx=0x7f5d4003b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f004d5a2dabbf274 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d3e7fc640 1 -- 172.21.15.2:0/3664106823 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40049040 con 0x5649c1f39b40 2024-09-12T00:59:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d3e7fc640 1 -- 172.21.15.2:0/3664106823 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d400bc4b0 con 0x5649c1f39b40 2024-09-12T00:59:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.272+0000 7f5d3e7fc640 1 -- 172.21.15.2:0/3664106823 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d400b8420 con 0x5649c1f39b40 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 -- 172.21.15.2:0/3664106823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 msgr2=0x5649c1f3b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3b120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d400ecfe0 tx=0x7f5d4003b5d0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 -- 172.21.15.2:0/3664106823 shutdown_connections 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f43370 0x5649c1f3b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3b120 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/3664106823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f385d0 0x5649c1f41f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 -- 172.21.15.2:0/3664106823 >> 172.21.15.2:0/3664106823 conn(0x5649c1f01310 msgr2=0x5649c1f41850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 -- 172.21.15.2:0/3664106823 shutdown_connections 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.273+0000 7f5d5d06f740 1 -- 172.21.15.2:0/3664106823 wait complete. 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d5d06f740 1 -- start start 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d5d06f740 1 Processor -- start 2024-09-12T00:59:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f3d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d5d06f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 0x5649c1f3dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5d541ac110 con 0x5649c1f385d0 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d541ad580 con 0x5649c1f39b40 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d5d06f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d541ac7e0 con 0x5649c1f43370 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.274+0000 7f5d58a32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f3d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d58a32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f3d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54932/0 (socket says 172.21.15.2:54932) 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d58a32640 1 -- 172.21.15.2:0/559843257 learned_addr learned my addr 172.21.15.2:0/559843257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d5d06f740 10 client.0 _ll_register_callbacks cb 0x7f5d4c009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d53fff640 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d59233640 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 0x5649c1f3dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d58a32640 1 -- 172.21.15.2:0/559843257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 msgr2=0x5649c1f3dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d58a32640 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 0x5649c1f3dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d58a32640 1 -- 172.21.15.2:0/559843257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 msgr2=0x5649c1f3d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d58a32640 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d58a32640 1 -- 172.21.15.2:0/559843257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c1fbcf50 con 0x5649c1f385d0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d58a32640 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f3d1c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800bd40 tx=0x7f5d4801af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2aa7a2241d5b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d33fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d33fff640 1 -- 172.21.15.2:0/559843257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48034060 con 0x5649c1f385d0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d5d06f740 1 -- 172.21.15.2:0/559843257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d400bc4b0 con 0x5649c1f385d0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.275+0000 7f5d33fff640 1 -- 172.21.15.2:0/559843257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5d48005240 con 0x5649c1f385d0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d33fff640 1 -- 172.21.15.2:0/559843257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5d48015040 con 0x5649c1f385d0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d5d06f740 10 client.16815 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d5d06f740 1 -- 172.21.15.2:0/559843257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5649c1fbe1d0 con 0x5649c1f385d0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d33fff640 1 -- 172.21.15.2:0/559843257 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d400bc4b0 con 0x5649c1f385d0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d33fff640 1 -- 172.21.15.2:0/559843257 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f5d48011610 con 0x5649c1f385d0 2024-09-12T00:59:26.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d5d06f740 10 client.16815 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d5d06f740 10 client.16815 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d5d06f740 20 client.16815 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5649c1f530a0 0x5649c1fc0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d5d06f740 4 client.16815 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.276+0000 7f5d5d06f740 1 -- 172.21.15.2:0/559843257 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649c1ea5d70 con 0x5649c1f530a0 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.277+0000 7f5d53fff640 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5649c1f530a0 0x5649c1fc0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.277+0000 7f5d53fff640 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5649c1f530a0 0x5649c1fc0720 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=adfa249acb0ca574 server_cookie=d02fe777b14e7514 in_seq=0 out_seq=0 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.277+0000 7f5d33fff640 10 client.16815 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.277+0000 7f5d33fff640 1 -- 172.21.15.2:0/559843257 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649c1ea5d70 con 0x5649c1f530a0 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.277+0000 7f5d33fff640 10 client.16815 handle_command_reply: tid=0 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.277+0000 7f5d5d06f740 1 client.16815 shutdown 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 -- 172.21.15.2:0/559843257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 msgr2=0x5649c1f3d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f3d1c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800bd40 tx=0x7f5d4801af90 comp rx=0 tx=0).stop 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 -- 172.21.15.2:0/559843257 shutdown_connections 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5649c1f530a0 0x5649c1fc0720 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649c1f43370 0x5649c1f3dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d33fff640 0 client.16815 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649c1f39b40 0x5649c1f3d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 --2- 172.21.15.2:0/559843257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649c1f385d0 0x5649c1f3d1c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 -- 172.21.15.2:0/559843257 >> 172.21.15.2:0/559843257 conn(0x5649c1f01310 msgr2=0x5649c1f42070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 -- 172.21.15.2:0/559843257 shutdown_connections 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 1 -- 172.21.15.2:0/559843257 wait complete. 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.278+0000 7f5d5d06f740 20 client.16815 trim_cache size 0 max 16384 2024-09-12T00:59:26.282 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:26.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 -- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5d440a2d70 msgr2=0x7f5d440a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5d440a2d70 0x7f5d440a5230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c005fd0 tx=0x7f5d4c004a40 comp rx=0 tx=0).stop 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 -- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 msgr2=0x7f5d54198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 0x7f5d54198b40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5d40005940 tx=0x7f5d400040c0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 -- 172.21.15.2:0/2983306371 shutdown_connections 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5d440a2d70 0x7f5d440a5230 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d541082a0 0x7f5d5419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d541036e0 0x7f5d54198b40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 --2- 172.21.15.2:0/2983306371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d54102d30 0x7f5d54198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 -- 172.21.15.2:0/2983306371 >> 172.21.15.2:0/2983306371 conn(0x7f5d540fc7d0 msgr2=0x7f5d54105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 -- 172.21.15.2:0/2983306371 shutdown_connections 2024-09-12T00:59:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:26.279+0000 7f5d5ac96640 1 -- 172.21.15.2:0/2983306371 wait complete. 2024-09-12T00:59:26.922 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:26 smithi002 ceph-mon[31210]: pgmap v198: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-12T00:59:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:26 smithi071 ceph-mon[35276]: pgmap v198: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-12T00:59:26.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:59:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:26 smithi167 ceph-mon[35234]: pgmap v198: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-12T00:59:27.212 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.661+0000 7f5df157e640 1 -- 172.21.15.2:0/1094418168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec103660 msgr2=0x7f5dec10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.661+0000 7f5df157e640 1 --2- 172.21.15.2:0/1094418168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec103660 0x7f5dec10bb50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009900 tx=0x7f5dd402a480 comp rx=0 tx=0).stop 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.661+0000 7f5df157e640 1 -- 172.21.15.2:0/1094418168 shutdown_connections 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 --2- 172.21.15.2:0/1094418168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dec10c170 0x7f5dec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 --2- 172.21.15.2:0/1094418168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec103660 0x7f5dec10bb50 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 --2- 172.21.15.2:0/1094418168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dec102d40 0x7f5dec103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 -- 172.21.15.2:0/1094418168 >> 172.21.15.2:0/1094418168 conn(0x7f5dec0fc7a0 msgr2=0x7f5dec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 -- 172.21.15.2:0/1094418168 shutdown_connections 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 -- 172.21.15.2:0/1094418168 wait complete. 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 Processor -- start 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 -- start start 2024-09-12T00:59:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec102d40 0x7f5dec198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dec103660 0x7f5dec198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dec10c170 0x7f5dec19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec111f70 con 0x7f5dec102d40 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec111df0 con 0x7f5dec10c170 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.662+0000 7f5df157e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1120f0 con 0x7f5dec103660 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec102d40 0x7f5dec198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec102d40 0x7f5dec198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54954/0 (socket says 172.21.15.2:54954) 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 -- 172.21.15.2:0/4062362145 learned_addr learned my addr 172.21.15.2:0/4062362145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5de3fff640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dec103660 0x7f5dec198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dec10c170 0x7f5dec19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 -- 172.21.15.2:0/4062362145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dec103660 msgr2=0x7f5dec198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dec103660 0x7f5dec198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 -- 172.21.15.2:0/4062362145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dec10c170 msgr2=0x7f5dec19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dec10c170 0x7f5dec19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 -- 172.21.15.2:0/4062362145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec19d400 con 0x7f5dec102d40 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5deaffd640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec102d40 0x7f5dec198450 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00d950 tx=0x7f5ddc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5de8ff9640 1 -- 172.21.15.2:0/4062362145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc017030 con 0x7f5dec102d40 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5de8ff9640 1 -- 172.21.15.2:0/4062362145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ddc004020 con 0x7f5dec102d40 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5de8ff9640 1 -- 172.21.15.2:0/4062362145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0047a0 con 0x7f5dec102d40 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.663+0000 7f5df157e640 1 -- 172.21.15.2:0/4062362145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec19d6f0 con 0x7f5dec102d40 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.664+0000 7f5df157e640 1 -- 172.21.15.2:0/4062362145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec1a4fd0 con 0x7f5dec102d40 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.666+0000 7f5de8ff9640 1 -- 172.21.15.2:0/4062362145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f5ddc0041d0 con 0x7f5dec102d40 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.666+0000 7f5df3957740 1 Processor -- start 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.666+0000 7f5df3957740 1 -- start start 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5df3957740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6644a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5df3957740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae6644aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5de8ff9640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5dd80a2d70 0x7f5dd80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5df3957740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae66459780 0x55ae6645bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5df3957740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ae663b02f0 con 0x55ae6644bb40 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5df3957740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae66357cf0 con 0x55ae6644a5d0 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5df3957740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae663ac2b0 con 0x55ae66459780 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6644a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6644a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54964/0 (socket says 172.21.15.2:54964) 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deb7fe640 1 -- 172.21.15.2:0/1326766718 learned_addr learned my addr 172.21.15.2:0/1326766718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5de8ff9640 1 -- 172.21.15.2:0/4062362145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5ddc0cedb0 con 0x7f5dec102d40 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5de3fff640 1 --2- 172.21.15.2:0/1326766718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae6644aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deaffd640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5dd80a2d70 0x7f5dd80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deb7fe640 1 -- 172.21.15.2:0/1326766718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae66459780 msgr2=0x55ae6645bb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:59:27.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/1326766718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae66459780 0x55ae6645bb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deb7fe640 1 -- 172.21.15.2:0/1326766718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 msgr2=0x55ae6644aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:27.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/1326766718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae6644aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.667+0000 7f5deb7fe640 1 -- 172.21.15.2:0/1326766718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae6633c3a0 con 0x55ae6644bb40 2024-09-12T00:59:27.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.668+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/1326766718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6644a090 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009f70 tx=0x7f5de40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46e5804bef318c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.668+0000 7f5de17fa640 1 -- 172.21.15.2:0/1326766718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4004d20 con 0x55ae6644bb40 2024-09-12T00:59:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.668+0000 7f5de17fa640 1 -- 172.21.15.2:0/1326766718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de400fa20 con 0x55ae6644bb40 2024-09-12T00:59:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.668+0000 7f5de17fa640 1 -- 172.21.15.2:0/1326766718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40056b0 con 0x55ae6644bb40 2024-09-12T00:59:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 -- 172.21.15.2:0/1326766718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 msgr2=0x55ae6644a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 --2- 172.21.15.2:0/1326766718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6644a090 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009f70 tx=0x7f5de40118d0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5deaffd640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5dd80a2d70 0x7f5dd80a5230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc000c00 tx=0x7f5ddc00df40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 -- 172.21.15.2:0/1326766718 shutdown_connections 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 --2- 172.21.15.2:0/1326766718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae66459780 0x55ae6645bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 --2- 172.21.15.2:0/1326766718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae6644aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 --2- 172.21.15.2:0/1326766718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6644a090 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 -- 172.21.15.2:0/1326766718 >> 172.21.15.2:0/1326766718 conn(0x55ae66413310 msgr2=0x55ae66446c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 -- 172.21.15.2:0/1326766718 shutdown_connections 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.669+0000 7f5df3957740 1 -- 172.21.15.2:0/1326766718 wait complete. 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 1 -- start start 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 1 Processor -- start 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae664526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae66452c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae66459780 0x55ae66453170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ae6644d550 con 0x55ae6644bb40 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae6636b060 con 0x55ae66459780 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae6644d6d0 con 0x55ae6644a5d0 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5df3957740 10 client.0 _ll_register_callbacks cb 0x55ae660be8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae66452c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae66452c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54974/0 (socket says 172.21.15.2:54974) 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5de3fff640 1 -- 172.21.15.2:0/2091082348 learned_addr learned my addr 172.21.15.2:0/2091082348 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.670+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae664526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae66459780 0x55ae66453170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5de3fff640 1 -- 172.21.15.2:0/2091082348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 msgr2=0x55ae664526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5de3fff640 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae664526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5de3fff640 1 -- 172.21.15.2:0/2091082348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae66459780 msgr2=0x55ae66453170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5de3fff640 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae66459780 0x55ae66453170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5de3fff640 1 -- 172.21.15.2:0/2091082348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae661213c0 con 0x55ae6644bb40 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae664526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5de3fff640 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae66452c30 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5dd402a9a0 tx=0x7f5dd4041d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d07e493ee4134ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5dd27fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5dd27fc640 1 -- 172.21.15.2:0/2091082348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd404f060 con 0x55ae6644bb40 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5dd27fc640 1 -- 172.21.15.2:0/2091082348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5dd40317c0 con 0x55ae6644bb40 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5df3957740 1 -- 172.21.15.2:0/2091082348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5de400fa20 con 0x55ae6644bb40 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5dd27fc640 1 -- 172.21.15.2:0/2091082348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5dd4035040 con 0x55ae6644bb40 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5df3957740 10 client.16827 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.671+0000 7f5df3957740 1 -- 172.21.15.2:0/2091082348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ae66463b40 con 0x55ae6644bb40 2024-09-12T00:59:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5dd27fc640 1 -- 172.21.15.2:0/2091082348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de400fa20 con 0x55ae6644bb40 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5dd27fc640 1 -- 172.21.15.2:0/2091082348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f5dd4003b90 con 0x55ae6644bb40 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5df3957740 10 client.16827 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5df3957740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5df3957740 20 client.16827 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5df3957740 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae66464f50 0x55ae66467370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5df3957740 4 client.16827 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5df3957740 1 -- 172.21.15.2:0/2091082348 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae663bd860 con 0x55ae66464f50 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.672+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae66464f50 0x55ae66467370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.673+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae66464f50 0x55ae66467370 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a96fe9eebf11656e server_cookie=fe67ef99b9aae79c in_seq=0 out_seq=0 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.673+0000 7f5dd27fc640 10 client.16827 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5dd27fc640 1 -- 172.21.15.2:0/2091082348 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae663bd860 con 0x55ae66464f50 2024-09-12T00:59:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5dd27fc640 10 client.16827 handle_command_reply: tid=0 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 client.16827 shutdown 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 -- 172.21.15.2:0/2091082348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 msgr2=0x55ae66452c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae66452c30 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5dd402a9a0 tx=0x7f5dd4041d90 comp rx=0 tx=0).stop 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 -- 172.21.15.2:0/2091082348 shutdown_connections 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae66464f50 0x55ae66467370 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae66459780 0x55ae66453170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae66452c30 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5dd27fc640 0 client.16827 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 --2- 172.21.15.2:0/2091082348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae664526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 -- 172.21.15.2:0/2091082348 >> 172.21.15.2:0/2091082348 conn(0x55ae66413310 msgr2=0x55ae6644c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 -- 172.21.15.2:0/2091082348 shutdown_connections 2024-09-12T00:59:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 1 -- 172.21.15.2:0/2091082348 wait complete. 2024-09-12T00:59:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.674+0000 7f5df3957740 20 client.16827 trim_cache size 0 max 16384 2024-09-12T00:59:27.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.687+0000 7f5df3957740 1 Processor -- start 2024-09-12T00:59:27.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.687+0000 7f5df3957740 1 -- start start 2024-09-12T00:59:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.687+0000 7f5df3957740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae66445c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.687+0000 7f5df3957740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6646cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.687+0000 7f5df3957740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae66459780 0x55ae6646d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.687+0000 7f5df3957740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1ae160 con 0x55ae6644bb40 2024-09-12T00:59:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.687+0000 7f5df3957740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1ab9a0 con 0x55ae6644a5d0 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.687+0000 7f5df3957740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1a97f0 con 0x55ae66459780 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6646cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6646cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54988/0 (socket says 172.21.15.2:54988) 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 -- 172.21.15.2:0/34234330 learned_addr learned my addr 172.21.15.2:0/34234330 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae66445c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 -- 172.21.15.2:0/34234330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae66459780 msgr2=0x55ae6646d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae66459780 0x55ae6646d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 -- 172.21.15.2:0/34234330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 msgr2=0x55ae66445c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae66445c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 -- 172.21.15.2:0/34234330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae664516a0 con 0x55ae6644bb40 2024-09-12T00:59:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae66445c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de3fff640 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6646cc20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5dd404a4b0 tx=0x7f5dd4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb5068ac2b0dc95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de0ff9640 1 -- 172.21.15.2:0/34234330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd404f040 con 0x55ae6644bb40 2024-09-12T00:59:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de0ff9640 1 -- 172.21.15.2:0/34234330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd4003f90 con 0x55ae6644bb40 2024-09-12T00:59:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.688+0000 7f5de0ff9640 1 -- 172.21.15.2:0/34234330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4005230 con 0x55ae6644bb40 2024-09-12T00:59:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 -- 172.21.15.2:0/34234330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 msgr2=0x55ae6646cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6646cc20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5dd404a4b0 tx=0x7f5dd4005e80 comp rx=0 tx=0).stop 2024-09-12T00:59:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 -- 172.21.15.2:0/34234330 shutdown_connections 2024-09-12T00:59:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae66459780 0x55ae6646d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6644bb40 0x55ae6646cc20 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 --2- 172.21.15.2:0/34234330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644a5d0 0x55ae66445c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 -- 172.21.15.2:0/34234330 >> 172.21.15.2:0/34234330 conn(0x55ae66413310 msgr2=0x55ae66445500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 -- 172.21.15.2:0/34234330 shutdown_connections 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 -- 172.21.15.2:0/34234330 wait complete. 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.689+0000 7f5df3957740 1 -- start start 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5df3957740 1 Processor -- start 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5df3957740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae6645d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5df3957740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644bb40 0x55ae6645d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5df3957740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae66459780 0x55ae6645dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5df3957740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1a9e60 con 0x55ae66459780 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5df3957740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1ab2d0 con 0x55ae6644bb40 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5df3957740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1aa530 con 0x55ae6644a5d0 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5df3957740 10 client.0 _ll_register_callbacks cb 0x7f5de40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae66459780 0x55ae6645dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae66459780 0x55ae6645dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55000/0 (socket says 172.21.15.2:55000) 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 -- 172.21.15.2:0/797374813 learned_addr learned my addr 172.21.15.2:0/797374813 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5de3fff640 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644bb40 0x55ae6645d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae6645d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 -- 172.21.15.2:0/797374813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 msgr2=0x55ae6645d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae6645d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 -- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644bb40 msgr2=0x55ae6645d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644bb40 0x55ae6645d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5deb7fe640 1 -- 172.21.15.2:0/797374813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae664cec70 con 0x55ae66459780 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.690+0000 7f5de3fff640 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644bb40 0x55ae6645d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5deb7fe640 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae66459780 0x55ae6645dca0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009f40 tx=0x7f5de4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536fd478d80eb229 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5dd27fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5dd27fc640 1 -- 172.21.15.2:0/797374813 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4034020 con 0x55ae66459780 2024-09-12T00:59:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5dd27fc640 1 -- 172.21.15.2:0/797374813 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5de4009b30 con 0x55ae66459780 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 1 -- 172.21.15.2:0/797374813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd4003f90 con 0x55ae66459780 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5dd27fc640 1 -- 172.21.15.2:0/797374813 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5de403f050 con 0x55ae66459780 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 10 client.16833 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 1 -- 172.21.15.2:0/797374813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ae664cfec0 con 0x55ae66459780 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5dd27fc640 1 -- 172.21.15.2:0/797374813 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd4003f90 con 0x55ae66459780 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5dd27fc640 1 -- 172.21.15.2:0/797374813 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f5de4025040 con 0x55ae66459780 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 10 client.16833 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 10 client.16833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 20 client.16833 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae664d0340 0x55ae664d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 4 client.16833 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.691+0000 7f5df3957740 1 -- 172.21.15.2:0/797374813 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae663b7d70 con 0x55ae664d0340 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.692+0000 7f5de3fff640 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae664d0340 0x55ae664d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.692+0000 7f5de3fff640 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae664d0340 0x55ae664d2730 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e99c6a25918ba11a server_cookie=80243b4d14d3da3e in_seq=0 out_seq=0 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.692+0000 7f5dd27fc640 10 client.16833 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.692+0000 7f5dd27fc640 1 -- 172.21.15.2:0/797374813 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae663b7d70 con 0x55ae664d0340 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.692+0000 7f5dd27fc640 10 client.16833 handle_command_reply: tid=0 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.692+0000 7f5df3957740 1 client.16833 shutdown 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 -- 172.21.15.2:0/797374813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae66459780 msgr2=0x55ae6645dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae66459780 0x55ae6645dca0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009f40 tx=0x7f5de4005bd0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 -- 172.21.15.2:0/797374813 shutdown_connections 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ae664d0340 0x55ae664d2730 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae66459780 0x55ae6645dca0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6644bb40 0x55ae6645d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 --2- 172.21.15.2:0/797374813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae6644a5d0 0x55ae6645d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 -- 172.21.15.2:0/797374813 >> 172.21.15.2:0/797374813 conn(0x55ae66413310 msgr2=0x55ae66456780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5dd27fc640 0 client.16833 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 -- 172.21.15.2:0/797374813 shutdown_connections 2024-09-12T00:59:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 1 -- 172.21.15.2:0/797374813 wait complete. 2024-09-12T00:59:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df3957740 20 client.16833 trim_cache size 0 max 16384 2024-09-12T00:59:27.699 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 -- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5dd80a2d70 msgr2=0x7f5dd80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5dd80a2d70 0x7f5dd80a5230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc000c00 tx=0x7f5ddc00df40 comp rx=0 tx=0).stop 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 -- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec102d40 msgr2=0x7f5dec198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec102d40 0x7f5dec198450 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00d950 tx=0x7f5ddc00de10 comp rx=0 tx=0).stop 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 -- 172.21.15.2:0/4062362145 shutdown_connections 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5dd80a2d70 0x7f5dd80a5230 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dec10c170 0x7f5dec19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dec103660 0x7f5dec198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 --2- 172.21.15.2:0/4062362145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dec102d40 0x7f5dec198450 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.693+0000 7f5df157e640 1 -- 172.21.15.2:0/4062362145 >> 172.21.15.2:0/4062362145 conn(0x7f5dec0fc7a0 msgr2=0x7f5dec0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.694+0000 7f5df157e640 1 -- 172.21.15.2:0/4062362145 shutdown_connections 2024-09-12T00:59:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:27.694+0000 7f5df157e640 1 -- 172.21.15.2:0/4062362145 wait complete. 2024-09-12T00:59:28.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:28 smithi002 ceph-mon[31210]: pgmap v199: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T00:59:28.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:28 smithi071 ceph-mon[35276]: pgmap v199: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T00:59:29.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:28 smithi167 ceph-mon[35234]: pgmap v199: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T00:59:29.385 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:59:29.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:59:29.658 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 -- 172.21.15.2:0/3219019419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074620 msgr2=0x7ffaf0074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 --2- 172.21.15.2:0/3219019419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074620 0x7ffaf0074a00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009900 tx=0x7ffad802a480 comp rx=0 tx=0).stop 2024-09-12T00:59:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 -- 172.21.15.2:0/3219019419 shutdown_connections 2024-09-12T00:59:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 --2- 172.21.15.2:0/3219019419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaf010e3c0 0x7ffaf0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 --2- 172.21.15.2:0/3219019419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf0074f40 0x7ffaf010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 --2- 172.21.15.2:0/3219019419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074620 0x7ffaf0074a00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 -- 172.21.15.2:0/3219019419 >> 172.21.15.2:0/3219019419 conn(0x7ffaf00fd8c0 msgr2=0x7ffaf00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 -- 172.21.15.2:0/3219019419 shutdown_connections 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.185+0000 7ffaf7256640 1 -- 172.21.15.2:0/3219019419 wait complete. 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaf7256640 1 Processor -- start 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaf7256640 1 -- start start 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaf7256640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf0074620 0x7ffaf019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaf7256640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074f40 0x7ffaf019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaf7256640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaf010e3c0 0x7ffaf019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaf7256640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01141c0 con 0x7ffaf0074f40 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaf7256640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf0114040 con 0x7ffaf010e3c0 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaf7256640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf0114340 con 0x7ffaf0074620 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaeffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074f40 0x7ffaf019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaeffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074f40 0x7ffaf019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55024/0 (socket says 172.21.15.2:55024) 2024-09-12T00:59:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.186+0000 7ffaeffff640 1 -- 172.21.15.2:0/382895909 learned_addr learned my addr 172.21.15.2:0/382895909 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf0074620 0x7ffaf019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaf010e3c0 0x7ffaf019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaeffff640 1 -- 172.21.15.2:0/382895909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf0074620 msgr2=0x7ffaf019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaeffff640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf0074620 0x7ffaf019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaeffff640 1 -- 172.21.15.2:0/382895909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaf010e3c0 msgr2=0x7ffaf019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaeffff640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaf010e3c0 0x7ffaf019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaeffff640 1 -- 172.21.15.2:0/382895909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf019f670 con 0x7ffaf0074f40 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf0074620 0x7ffaf019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaeffff640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074f40 0x7ffaf019ac00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffae000ba50 tx=0x7ffae000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaedffb640 1 -- 172.21.15.2:0/382895909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0019070 con 0x7ffaf0074f40 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaedffb640 1 -- 172.21.15.2:0/382895909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae000cbe0 con 0x7ffaf0074f40 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaf7256640 1 -- 172.21.15.2:0/382895909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf019f960 con 0x7ffaf0074f40 2024-09-12T00:59:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaedffb640 1 -- 172.21.15.2:0/382895909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae00076e0 con 0x7ffaf0074f40 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.187+0000 7ffaf7256640 1 -- 172.21.15.2:0/382895909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf01a7240 con 0x7ffaf0074f40 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaedffb640 1 -- 172.21.15.2:0/382895909 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7ffae001c070 con 0x7ffaf0074f40 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaf962f740 1 Processor -- start 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaf962f740 1 -- start start 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3eb60 0x563d75e3ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e49800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e4c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaedffb640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffadc0a2d70 0x7ffadc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaf962f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d75da4280 con 0x563d75e49d40 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaf962f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563d75d4bb10 con 0x563d75e3f480 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.190+0000 7ffaf962f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563d75da0240 con 0x563d75e3eb60 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e4c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffadc0a2d70 0x7ffadc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e4c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55036/0 (socket says 172.21.15.2:55036) 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 -- 172.21.15.2:0/3105451821 learned_addr learned my addr 172.21.15.2:0/3105451821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3eb60 0x563d75e3ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaedffb640 1 -- 172.21.15.2:0/382895909 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7ffae00ce8a0 con 0x7ffaf0074f40 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e49800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 -- 172.21.15.2:0/3105451821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3eb60 msgr2=0x563d75e3ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3eb60 0x563d75e3ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 -- 172.21.15.2:0/3105451821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 msgr2=0x563d75e49800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e49800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 -- 172.21.15.2:0/3105451821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d75d581f0 con 0x563d75e49d40 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e49800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffadc0a2d70 0x7ffadc0a5230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffae8005fd0 tx=0x7ffae800ba80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffaeffff640 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e4c130 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffae009aec0 tx=0x7ffae006ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8535a59cf6ebf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffae6ffd640 1 -- 172.21.15.2:0/3105451821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae009a890 con 0x563d75e49d40 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffae6ffd640 1 -- 172.21.15.2:0/3105451821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae009af30 con 0x563d75e49d40 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.191+0000 7ffae6ffd640 1 -- 172.21.15.2:0/3105451821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae00cc220 con 0x563d75e49d40 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 -- 172.21.15.2:0/3105451821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 msgr2=0x563d75e4c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e4c130 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffae009aec0 tx=0x7ffae006ad90 comp rx=0 tx=0).stop 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 -- 172.21.15.2:0/3105451821 shutdown_connections 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e4c130 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e49800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3105451821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3eb60 0x563d75e3ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 -- 172.21.15.2:0/3105451821 >> 172.21.15.2:0/3105451821 conn(0x563d75e3b0f0 msgr2=0x563d75e3b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 -- 172.21.15.2:0/3105451821 shutdown_connections 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.192+0000 7ffaf962f740 1 -- 172.21.15.2:0/3105451821 wait complete. 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 1 -- start start 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 1 Processor -- start 2024-09-12T00:59:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e47130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e49d40 0x563d75e47670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d75e4c910 con 0x563d75e3eb60 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563d75d5ef10 con 0x563d75e49d40 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563d75e4ca90 con 0x563d75e3f480 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf962f740 10 client.0 _ll_register_callbacks cb 0x563d75d27a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf4ff2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.193+0000 7ffaf4ff2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55044/0 (socket says 172.21.15.2:55044) 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf4ff2640 1 -- 172.21.15.2:0/3175313127 learned_addr learned my addr 172.21.15.2:0/3175313127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e49d40 0x563d75e47670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaeffff640 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e47130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf4ff2640 1 -- 172.21.15.2:0/3175313127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 msgr2=0x563d75e47130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e47130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf4ff2640 1 -- 172.21.15.2:0/3175313127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e49d40 msgr2=0x563d75e47670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e49d40 0x563d75e47670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf4ff2640 1 -- 172.21.15.2:0/3175313127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d75b156a0 con 0x563d75e3eb60 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46bf0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009900 tx=0x7ffad80319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ad76ba91e78363 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffacffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffacffff640 1 -- 172.21.15.2:0/3175313127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8035070 con 0x563d75e3eb60 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffacffff640 1 -- 172.21.15.2:0/3175313127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7ffad8004300 con 0x563d75e3eb60 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffaf962f740 1 -- 172.21.15.2:0/3175313127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffae009af30 con 0x563d75e3eb60 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.194+0000 7ffacffff640 1 -- 172.21.15.2:0/3175313127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ffad8005030 con 0x563d75e3eb60 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaf962f740 10 client.16845 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaf962f740 1 -- 172.21.15.2:0/3175313127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563d75e584e0 con 0x563d75e3eb60 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffacffff640 1 -- 172.21.15.2:0/3175313127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae009af30 con 0x563d75e3eb60 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffacffff640 1 -- 172.21.15.2:0/3175313127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7ffad80035f0 con 0x563d75e3eb60 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaf962f740 10 client.16845 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaf962f740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaf962f740 20 client.16845 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563d75e599a0 0x563d75e5bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaf962f740 4 client.16845 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaf962f740 1 -- 172.21.15.2:0/3175313127 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d75db17f0 con 0x563d75e599a0 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.195+0000 7ffaeffff640 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563d75e599a0 0x563d75e5bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaeffff640 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563d75e599a0 0x563d75e5bd90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=915d67ab510f1aba server_cookie=2deeea8f0917acc0 in_seq=0 out_seq=0 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffacffff640 10 client.16845 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffacffff640 1 -- 172.21.15.2:0/3175313127 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d75db17f0 con 0x563d75e599a0 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffacffff640 10 client.16845 handle_command_reply: tid=0 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 client.16845 shutdown 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 -- 172.21.15.2:0/3175313127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 msgr2=0x563d75e46bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46bf0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009900 tx=0x7ffad80319a0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 -- 172.21.15.2:0/3175313127 shutdown_connections 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563d75e599a0 0x563d75e5bd90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e49d40 0x563d75e47670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e47130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffacffff640 0 client.16845 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3175313127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46bf0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.196+0000 7ffaf962f740 1 -- 172.21.15.2:0/3175313127 >> 172.21.15.2:0/3175313127 conn(0x563d75e3b0f0 msgr2=0x563d75e40e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.197+0000 7ffaf962f740 1 -- 172.21.15.2:0/3175313127 shutdown_connections 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.197+0000 7ffaf962f740 1 -- 172.21.15.2:0/3175313127 wait complete. 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.197+0000 7ffaf962f740 20 client.16845 trim_cache size 0 max 16384 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.214+0000 7ffaf962f740 1 Processor -- start 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.214+0000 7ffaf962f740 1 -- start start 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.214+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.214+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e40cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.214+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e49d40 0x563d75e61640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.214+0000 7ffaf962f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01b24f0 con 0x563d75e3eb60 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.214+0000 7ffaf962f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01afd30 con 0x563d75e3f480 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.214+0000 7ffaf962f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01adb80 con 0x563d75e49d40 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55052/0 (socket says 172.21.15.2:55052) 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 -- 172.21.15.2:0/498981529 learned_addr learned my addr 172.21.15.2:0/498981529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaeffff640 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e40cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 -- 172.21.15.2:0/498981529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e49d40 msgr2=0x563d75e61640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e49d40 0x563d75e61640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e49d40 0x563d75e61640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 -- 172.21.15.2:0/498981529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 msgr2=0x563d75e40cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e40cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 -- 172.21.15.2:0/498981529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d75e491d0 con 0x563d75e3eb60 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaeffff640 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e40cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46510 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffad8000c00 tx=0x7ffad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0c02944ace9220 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffae67fc640 1 -- 172.21.15.2:0/498981529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8035030 con 0x563d75e3eb60 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffae67fc640 1 -- 172.21.15.2:0/498981529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad8003c30 con 0x563d75e3eb60 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.215+0000 7ffae67fc640 1 -- 172.21.15.2:0/498981529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad80051d0 con 0x563d75e3eb60 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 -- 172.21.15.2:0/498981529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 msgr2=0x563d75e46510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46510 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffad8000c00 tx=0x7ffad8009250 comp rx=0 tx=0).stop 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 -- 172.21.15.2:0/498981529 shutdown_connections 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e49d40 0x563d75e61640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3f480 0x563d75e40cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 --2- 172.21.15.2:0/498981529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e3eb60 0x563d75e46510 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 -- 172.21.15.2:0/498981529 >> 172.21.15.2:0/498981529 conn(0x563d75e3b0f0 msgr2=0x563d75e405b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:30.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 -- 172.21.15.2:0/498981529 shutdown_connections 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 -- 172.21.15.2:0/498981529 wait complete. 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 -- start start 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.216+0000 7ffaf962f740 1 Processor -- start 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3eb60 0x563d75e43d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf962f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf962f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01ae1f0 con 0x563d75e49d40 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf962f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01af660 con 0x563d75e3eb60 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf962f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01ae8c0 con 0x563d75e3f480 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf962f740 10 client.0 _ll_register_callbacks cb 0x7ffad8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf57f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf57f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55066/0 (socket says 172.21.15.2:55066) 2024-09-12T00:59:30.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf57f3640 1 -- 172.21.15.2:0/3126271018 learned_addr learned my addr 172.21.15.2:0/3126271018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaeffff640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3eb60 0x563d75e43d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf57f3640 1 -- 172.21.15.2:0/3126271018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 msgr2=0x563d75e442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf57f3640 1 -- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3eb60 msgr2=0x563d75e43d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3eb60 0x563d75e43d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf57f3640 1 -- 172.21.15.2:0/3126271018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d75ec3740 con 0x563d75e49d40 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaeffff640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.217+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3eb60 0x563d75e43d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf57f3640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e447f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ffae8004260 tx=0x7ffae8005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7e05d3a569881c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffacffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffacffff640 1 -- 172.21.15.2:0/3126271018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae802e060 con 0x563d75e49d40 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffacffff640 1 -- 172.21.15.2:0/3126271018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7ffae801b040 con 0x563d75e49d40 2024-09-12T00:59:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 1 -- 172.21.15.2:0/3126271018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad8003c30 con 0x563d75e49d40 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffacffff640 1 -- 172.21.15.2:0/3126271018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ffae8003800 con 0x563d75e49d40 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 10 client.16851 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 1 -- 172.21.15.2:0/3126271018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563d75ec4a00 con 0x563d75e49d40 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffacffff640 1 -- 172.21.15.2:0/3126271018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad8003c30 con 0x563d75e49d40 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffacffff640 1 -- 172.21.15.2:0/3126271018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7ffae8028070 con 0x563d75e49d40 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 10 client.16851 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 20 client.16851 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563d75ec5120 0x563d75ec7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 4 client.16851 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:59:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.218+0000 7ffaf962f740 1 -- 172.21.15.2:0/3126271018 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563d75dabd00 con 0x563d75ec5120 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7113bb17-2d81-4b4c-95f6-7fbe6697b88f", 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.219+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563d75ec5120 0x563d75ec7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.219+0000 7ffaf4ff2640 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563d75ec5120 0x563d75ec7540 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac37cb5a5532d581 server_cookie=1b08d10bd385eeda in_seq=0 out_seq=0 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.219+0000 7ffacffff640 10 client.16851 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffacffff640 1 -- 172.21.15.2:0/3126271018 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563d75dabd00 con 0x563d75ec5120 2024-09-12T00:59:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffacffff640 10 client.16851 handle_command_reply: tid=0 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 client.16851 shutdown 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 -- 172.21.15.2:0/3126271018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 msgr2=0x563d75e447f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e447f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ffae8004260 tx=0x7ffae8005cc0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 -- 172.21.15.2:0/3126271018 shutdown_connections 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x563d75ec5120 0x563d75ec7540 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d75e49d40 0x563d75e447f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d75e3f480 0x563d75e442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 --2- 172.21.15.2:0/3126271018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d75e3eb60 0x563d75e43d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffaf962f740 1 -- 172.21.15.2:0/3126271018 >> 172.21.15.2:0/3126271018 conn(0x563d75e3b0f0 msgr2=0x563d75e473b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.220+0000 7ffacffff640 0 client.16851 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf962f740 1 -- 172.21.15.2:0/3126271018 shutdown_connections 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf962f740 1 -- 172.21.15.2:0/3126271018 wait complete. 2024-09-12T00:59:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf962f740 20 client.16851 trim_cache size 0 max 16384 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 -- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffadc0a2d70 msgr2=0x7ffadc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffadc0a2d70 0x7ffadc0a5230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffae8005fd0 tx=0x7ffae800ba80 comp rx=0 tx=0).stop 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 -- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074f40 msgr2=0x7ffaf019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074f40 0x7ffaf019ac00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffae000ba50 tx=0x7ffae000bf10 comp rx=0 tx=0).stop 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 -- 172.21.15.2:0/382895909 shutdown_connections 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffadc0a2d70 0x7ffadc0a5230 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffaf010e3c0 0x7ffaf019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaf0074f40 0x7ffaf019ac00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 --2- 172.21.15.2:0/382895909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf0074620 0x7ffaf019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 -- 172.21.15.2:0/382895909 >> 172.21.15.2:0/382895909 conn(0x7ffaf00fd8c0 msgr2=0x7ffaf00ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 -- 172.21.15.2:0/382895909 shutdown_connections 2024-09-12T00:59:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:30.221+0000 7ffaf7256640 1 -- 172.21.15.2:0/382895909 wait complete. 2024-09-12T00:59:30.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:30 smithi002 ceph-mon[31210]: pgmap v200: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-12T00:59:30.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:59:30.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:30 smithi071 ceph-mon[35276]: pgmap v200: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-12T00:59:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:30 smithi167 ceph-mon[35234]: pgmap v200: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-12T00:59:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 -- 172.21.15.2:0/1475128299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 msgr2=0x7fedd010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 --2- 172.21.15.2:0/1475128299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 0x7fedd010ea90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009ca0 tx=0x7fedc802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 -- 172.21.15.2:0/1475128299 shutdown_connections 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 --2- 172.21.15.2:0/1475128299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 0x7fedd010ea90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 --2- 172.21.15.2:0/1475128299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0102790 0x7fedd01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 --2- 172.21.15.2:0/1475128299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd0101de0 0x7fedd01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 -- 172.21.15.2:0/1475128299 >> 172.21.15.2:0/1475128299 conn(0x7fedd00fd8c0 msgr2=0x7fedd00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 -- 172.21.15.2:0/1475128299 shutdown_connections 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.643+0000 7fedd7517640 1 -- 172.21.15.2:0/1475128299 wait complete. 2024-09-12T00:59:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd7517640 1 Processor -- start 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd7517640 1 -- start start 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd7517640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101de0 0x7fedd00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd7517640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd0102790 0x7fedd0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd7517640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 0x7fedd0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd7517640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fedd0111f90 con 0x7fedd0106f10 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd7517640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fedd0111e10 con 0x7fedd0102790 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd7517640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fedd0112110 con 0x7fedd0101de0 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd5ab4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 0x7fedd0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd5ab4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 0x7fedd0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55084/0 (socket says 172.21.15.2:55084) 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd5ab4640 1 -- 172.21.15.2:0/287109263 learned_addr learned my addr 172.21.15.2:0/287109263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd0102790 0x7fedd0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd52b3640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101de0 0x7fedd00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd5ab4640 1 -- 172.21.15.2:0/287109263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101de0 msgr2=0x7fedd00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd5ab4640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101de0 0x7fedd00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd5ab4640 1 -- 172.21.15.2:0/287109263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd0102790 msgr2=0x7fedd0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd5ab4640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd0102790 0x7fedd0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd5ab4640 1 -- 172.21.15.2:0/287109263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd01a6930 con 0x7fedd0106f10 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.644+0000 7fedd52b3640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101de0 0x7fedd00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.645+0000 7fedd5ab4640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 0x7fedd0074f70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fedc8031a20 tx=0x7fedc8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.645+0000 7fedc67fc640 1 -- 172.21.15.2:0/287109263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8003b70 con 0x7fedd0106f10 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.645+0000 7fedd7517640 1 -- 172.21.15.2:0/287109263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd01a6bc0 con 0x7fedd0106f10 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.645+0000 7fedc67fc640 1 -- 172.21.15.2:0/287109263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedc8003d10 con 0x7fedd0106f10 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.645+0000 7fedc67fc640 1 -- 172.21.15.2:0/287109263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc802fc80 con 0x7fedd0106f10 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.645+0000 7fedd7517640 1 -- 172.21.15.2:0/287109263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd01a7150 con 0x7fedd0106f10 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.647+0000 7fedc67fc640 1 -- 172.21.15.2:0/287109263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fedc80046a0 con 0x7fedd0106f10 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.647+0000 7fedd98f0740 1 Processor -- start 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd98f0740 1 -- start start 2024-09-12T00:59:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 0x55a88af89880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 0x55a88af94140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af96a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd98f0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a88aeef2e0 con 0x55a88af94680 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd98f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a88ae96ce0 con 0x55a88af89dc0 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd98f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a88aeeb2a0 con 0x55a88af894a0 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af96a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af96a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55098/0 (socket says 172.21.15.2:55098) 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 -- 172.21.15.2:0/1592717995 learned_addr learned my addr 172.21.15.2:0/1592717995 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 0x55a88af89880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd52b3640 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 0x55a88af94140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedc67fc640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fedbc0a2cf0 0x7fedbc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 -- 172.21.15.2:0/1592717995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 msgr2=0x55a88af89880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 0x55a88af89880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 -- 172.21.15.2:0/1592717995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 msgr2=0x55a88af94140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 0x55a88af94140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd4ab2640 1 -- 172.21.15.2:0/1592717995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88ae7b440 con 0x55a88af94680 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.648+0000 7fedd5ab4640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fedbc0a2cf0 0x7fedbc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.649+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af96a70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fedc0006aa0 tx=0x7fedc0009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3712b467fdba19da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.649+0000 7fedc67fc640 1 -- 172.21.15.2:0/287109263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fedc80f07c0 con 0x7fedd0106f10 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.649+0000 7fedbb7fe640 1 -- 172.21.15.2:0/1592717995 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0015760 con 0x55a88af94680 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.649+0000 7fedbb7fe640 1 -- 172.21.15.2:0/1592717995 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedc001d070 con 0x55a88af94680 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.649+0000 7fedbb7fe640 1 -- 172.21.15.2:0/1592717995 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0018ac0 con 0x55a88af94680 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 -- 172.21.15.2:0/1592717995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 msgr2=0x55a88af96a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af96a70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fedc0006aa0 tx=0x7fedc0009510 comp rx=0 tx=0).stop 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd5ab4640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fedbc0a2cf0 0x7fedbc0a51b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedc80bcb30 tx=0x7fedc8087e50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 -- 172.21.15.2:0/1592717995 shutdown_connections 2024-09-12T00:59:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af96a70 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 0x55a88af94140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 --2- 172.21.15.2:0/1592717995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 0x55a88af89880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 -- 172.21.15.2:0/1592717995 >> 172.21.15.2:0/1592717995 conn(0x55a88af85a30 msgr2=0x55a88af85e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 -- 172.21.15.2:0/1592717995 shutdown_connections 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 -- 172.21.15.2:0/1592717995 wait complete. 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 -- start start 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 Processor -- start 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 0x55a88af93fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.650+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af91280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af917e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd98f0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a88af97250 con 0x55a88af94680 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd98f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a88aeaa050 con 0x55a88af894a0 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd98f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a88af973d0 con 0x55a88af89dc0 2024-09-12T00:59:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd98f0740 10 client.0 _ll_register_callbacks cb 0x55a88aeea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af917e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55114/0 (socket says 172.21.15.2:55114) 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 -- 172.21.15.2:0/2719984916 learned_addr learned my addr 172.21.15.2:0/2719984916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd52b3640 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af91280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 0x55a88af93fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 -- 172.21.15.2:0/2719984916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 msgr2=0x55a88af91280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af91280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 -- 172.21.15.2:0/2719984916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 msgr2=0x55a88af93fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 0x55a88af93fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 -- 172.21.15.2:0/2719984916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88ac603c0 con 0x55a88af94680 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd52b3640 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af91280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af917e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fedc0017ee0 tx=0x7fedc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a36ce251f562a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedb8ff9640 1 -- 172.21.15.2:0/2719984916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0015730 con 0x55a88af94680 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedb8ff9640 1 -- 172.21.15.2:0/2719984916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fedc00158d0 con 0x55a88af94680 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.651+0000 7fedd98f0740 1 -- 172.21.15.2:0/2719984916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedc001d070 con 0x55a88af94680 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedb8ff9640 1 -- 172.21.15.2:0/2719984916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fedc0032050 con 0x55a88af94680 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd98f0740 10 client.16863 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd98f0740 1 -- 172.21.15.2:0/2719984916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a88afa2c30 con 0x55a88af94680 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedb8ff9640 1 -- 172.21.15.2:0/2719984916 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedc001d070 con 0x55a88af94680 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedb8ff9640 1 -- 172.21.15.2:0/2719984916 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fedc0023930 con 0x55a88af94680 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd98f0740 10 client.16863 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd98f0740 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd98f0740 20 client.16863 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd98f0740 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a88afa4030 0x55a88afa6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd98f0740 4 client.16863 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd98f0740 1 -- 172.21.15.2:0/2719984916 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a88aefc850 con 0x55a88afa4030 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.652+0000 7fedd52b3640 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a88afa4030 0x55a88afa6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.653+0000 7fedb8ff9640 10 client.16863 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.653+0000 7fedd52b3640 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a88afa4030 0x55a88afa6420 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e4420f3fc8fb969 server_cookie=2bb5c708a7659217 in_seq=0 out_seq=0 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.653+0000 7fedb8ff9640 1 -- 172.21.15.2:0/2719984916 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a88aefc850 con 0x55a88afa4030 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.653+0000 7fedb8ff9640 10 client.16863 handle_command_reply: tid=0 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 client.16863 shutdown 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 -- 172.21.15.2:0/2719984916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 msgr2=0x55a88af917e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af917e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fedc0017ee0 tx=0x7fedc0008040 comp rx=0 tx=0).stop 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 -- 172.21.15.2:0/2719984916 shutdown_connections 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a88afa4030 0x55a88afa6420 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88af917e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af91280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 --2- 172.21.15.2:0/2719984916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 0x55a88af93fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 -- 172.21.15.2:0/2719984916 >> 172.21.15.2:0/2719984916 conn(0x55a88af85a30 msgr2=0x55a88af8b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:31.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedb8ff9640 0 client.16863 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:31.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 -- 172.21.15.2:0/2719984916 shutdown_connections 2024-09-12T00:59:31.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 1 -- 172.21.15.2:0/2719984916 wait complete. 2024-09-12T00:59:31.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.654+0000 7fedd98f0740 20 client.16863 trim_cache size 0 max 16384 2024-09-12T00:59:31.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd98f0740 1 Processor -- start 2024-09-12T00:59:31.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd98f0740 1 -- start start 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 0x55a88afa04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 0x55a88afaba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88afabfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd98f0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01b2530 con 0x55a88af94680 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd98f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01afd70 con 0x55a88af89dc0 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd98f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01adbc0 con 0x55a88af894a0 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88afabfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88afabfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55130/0 (socket says 172.21.15.2:55130) 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 -- 172.21.15.2:0/792469162 learned_addr learned my addr 172.21.15.2:0/792469162 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 0x55a88afa04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd52b3640 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 0x55a88afaba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 -- 172.21.15.2:0/792469162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 msgr2=0x55a88afa04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 0x55a88afa04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 -- 172.21.15.2:0/792469162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 msgr2=0x55a88afaba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 0x55a88afaba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.672+0000 7fedd4ab2640 1 -- 172.21.15.2:0/792469162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88af89bf0 con 0x55a88af94680 2024-09-12T00:59:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88afabfc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009fd0 tx=0x7fedc00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10c83b3f5059ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedbaffd640 1 -- 172.21.15.2:0/792469162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0022750 con 0x55a88af94680 2024-09-12T00:59:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedbaffd640 1 -- 172.21.15.2:0/792469162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedc001d040 con 0x55a88af94680 2024-09-12T00:59:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedbaffd640 1 -- 172.21.15.2:0/792469162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0023780 con 0x55a88af94680 2024-09-12T00:59:31.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedd98f0740 1 -- 172.21.15.2:0/792469162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 msgr2=0x55a88afabfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedd98f0740 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88afabfc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009fd0 tx=0x7fedc00047d0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedd98f0740 1 -- 172.21.15.2:0/792469162 shutdown_connections 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedd98f0740 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88afabfc0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedd98f0740 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af89dc0 0x55a88afaba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedd98f0740 1 --2- 172.21.15.2:0/792469162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af894a0 0x55a88afa04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.673+0000 7fedd98f0740 1 -- 172.21.15.2:0/792469162 >> 172.21.15.2:0/792469162 conn(0x55a88af85a30 msgr2=0x55a88af90370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 -- 172.21.15.2:0/792469162 shutdown_connections 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 -- 172.21.15.2:0/792469162 wait complete. 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 -- start start 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 Processor -- start 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 0x55a88af97b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af980b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88b00ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01ae230 con 0x55a88af94680 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01af6a0 con 0x55a88af894a0 2024-09-12T00:59:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01ae900 con 0x55a88af89dc0 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.674+0000 7fedd98f0740 10 client.0 _ll_register_callbacks cb 0x7fedc0009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88b00ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88b00ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55136/0 (socket says 172.21.15.2:55136) 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 -- 172.21.15.2:0/367175556 learned_addr learned my addr 172.21.15.2:0/367175556 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd52b3640 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 0x55a88af97b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 -- 172.21.15.2:0/367175556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 msgr2=0x55a88af980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 -- 172.21.15.2:0/367175556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 msgr2=0x55a88af97b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 0x55a88af97b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 -- 172.21.15.2:0/367175556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88b00d000 con 0x55a88af94680 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd4ab2640 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88b00ca40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fedc0017730 tx=0x7fedc0022ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58187075f89e452 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedb8ff9640 1 -- 172.21.15.2:0/367175556 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0022b60 con 0x55a88af94680 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedb8ff9640 1 -- 172.21.15.2:0/367175556 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fedc0023520 con 0x55a88af94680 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.675+0000 7fedd98f0740 1 -- 172.21.15.2:0/367175556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedc001d040 con 0x55a88af94680 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedb8ff9640 1 -- 172.21.15.2:0/367175556 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fedc0022d00 con 0x55a88af94680 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd98f0740 10 client.16869 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd98f0740 1 -- 172.21.15.2:0/367175556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a88b00e2b0 con 0x55a88af94680 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedb8ff9640 1 -- 172.21.15.2:0/367175556 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedc001d040 con 0x55a88af94680 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedb8ff9640 1 -- 172.21.15.2:0/367175556 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fedc0015930 con 0x55a88af94680 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd98f0740 10 client.16869 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd98f0740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd98f0740 20 client.16869 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd98f0740 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a88b00e860 0x55a88b010c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd98f0740 4 client.16869 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:59:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd98f0740 1 -- 172.21.15.2:0/367175556 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a88aef6d60 con 0x55a88b00e860 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.676+0000 7fedd52b3640 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a88b00e860 0x55a88b010c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd52b3640 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a88b00e860 0x55a88b010c50 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2832545c5fb864c5 server_cookie=67a1a73aad4ef8f4 in_seq=0 out_seq=0 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedb8ff9640 10 client.16869 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedb8ff9640 1 -- 172.21.15.2:0/367175556 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a88aef6d60 con 0x55a88b00e860 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedb8ff9640 10 client.16869 handle_command_reply: tid=0 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 client.16869 shutdown 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 -- 172.21.15.2:0/367175556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 msgr2=0x55a88b00ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88b00ca40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fedc0017730 tx=0x7fedc0022ee0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 -- 172.21.15.2:0/367175556 shutdown_connections 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a88b00e860 0x55a88b010c50 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a88af94680 0x55a88b00ca40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a88af89dc0 0x55a88af980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 --2- 172.21.15.2:0/367175556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a88af894a0 0x55a88af97b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedb8ff9640 0 client.16869 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:31.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 -- 172.21.15.2:0/367175556 >> 172.21.15.2:0/367175556 conn(0x55a88af85a30 msgr2=0x55a88af92ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:31.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 -- 172.21.15.2:0/367175556 shutdown_connections 2024-09-12T00:59:31.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 1 -- 172.21.15.2:0/367175556 wait complete. 2024-09-12T00:59:31.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.677+0000 7fedd98f0740 20 client.16869 trim_cache size 0 max 16384 2024-09-12T00:59:31.682 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:31.682 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:59:31.682 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:59:31.682 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 -- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fedbc0a2cf0 msgr2=0x7fedbc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fedbc0a2cf0 0x7fedbc0a51b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedc80bcb30 tx=0x7fedc8087e50 comp rx=0 tx=0).stop 2024-09-12T00:59:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 -- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 msgr2=0x7fedd0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 0x7fedd0074f70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fedc8031a20 tx=0x7fedc8031a50 comp rx=0 tx=0).stop 2024-09-12T00:59:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 -- 172.21.15.2:0/287109263 shutdown_connections 2024-09-12T00:59:31.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fedbc0a2cf0 0x7fedbc0a51b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0106f10 0x7fedd0074f70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd0102790 0x7fedd0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 --2- 172.21.15.2:0/287109263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101de0 0x7fedd00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:31.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 -- 172.21.15.2:0/287109263 >> 172.21.15.2:0/287109263 conn(0x7fedd00fd8c0 msgr2=0x7fedd00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:31.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 -- 172.21.15.2:0/287109263 shutdown_connections 2024-09-12T00:59:31.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:31.678+0000 7fedd7517640 1 -- 172.21.15.2:0/287109263 wait complete. 2024-09-12T00:59:31.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:31 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:59:31.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:31 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:31.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:31 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:59:31.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:31 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:31.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:31 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:59:31.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:31 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:59:31.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:31 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:31.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:31 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:59:31.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:31 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:31.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:31 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:59:32.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:31 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:59:32.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:31 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:32.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:31 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:59:32.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:31 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:32.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:31 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:59:32.443 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:59:32.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:59:32.703 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:32.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:32 smithi002 ceph-mon[31210]: pgmap v201: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-12T00:59:32.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:32 smithi071 ceph-mon[35276]: pgmap v201: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-12T00:59:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:32 smithi167 ceph-mon[35234]: pgmap v201: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-12T00:59:33.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 -- 172.21.15.2:0/2001296693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160101de0 msgr2=0x7f71601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:33.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 --2- 172.21.15.2:0/2001296693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160101de0 0x7f71601021c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7150009900 tx=0x7f715002a410 comp rx=0 tx=0).stop 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 -- 172.21.15.2:0/2001296693 shutdown_connections 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 --2- 172.21.15.2:0/2001296693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7160106f10 0x7f716010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 --2- 172.21.15.2:0/2001296693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7160102790 0x7f71601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 --2- 172.21.15.2:0/2001296693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160101de0 0x7f71601021c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 -- 172.21.15.2:0/2001296693 >> 172.21.15.2:0/2001296693 conn(0x7f71600fd8c0 msgr2=0x7f71600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 -- 172.21.15.2:0/2001296693 shutdown_connections 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 -- 172.21.15.2:0/2001296693 wait complete. 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.181+0000 7f71657e6640 1 Processor -- start 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f71657e6640 1 -- start start 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f71657e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7160101de0 0x7f71600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f71657e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160102790 0x7f7160074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f71657e6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7160106f10 0x7f7160074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f71657e6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7160111f90 con 0x7f7160102790 2024-09-12T00:59:33.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f71657e6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7160111e10 con 0x7f7160106f10 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f71657e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7160112110 con 0x7f7160101de0 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160102790 0x7f7160074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160102790 0x7f7160074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55158/0 (socket says 172.21.15.2:55158) 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715e7fc640 1 -- 172.21.15.2:0/2074611533 learned_addr learned my addr 172.21.15.2:0/2074611533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715effd640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7160101de0 0x7f71600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715f7fe640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7160106f10 0x7f7160074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715e7fc640 1 -- 172.21.15.2:0/2074611533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7160101de0 msgr2=0x7f71600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715e7fc640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7160101de0 0x7f71600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715e7fc640 1 -- 172.21.15.2:0/2074611533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7160106f10 msgr2=0x7f7160074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.182+0000 7f715e7fc640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7160106f10 0x7f7160074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.183+0000 7f715e7fc640 1 -- 172.21.15.2:0/2074611533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71601aad70 con 0x7f7160102790 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.183+0000 7f715e7fc640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160102790 0x7f7160074a30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f714800c920 tx=0x7f714800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.183+0000 7f7157fff640 1 -- 172.21.15.2:0/2074611533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148007c70 con 0x7f7160102790 2024-09-12T00:59:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.183+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71601aafa0 con 0x7f7160102790 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.183+0000 7f7157fff640 1 -- 172.21.15.2:0/2074611533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7148007e10 con 0x7f7160102790 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.183+0000 7f7157fff640 1 -- 172.21.15.2:0/2074611533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148018890 con 0x7f7160102790 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.183+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71601ab3f0 con 0x7f7160102790 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.184+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71601032c0 con 0x7f7160102790 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.185+0000 7f7157fff640 1 -- 172.21.15.2:0/2074611533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f7148018a50 con 0x7f7160102790 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.186+0000 7f7157fff640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f714c0a2cf0 0x7f714c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.186+0000 7f715effd640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f714c0a2cf0 0x7f714c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.187+0000 7f7157fff640 1 -- 172.21.15.2:0/2074611533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f71480cf870 con 0x7f7160102790 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.187+0000 7f715effd640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f714c0a2cf0 0x7f714c0a51b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7150000c00 tx=0x7f71500058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.190+0000 7f7157fff640 1 -- 172.21.15.2:0/2074611533 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7148014030 con 0x7f7160102790 2024-09-12T00:59:33.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.402+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71601021c0 con 0x7f7160102790 2024-09-12T00:59:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.402+0000 7f7157fff640 1 -- 172.21.15.2:0/2074611533 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7f71601021c0 con 0x7f7160102790 2024-09-12T00:59:33.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:59:33.402 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:59:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T00:59:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f714c0a2cf0 msgr2=0x7f714c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f714c0a2cf0 0x7f714c0a51b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7150000c00 tx=0x7f71500058d0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160102790 msgr2=0x7f7160074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160102790 0x7f7160074a30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f714800c920 tx=0x7f714800cde0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 shutdown_connections 2024-09-12T00:59:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f714c0a2cf0 0x7f714c0a51b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7160106f10 0x7f7160074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7160102790 0x7f7160074a30 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 --2- 172.21.15.2:0/2074611533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7160101de0 0x7f71600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.404+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 >> 172.21.15.2:0/2074611533 conn(0x7f71600fd8c0 msgr2=0x7f71600fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.405+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 shutdown_connections 2024-09-12T00:59:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:33.405+0000 7f71657e6640 1 -- 172.21.15.2:0/2074611533 wait complete. 2024-09-12T00:59:33.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:33 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2074611533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:33.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:33 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2074611533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:34.000 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:59:34.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:33 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2074611533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:34.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:34 smithi002 ceph-mon[31210]: pgmap v202: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 -- 172.21.15.2:0/84840693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 msgr2=0x7f32d810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 --2- 172.21.15.2:0/84840693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 0x7f32d810d950 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009cd0 tx=0x7f32d002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 -- 172.21.15.2:0/84840693 shutdown_connections 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 --2- 172.21.15.2:0/84840693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 0x7f32d810d950 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 --2- 172.21.15.2:0/84840693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32d8100a80 0x7f32d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 --2- 172.21.15.2:0/84840693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32d8106a80 0x7f32d8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 -- 172.21.15.2:0/84840693 >> 172.21.15.2:0/84840693 conn(0x7f32d80fc7a0 msgr2=0x7f32d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 -- 172.21.15.2:0/84840693 shutdown_connections 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.698+0000 7f32ded61640 1 -- 172.21.15.2:0/84840693 wait complete. 2024-09-12T00:59:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.699+0000 7f32ded61640 1 Processor -- start 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.699+0000 7f32ded61640 1 -- start start 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.699+0000 7f32ded61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32d8100a80 0x7f32d81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.699+0000 7f32ded61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 0x7f32d8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.699+0000 7f32ded61640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32d8106a80 0x7f32d819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.699+0000 7f32ded61640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8110ea0 con 0x7f32d8101420 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.699+0000 7f32ded61640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8110d20 con 0x7f32d8106a80 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.699+0000 7f32ded61640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8111020 con 0x7f32d8100a80 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 0x7f32d8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 0x7f32d8198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55166/0 (socket says 172.21.15.2:55166) 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 -- 172.21.15.2:0/3464882576 learned_addr learned my addr 172.21.15.2:0/3464882576 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32dcafd640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32d8100a80 0x7f32d81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32d8106a80 0x7f32d819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 -- 172.21.15.2:0/3464882576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32d8100a80 msgr2=0x7f32d81983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32d8100a80 0x7f32d81983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 -- 172.21.15.2:0/3464882576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32d8106a80 msgr2=0x7f32d819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32d8106a80 0x7f32d819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 -- 172.21.15.2:0/3464882576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d819d380 con 0x7f32d8101420 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d7fff640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 0x7f32d8198910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c920 tx=0x7f32c400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d5ffb640 1 -- 172.21.15.2:0/3464882576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4007bb0 con 0x7f32d8101420 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32ded61640 1 -- 172.21.15.2:0/3464882576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d819d670 con 0x7f32d8101420 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d5ffb640 1 -- 172.21.15.2:0/3464882576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c4007d50 con 0x7f32d8101420 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.700+0000 7f32d5ffb640 1 -- 172.21.15.2:0/3464882576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40187d0 con 0x7f32d8101420 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.701+0000 7f32ded61640 1 -- 172.21.15.2:0/3464882576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d81a4f50 con 0x7f32d8101420 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32d5ffb640 1 -- 172.21.15.2:0/3464882576 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f32c400f450 con 0x7f32d8101420 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32e113a740 1 Processor -- start 2024-09-12T00:59:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32e113a740 1 -- start start 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32e113a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2bef7f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32e113a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2bef7fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32e113a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef8cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32e113a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c2beee12f0 con 0x55c2bef80f50 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32e113a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c2bee88cf0 con 0x55c2bef7f9e0 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32e113a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c2beedd2b0 con 0x55c2bef8a780 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32dd2fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2bef7f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32dd2fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2bef7f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55168/0 (socket says 172.21.15.2:55168) 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32dd2fe640 1 -- 172.21.15.2:0/1902919183 learned_addr learned my addr 172.21.15.2:0/1902919183 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.703+0000 7f32d5ffb640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32c80a2d70 0x7f32c80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dcafd640 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2bef7fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32d7fff640 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef8cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32c80a2d70 0x7f32c80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32d5ffb640 1 -- 172.21.15.2:0/3464882576 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f32c40cf560 con 0x7f32d8101420 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dd2fe640 1 -- 172.21.15.2:0/1902919183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 msgr2=0x55c2bef8cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef8cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dd2fe640 1 -- 172.21.15.2:0/1902919183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 msgr2=0x55c2bef7fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2bef7fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dd2fe640 1 -- 172.21.15.2:0/1902919183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bee6d3a0 con 0x55c2bef80f50 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2bef7f4a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009430 tx=0x7f32d0031c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec201944ae632e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32c80a2d70 0x7f32c80a5230 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f32d0046000 tx=0x7f32d0049000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32c2ffd640 1 -- 172.21.15.2:0/1902919183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0004040 con 0x55c2bef80f50 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32c2ffd640 1 -- 172.21.15.2:0/1902919183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32d0036040 con 0x55c2bef80f50 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.704+0000 7f32c2ffd640 1 -- 172.21.15.2:0/1902919183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0030cb0 con 0x55c2bef80f50 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 -- 172.21.15.2:0/1902919183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 msgr2=0x55c2bef7f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2bef7f4a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009430 tx=0x7f32d0031c00 comp rx=0 tx=0).stop 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 -- 172.21.15.2:0/1902919183 shutdown_connections 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef8cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2bef7fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 --2- 172.21.15.2:0/1902919183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2bef7f4a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 -- 172.21.15.2:0/1902919183 >> 172.21.15.2:0/1902919183 conn(0x55c2bef44310 msgr2=0x55c2bef7c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 -- 172.21.15.2:0/1902919183 shutdown_connections 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.705+0000 7f32e113a740 1 -- 172.21.15.2:0/1902919183 wait complete. 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 1 -- start start 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 1 Processor -- start 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef7f9e0 0x55c2bef8a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef80f50 0x55c2bef874e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef8a780 0x55c2bef87c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c2bef8d3c0 con 0x55c2bef7f9e0 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c2bee9c060 con 0x55c2bef8a780 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c2bef8d540 con 0x55c2bef80f50 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32e113a740 10 client.0 _ll_register_callbacks cb 0x55c2bebef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32dcafd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef7f9e0 0x55c2bef8a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32dcafd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef7f9e0 0x55c2bef8a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55172/0 (socket says 172.21.15.2:55172) 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32dcafd640 1 -- 172.21.15.2:0/102530673 learned_addr learned my addr 172.21.15.2:0/102530673 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.706+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef8a780 0x55c2bef87c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32d7fff640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef80f50 0x55c2bef874e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32dcafd640 1 -- 172.21.15.2:0/102530673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef80f50 msgr2=0x55c2bef874e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32dcafd640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef80f50 0x55c2bef874e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32dcafd640 1 -- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef8a780 msgr2=0x55c2bef87c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:34.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32dcafd640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef8a780 0x55c2bef87c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32dcafd640 1 -- 172.21.15.2:0/102530673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bec523c0 con 0x55c2bef7f9e0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef8a780 0x55c2bef87c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32d7fff640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef80f50 0x55c2bef874e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32dcafd640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef7f9e0 0x55c2bef8a230 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f32cc011540 tx=0x7f32cc011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4845f2e6b1efc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32b7fff640 1 -- 172.21.15.2:0/102530673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00f6d0 con 0x55c2bef7f9e0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32b7fff640 1 -- 172.21.15.2:0/102530673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f32cc00f870 con 0x55c2bef7f9e0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32e113a740 1 -- 172.21.15.2:0/102530673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32d0036040 con 0x55c2bef7f9e0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32b7fff640 1 -- 172.21.15.2:0/102530673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f32cc00fab0 con 0x55c2bef7f9e0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32e113a740 10 client.16887 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32e113a740 1 -- 172.21.15.2:0/102530673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c2bef98f00 con 0x55c2bef7f9e0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32b7fff640 1 -- 172.21.15.2:0/102530673 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32d0036040 con 0x55c2bef7f9e0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32b7fff640 1 -- 172.21.15.2:0/102530673 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f32cc025400 con 0x55c2bef7f9e0 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.707+0000 7f32e113a740 10 client.16887 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:34.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.708+0000 7f32e113a740 10 client.16887 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.708+0000 7f32e113a740 20 client.16887 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.708+0000 7f32e113a740 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55c2bef9a3c0 0x55c2bef9c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.708+0000 7f32e113a740 4 client.16887 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.708+0000 7f32e113a740 1 -- 172.21.15.2:0/102530673 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2beeee860 con 0x55c2bef9a3c0 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.708+0000 7f32d7fff640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55c2bef9a3c0 0x55c2bef9c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.708+0000 7f32d7fff640 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55c2bef9a3c0 0x55c2bef9c7f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed2b0b8d155e432b server_cookie=b41677e68ddc620b in_seq=0 out_seq=0 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.708+0000 7f32b7fff640 10 client.16887 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32b7fff640 1 -- 172.21.15.2:0/102530673 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2beeee860 con 0x55c2bef9a3c0 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32b7fff640 10 client.16887 handle_command_reply: tid=0 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 client.16887 shutdown 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 -- 172.21.15.2:0/102530673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef7f9e0 msgr2=0x55c2bef8a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef7f9e0 0x55c2bef8a230 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f32cc011540 tx=0x7f32cc011a00 comp rx=0 tx=0).stop 2024-09-12T00:59:34.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 -- 172.21.15.2:0/102530673 shutdown_connections 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55c2bef9a3c0 0x55c2bef9c7f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef8a780 0x55c2bef87c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef80f50 0x55c2bef874e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32b7fff640 0 client.16887 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 --2- 172.21.15.2:0/102530673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef7f9e0 0x55c2bef8a230 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 -- 172.21.15.2:0/102530673 >> 172.21.15.2:0/102530673 conn(0x55c2bef44310 msgr2=0x55c2bef81d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 -- 172.21.15.2:0/102530673 shutdown_connections 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 1 -- 172.21.15.2:0/102530673 wait complete. 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.709+0000 7f32e113a740 20 client.16887 trim_cache size 0 max 16384 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.722+0000 7f32e113a740 1 Processor -- start 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.722+0000 7f32e113a740 1 -- start start 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32e113a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2befa20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32e113a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2befa2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32e113a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef84740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32e113a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81ae060 con 0x55c2bef80f50 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32e113a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81ab8a0 con 0x55c2bef7f9e0 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32e113a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81a96f0 con 0x55c2bef8a780 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2befa2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2befa2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55182/0 (socket says 172.21.15.2:55182) 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 -- 172.21.15.2:0/3593613447 learned_addr learned my addr 172.21.15.2:0/3593613447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef84740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32dcafd640 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2befa20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 -- 172.21.15.2:0/3593613447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 msgr2=0x55c2bef84740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef84740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 -- 172.21.15.2:0/3593613447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 msgr2=0x55c2befa20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2befa20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 -- 172.21.15.2:0/3593613447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bef76310 con 0x55c2bef80f50 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef84740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32dcafd640 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2befa20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32d7fff640 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2befa2600 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f32c40cd260 tx=0x7f32c40665b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6328b0effc4fa355 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32c27fc640 1 -- 172.21.15.2:0/3593613447 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c409c130 con 0x55c2bef80f50 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32c27fc640 1 -- 172.21.15.2:0/3593613447 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c4008230 con 0x55c2bef80f50 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.723+0000 7f32c27fc640 1 -- 172.21.15.2:0/3593613447 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4099dc0 con 0x55c2bef80f50 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 -- 172.21.15.2:0/3593613447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 msgr2=0x55c2befa2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2befa2600 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f32c40cd260 tx=0x7f32c40665b0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 -- 172.21.15.2:0/3593613447 shutdown_connections 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef8a780 0x55c2bef84740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef80f50 0x55c2befa2600 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 --2- 172.21.15.2:0/3593613447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef7f9e0 0x55c2befa20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 -- 172.21.15.2:0/3593613447 >> 172.21.15.2:0/3593613447 conn(0x55c2bef44310 msgr2=0x55c2bef85db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 -- 172.21.15.2:0/3593613447 shutdown_connections 2024-09-12T00:59:34.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 -- 172.21.15.2:0/3593613447 wait complete. 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.724+0000 7f32e113a740 1 -- start start 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32e113a740 1 Processor -- start 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32e113a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef7f9e0 0x55c2bef93020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32e113a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef80f50 0x55c2bef8e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32e113a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef8a780 0x55c2bef8e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32e113a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81a9d60 con 0x55c2bef8a780 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32e113a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81ab1d0 con 0x55c2bef80f50 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32e113a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81aa430 con 0x55c2bef7f9e0 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32e113a740 10 client.0 _ll_register_callbacks cb 0x7f32cc009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dd2fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef8a780 0x55c2bef8e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dd2fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef8a780 0x55c2bef8e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55198/0 (socket says 172.21.15.2:55198) 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dd2fe640 1 -- 172.21.15.2:0/479479195 learned_addr learned my addr 172.21.15.2:0/479479195 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32d7fff640 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef80f50 0x55c2bef8e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dcafd640 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef7f9e0 0x55c2bef93020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dd2fe640 1 -- 172.21.15.2:0/479479195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef7f9e0 msgr2=0x55c2bef93020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef7f9e0 0x55c2bef93020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dd2fe640 1 -- 172.21.15.2:0/479479195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef80f50 msgr2=0x55c2bef8e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef80f50 0x55c2bef8e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dd2fe640 1 -- 172.21.15.2:0/479479195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bef8f150 con 0x55c2bef8a780 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.725+0000 7f32dcafd640 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef7f9e0 0x55c2bef93020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32dd2fe640 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef8a780 0x55c2bef8e920 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f32d004c040 tx=0x7f32d00044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac3e8447c7e9b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32b7fff640 1 -- 172.21.15.2:0/479479195 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0062060 con 0x55c2bef8a780 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32b7fff640 1 -- 172.21.15.2:0/479479195 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f32d0031580 con 0x55c2bef8a780 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32e113a740 1 -- 172.21.15.2:0/479479195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32c4008230 con 0x55c2bef8a780 2024-09-12T00:59:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32b7fff640 1 -- 172.21.15.2:0/479479195 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f32d0004830 con 0x55c2bef8a780 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32e113a740 10 client.16893 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32e113a740 1 -- 172.21.15.2:0/479479195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c2bf005100 con 0x55c2bef8a780 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32b7fff640 1 -- 172.21.15.2:0/479479195 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c4008230 con 0x55c2bef8a780 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32b7fff640 1 -- 172.21.15.2:0/479479195 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f32d0030070 con 0x55c2bef8a780 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32e113a740 10 client.16893 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32e113a740 10 client.16893 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.726+0000 7f32e113a740 20 client.16893 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32e113a740 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55c2bf005490 0x55c2bf007880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32e113a740 4 client.16893 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32e113a740 1 -- 172.21.15.2:0/479479195 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2beee8d70 con 0x55c2bf005490 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32dcafd640 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55c2bf005490 0x55c2bf007880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32b7fff640 10 client.16893 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32dcafd640 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55c2bf005490 0x55c2bf007880 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e515dc59e8173b7d server_cookie=b051f900ea203f57 in_seq=0 out_seq=0 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32b7fff640 1 -- 172.21.15.2:0/479479195 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2beee8d70 con 0x55c2bf005490 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32b7fff640 10 client.16893 handle_command_reply: tid=0 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32e113a740 1 client.16893 shutdown 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32e113a740 1 -- 172.21.15.2:0/479479195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef8a780 msgr2=0x55c2bef8e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.727+0000 7f32e113a740 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef8a780 0x55c2bef8e920 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f32d004c040 tx=0x7f32d00044b0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 1 -- 172.21.15.2:0/479479195 shutdown_connections 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55c2bf005490 0x55c2bf007880 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2bef8a780 0x55c2bef8e920 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2bef80f50 0x55c2bef8e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 1 --2- 172.21.15.2:0/479479195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2bef7f9e0 0x55c2bef93020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32b7fff640 0 client.16893 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 1 -- 172.21.15.2:0/479479195 >> 172.21.15.2:0/479479195 conn(0x55c2bef44310 msgr2=0x55c2bef764e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 1 -- 172.21.15.2:0/479479195 shutdown_connections 2024-09-12T00:59:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 1 -- 172.21.15.2:0/479479195 wait complete. 2024-09-12T00:59:34.751 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32e113a740 20 client.16893 trim_cache size 0 max 16384 2024-09-12T00:59:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 -- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32c80a2d70 msgr2=0x7f32c80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32c80a2d70 0x7f32c80a5230 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f32d0046000 tx=0x7f32d0049000 comp rx=0 tx=0).stop 2024-09-12T00:59:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 -- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 msgr2=0x7f32d8198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 0x7f32d8198910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c920 tx=0x7f32c400cd20 comp rx=0 tx=0).stop 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 -- 172.21.15.2:0/3464882576 shutdown_connections 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32c80a2d70 0x7f32c80a5230 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32d8106a80 0x7f32d819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d8101420 0x7f32d8198910 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 --2- 172.21.15.2:0/3464882576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32d8100a80 0x7f32d81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.728+0000 7f32ded61640 1 -- 172.21.15.2:0/3464882576 >> 172.21.15.2:0/3464882576 conn(0x7f32d80fc7a0 msgr2=0x7f32d8104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.729+0000 7f32ded61640 1 -- 172.21.15.2:0/3464882576 shutdown_connections 2024-09-12T00:59:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:34.729+0000 7f32ded61640 1 -- 172.21.15.2:0/3464882576 wait complete. 2024-09-12T00:59:34.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:34 smithi071 ceph-mon[35276]: pgmap v202: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T00:59:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:34 smithi167 ceph-mon[35234]: pgmap v202: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T00:59:35.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:59:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 -- 172.21.15.2:0/2004718920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818103660 msgr2=0x7f581810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 --2- 172.21.15.2:0/2004718920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818103660 0x7f581810bb50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f580c009900 tx=0x7f580c02a480 comp rx=0 tx=0).stop 2024-09-12T00:59:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 -- 172.21.15.2:0/2004718920 shutdown_connections 2024-09-12T00:59:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 --2- 172.21.15.2:0/2004718920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581810c170 0x7f581810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 --2- 172.21.15.2:0/2004718920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818103660 0x7f581810bb50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 --2- 172.21.15.2:0/2004718920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5818102d40 0x7f5818103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 -- 172.21.15.2:0/2004718920 >> 172.21.15.2:0/2004718920 conn(0x7f58180fc7a0 msgr2=0x7f58180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 -- 172.21.15.2:0/2004718920 shutdown_connections 2024-09-12T00:59:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.214+0000 7f581ef77640 1 -- 172.21.15.2:0/2004718920 wait complete. 2024-09-12T00:59:36.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.215+0000 7f581ef77640 1 Processor -- start 2024-09-12T00:59:36.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.215+0000 7f581ef77640 1 -- start start 2024-09-12T00:59:36.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.215+0000 7f581ef77640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818102d40 0x7f58181009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581ef77640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5818103660 0x7f5818100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581ef77640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581810c170 0x7f5818101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581ef77640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5818111fb0 con 0x7f5818102d40 2024-09-12T00:59:36.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581ef77640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5818111e30 con 0x7f581810c170 2024-09-12T00:59:36.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581ef77640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5818112130 con 0x7f5818103660 2024-09-12T00:59:36.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818102d40 0x7f58181009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818102d40 0x7f58181009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49150/0 (socket says 172.21.15.2:49150) 2024-09-12T00:59:36.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 -- 172.21.15.2:0/312288144 learned_addr learned my addr 172.21.15.2:0/312288144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f5817fff640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5818103660 0x7f5818100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 -- 172.21.15.2:0/312288144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5818103660 msgr2=0x7f5818100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5818103660 0x7f5818100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581d514640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581810c170 0x7f5818101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 -- 172.21.15.2:0/312288144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581810c170 msgr2=0x7f5818101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581810c170 0x7f5818101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 -- 172.21.15.2:0/312288144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58181a6920 con 0x7f5818102d40 2024-09-12T00:59:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f5817fff640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5818103660 0x7f5818100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581d514640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581810c170 0x7f5818101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581cd13640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818102d40 0x7f58181009a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f580800b4a0 tx=0x7f580800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f5815ffb640 1 -- 172.21.15.2:0/312288144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808014070 con 0x7f5818102d40 2024-09-12T00:59:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f5815ffb640 1 -- 172.21.15.2:0/312288144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5808010af0 con 0x7f5818102d40 2024-09-12T00:59:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f5815ffb640 1 -- 172.21.15.2:0/312288144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808017d10 con 0x7f5818102d40 2024-09-12T00:59:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.216+0000 7f581ef77640 1 -- 172.21.15.2:0/312288144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58181a6c10 con 0x7f5818102d40 2024-09-12T00:59:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.217+0000 7f581ef77640 1 -- 172.21.15.2:0/312288144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58181a7150 con 0x7f5818102d40 2024-09-12T00:59:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.219+0000 7f5815ffb640 1 -- 172.21.15.2:0/312288144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f5808017070 con 0x7f5818102d40 2024-09-12T00:59:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.219+0000 7f5821350740 1 Processor -- start 2024-09-12T00:59:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.219+0000 7f5815ffb640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58000a2cf0 0x7f58000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.219+0000 7f5821350740 1 -- start start 2024-09-12T00:59:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581d514640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58000a2cf0 0x7f58000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f5815ffb640 1 -- 172.21.15.2:0/312288144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f58080ce7b0 con 0x7f5818102d40 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f5821350740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd89090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f5821350740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 0x55fe2dd89a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f5821350740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 0x55fe2dd96760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f5821350740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fe2dcef2f0 con 0x55fe2dd8ab40 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f5821350740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fe2dc96cf0 con 0x55fe2dd94370 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f5821350740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fe2dceb2b0 con 0x55fe2dd895d0 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd89090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd89090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49158/0 (socket says 172.21.15.2:49158) 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 -- 172.21.15.2:0/1628609860 learned_addr learned my addr 172.21.15.2:0/1628609860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581d514640 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 0x55fe2dd96760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f5817fff640 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 0x55fe2dd89a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 -- 172.21.15.2:0/1628609860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 msgr2=0x55fe2dd89a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 0x55fe2dd89a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581d514640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58000a2cf0 0x7f58000a51b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5810005fd0 tx=0x7f581000d710 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 -- 172.21.15.2:0/1628609860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 msgr2=0x55fe2dd96760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 0x55fe2dd96760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 -- 172.21.15.2:0/1628609860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2dc7b3a0 con 0x55fe2dd8ab40 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.220+0000 7f581cd13640 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd89090 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f580809ad20 tx=0x7f58080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34abfce93c235153 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f57feffd640 1 -- 172.21.15.2:0/1628609860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580801e070 con 0x55fe2dd8ab40 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f57feffd640 1 -- 172.21.15.2:0/1628609860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58080a3a00 con 0x55fe2dd8ab40 2024-09-12T00:59:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f57feffd640 1 -- 172.21.15.2:0/1628609860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580809a1e0 con 0x55fe2dd8ab40 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f5821350740 1 -- 172.21.15.2:0/1628609860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 msgr2=0x55fe2dd89090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f5821350740 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd89090 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f580809ad20 tx=0x7f58080046c0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f5821350740 1 -- 172.21.15.2:0/1628609860 shutdown_connections 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f5821350740 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 0x55fe2dd96760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f5821350740 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 0x55fe2dd89a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f5821350740 1 --2- 172.21.15.2:0/1628609860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd89090 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.221+0000 7f5821350740 1 -- 172.21.15.2:0/1628609860 >> 172.21.15.2:0/1628609860 conn(0x55fe2dd52310 msgr2=0x55fe2dd85c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 -- 172.21.15.2:0/1628609860 shutdown_connections 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 -- 172.21.15.2:0/1628609860 wait complete. 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 -- start start 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 Processor -- start 2024-09-12T00:59:36.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd895d0 0x55fe2dd93d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd90fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd94370 0x55fe2dd915d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fe2dd97010 con 0x55fe2dd8ab40 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fe2dcaa060 con 0x55fe2dd895d0 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fe2dd97190 con 0x55fe2dd94370 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.222+0000 7f5821350740 10 client.0 _ll_register_callbacks cb 0x55fe2d9fd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd90fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd90fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49160/0 (socket says 172.21.15.2:49160) 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 -- 172.21.15.2:0/1564424639 learned_addr learned my addr 172.21.15.2:0/1564424639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f581d514640 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd94370 0x55fe2dd915d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f581cd13640 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd895d0 0x55fe2dd93d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 -- 172.21.15.2:0/1564424639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd94370 msgr2=0x55fe2dd915d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd94370 0x55fe2dd915d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 -- 172.21.15.2:0/1564424639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd895d0 msgr2=0x55fe2dd93d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd895d0 0x55fe2dd93d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 -- 172.21.15.2:0/1564424639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2da603c0 con 0x55fe2dd8ab40 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f581cd13640 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd895d0 0x55fe2dd93d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5817fff640 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd90fe0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f580c006010 tx=0x7f580c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc90eebdac130b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f57f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f57f7fff640 1 -- 172.21.15.2:0/1564424639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c03f070 con 0x55fe2dd8ab40 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f57f7fff640 1 -- 172.21.15.2:0/1564424639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f580c004240 con 0x55fe2dd8ab40 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f5821350740 1 -- 172.21.15.2:0/1564424639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58080a3a00 con 0x55fe2dd8ab40 2024-09-12T00:59:36.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.223+0000 7f57f7fff640 1 -- 172.21.15.2:0/1564424639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f580c04b050 con 0x55fe2dd8ab40 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f5821350740 10 client.16905 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f5821350740 1 -- 172.21.15.2:0/1564424639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe2dda2aa0 con 0x55fe2dd8ab40 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f57f7fff640 1 -- 172.21.15.2:0/1564424639 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58080a3a00 con 0x55fe2dd8ab40 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f57f7fff640 1 -- 172.21.15.2:0/1564424639 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f580c004960 con 0x55fe2dd8ab40 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f5821350740 10 client.16905 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f5821350740 10 client.16905 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f5821350740 20 client.16905 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f5821350740 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55fe2dda3f50 0x55fe2dda63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f5821350740 4 client.16905 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f5821350740 1 -- 172.21.15.2:0/1564424639 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe2dcfc860 con 0x55fe2dda3f50 2024-09-12T00:59:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.224+0000 7f581cd13640 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55fe2dda3f50 0x55fe2dda63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.225+0000 7f57f7fff640 10 client.16905 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.225+0000 7f581cd13640 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55fe2dda3f50 0x55fe2dda63b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7250374217ac8b4 server_cookie=868c5c7e37e98bfa in_seq=0 out_seq=0 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.225+0000 7f57f7fff640 1 -- 172.21.15.2:0/1564424639 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe2dcfc860 con 0x55fe2dda3f50 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.225+0000 7f57f7fff640 10 client.16905 handle_command_reply: tid=0 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.225+0000 7f5821350740 1 client.16905 shutdown 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 -- 172.21.15.2:0/1564424639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 msgr2=0x55fe2dd90fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd90fe0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f580c006010 tx=0x7f580c005e50 comp rx=0 tx=0).stop 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 -- 172.21.15.2:0/1564424639 shutdown_connections 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55fe2dda3f50 0x55fe2dda63b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd94370 0x55fe2dd915d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd90fe0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 --2- 172.21.15.2:0/1564424639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd895d0 0x55fe2dd93d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 -- 172.21.15.2:0/1564424639 >> 172.21.15.2:0/1564424639 conn(0x55fe2dd52310 msgr2=0x55fe2dd8b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:36.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f57f7fff640 0 client.16905 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:36.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 -- 172.21.15.2:0/1564424639 shutdown_connections 2024-09-12T00:59:36.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 1 -- 172.21.15.2:0/1564424639 wait complete. 2024-09-12T00:59:36.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.226+0000 7f5821350740 20 client.16905 trim_cache size 0 max 16384 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5821350740 1 Processor -- start 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5821350740 1 -- start start 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5821350740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd895d0 0x55fe2dd8c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5821350740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd8c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5821350740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 0x55fe2ddabc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5821350740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58181b2600 con 0x55fe2dd895d0 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5821350740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58181afe40 con 0x55fe2dd94370 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5821350740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f58181adc90 con 0x55fe2dd8ab40 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f581cd13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd895d0 0x55fe2dd8c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f581cd13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd895d0 0x55fe2dd8c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49166/0 (socket says 172.21.15.2:49166) 2024-09-12T00:59:36.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f581cd13640 1 -- 172.21.15.2:0/990544906 learned_addr learned my addr 172.21.15.2:0/990544906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f581d514640 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 0x55fe2ddabc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.239+0000 7f5817fff640 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd8c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f581cd13640 1 -- 172.21.15.2:0/990544906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd8ab40 msgr2=0x55fe2dd8c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f581cd13640 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd8c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f581cd13640 1 -- 172.21.15.2:0/990544906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 msgr2=0x55fe2ddabc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f581cd13640 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 0x55fe2ddabc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f581cd13640 1 -- 172.21.15.2:0/990544906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2dd86960 con 0x55fe2dd895d0 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f581cd13640 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd895d0 0x55fe2dd8c180 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5808097760 tx=0x7f5808017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17238a67601951ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f57fe7fc640 1 -- 172.21.15.2:0/990544906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580801e040 con 0x55fe2dd895d0 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f57fe7fc640 1 -- 172.21.15.2:0/990544906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58080cc0a0 con 0x55fe2dd895d0 2024-09-12T00:59:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f57fe7fc640 1 -- 172.21.15.2:0/990544906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808096ae0 con 0x55fe2dd895d0 2024-09-12T00:59:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f5821350740 1 -- 172.21.15.2:0/990544906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd895d0 msgr2=0x55fe2dd8c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f5821350740 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd895d0 0x55fe2dd8c180 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5808097760 tx=0x7f5808017730 comp rx=0 tx=0).stop 2024-09-12T00:59:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f5821350740 1 -- 172.21.15.2:0/990544906 shutdown_connections 2024-09-12T00:59:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f5821350740 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd94370 0x55fe2ddabc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f5821350740 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd8c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.240+0000 7f5821350740 1 --2- 172.21.15.2:0/990544906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd895d0 0x55fe2dd8c180 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 -- 172.21.15.2:0/990544906 >> 172.21.15.2:0/990544906 conn(0x55fe2dd52310 msgr2=0x55fe2dd93060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 -- 172.21.15.2:0/990544906 shutdown_connections 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 -- 172.21.15.2:0/990544906 wait complete. 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 -- start start 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 Processor -- start 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 0x55fe2dd983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd988f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd94370 0x55fe2dd98e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58181ae300 con 0x55fe2dd94370 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58181af770 con 0x55fe2dd8ab40 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f58181ae9d0 con 0x55fe2dd895d0 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.241+0000 7f5821350740 10 client.0 _ll_register_callbacks cb 0x7f581806b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd94370 0x55fe2dd98e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd94370 0x55fe2dd98e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49168/0 (socket says 172.21.15.2:49168) 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 -- 172.21.15.2:0/3392944577 learned_addr learned my addr 172.21.15.2:0/3392944577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581cd13640 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 0x55fe2dd983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f5817fff640 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 -- 172.21.15.2:0/3392944577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 msgr2=0x55fe2dd983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 0x55fe2dd983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 -- 172.21.15.2:0/3392944577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd8ab40 msgr2=0x55fe2dd988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 -- 172.21.15.2:0/3392944577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2de0de50 con 0x55fe2dd94370 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f5817fff640 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f581d514640 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd94370 0x55fe2dd98e30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5810011f80 tx=0x7f5810004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2275cbf3bd6b3588 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f57f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f57f7fff640 1 -- 172.21.15.2:0/3392944577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810004b20 con 0x55fe2dd94370 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f57f7fff640 1 -- 172.21.15.2:0/3392944577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f5810004cc0 con 0x55fe2dd94370 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f5821350740 1 -- 172.21.15.2:0/3392944577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58080cc0a0 con 0x55fe2dd94370 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.242+0000 7f57f7fff640 1 -- 172.21.15.2:0/3392944577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5810034050 con 0x55fe2dd94370 2024-09-12T00:59:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f5821350740 10 client.16911 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f5821350740 1 -- 172.21.15.2:0/3392944577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe2de0f130 con 0x55fe2dd94370 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f57f7fff640 1 -- 172.21.15.2:0/3392944577 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58080cc0a0 con 0x55fe2dd94370 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f57f7fff640 1 -- 172.21.15.2:0/3392944577 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f5810027650 con 0x55fe2dd94370 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f5821350740 10 client.16911 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f5821350740 10 client.16911 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f5821350740 20 client.16911 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f5821350740 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55fe2de0f930 0x55fe2de11d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f5821350740 4 client.16911 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f5821350740 1 -- 172.21.15.2:0/3392944577 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe2dcf6d70 con 0x55fe2de0f930 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.243+0000 7f581cd13640 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55fe2de0f930 0x55fe2de11d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f581cd13640 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55fe2de0f930 0x55fe2de11d50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b21b4ba573b73f5 server_cookie=8bdfe0047e5b69d2 in_seq=0 out_seq=0 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f57f7fff640 10 client.16911 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f57f7fff640 1 -- 172.21.15.2:0/3392944577 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe2dcf6d70 con 0x55fe2de0f930 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f57f7fff640 10 client.16911 handle_command_reply: tid=0 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 client.16911 shutdown 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 -- 172.21.15.2:0/3392944577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd94370 msgr2=0x55fe2dd98e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd94370 0x55fe2dd98e30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5810011f80 tx=0x7f5810004ab0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 -- 172.21.15.2:0/3392944577 shutdown_connections 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55fe2de0f930 0x55fe2de11d50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe2dd94370 0x55fe2dd98e30 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f57f7fff640 0 client.16911 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe2dd8ab40 0x55fe2dd988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 --2- 172.21.15.2:0/3392944577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe2dd895d0 0x55fe2dd983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 -- 172.21.15.2:0/3392944577 >> 172.21.15.2:0/3392944577 conn(0x55fe2dd52310 msgr2=0x55fe2dd93060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:36.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 -- 172.21.15.2:0/3392944577 shutdown_connections 2024-09-12T00:59:36.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 1 -- 172.21.15.2:0/3392944577 wait complete. 2024-09-12T00:59:36.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.244+0000 7f5821350740 20 client.16911 trim_cache size 0 max 16384 2024-09-12T00:59:36.252 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:36.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 -- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58000a2cf0 msgr2=0x7f58000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58000a2cf0 0x7f58000a51b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5810005fd0 tx=0x7f581000d710 comp rx=0 tx=0).stop 2024-09-12T00:59:36.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 -- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818102d40 msgr2=0x7f58181009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:36.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818102d40 0x7f58181009a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f580800b4a0 tx=0x7f580800b960 comp rx=0 tx=0).stop 2024-09-12T00:59:36.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 -- 172.21.15.2:0/312288144 shutdown_connections 2024-09-12T00:59:36.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58000a2cf0 0x7f58000a51b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581810c170 0x7f5818101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5818103660 0x7f5818100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 --2- 172.21.15.2:0/312288144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818102d40 0x7f58181009a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 -- 172.21.15.2:0/312288144 >> 172.21.15.2:0/312288144 conn(0x7f58180fc7a0 msgr2=0x7f58180fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 -- 172.21.15.2:0/312288144 shutdown_connections 2024-09-12T00:59:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:36.245+0000 7f581ef77640 1 -- 172.21.15.2:0/312288144 wait complete. 2024-09-12T00:59:36.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:36 smithi002 ceph-mon[31210]: pgmap v203: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T00:59:36.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:36 smithi071 ceph-mon[35276]: pgmap v203: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T00:59:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:36 smithi167 ceph-mon[35234]: pgmap v203: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T00:59:37.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:59:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 -- 172.21.15.2:0/3315942384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec100a70 msgr2=0x7fe0ec10ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 --2- 172.21.15.2:0/3315942384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec100a70 0x7fe0ec10ea60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009ca0 tx=0x7fe0e402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 -- 172.21.15.2:0/3315942384 shutdown_connections 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 --2- 172.21.15.2:0/3315942384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec100a70 0x7fe0ec10ea60 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 --2- 172.21.15.2:0/3315942384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0ec1000d0 0x7fe0ec100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 --2- 172.21.15.2:0/3315942384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0ec106ba0 0x7fe0ec106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 -- 172.21.15.2:0/3315942384 >> 172.21.15.2:0/3315942384 conn(0x7fe0ec077210 msgr2=0x7fe0ec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 -- 172.21.15.2:0/3315942384 shutdown_connections 2024-09-12T00:59:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.792+0000 7fe0f1887640 1 -- 172.21.15.2:0/3315942384 wait complete. 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0f1887640 1 Processor -- start 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0f1887640 1 -- start start 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0f1887640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0ec1000d0 0x7fe0ec198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0f1887640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0ec100a70 0x7fe0ec198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0f1887640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec106ba0 0x7fe0ec19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0f1887640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec112100 con 0x7fe0ec106ba0 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0f1887640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec111f80 con 0x7fe0ec100a70 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0f1887640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec112280 con 0x7fe0ec1000d0 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec106ba0 0x7fe0ec19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec106ba0 0x7fe0ec19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49188/0 (socket says 172.21.15.2:49188) 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.793+0000 7fe0eb7fe640 1 -- 172.21.15.2:0/2476584099 learned_addr learned my addr 172.21.15.2:0/2476584099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0ec100a70 0x7fe0ec198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0ec1000d0 0x7fe0ec198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0eb7fe640 1 -- 172.21.15.2:0/2476584099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0ec1000d0 msgr2=0x7fe0ec198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0eb7fe640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0ec1000d0 0x7fe0ec198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0eb7fe640 1 -- 172.21.15.2:0/2476584099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0ec100a70 msgr2=0x7fe0ec198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0eb7fe640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0ec100a70 0x7fe0ec198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0eb7fe640 1 -- 172.21.15.2:0/2476584099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec19d4d0 con 0x7fe0ec106ba0 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0ec1000d0 0x7fe0ec198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0eb7fe640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec106ba0 0x7fe0ec19cdf0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4003f10 tx=0x7fe0e4003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0f0885640 1 -- 172.21.15.2:0/2476584099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4031710 con 0x7fe0ec106ba0 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0f0885640 1 -- 172.21.15.2:0/2476584099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e40318b0 con 0x7fe0ec106ba0 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0f1887640 1 -- 172.21.15.2:0/2476584099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec19d760 con 0x7fe0ec106ba0 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0f0885640 1 -- 172.21.15.2:0/2476584099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e402fb20 con 0x7fe0ec106ba0 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.794+0000 7fe0f1887640 1 -- 172.21.15.2:0/2476584099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1a50a0 con 0x7fe0ec106ba0 2024-09-12T00:59:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.796+0000 7fe0f0885640 1 -- 172.21.15.2:0/2476584099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe0e402fd40 con 0x7fe0ec106ba0 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f3c60740 1 Processor -- start 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f3c60740 1 -- start start 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec90fd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec90fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec910a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dec90632f0 con 0x55dec90fd5d0 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dec900acf0 con 0x55dec9108370 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dec905f2b0 con 0x55dec90feb40 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec90fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec90fda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49190/0 (socket says 172.21.15.2:49190) 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eaffd640 1 -- 172.21.15.2:0/2623046271 learned_addr learned my addr 172.21.15.2:0/2623046271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f0885640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec910a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eb7fe640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec90fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eaffd640 1 -- 172.21.15.2:0/2623046271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 msgr2=0x55dec90fd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec90fd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eaffd640 1 -- 172.21.15.2:0/2623046271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 msgr2=0x55dec910a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec910a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0eaffd640 1 -- 172.21.15.2:0/2623046271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec8fef3a0 con 0x55dec90fd5d0 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec90fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.797+0000 7fe0f0885640 1 -- 172.21.15.2:0/2476584099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe0e40f0a40 con 0x7fe0ec106ba0 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.798+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec90fda10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00aa10 tx=0x7fe0dc00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614faf5be7c62f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.798+0000 7fe0eb7fe640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40bccc0 tx=0x7fe0e40a7af0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.798+0000 7fe0d1ffb640 1 -- 172.21.15.2:0/2623046271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc015070 con 0x55dec90fd5d0 2024-09-12T00:59:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.798+0000 7fe0d1ffb640 1 -- 172.21.15.2:0/2623046271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0dc00cc60 con 0x55dec90fd5d0 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.798+0000 7fe0d1ffb640 1 -- 172.21.15.2:0/2623046271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc018700 con 0x55dec90fd5d0 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2623046271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 msgr2=0x55dec90fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec90fda10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00aa10 tx=0x7fe0dc00aed0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2623046271 shutdown_connections 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec910a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec90fda10 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/2623046271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec90fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2623046271 >> 172.21.15.2:0/2623046271 conn(0x55dec90c6310 msgr2=0x55dec90f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2623046271 shutdown_connections 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2623046271 wait complete. 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 -- start start 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.799+0000 7fe0f3c60740 1 Processor -- start 2024-09-12T00:59:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9107d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9104fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec9105570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dec910b070 con 0x55dec90fd5d0 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dec901e060 con 0x55dec9108370 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dec910b1f0 con 0x55dec90feb40 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0f3c60740 10 client.0 _ll_register_callbacks cb 0x55dec8d718c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9107d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9107d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49192/0 (socket says 172.21.15.2:49192) 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/1522596305 learned_addr learned my addr 172.21.15.2:0/1522596305 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9104fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/1522596305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 msgr2=0x55dec9104fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9104fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/1522596305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 msgr2=0x55dec9105570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec9105570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/1522596305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dec8dd43c0 con 0x55dec90fd5d0 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9107d20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000cf80 tx=0x7fe0e0014cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad87e7bc34e0ef88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.800+0000 7fe0caffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0caffd640 1 -- 172.21.15.2:0/1522596305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00142d0 con 0x55dec90fd5d0 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0caffd640 1 -- 172.21.15.2:0/1522596305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe0e0011c30 con 0x55dec90fd5d0 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 1 -- 172.21.15.2:0/1522596305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0dc00cc60 con 0x55dec90fd5d0 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0caffd640 1 -- 172.21.15.2:0/1522596305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe0e0011e30 con 0x55dec90fd5d0 2024-09-12T00:59:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 10 client.16923 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 1 -- 172.21.15.2:0/1522596305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dec9116a90 con 0x55dec90fd5d0 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0caffd640 1 -- 172.21.15.2:0/1522596305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0dc00cc60 con 0x55dec90fd5d0 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0caffd640 1 -- 172.21.15.2:0/1522596305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fe0e001d540 con 0x55dec90fd5d0 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 10 client.16923 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 20 client.16923 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dec9117f50 0x55dec911a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 4 client.16923 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.801+0000 7fe0f3c60740 1 -- 172.21.15.2:0/1522596305 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dec9070860 con 0x55dec9117f50 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.802+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dec9117f50 0x55dec911a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.802+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dec9117f50 0x55dec911a3d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec183582a2650388 server_cookie=af4cb12bead77bb9 in_seq=0 out_seq=0 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.802+0000 7fe0caffd640 10 client.16923 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0caffd640 1 -- 172.21.15.2:0/1522596305 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dec9070860 con 0x55dec9117f50 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0caffd640 10 client.16923 handle_command_reply: tid=0 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 client.16923 shutdown 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 -- 172.21.15.2:0/1522596305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 msgr2=0x55dec9107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9107d20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000cf80 tx=0x7fe0e0014cc0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 -- 172.21.15.2:0/1522596305 shutdown_connections 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dec9117f50 0x55dec911a3d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec9105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0caffd640 0 client.16923 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/1522596305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9107d20 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 -- 172.21.15.2:0/1522596305 >> 172.21.15.2:0/1522596305 conn(0x55dec90c6310 msgr2=0x55dec90ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 -- 172.21.15.2:0/1522596305 shutdown_connections 2024-09-12T00:59:37.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 1 -- 172.21.15.2:0/1522596305 wait complete. 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.803+0000 7fe0f3c60740 20 client.16923 trim_cache size 0 max 16384 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0f3c60740 1 Processor -- start 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0f3c60740 1 -- start start 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9114310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9100120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec9100660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b02b0 con 0x55dec90fd5d0 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1adaf0 con 0x55dec9108370 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1ab940 con 0x55dec90feb40 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9114310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9114310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49202/0 (socket says 172.21.15.2:49202) 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.816+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/2841668109 learned_addr learned my addr 172.21.15.2:0/2841668109 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9100120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/2841668109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 msgr2=0x55dec9100120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9100120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/2841668109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 msgr2=0x55dec9100660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec9100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/2841668109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec90f8310 con 0x55dec90fd5d0 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9114310 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0001eb0 tx=0x7fe0e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88b82e0bc4fc287 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0d17fa640 1 -- 172.21.15.2:0/2841668109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0029070 con 0x55dec90fd5d0 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0d17fa640 1 -- 172.21.15.2:0/2841668109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e002a040 con 0x55dec90fd5d0 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.817+0000 7fe0d17fa640 1 -- 172.21.15.2:0/2841668109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0003850 con 0x55dec90fd5d0 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2841668109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 msgr2=0x55dec9114310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9114310 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0001eb0 tx=0x7fe0e000c830 comp rx=0 tx=0).stop 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2841668109 shutdown_connections 2024-09-12T00:59:37.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec9108370 0x55dec9100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec90feb40 0x55dec9100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/2841668109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9114310 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2841668109 >> 172.21.15.2:0/2841668109 conn(0x55dec90c6310 msgr2=0x55dec90f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2841668109 shutdown_connections 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 -- 172.21.15.2:0/2841668109 wait complete. 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 -- start start 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 Processor -- start 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9110480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec90feb40 0x55dec91109c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9108370 0x55dec9101900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1abfb0 con 0x55dec90fd5d0 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.818+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1ad420 con 0x55dec90feb40 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0f3c60740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1ac680 con 0x55dec9108370 2024-09-12T00:59:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0f3c60740 10 client.0 _ll_register_callbacks cb 0x7fe0e000c6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9110480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9110480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49204/0 (socket says 172.21.15.2:49204) 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/3256106144 learned_addr learned my addr 172.21.15.2:0/3256106144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec90feb40 0x55dec91109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/3256106144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9108370 msgr2=0x55dec9101900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9108370 0x55dec9101900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/3256106144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec90feb40 msgr2=0x55dec91109c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec90feb40 0x55dec91109c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 -- 172.21.15.2:0/3256106144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dec90facf0 con 0x55dec90fd5d0 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0ea7fc640 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9110480 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe0e001d660 tx=0x7fe0e0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4426e02697f1cb22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0caffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0caffd640 1 -- 172.21.15.2:0/3256106144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0032070 con 0x55dec90fd5d0 2024-09-12T00:59:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0caffd640 1 -- 172.21.15.2:0/3256106144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe0e00142d0 con 0x55dec90fd5d0 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0f3c60740 1 -- 172.21.15.2:0/3256106144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e002a040 con 0x55dec90fd5d0 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0caffd640 1 -- 172.21.15.2:0/3256106144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe0e003d050 con 0x55dec90fd5d0 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0f3c60740 10 client.16929 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.819+0000 7fe0f3c60740 1 -- 172.21.15.2:0/3256106144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dec9182e80 con 0x55dec90fd5d0 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0caffd640 1 -- 172.21.15.2:0/3256106144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e002a040 con 0x55dec90fd5d0 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0caffd640 1 -- 172.21.15.2:0/3256106144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fe0e0003c00 con 0x55dec90fd5d0 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0f3c60740 10 client.16929 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0f3c60740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0f3c60740 20 client.16929 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dec9183480 0x55dec9185870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0f3c60740 4 client.16929 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0f3c60740 1 -- 172.21.15.2:0/3256106144 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dec906ad70 con 0x55dec9183480 2024-09-12T00:59:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.820+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dec9183480 0x55dec9185870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:37.843 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:37.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0eaffd640 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dec9183480 0x55dec9185870 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6561929fbc3db0d7 server_cookie=8cd382edf125fecb in_seq=0 out_seq=0 2024-09-12T00:59:37.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0caffd640 10 client.16929 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:37.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0caffd640 1 -- 172.21.15.2:0/3256106144 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dec906ad70 con 0x55dec9183480 2024-09-12T00:59:37.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0caffd640 10 client.16929 handle_command_reply: tid=0 2024-09-12T00:59:37.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 client.16929 shutdown 2024-09-12T00:59:37.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 -- 172.21.15.2:0/3256106144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 msgr2=0x55dec9110480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9110480 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe0e001d660 tx=0x7fe0e0005850 comp rx=0 tx=0).stop 2024-09-12T00:59:37.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 -- 172.21.15.2:0/3256106144 shutdown_connections 2024-09-12T00:59:37.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55dec9183480 0x55dec9185870 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9108370 0x55dec9101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dec90feb40 0x55dec91109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 --2- 172.21.15.2:0/3256106144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dec90fd5d0 0x55dec9110480 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0caffd640 0 client.16929 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 -- 172.21.15.2:0/3256106144 >> 172.21.15.2:0/3256106144 conn(0x55dec90c6310 msgr2=0x55dec90f8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 -- 172.21.15.2:0/3256106144 shutdown_connections 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 1 -- 172.21.15.2:0/3256106144 wait complete. 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.821+0000 7fe0f3c60740 20 client.16929 trim_cache size 0 max 16384 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 -- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0d40a2cf0 msgr2=0x7fe0d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40bccc0 tx=0x7fe0e40a7af0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 -- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec106ba0 msgr2=0x7fe0ec19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec106ba0 0x7fe0ec19cdf0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4003f10 tx=0x7fe0e4003f40 comp rx=0 tx=0).stop 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 -- 172.21.15.2:0/2476584099 shutdown_connections 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec106ba0 0x7fe0ec19cdf0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0ec100a70 0x7fe0ec198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 --2- 172.21.15.2:0/2476584099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0ec1000d0 0x7fe0ec198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:37.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 -- 172.21.15.2:0/2476584099 >> 172.21.15.2:0/2476584099 conn(0x7fe0ec077210 msgr2=0x7fe0ec104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:37.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 -- 172.21.15.2:0/2476584099 shutdown_connections 2024-09-12T00:59:37.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:37.822+0000 7fe0f1887640 1 -- 172.21.15.2:0/2476584099 wait complete. 2024-09-12T00:59:38.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:38 smithi071 ceph-mon[35276]: pgmap v204: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-12T00:59:38.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:38 smithi002 ceph-mon[31210]: pgmap v204: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-12T00:59:39.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:38 smithi167 ceph-mon[35234]: pgmap v204: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-12T00:59:39.671 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:59:39.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:59:39.942 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:40.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 -- 172.21.15.2:0/1495420654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 msgr2=0x7f3408107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 --2- 172.21.15.2:0/1495420654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 0x7f3408107b90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009cd0 tx=0x7f33fc02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 -- 172.21.15.2:0/1495420654 shutdown_connections 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 --2- 172.21.15.2:0/1495420654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34081082a0 0x7f340810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 --2- 172.21.15.2:0/1495420654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 0x7f3408107b90 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 --2- 172.21.15.2:0/1495420654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3408102d30 0x7f3408103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 -- 172.21.15.2:0/1495420654 >> 172.21.15.2:0/1495420654 conn(0x7f34080fc7d0 msgr2=0x7f34080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 -- 172.21.15.2:0/1495420654 shutdown_connections 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 -- 172.21.15.2:0/1495420654 wait complete. 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 Processor -- start 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.369+0000 7f340fcff640 1 -- start start 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340fcff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3408102d30 0x7f3408100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340fcff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 0x7f3408100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340fcff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34081082a0 0x7f3408101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340fcff640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3408112060 con 0x7f34081036e0 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340fcff640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3408111ee0 con 0x7f3408102d30 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340fcff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34081121e0 con 0x7f34081082a0 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 0x7f3408100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 0x7f3408100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49216/0 (socket says 172.21.15.2:49216) 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 -- 172.21.15.2:0/3803448581 learned_addr learned my addr 172.21.15.2:0/3803448581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340e29c640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34081082a0 0x7f3408101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340da9b640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3408102d30 0x7f3408100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 -- 172.21.15.2:0/3803448581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34081082a0 msgr2=0x7f3408101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34081082a0 0x7f3408101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 -- 172.21.15.2:0/3803448581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3408102d30 msgr2=0x7f3408100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3408102d30 0x7f3408100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 -- 172.21.15.2:0/3803448581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34081a6a00 con 0x7f34081036e0 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340da9b640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3408102d30 0x7f3408100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.370+0000 7f340d29a640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 0x7f3408100ed0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f33fc000f80 tx=0x7f33fc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.371+0000 7f3406ffd640 1 -- 172.21.15.2:0/3803448581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004240 con 0x7f34081036e0 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.371+0000 7f3406ffd640 1 -- 172.21.15.2:0/3803448581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33fc0305a0 con 0x7f34081036e0 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.371+0000 7f3406ffd640 1 -- 172.21.15.2:0/3803448581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0466c0 con 0x7f34081036e0 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.371+0000 7f340fcff640 1 -- 172.21.15.2:0/3803448581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34081a6c90 con 0x7f34081036e0 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.371+0000 7f340fcff640 1 -- 172.21.15.2:0/3803448581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34081a7180 con 0x7f34081036e0 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.373+0000 7f3406ffd640 1 -- 172.21.15.2:0/3803448581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f33fc030750 con 0x7f34081036e0 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.373+0000 7f34120d8740 1 Processor -- start 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f34120d8740 1 -- start start 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f34120d8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebaf5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f34120d8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf6480 0x55aaebb00800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f34120d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebb00d40 0x55aaebb03130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f34120d8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55aaeba5b280 con 0x55aaebaf6480 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f34120d8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55aaeba02b10 con 0x55aaebaf5b60 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f34120d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aaeba57240 con 0x55aaebb00d40 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f3406ffd640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33f00a2cf0 0x7f33f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340da9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf6480 0x55aaebb00800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340da9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf6480 0x55aaebb00800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49230/0 (socket says 172.21.15.2:49230) 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340da9b640 1 -- 172.21.15.2:0/3843152620 learned_addr learned my addr 172.21.15.2:0/3843152620 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340e29c640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33f00a2cf0 0x7f33f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340d29a640 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebb00d40 0x55aaebb03130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340e29c640 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebaf5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f3406ffd640 1 -- 172.21.15.2:0/3803448581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f33fc02e030 con 0x7f34081036e0 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340da9b640 1 -- 172.21.15.2:0/3843152620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebb00d40 msgr2=0x55aaebb03130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340da9b640 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebb00d40 0x55aaebb03130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340da9b640 1 -- 172.21.15.2:0/3843152620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 msgr2=0x55aaebaf5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340da9b640 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebaf5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.374+0000 7f340da9b640 1 -- 172.21.15.2:0/3843152620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaeba0f1f0 con 0x55aaebaf6480 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.375+0000 7f340da9b640 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf6480 0x55aaebb00800 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f33f800bc20 tx=0x7f33f800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11b63a695ebb413 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.375+0000 7f340e29c640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33f00a2cf0 0x7f33f00a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3400005d50 tx=0x7f3400005dd0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.375+0000 7f33effff640 1 -- 172.21.15.2:0/3843152620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8017620 con 0x55aaebaf6480 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.375+0000 7f33effff640 1 -- 172.21.15.2:0/3843152620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f8017ca0 con 0x55aaebaf6480 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.375+0000 7f33effff640 1 -- 172.21.15.2:0/3843152620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f800fd40 con 0x55aaebaf6480 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 -- 172.21.15.2:0/3843152620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf6480 msgr2=0x55aaebb00800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf6480 0x55aaebb00800 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f33f800bc20 tx=0x7f33f800d710 comp rx=0 tx=0).stop 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 -- 172.21.15.2:0/3843152620 shutdown_connections 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebb00d40 0x55aaebb03130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf6480 0x55aaebb00800 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 --2- 172.21.15.2:0/3843152620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebaf5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 -- 172.21.15.2:0/3843152620 >> 172.21.15.2:0/3843152620 conn(0x55aaebaf20f0 msgr2=0x55aaebaf24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 -- 172.21.15.2:0/3843152620 shutdown_connections 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 -- 172.21.15.2:0/3843152620 wait complete. 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 -- start start 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.376+0000 7f34120d8740 1 Processor -- start 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f34120d8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebb007f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f34120d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebafdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f34120d8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 0x55aaebafe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f34120d8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55aaebb03910 con 0x55aaebaf5b60 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f34120d8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55aaeba15f10 con 0x55aaebb00d40 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f34120d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aaebb03a90 con 0x55aaebaf6480 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f34120d8740 10 client.0 _ll_register_callbacks cb 0x55aaeb9dea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebb007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebb007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49232/0 (socket says 172.21.15.2:49232) 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 -- 172.21.15.2:0/1267232139 learned_addr learned my addr 172.21.15.2:0/1267232139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340e29c640 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 0x55aaebafe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340d29a640 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebafdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 -- 172.21.15.2:0/1267232139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 msgr2=0x55aaebafdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebafdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 -- 172.21.15.2:0/1267232139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 msgr2=0x55aaebafe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 0x55aaebafe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 -- 172.21.15.2:0/1267232139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaeb7cc6a0 con 0x55aaebaf5b60 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f340da9b640 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebb007f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f33f800bbf0 tx=0x7f33f800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8aaca5f470322c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f33ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f33ed7fa640 1 -- 172.21.15.2:0/1267232139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8025020 con 0x55aaebaf5b60 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f33ed7fa640 1 -- 172.21.15.2:0/1267232139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f33f8005260 con 0x55aaebaf5b60 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.377+0000 7f34120d8740 1 -- 172.21.15.2:0/1267232139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f8017ca0 con 0x55aaebaf5b60 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f33ed7fa640 1 -- 172.21.15.2:0/1267232139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f33f8030050 con 0x55aaebaf5b60 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f34120d8740 10 client.16941 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f34120d8740 1 -- 172.21.15.2:0/1267232139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55aaebb0f470 con 0x55aaebaf5b60 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f33ed7fa640 1 -- 172.21.15.2:0/1267232139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f8017ca0 con 0x55aaebaf5b60 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f33ed7fa640 1 -- 172.21.15.2:0/1267232139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f33f80046c0 con 0x55aaebaf5b60 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f34120d8740 10 client.16941 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:40.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f34120d8740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f34120d8740 20 client.16941 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f34120d8740 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55aaebb108d0 0x55aaebb12cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f34120d8740 4 client.16941 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.378+0000 7f34120d8740 1 -- 172.21.15.2:0/1267232139 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aaeba687f0 con 0x55aaebb108d0 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.379+0000 7f340d29a640 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55aaebb108d0 0x55aaebb12cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.379+0000 7f33ed7fa640 10 client.16941 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.379+0000 7f340d29a640 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55aaebb108d0 0x55aaebb12cc0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f35e764a2fd9db29 server_cookie=904f7776e11cccf8 in_seq=0 out_seq=0 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f33ed7fa640 1 -- 172.21.15.2:0/1267232139 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aaeba687f0 con 0x55aaebb108d0 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f33ed7fa640 10 client.16941 handle_command_reply: tid=0 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 client.16941 shutdown 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 -- 172.21.15.2:0/1267232139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 msgr2=0x55aaebb007f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebb007f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f33f800bbf0 tx=0x7f33f800ff90 comp rx=0 tx=0).stop 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 -- 172.21.15.2:0/1267232139 shutdown_connections 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55aaebb108d0 0x55aaebb12cc0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 0x55aaebafe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebafdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 --2- 172.21.15.2:0/1267232139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebb007f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f33ed7fa640 0 client.16941 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 -- 172.21.15.2:0/1267232139 >> 172.21.15.2:0/1267232139 conn(0x55aaebaf20f0 msgr2=0x55aaebaf7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 -- 172.21.15.2:0/1267232139 shutdown_connections 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 1 -- 172.21.15.2:0/1267232139 wait complete. 2024-09-12T00:59:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.380+0000 7f34120d8740 20 client.16941 trim_cache size 0 max 16384 2024-09-12T00:59:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f34120d8740 1 Processor -- start 2024-09-12T00:59:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f34120d8740 1 -- start start 2024-09-12T00:59:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f34120d8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebafcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f34120d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebb18320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f34120d8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 0x55aaebb18860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f34120d8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f34081b2550 con 0x55aaebaf5b60 2024-09-12T00:59:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f34120d8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34081afd90 con 0x55aaebb00d40 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f34120d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34081adbe0 con 0x55aaebaf6480 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340da9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebafcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340da9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebafcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49244/0 (socket says 172.21.15.2:49244) 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340da9b640 1 -- 172.21.15.2:0/2376237089 learned_addr learned my addr 172.21.15.2:0/2376237089 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340d29a640 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebb18320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340e29c640 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 0x55aaebb18860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340da9b640 1 -- 172.21.15.2:0/2376237089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 msgr2=0x55aaebb18320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340da9b640 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebb18320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340da9b640 1 -- 172.21.15.2:0/2376237089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 msgr2=0x55aaebb18860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340da9b640 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 0x55aaebb18860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.400+0000 7f340da9b640 1 -- 172.21.15.2:0/2376237089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaebafe640 con 0x55aaebaf5b60 2024-09-12T00:59:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.401+0000 7f340da9b640 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebafcb20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f33f8004ca0 tx=0x7f33f800baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b88b73d4b77633 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.401+0000 7f33ef7fe640 1 -- 172.21.15.2:0/2376237089 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8039070 con 0x55aaebaf5b60 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.401+0000 7f33ef7fe640 1 -- 172.21.15.2:0/2376237089 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f8005e90 con 0x55aaebaf5b60 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.401+0000 7f33ef7fe640 1 -- 172.21.15.2:0/2376237089 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8025070 con 0x55aaebaf5b60 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.401+0000 7f34120d8740 1 -- 172.21.15.2:0/2376237089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 msgr2=0x55aaebafcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.401+0000 7f34120d8740 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebafcb20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f33f8004ca0 tx=0x7f33f800baf0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 -- 172.21.15.2:0/2376237089 shutdown_connections 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebb00d40 0x55aaebb18860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebb18320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 --2- 172.21.15.2:0/2376237089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebaf5b60 0x55aaebafcb20 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 -- 172.21.15.2:0/2376237089 >> 172.21.15.2:0/2376237089 conn(0x55aaebaf20f0 msgr2=0x55aaebafc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 -- 172.21.15.2:0/2376237089 shutdown_connections 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 -- 172.21.15.2:0/2376237089 wait complete. 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 -- start start 2024-09-12T00:59:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 Processor -- start 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebb04d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebb05270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebb00d40 0x55aaebb057b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.402+0000 7f34120d8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f34081ae250 con 0x55aaebb00d40 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f34120d8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34081af6c0 con 0x55aaebaf5b60 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f34120d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34081ae920 con 0x55aaebaf6480 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f34120d8740 10 client.0 _ll_register_callbacks cb 0x7f33fc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebb00d40 0x55aaebb057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebb00d40 0x55aaebb057b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49254/0 (socket says 172.21.15.2:49254) 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 -- 172.21.15.2:0/2101993244 learned_addr learned my addr 172.21.15.2:0/2101993244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340d29a640 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebb05270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340da9b640 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebb04d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 -- 172.21.15.2:0/2101993244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 msgr2=0x55aaebb05270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebb05270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 -- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 msgr2=0x55aaebb04d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebb04d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 -- 172.21.15.2:0/2101993244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaebb7a590 con 0x55aaebb00d40 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340da9b640 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebb04d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f340e29c640 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebb00d40 0x55aaebb057b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f34000116c0 tx=0x7f3400004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69f6cc6fec2a2c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f33ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f33ed7fa640 1 -- 172.21.15.2:0/2101993244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400010780 con 0x55aaebb00d40 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f34120d8740 1 -- 172.21.15.2:0/2101993244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f8005e90 con 0x55aaebb00d40 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.403+0000 7f33ed7fa640 1 -- 172.21.15.2:0/2101993244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f3400010920 con 0x55aaebb00d40 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f33ed7fa640 1 -- 172.21.15.2:0/2101993244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3400010b20 con 0x55aaebb00d40 2024-09-12T00:59:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f34120d8740 10 client.16947 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f34120d8740 1 -- 172.21.15.2:0/2101993244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55aaebb7b930 con 0x55aaebb00d40 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f33ed7fa640 1 -- 172.21.15.2:0/2101993244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f8005e90 con 0x55aaebb00d40 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f33ed7fa640 1 -- 172.21.15.2:0/2101993244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f34000214d0 con 0x55aaebb00d40 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f34120d8740 10 client.16947 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f34120d8740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f34120d8740 20 client.16947 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f34120d8740 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55aaebb7c0b0 0x55aaebb7e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f34120d8740 4 client.16947 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f34120d8740 1 -- 172.21.15.2:0/2101993244 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aaeba62d00 con 0x55aaebb7c0b0 2024-09-12T00:59:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.404+0000 7f340da9b640 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55aaebb7c0b0 0x55aaebb7e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:40.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.405+0000 7f340da9b640 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55aaebb7c0b0 0x55aaebb7e4d0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=907e5296e8c98468 server_cookie=8c18027a48378082 in_seq=0 out_seq=0 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.405+0000 7f33ed7fa640 10 client.16947 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f33ed7fa640 1 -- 172.21.15.2:0/2101993244 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aaeba62d00 con 0x55aaebb7c0b0 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f33ed7fa640 10 client.16947 handle_command_reply: tid=0 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 client.16947 shutdown 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 -- 172.21.15.2:0/2101993244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebb00d40 msgr2=0x55aaebb057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebb00d40 0x55aaebb057b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f34000116c0 tx=0x7f3400004730 comp rx=0 tx=0).stop 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 -- 172.21.15.2:0/2101993244 shutdown_connections 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55aaebb7c0b0 0x55aaebb7e4d0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aaebb00d40 0x55aaebb057b0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aaebaf6480 0x55aaebb05270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f33ed7fa640 0 client.16947 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 --2- 172.21.15.2:0/2101993244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aaebaf5b60 0x55aaebb04d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 -- 172.21.15.2:0/2101993244 >> 172.21.15.2:0/2101993244 conn(0x55aaebaf20f0 msgr2=0x55aaebafcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:40.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 -- 172.21.15.2:0/2101993244 shutdown_connections 2024-09-12T00:59:40.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 1 -- 172.21.15.2:0/2101993244 wait complete. 2024-09-12T00:59:40.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.406+0000 7f34120d8740 20 client.16947 trim_cache size 0 max 16384 2024-09-12T00:59:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:40.412 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:59:40.412 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "f44640d3-3a7c-4307-b013-6f111718b4cd", 2024-09-12T00:59:40.412 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:59:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:40.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 -- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33f00a2cf0 msgr2=0x7f33f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33f00a2cf0 0x7f33f00a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3400005d50 tx=0x7f3400005dd0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 -- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 msgr2=0x7f3408100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:40.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 0x7f3408100ed0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f33fc000f80 tx=0x7f33fc003ba0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 -- 172.21.15.2:0/3803448581 shutdown_connections 2024-09-12T00:59:40.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f33f00a2cf0 0x7f33f00a51b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34081082a0 0x7f3408101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34081036e0 0x7f3408100ed0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 --2- 172.21.15.2:0/3803448581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3408102d30 0x7f3408100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:40.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 -- 172.21.15.2:0/3803448581 >> 172.21.15.2:0/3803448581 conn(0x7f34080fc7d0 msgr2=0x7f3408105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:40.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 -- 172.21.15.2:0/3803448581 shutdown_connections 2024-09-12T00:59:40.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:40.407+0000 7f340fcff640 1 -- 172.21.15.2:0/3803448581 wait complete. 2024-09-12T00:59:40.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:40 smithi002 ceph-mon[31210]: pgmap v205: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:59:40.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:40 smithi071 ceph-mon[35276]: pgmap v205: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:59:41.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:40 smithi167 ceph-mon[35234]: pgmap v205: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T00:59:41.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:59:41.496 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:41.926 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:41 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:59:41.926 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:41 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:41.926 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:41 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:59:41.926 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:41 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:41.926 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:41 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:59:41.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:41 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:59:41.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:41 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:41.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:41 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:59:41.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:41 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:41.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:41 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:59:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.926+0000 7fce2cb92640 1 -- 172.21.15.2:0/1754934895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28103740 msgr2=0x7fce28107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.926+0000 7fce2cb92640 1 --2- 172.21.15.2:0/1754934895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28103740 0x7fce28107b80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce10009930 tx=0x7fce1002a420 comp rx=0 tx=0).stop 2024-09-12T00:59:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.926+0000 7fce2cb92640 1 -- 172.21.15.2:0/1754934895 shutdown_connections 2024-09-12T00:59:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.926+0000 7fce2cb92640 1 --2- 172.21.15.2:0/1754934895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce28108290 0x7fce2810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.926+0000 7fce2cb92640 1 --2- 172.21.15.2:0/1754934895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28103740 0x7fce28107b80 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.926+0000 7fce2cb92640 1 --2- 172.21.15.2:0/1754934895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce28102d90 0x7fce28103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.926+0000 7fce2cb92640 1 -- 172.21.15.2:0/1754934895 >> 172.21.15.2:0/1754934895 conn(0x7fce280fc7d0 msgr2=0x7fce280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.927+0000 7fce2cb92640 1 -- 172.21.15.2:0/1754934895 shutdown_connections 2024-09-12T00:59:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.927+0000 7fce2cb92640 1 -- 172.21.15.2:0/1754934895 wait complete. 2024-09-12T00:59:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.927+0000 7fce2cb92640 1 Processor -- start 2024-09-12T00:59:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2cb92640 1 -- start start 2024-09-12T00:59:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2cb92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28102d90 0x7fce281985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2cb92640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce28103740 0x7fce28198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2cb92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce28108290 0x7fce2819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2cb92640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce28112050 con 0x7fce28102d90 2024-09-12T00:59:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2cb92640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce28111ed0 con 0x7fce28103740 2024-09-12T00:59:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2cb92640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce281121d0 con 0x7fce28108290 2024-09-12T00:59:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28102d90 0x7fce281985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28102d90 0x7fce281985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49258/0 (socket says 172.21.15.2:49258) 2024-09-12T00:59:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2659c640 1 -- 172.21.15.2:0/931367897 learned_addr learned my addr 172.21.15.2:0/931367897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce28103740 0x7fce28198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce26d9d640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce28108290 0x7fce2819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2659c640 1 -- 172.21.15.2:0/931367897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce28108290 msgr2=0x7fce2819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.928+0000 7fce2659c640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce28108290 0x7fce2819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce2659c640 1 -- 172.21.15.2:0/931367897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce28103740 msgr2=0x7fce28198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce2659c640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce28103740 0x7fce28198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce2659c640 1 -- 172.21.15.2:0/931367897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2819d5a0 con 0x7fce28102d90 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce26d9d640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce28108290 0x7fce2819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce2659c640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28102d90 0x7fce281985f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fce1800d950 tx=0x7fce1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce1ffff640 1 -- 172.21.15.2:0/931367897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18017030 con 0x7fce28102d90 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce2cb92640 1 -- 172.21.15.2:0/931367897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2819d890 con 0x7fce28102d90 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce1ffff640 1 -- 172.21.15.2:0/931367897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce18004020 con 0x7fce28102d90 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce1ffff640 1 -- 172.21.15.2:0/931367897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180047a0 con 0x7fce28102d90 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.929+0000 7fce2cb92640 1 -- 172.21.15.2:0/931367897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce281a5170 con 0x7fce28102d90 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.931+0000 7fce1ffff640 1 -- 172.21.15.2:0/931367897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fce180041d0 con 0x7fce28102d90 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2ef6b740 1 Processor -- start 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2ef6b740 1 -- start start 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce1ffff640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce140a2cf0 0x7fce140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b7ee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 0x55898b7f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55898b7492e0 con 0x55898b7e34a0 2024-09-12T00:59:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55898b6f0ce0 con 0x55898b7e3dc0 2024-09-12T00:59:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55898b7452a0 con 0x55898b7ee680 2024-09-12T00:59:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce1ffff640 1 -- 172.21.15.2:0/931367897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fce180cee80 con 0x7fce28102d90 2024-09-12T00:59:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7e3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49266/0 (socket says 172.21.15.2:49266) 2024-09-12T00:59:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce2659c640 1 -- 172.21.15.2:0/1679053008 learned_addr learned my addr 172.21.15.2:0/1679053008 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce26d9d640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce140a2cf0 0x7fce140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.932+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b7ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce2659c640 1 -- 172.21.15.2:0/1679053008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 msgr2=0x55898b7f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce2659c640 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 0x55898b7f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce2659c640 1 -- 172.21.15.2:0/1679053008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 msgr2=0x55898b7ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce2659c640 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b7ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce2659c640 1 -- 172.21.15.2:0/1679053008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55898b6d5440 con 0x55898b7e34a0 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b7ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce2659c640 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7e3880 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fce18000c00 tx=0x7fce18016f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c402246341408729 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce26d9d640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce140a2cf0 0x7fce140a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55898b7e0db0 tx=0x7fce2000e720 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce1cd99640 1 -- 172.21.15.2:0/1679053008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180171d0 con 0x55898b7e34a0 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce1cd99640 1 -- 172.21.15.2:0/1679053008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce1809ba50 con 0x55898b7e34a0 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.933+0000 7fce1cd99640 1 -- 172.21.15.2:0/1679053008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18020590 con 0x55898b7e34a0 2024-09-12T00:59:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1679053008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 msgr2=0x55898b7e3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7e3880 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fce18000c00 tx=0x7fce18016f90 comp rx=0 tx=0).stop 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1679053008 shutdown_connections 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 0x55898b7f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b7ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1679053008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7e3880 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1679053008 >> 172.21.15.2:0/1679053008 conn(0x55898b7dfa30 msgr2=0x55898b7dfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1679053008 shutdown_connections 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1679053008 wait complete. 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 -- start start 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.934+0000 7fce2ef6b740 1 Processor -- start 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7ee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e3dc0 0x55898b7eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7ee680 0x55898b7eb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55898b7f1250 con 0x55898b7e34a0 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55898b704050 con 0x55898b7ee680 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55898b7f13d0 con 0x55898b7e3dc0 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2ef6b740 10 client.0 _ll_register_callbacks cb 0x55898b744160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7ee010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49276/0 (socket says 172.21.15.2:49276) 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 -- 172.21.15.2:0/1199901704 learned_addr learned my addr 172.21.15.2:0/1199901704 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e3dc0 0x55898b7eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 -- 172.21.15.2:0/1199901704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e3dc0 msgr2=0x55898b7eb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e3dc0 0x55898b7eb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 -- 172.21.15.2:0/1199901704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7ee680 msgr2=0x55898b7eb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7ee680 0x55898b7eb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 -- 172.21.15.2:0/1199901704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55898b4ba3c0 con 0x55898b7e34a0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e3dc0 0x55898b7eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2659c640 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7ee010 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fce180ccb80 tx=0x7fce18016170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a07f8539a62273b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce0dffb640 1 -- 172.21.15.2:0/1199901704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1809f700 con 0x55898b7e34a0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce0dffb640 1 -- 172.21.15.2:0/1199901704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fce180cc800 con 0x55898b7e34a0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1199901704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce1809ba50 con 0x55898b7e34a0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.935+0000 7fce0dffb640 1 -- 172.21.15.2:0/1199901704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fce180a3fc0 con 0x55898b7e34a0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce2ef6b740 10 client.16959 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1199901704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55898b7fcc40 con 0x55898b7e34a0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce0dffb640 1 -- 172.21.15.2:0/1199901704 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce1809ba50 con 0x55898b7e34a0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce0dffb640 1 -- 172.21.15.2:0/1199901704 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fce180a3b30 con 0x55898b7e34a0 2024-09-12T00:59:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce2ef6b740 10 client.16959 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce2ef6b740 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce2ef6b740 20 client.16959 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55898b7fdf90 0x55898b800380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce2ef6b740 4 client.16959 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1199901704 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55898b756850 con 0x55898b7fdf90 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.936+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55898b7fdf90 0x55898b800380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.937+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55898b7fdf90 0x55898b800380 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9439988251f0cc7 server_cookie=6397f7be8db5c6f8 in_seq=0 out_seq=0 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.937+0000 7fce0dffb640 10 client.16959 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.937+0000 7fce0dffb640 1 -- 172.21.15.2:0/1199901704 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55898b756850 con 0x55898b7fdf90 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.937+0000 7fce0dffb640 10 client.16959 handle_command_reply: tid=0 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.937+0000 7fce2ef6b740 1 client.16959 shutdown 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1199901704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 msgr2=0x55898b7ee010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:41.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7ee010 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fce180ccb80 tx=0x7fce18016170 comp rx=0 tx=0).stop 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1199901704 shutdown_connections 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55898b7fdf90 0x55898b800380 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7ee680 0x55898b7eb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e3dc0 0x55898b7eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce0dffb640 0 client.16959 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/1199901704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b7ee010 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1199901704 >> 172.21.15.2:0/1199901704 conn(0x55898b7dfa30 msgr2=0x55898b7e5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1199901704 shutdown_connections 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 1 -- 172.21.15.2:0/1199901704 wait complete. 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.938+0000 7fce2ef6b740 20 client.16959 trim_cache size 0 max 16384 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce2ef6b740 1 Processor -- start 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce2ef6b740 1 -- start start 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e34a0 0x55898b8033a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b8038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7ee680 0x55898b7e8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce281b03c0 con 0x55898b7ee680 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce281adc00 con 0x55898b7e3dc0 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce281aba50 con 0x55898b7e34a0 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.955+0000 7fce26d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7ee680 0x55898b7e8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce26d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7ee680 0x55898b7e8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49280/0 (socket says 172.21.15.2:49280) 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce26d9d640 1 -- 172.21.15.2:0/256962445 learned_addr learned my addr 172.21.15.2:0/256962445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce2659c640 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e34a0 0x55898b8033a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b8038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce26d9d640 1 -- 172.21.15.2:0/256962445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e34a0 msgr2=0x55898b8033a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce26d9d640 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e34a0 0x55898b8033a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce26d9d640 1 -- 172.21.15.2:0/256962445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 msgr2=0x55898b8038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:41.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce26d9d640 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b8038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce26d9d640 1 -- 172.21.15.2:0/256962445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55898b7ee380 con 0x55898b7ee680 2024-09-12T00:59:41.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b8038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:41.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce26d9d640 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7ee680 0x55898b7e8520 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fce2000a3b0 tx=0x7fce20004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda5fdca22dd804b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:41.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce0ffff640 1 -- 172.21.15.2:0/256962445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce20021070 con 0x55898b7ee680 2024-09-12T00:59:41.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce0ffff640 1 -- 172.21.15.2:0/256962445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2001dd40 con 0x55898b7ee680 2024-09-12T00:59:41.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.956+0000 7fce0ffff640 1 -- 172.21.15.2:0/256962445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2001cd20 con 0x55898b7ee680 2024-09-12T00:59:41.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 -- 172.21.15.2:0/256962445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7ee680 msgr2=0x55898b7e8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:41.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7ee680 0x55898b7e8520 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fce2000a3b0 tx=0x7fce20004ab0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 -- 172.21.15.2:0/256962445 shutdown_connections 2024-09-12T00:59:41.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7ee680 0x55898b7e8520 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b8038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/256962445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7e34a0 0x55898b8033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 -- 172.21.15.2:0/256962445 >> 172.21.15.2:0/256962445 conn(0x55898b7dfa30 msgr2=0x55898b7ea3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:41.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 -- 172.21.15.2:0/256962445 shutdown_connections 2024-09-12T00:59:41.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 -- 172.21.15.2:0/256962445 wait complete. 2024-09-12T00:59:41.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 -- start start 2024-09-12T00:59:41.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.957+0000 7fce2ef6b740 1 Processor -- start 2024-09-12T00:59:41.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b803bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b800f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 0x55898b801530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce281ac0c0 con 0x55898b7e34a0 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce281ad530 con 0x55898b7e3dc0 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce281ac790 con 0x55898b7ee680 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 10 client.0 _ll_register_callbacks cb 0x7fce180975f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b803bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b803bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49284/0 (socket says 172.21.15.2:49284) 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 -- 172.21.15.2:0/3152020664 learned_addr learned my addr 172.21.15.2:0/3152020664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce26d9d640 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 0x55898b801530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 -- 172.21.15.2:0/3152020664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 msgr2=0x55898b801530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:41.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 0x55898b801530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 -- 172.21.15.2:0/3152020664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 msgr2=0x55898b800f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b800f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 -- 172.21.15.2:0/3152020664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55898b801d30 con 0x55898b7e34a0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2659c640 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b803bf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fce180a3f30 tx=0x7fce180976a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601974d14e24623b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce0dffb640 1 -- 172.21.15.2:0/3152020664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1809ba50 con 0x55898b7e34a0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce0dffb640 1 -- 172.21.15.2:0/3152020664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fce180979c0 con 0x55898b7e34a0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 1 -- 172.21.15.2:0/3152020664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce2001dd40 con 0x55898b7e34a0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce0dffb640 1 -- 172.21.15.2:0/3152020664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fce1807b050 con 0x55898b7e34a0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 10 client.16965 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.958+0000 7fce2ef6b740 1 -- 172.21.15.2:0/3152020664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55898b8689c0 con 0x55898b7e34a0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce0dffb640 1 -- 172.21.15.2:0/3152020664 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2001dd40 con 0x55898b7e34a0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce0dffb640 1 -- 172.21.15.2:0/3152020664 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fce180a3b30 con 0x55898b7e34a0 2024-09-12T00:59:41.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce2ef6b740 10 client.16965 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce2ef6b740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce2ef6b740 20 client.16965 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55898b868ef0 0x55898b86b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce2ef6b740 4 client.16965 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce2ef6b740 1 -- 172.21.15.2:0/3152020664 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55898b750d60 con 0x55898b868ef0 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55898b868ef0 0x55898b86b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce0dffb640 10 client.16965 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.959+0000 7fce1dd9b640 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55898b868ef0 0x55898b86b2e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7652f3c526ba4935 server_cookie=cc7e9224e1628ff2 in_seq=0 out_seq=0 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce0dffb640 1 -- 172.21.15.2:0/3152020664 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55898b750d60 con 0x55898b868ef0 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce0dffb640 10 client.16965 handle_command_reply: tid=0 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 client.16965 shutdown 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 -- 172.21.15.2:0/3152020664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 msgr2=0x55898b803bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:41.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b803bf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fce180a3f30 tx=0x7fce180976a0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 -- 172.21.15.2:0/3152020664 shutdown_connections 2024-09-12T00:59:41.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55898b868ef0 0x55898b86b2e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:41.999 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:59:41.999 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:59:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55898b7ee680 0x55898b801530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55898b7e3dc0 0x55898b800f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce0dffb640 0 client.16965 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 --2- 172.21.15.2:0/3152020664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55898b7e34a0 0x55898b803bf0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 -- 172.21.15.2:0/3152020664 >> 172.21.15.2:0/3152020664 conn(0x55898b7dfa30 msgr2=0x55898b7e6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 -- 172.21.15.2:0/3152020664 shutdown_connections 2024-09-12T00:59:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 1 -- 172.21.15.2:0/3152020664 wait complete. 2024-09-12T00:59:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2ef6b740 20 client.16965 trim_cache size 0 max 16384 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2cb92640 1 -- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce140a2cf0 msgr2=0x7fce140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2cb92640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce140a2cf0 0x7fce140a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55898b7e0db0 tx=0x7fce2000e720 comp rx=0 tx=0).stop 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2cb92640 1 -- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28102d90 msgr2=0x7fce281985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.960+0000 7fce2cb92640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28102d90 0x7fce281985f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fce1800d950 tx=0x7fce1800de10 comp rx=0 tx=0).stop 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.961+0000 7fce2cb92640 1 -- 172.21.15.2:0/931367897 shutdown_connections 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.961+0000 7fce2cb92640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fce140a2cf0 0x7fce140a51b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.961+0000 7fce2cb92640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce28108290 0x7fce2819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.961+0000 7fce2cb92640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce28103740 0x7fce28198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.961+0000 7fce2cb92640 1 --2- 172.21.15.2:0/931367897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce28102d90 0x7fce281985f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.961+0000 7fce2cb92640 1 -- 172.21.15.2:0/931367897 >> 172.21.15.2:0/931367897 conn(0x7fce280fc7d0 msgr2=0x7fce28105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.961+0000 7fce2cb92640 1 -- 172.21.15.2:0/931367897 shutdown_connections 2024-09-12T00:59:42.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:41.961+0000 7fce2cb92640 1 -- 172.21.15.2:0/931367897 wait complete. 2024-09-12T00:59:42.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:41 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:59:42.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:41 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:42.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:41 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:59:42.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:41 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:42.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:41 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:59:42.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:42 smithi002 ceph-mon[31210]: pgmap v206: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T00:59:42.863 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:59:42.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:59:42.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:42 smithi071 ceph-mon[35276]: pgmap v206: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T00:59:43.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:42 smithi167 ceph-mon[35234]: pgmap v206: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T00:59:43.128 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:43.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 -- 172.21.15.2:0/3108380782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474102790 msgr2=0x7fe4741067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:43.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/3108380782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474102790 0x7fe4741067e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe468009900 tx=0x7fe46802a410 comp rx=0 tx=0).stop 2024-09-12T00:59:43.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 -- 172.21.15.2:0/3108380782 shutdown_connections 2024-09-12T00:59:43.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/3108380782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe474106f10 0x7fe47410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/3108380782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474102790 0x7fe4741067e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/3108380782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474101de0 0x7fe4741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 -- 172.21.15.2:0/3108380782 >> 172.21.15.2:0/3108380782 conn(0x7fe4740fd8c0 msgr2=0x7fe4740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 -- 172.21.15.2:0/3108380782 shutdown_connections 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.609+0000 7fe47a9e5640 1 -- 172.21.15.2:0/3108380782 wait complete. 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.610+0000 7fe47a9e5640 1 Processor -- start 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.610+0000 7fe47a9e5640 1 -- start start 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe47a9e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474101de0 0x7fe474198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe47a9e5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe474102790 0x7fe474198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe47a9e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474106f10 0x7fe47419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:43.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe47a9e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe474111f70 con 0x7fe474106f10 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe47a9e5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe474111df0 con 0x7fe474102790 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe47a9e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4741120f0 con 0x7fe474101de0 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474106f10 0x7fe47419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474106f10 0x7fe47419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49306/0 (socket says 172.21.15.2:49306) 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 -- 172.21.15.2:0/2144739357 learned_addr learned my addr 172.21.15.2:0/2144739357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe4737fe640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe474102790 0x7fe474198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe473fff640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474101de0 0x7fe474198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 -- 172.21.15.2:0/2144739357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474101de0 msgr2=0x7fe474198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474101de0 0x7fe474198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 -- 172.21.15.2:0/2144739357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe474102790 msgr2=0x7fe474198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe474102790 0x7fe474198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 -- 172.21.15.2:0/2144739357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47419d400 con 0x7fe474106f10 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.611+0000 7fe478f82640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474106f10 0x7fe47419cd20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00eaa0 tx=0x7fe46c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.612+0000 7fe4717fa640 1 -- 172.21.15.2:0/2144739357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00cdb0 con 0x7fe474106f10 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.612+0000 7fe4717fa640 1 -- 172.21.15.2:0/2144739357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe46c005020 con 0x7fe474106f10 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.612+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47419d6f0 con 0x7fe474106f10 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.612+0000 7fe4717fa640 1 -- 172.21.15.2:0/2144739357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0116b0 con 0x7fe474106f10 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.612+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4741a4fd0 con 0x7fe474106f10 2024-09-12T00:59:43.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.613+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4741021c0 con 0x7fe474106f10 2024-09-12T00:59:43.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.614+0000 7fe4717fa640 1 -- 172.21.15.2:0/2144739357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe46c005560 con 0x7fe474106f10 2024-09-12T00:59:43.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.615+0000 7fe4717fa640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe45c0a2cf0 0x7fe45c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:43.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.615+0000 7fe473fff640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe45c0a2cf0 0x7fe45c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:43.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.615+0000 7fe4717fa640 1 -- 172.21.15.2:0/2144739357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fe46c0cfa60 con 0x7fe474106f10 2024-09-12T00:59:43.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.615+0000 7fe473fff640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe45c0a2cf0 0x7fe45c0a51b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe464005fd0 tx=0x7fe464005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:43.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.618+0000 7fe4717fa640 1 -- 172.21.15.2:0/2144739357 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe46c016030 con 0x7fe474106f10 2024-09-12T00:59:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.831+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4741997b0 con 0x7fe474106f10 2024-09-12T00:59:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.831+0000 7fe4717fa640 1 -- 172.21.15.2:0/2144739357 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7fe46c09c630 con 0x7fe474106f10 2024-09-12T00:59:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:59:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:59:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T00:59:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.834+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe45c0a2cf0 msgr2=0x7fe45c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.834+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe45c0a2cf0 0x7fe45c0a51b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe464005fd0 tx=0x7fe464005850 comp rx=0 tx=0).stop 2024-09-12T00:59:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.834+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474106f10 msgr2=0x7fe47419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.834+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474106f10 0x7fe47419cd20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00eaa0 tx=0x7fe46c00ef60 comp rx=0 tx=0).stop 2024-09-12T00:59:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.834+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 shutdown_connections 2024-09-12T00:59:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.834+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe45c0a2cf0 0x7fe45c0a51b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.834+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474106f10 0x7fe47419cd20 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.835+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe474102790 0x7fe474198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.835+0000 7fe47a9e5640 1 --2- 172.21.15.2:0/2144739357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474101de0 0x7fe474198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.835+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 >> 172.21.15.2:0/2144739357 conn(0x7fe4740fd8c0 msgr2=0x7fe4740fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.835+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 shutdown_connections 2024-09-12T00:59:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:43.835+0000 7fe47a9e5640 1 -- 172.21.15.2:0/2144739357 wait complete. 2024-09-12T00:59:44.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:59:44.844 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:44.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:44 smithi071 ceph-mon[35276]: pgmap v207: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:44.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:44 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2144739357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:44.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:44 smithi002 ceph-mon[31210]: pgmap v207: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:44.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:44 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2144739357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:45.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:44 smithi167 ceph-mon[35234]: pgmap v207: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:45.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:44 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2144739357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:45.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.284+0000 7f83cda41640 1 -- 172.21.15.2:0/2379034881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 msgr2=0x7f83c8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.284+0000 7f83cda41640 1 --2- 172.21.15.2:0/2379034881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 0x7f83c8106e60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009930 tx=0x7f83b802a420 comp rx=0 tx=0).stop 2024-09-12T00:59:45.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 -- 172.21.15.2:0/2379034881 shutdown_connections 2024-09-12T00:59:45.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 --2- 172.21.15.2:0/2379034881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8101420 0x7f83c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 --2- 172.21.15.2:0/2379034881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c8100a80 0x7f83c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 --2- 172.21.15.2:0/2379034881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 0x7f83c8106e60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 -- 172.21.15.2:0/2379034881 >> 172.21.15.2:0/2379034881 conn(0x7f83c80fc7a0 msgr2=0x7f83c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:45.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 -- 172.21.15.2:0/2379034881 shutdown_connections 2024-09-12T00:59:45.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 -- 172.21.15.2:0/2379034881 wait complete. 2024-09-12T00:59:45.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 Processor -- start 2024-09-12T00:59:45.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.285+0000 7f83cda41640 1 -- start start 2024-09-12T00:59:45.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83cda41640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c8100a80 0x7f83c81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83cda41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8101420 0x7f83c8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83cda41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 0x7f83c819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83cda41640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83c806b050 con 0x7f83c8106a80 2024-09-12T00:59:45.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83cda41640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83c806aed0 con 0x7f83c8100a80 2024-09-12T00:59:45.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83cda41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83c806b1d0 con 0x7f83c8101420 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 0x7f83c819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 0x7f83c819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49322/0 (socket says 172.21.15.2:49322) 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 -- 172.21.15.2:0/3086251191 learned_addr learned my addr 172.21.15.2:0/3086251191 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c8100a80 0x7f83c81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c67fc640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8101420 0x7f83c8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 -- 172.21.15.2:0/3086251191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8101420 msgr2=0x7f83c8198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8101420 0x7f83c8198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 -- 172.21.15.2:0/3086251191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c8100a80 msgr2=0x7f83c81983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c8100a80 0x7f83c81983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 -- 172.21.15.2:0/3086251191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c819d380 con 0x7f83c8106a80 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.286+0000 7f83c77fe640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 0x7f83c819cca0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f83c000cce0 tx=0x7f83c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.287+0000 7f83cca3f640 1 -- 172.21.15.2:0/3086251191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c000f450 con 0x7f83c8106a80 2024-09-12T00:59:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.287+0000 7f83cda41640 1 -- 172.21.15.2:0/3086251191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c819d670 con 0x7f83c8106a80 2024-09-12T00:59:45.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.287+0000 7f83cca3f640 1 -- 172.21.15.2:0/3086251191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83c000fad0 con 0x7f83c8106a80 2024-09-12T00:59:45.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.287+0000 7f83cca3f640 1 -- 172.21.15.2:0/3086251191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0018c10 con 0x7f83c8106a80 2024-09-12T00:59:45.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.287+0000 7f83cda41640 1 -- 172.21.15.2:0/3086251191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c81a4f50 con 0x7f83c8106a80 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.289+0000 7f83cca3f640 1 -- 172.21.15.2:0/3086251191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f83c000f5f0 con 0x7f83c8106a80 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.289+0000 7f83cfe1a740 1 Processor -- start 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cfe1a740 1 -- start start 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cca3f640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b00a2cf0 0x7f83b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579712ec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712ec5d0 0x5579712eca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712fb780 0x5579712fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5579712522f0 con 0x5579712edb40 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5579711f9cf0 con 0x5579712ec5d0 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55797124e2b0 con 0x5579712fb780 2024-09-12T00:59:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c67fc640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b00a2cf0 0x7f83b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579712ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579712ec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49332/0 (socket says 172.21.15.2:49332) 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c6ffd640 1 -- 172.21.15.2:0/3408383239 learned_addr learned my addr 172.21.15.2:0/3408383239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83cca3f640 1 -- 172.21.15.2:0/3086251191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f83c00cfa70 con 0x7f83c8106a80 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c67fc640 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712ec5d0 0x5579712eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c77fe640 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712fb780 0x5579712fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c6ffd640 1 -- 172.21.15.2:0/3408383239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712fb780 msgr2=0x5579712fdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712fb780 0x5579712fdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c6ffd640 1 -- 172.21.15.2:0/3408383239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712ec5d0 msgr2=0x5579712eca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712ec5d0 0x5579712eca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.290+0000 7f83c6ffd640 1 -- 172.21.15.2:0/3408383239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579711de3a0 con 0x5579712edb40 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.291+0000 7f83c67fc640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b00a2cf0 0x7f83b00a51b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00bfd0 tx=0x7f83bc00bb00 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.291+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579712ec090 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009930 tx=0x7f83b8004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c514045c36189f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.291+0000 7f83adffb640 1 -- 172.21.15.2:0/3408383239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8035040 con 0x5579712edb40 2024-09-12T00:59:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.291+0000 7f83adffb640 1 -- 172.21.15.2:0/3408383239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b8005520 con 0x5579712edb40 2024-09-12T00:59:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.291+0000 7f83adffb640 1 -- 172.21.15.2:0/3408383239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8003850 con 0x5579712edb40 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 -- 172.21.15.2:0/3408383239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 msgr2=0x5579712ec090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579712ec090 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009930 tx=0x7f83b8004180 comp rx=0 tx=0).stop 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 -- 172.21.15.2:0/3408383239 shutdown_connections 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712fb780 0x5579712fdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712ec5d0 0x5579712eca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/3408383239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579712ec090 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 -- 172.21.15.2:0/3408383239 >> 172.21.15.2:0/3408383239 conn(0x5579712b5310 msgr2=0x5579712e8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 -- 172.21.15.2:0/3408383239 shutdown_connections 2024-09-12T00:59:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 -- 172.21.15.2:0/3408383239 wait complete. 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 -- start start 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.292+0000 7f83cfe1a740 1 Processor -- start 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579712fb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712f8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x5579712f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5579712fe420 con 0x5579712ec5d0 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55797120d060 con 0x5579712fb780 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5579712fe5a0 con 0x5579712edb40 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83cfe1a740 10 client.0 _ll_register_callbacks cb 0x557970f608c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579712fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579712fb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49340/0 (socket says 172.21.15.2:49340) 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c67fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 -- 172.21.15.2:0/433641330 learned_addr learned my addr 172.21.15.2:0/433641330 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c77fe640 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x5579712f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 -- 172.21.15.2:0/433641330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 msgr2=0x5579712f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 -- 172.21.15.2:0/433641330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 msgr2=0x5579712f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x5579712f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 -- 172.21.15.2:0/433641330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557970fc33c0 con 0x5579712ec5d0 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c67fc640 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579712fb110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f83b80045c0 tx=0x7f83b802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b81ad24ef17b237 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.293+0000 7f83a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83a6ffd640 1 -- 172.21.15.2:0/433641330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8035050 con 0x5579712ec5d0 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83a6ffd640 1 -- 172.21.15.2:0/433641330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f83b8004ed0 con 0x5579712ec5d0 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 1 -- 172.21.15.2:0/433641330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83b8005520 con 0x5579712ec5d0 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83a6ffd640 1 -- 172.21.15.2:0/433641330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f83b80048d0 con 0x5579712ec5d0 2024-09-12T00:59:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 10 client.16983 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 1 -- 172.21.15.2:0/433641330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557971309e90 con 0x5579712ec5d0 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83a6ffd640 1 -- 172.21.15.2:0/433641330 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b8005520 con 0x5579712ec5d0 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83a6ffd640 1 -- 172.21.15.2:0/433641330 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f83b80035f0 con 0x5579712ec5d0 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 10 client.16983 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 10 client.16983 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 20 client.16983 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55797130b1e0 0x55797130d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 4 client.16983 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:45.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.294+0000 7f83cfe1a740 1 -- 172.21.15.2:0/433641330 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55797125f860 con 0x55797130b1e0 2024-09-12T00:59:45.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.295+0000 7f83c67fc640 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55797130b1e0 0x55797130d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.295+0000 7f83c67fc640 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55797130b1e0 0x55797130d5d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f35a07e46a14014e server_cookie=b098ef474ea98381 in_seq=0 out_seq=0 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.295+0000 7f83a6ffd640 10 client.16983 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83a6ffd640 1 -- 172.21.15.2:0/433641330 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55797125f860 con 0x55797130b1e0 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83a6ffd640 10 client.16983 handle_command_reply: tid=0 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 client.16983 shutdown 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 -- 172.21.15.2:0/433641330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 msgr2=0x5579712fb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579712fb110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f83b80045c0 tx=0x7f83b802a420 comp rx=0 tx=0).stop 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 -- 172.21.15.2:0/433641330 shutdown_connections 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55797130b1e0 0x55797130d5d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83a6ffd640 0 client.16983 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x5579712f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/433641330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579712fb110 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 -- 172.21.15.2:0/433641330 >> 172.21.15.2:0/433641330 conn(0x5579712b5310 msgr2=0x5579712ee960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 -- 172.21.15.2:0/433641330 shutdown_connections 2024-09-12T00:59:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 1 -- 172.21.15.2:0/433641330 wait complete. 2024-09-12T00:59:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.296+0000 7f83cfe1a740 20 client.16983 trim_cache size 0 max 16384 2024-09-12T00:59:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.309+0000 7f83cfe1a740 1 Processor -- start 2024-09-12T00:59:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.309+0000 7f83cfe1a740 1 -- start start 2024-09-12T00:59:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.309+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579713076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712ee820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x557971312ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81adfe0 con 0x5579712ec5d0 2024-09-12T00:59:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81ab820 con 0x5579712fb780 2024-09-12T00:59:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81a9690 con 0x5579712edb40 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579713076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579713076c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49354/0 (socket says 172.21.15.2:49354) 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 -- 172.21.15.2:0/104933653 learned_addr learned my addr 172.21.15.2:0/104933653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c67fc640 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 -- 172.21.15.2:0/104933653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 msgr2=0x5579712ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c77fe640 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x557971312ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712ee820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 -- 172.21.15.2:0/104933653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 msgr2=0x557971312ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x557971312ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 -- 172.21.15.2:0/104933653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579712fb480 con 0x5579712ec5d0 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579713076c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009a50 tx=0x7f83b8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33a098ae1ac5cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83ad7fa640 1 -- 172.21.15.2:0/104933653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8035070 con 0x5579712ec5d0 2024-09-12T00:59:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83ad7fa640 1 -- 172.21.15.2:0/104933653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b80035f0 con 0x5579712ec5d0 2024-09-12T00:59:45.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.310+0000 7f83ad7fa640 1 -- 172.21.15.2:0/104933653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8004da0 con 0x5579712ec5d0 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 -- 172.21.15.2:0/104933653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 msgr2=0x5579713076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579713076c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009a50 tx=0x7f83b8031400 comp rx=0 tx=0).stop 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 -- 172.21.15.2:0/104933653 shutdown_connections 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x557971312ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712edb40 0x5579712ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/104933653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712ec5d0 0x5579713076c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 -- 172.21.15.2:0/104933653 >> 172.21.15.2:0/104933653 conn(0x5579712b5310 msgr2=0x5579712ee110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 -- 172.21.15.2:0/104933653 shutdown_connections 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 -- 172.21.15.2:0/104933653 wait complete. 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.311+0000 7f83cfe1a740 1 -- start start 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83cfe1a740 1 Processor -- start 2024-09-12T00:59:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712ec5d0 0x557971303b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579713040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83cfe1a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x5579712fefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81a9ce0 con 0x5579712edb40 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81ab150 con 0x5579712fb780 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83cfe1a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83c81aa3b0 con 0x5579712ec5d0 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83cfe1a740 10 client.0 _ll_register_callbacks cb 0x7f83bc012470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83c67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579713040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83c67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579713040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49370/0 (socket says 172.21.15.2:49370) 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83c67fc640 1 -- 172.21.15.2:0/4141554279 learned_addr learned my addr 172.21.15.2:0/4141554279 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83c77fe640 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x5579712fefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712ec5d0 0x557971303b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.312+0000 7f83c67fc640 1 -- 172.21.15.2:0/4141554279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712ec5d0 msgr2=0x557971303b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83c67fc640 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712ec5d0 0x557971303b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83c67fc640 1 -- 172.21.15.2:0/4141554279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 msgr2=0x5579712fefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83c67fc640 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x5579712fefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83c67fc640 1 -- 172.21.15.2:0/4141554279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579712ff800 con 0x5579712edb40 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712ec5d0 0x557971303b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83c67fc640 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579713040c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e790 tx=0x7f83bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d82cb14f5dd2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83a6ffd640 1 -- 172.21.15.2:0/4141554279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00b750 con 0x5579712edb40 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83a6ffd640 1 -- 172.21.15.2:0/4141554279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f83bc01b040 con 0x5579712edb40 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83cfe1a740 1 -- 172.21.15.2:0/4141554279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83b80035f0 con 0x5579712edb40 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83a6ffd640 1 -- 172.21.15.2:0/4141554279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f83bc01e8f0 con 0x5579712edb40 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83cfe1a740 10 client.16989 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83cfe1a740 1 -- 172.21.15.2:0/4141554279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5579713757a0 con 0x5579712edb40 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83a6ffd640 1 -- 172.21.15.2:0/4141554279 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b80035f0 con 0x5579712edb40 2024-09-12T00:59:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83a6ffd640 1 -- 172.21.15.2:0/4141554279 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f83bc01f070 con 0x5579712edb40 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83cfe1a740 10 client.16989 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.313+0000 7f83cfe1a740 10 client.16989 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83cfe1a740 20 client.16989 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55797130b1e0 0x557971378040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83cfe1a740 4 client.16989 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83cfe1a740 1 -- 172.21.15.2:0/4141554279 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557971259d70 con 0x55797130b1e0 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55797130b1e0 0x557971378040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83c6ffd640 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55797130b1e0 0x557971378040 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc40720724fe3f15 server_cookie=3a41d3b0065affee in_seq=0 out_seq=0 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83a6ffd640 10 client.16989 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83a6ffd640 1 -- 172.21.15.2:0/4141554279 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557971259d70 con 0x55797130b1e0 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83a6ffd640 10 client.16989 handle_command_reply: tid=0 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.314+0000 7f83cfe1a740 1 client.16989 shutdown 2024-09-12T00:59:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 -- 172.21.15.2:0/4141554279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 msgr2=0x5579713040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579713040c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e790 tx=0x7f83bc004730 comp rx=0 tx=0).stop 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 -- 172.21.15.2:0/4141554279 shutdown_connections 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55797130b1e0 0x557971378040 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579712fb780 0x5579712fefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579712edb40 0x5579713040c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83a6ffd640 0 client.16989 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 --2- 172.21.15.2:0/4141554279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579712ec5d0 0x557971303b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 -- 172.21.15.2:0/4141554279 >> 172.21.15.2:0/4141554279 conn(0x5579712b5310 msgr2=0x5579712ee930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 -- 172.21.15.2:0/4141554279 shutdown_connections 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 1 -- 172.21.15.2:0/4141554279 wait complete. 2024-09-12T00:59:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cfe1a740 20 client.16989 trim_cache size 0 max 16384 2024-09-12T00:59:45.319 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:45.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 -- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b00a2cf0 msgr2=0x7f83b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b00a2cf0 0x7f83b00a51b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00bfd0 tx=0x7f83bc00bb00 comp rx=0 tx=0).stop 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 -- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 msgr2=0x7f83c819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 0x7f83c819cca0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f83c000cce0 tx=0x7f83c000a620 comp rx=0 tx=0).stop 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 -- 172.21.15.2:0/3086251191 shutdown_connections 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f83b00a2cf0 0x7f83b00a51b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c8106a80 0x7f83c819cca0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c8101420 0x7f83c8198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 --2- 172.21.15.2:0/3086251191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83c8100a80 0x7f83c81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.315+0000 7f83cda41640 1 -- 172.21.15.2:0/3086251191 >> 172.21.15.2:0/3086251191 conn(0x7f83c80fc7a0 msgr2=0x7f83c80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.316+0000 7f83cda41640 1 -- 172.21.15.2:0/3086251191 shutdown_connections 2024-09-12T00:59:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:45.316+0000 7f83cda41640 1 -- 172.21.15.2:0/3086251191 wait complete. 2024-09-12T00:59:46.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:59:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:46.691 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:46 smithi002 ceph-mon[31210]: pgmap v208: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:46.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 -- 172.21.15.2:0/1039854186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 msgr2=0x7efc0410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 --2- 172.21.15.2:0/1039854186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 0x7efc0410ea90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009ca0 tx=0x7efbfc02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 -- 172.21.15.2:0/1039854186 shutdown_connections 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 --2- 172.21.15.2:0/1039854186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 0x7efc0410ea90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 --2- 172.21.15.2:0/1039854186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc04102790 0x7efc041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 --2- 172.21.15.2:0/1039854186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc04101de0 0x7efc041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 -- 172.21.15.2:0/1039854186 >> 172.21.15.2:0/1039854186 conn(0x7efc040fd8c0 msgr2=0x7efc040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 -- 172.21.15.2:0/1039854186 shutdown_connections 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.776+0000 7efc0accc640 1 -- 172.21.15.2:0/1039854186 wait complete. 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc0accc640 1 Processor -- start 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc0accc640 1 -- start start 2024-09-12T00:59:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc0accc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc04101de0 0x7efc0419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc0accc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc04102790 0x7efc0419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc0accc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 0x7efc0419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc0accc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc04111f90 con 0x7efc04106f10 2024-09-12T00:59:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc0accc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efc04111e10 con 0x7efc04102790 2024-09-12T00:59:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc0accc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc04112110 con 0x7efc04101de0 2024-09-12T00:59:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc09269640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 0x7efc0419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc09269640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 0x7efc0419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50402/0 (socket says 172.21.15.2:50402) 2024-09-12T00:59:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc09269640 1 -- 172.21.15.2:0/4110936919 learned_addr learned my addr 172.21.15.2:0/4110936919 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efbfbfff640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc04102790 0x7efc0419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc08a68640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc04101de0 0x7efc0419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc09269640 1 -- 172.21.15.2:0/4110936919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc04101de0 msgr2=0x7efc0419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.777+0000 7efc09269640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc04101de0 0x7efc0419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efc09269640 1 -- 172.21.15.2:0/4110936919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc04102790 msgr2=0x7efc0419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efc09269640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc04102790 0x7efc0419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efc09269640 1 -- 172.21.15.2:0/4110936919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0419f5c0 con 0x7efc04106f10 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efc09269640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 0x7efc0419eee0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7efbfc031a60 tx=0x7efbfc031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efbf9ffb640 1 -- 172.21.15.2:0/4110936919 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc003c30 con 0x7efc04106f10 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efbf9ffb640 1 -- 172.21.15.2:0/4110936919 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbfc003dd0 con 0x7efc04106f10 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efc0accc640 1 -- 172.21.15.2:0/4110936919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0419f850 con 0x7efc04106f10 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efbf9ffb640 1 -- 172.21.15.2:0/4110936919 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0047e0 con 0x7efc04106f10 2024-09-12T00:59:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.778+0000 7efc0accc640 1 -- 172.21.15.2:0/4110936919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc041a7190 con 0x7efc04106f10 2024-09-12T00:59:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efbf9ffb640 1 -- 172.21.15.2:0/4110936919 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7efbfc02f790 con 0x7efc04106f10 2024-09-12T00:59:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc0d0a5740 1 Processor -- start 2024-09-12T00:59:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc0d0a5740 1 -- start start 2024-09-12T00:59:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 0x55c953b4ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b58760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c953ab12f0 con 0x55c953b56370 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c953a58cf0 con 0x55c953b4cb40 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c953aad2b0 con 0x55c953b4b5d0 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efbf9ffb640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7efbec0a2d70 0x7efbec0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b58760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b58760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50404/0 (socket says 172.21.15.2:50404) 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efbfbfff640 1 -- 172.21.15.2:0/3405732795 learned_addr learned my addr 172.21.15.2:0/3405732795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.781+0000 7efc09269640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7efbec0a2d70 0x7efbec0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbfbfff640 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efc08a68640 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 0x55c953b4ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbf9ffb640 1 -- 172.21.15.2:0/4110936919 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7efbfc0f07f0 con 0x7efc04106f10 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbfbfff640 1 -- 172.21.15.2:0/3405732795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 msgr2=0x55c953b4ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbfbfff640 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 0x55c953b4ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbfbfff640 1 -- 172.21.15.2:0/3405732795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 msgr2=0x55c953b4b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbfbfff640 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbfbfff640 1 -- 172.21.15.2:0/3405732795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c953a3d3a0 con 0x55c953b56370 2024-09-12T00:59:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efc09269640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7efbec0a2d70 0x7efbec0a5230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0bcd60 tx=0x7efbfc08ff60 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbfbfff640 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b58760 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7efbf4013930 tx=0x7efbf400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584e26cc84733dca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbeaffd640 1 -- 172.21.15.2:0/3405732795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400e950 con 0x55c953b56370 2024-09-12T00:59:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbeaffd640 1 -- 172.21.15.2:0/3405732795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbf4010430 con 0x55c953b56370 2024-09-12T00:59:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.782+0000 7efbeaffd640 1 -- 172.21.15.2:0/3405732795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400f600 con 0x55c953b56370 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 -- 172.21.15.2:0/3405732795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 msgr2=0x55c953b58760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b58760 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7efbf4013930 tx=0x7efbf400b460 comp rx=0 tx=0).stop 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 -- 172.21.15.2:0/3405732795 shutdown_connections 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b58760 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 0x55c953b4ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/3405732795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 -- 172.21.15.2:0/3405732795 >> 172.21.15.2:0/3405732795 conn(0x55c953b14310 msgr2=0x55c953b47c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 -- 172.21.15.2:0/3405732795 shutdown_connections 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 -- 172.21.15.2:0/3405732795 wait complete. 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.783+0000 7efc0d0a5740 1 -- start start 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc0d0a5740 1 Processor -- start 2024-09-12T00:59:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 0x55c953b55d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b53020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b53610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c953b59070 con 0x55c953b56370 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c953a6c060 con 0x55c953b4b5d0 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c953b591f0 con 0x55c953b4cb40 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc0d0a5740 10 client.0 _ll_register_callbacks cb 0x55c9537bf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b53610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b53610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50410/0 (socket says 172.21.15.2:50410) 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efbfbfff640 1 -- 172.21.15.2:0/1212270640 learned_addr learned my addr 172.21.15.2:0/1212270640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efbfbfff640 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 0x55c953b55d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.784+0000 7efc08a68640 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b53020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbfbfff640 1 -- 172.21.15.2:0/1212270640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 msgr2=0x55c953b53020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbfbfff640 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b53020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbfbfff640 1 -- 172.21.15.2:0/1212270640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 msgr2=0x55c953b55d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbfbfff640 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 0x55c953b55d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbfbfff640 1 -- 172.21.15.2:0/1212270640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9538223c0 con 0x55c953b56370 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbfbfff640 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b53610 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7efbf400b580 tx=0x7efbf4010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdd2ba025443ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbe3fff640 1 -- 172.21.15.2:0/1212270640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf40105e0 con 0x55c953b56370 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbe3fff640 1 -- 172.21.15.2:0/1212270640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7efbf4010780 con 0x55c953b56370 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efc0d0a5740 1 -- 172.21.15.2:0/1212270640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbf4010430 con 0x55c953b56370 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbe3fff640 1 -- 172.21.15.2:0/1212270640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efbf4005030 con 0x55c953b56370 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efc0d0a5740 10 client.17001 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efc0d0a5740 1 -- 172.21.15.2:0/1212270640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c953b64b10 con 0x55c953b56370 2024-09-12T00:59:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.785+0000 7efbe3fff640 1 -- 172.21.15.2:0/1212270640 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbf4010430 con 0x55c953b56370 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.786+0000 7efbe3fff640 1 -- 172.21.15.2:0/1212270640 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7efbf400ec10 con 0x55c953b56370 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.786+0000 7efc0d0a5740 10 client.17001 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.786+0000 7efc0d0a5740 10 client.17001 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.786+0000 7efc0d0a5740 20 client.17001 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.786+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c953b65ec0 0x55c953b682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.786+0000 7efc0d0a5740 4 client.17001 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.786+0000 7efc0d0a5740 1 -- 172.21.15.2:0/1212270640 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c953abe860 con 0x55c953b65ec0 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.786+0000 7efc08a68640 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c953b65ec0 0x55c953b682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc08a68640 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c953b65ec0 0x55c953b682b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6eb925fb3ff6255f server_cookie=dce2bf49e1719c74 in_seq=0 out_seq=0 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efbe3fff640 10 client.17001 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efbe3fff640 1 -- 172.21.15.2:0/1212270640 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c953abe860 con 0x55c953b65ec0 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efbe3fff640 10 client.17001 handle_command_reply: tid=0 2024-09-12T00:59:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 client.17001 shutdown 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 -- 172.21.15.2:0/1212270640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 msgr2=0x55c953b53610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b53610 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7efbf400b580 tx=0x7efbf4010de0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 -- 172.21.15.2:0/1212270640 shutdown_connections 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c953b65ec0 0x55c953b682b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efbe3fff640 0 client.17001 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b53610 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b53020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/1212270640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 0x55c953b55d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.787+0000 7efc0d0a5740 1 -- 172.21.15.2:0/1212270640 >> 172.21.15.2:0/1212270640 conn(0x55c953b14310 msgr2=0x55c953b4d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.788+0000 7efc0d0a5740 1 -- 172.21.15.2:0/1212270640 shutdown_connections 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.788+0000 7efc0d0a5740 1 -- 172.21.15.2:0/1212270640 wait complete. 2024-09-12T00:59:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.788+0000 7efc0d0a5740 20 client.17001 trim_cache size 0 max 16384 2024-09-12T00:59:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc0d0a5740 1 Processor -- start 2024-09-12T00:59:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc0d0a5740 1 -- start start 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 0x55c953b54f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b4e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc041b24d0 con 0x55c953b56370 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efc041afd10 con 0x55c953b4cb40 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc041adb60 con 0x55c953b4b5d0 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b4e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b4e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50414/0 (socket says 172.21.15.2:50414) 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 -- 172.21.15.2:0/2653305993 learned_addr learned my addr 172.21.15.2:0/2653305993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc08a68640 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 0x55c953b54f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 -- 172.21.15.2:0/2653305993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 msgr2=0x55c953b54f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 0x55c953b54f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 -- 172.21.15.2:0/2653305993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 msgr2=0x55c953b4e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efbfbfff640 1 -- 172.21.15.2:0/2653305993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c953b51ff0 con 0x55c953b56370 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.801+0000 7efc08a68640 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efbfbfff640 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b4e660 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005d40 tx=0x7efbf400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa5637907b9c5fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efbea7fc640 1 -- 172.21.15.2:0/2653305993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400b900 con 0x55c953b56370 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efbea7fc640 1 -- 172.21.15.2:0/2653305993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbf4010b00 con 0x55c953b56370 2024-09-12T00:59:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efbea7fc640 1 -- 172.21.15.2:0/2653305993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4004cd0 con 0x55c953b56370 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 -- 172.21.15.2:0/2653305993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 msgr2=0x55c953b4e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b4e660 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005d40 tx=0x7efbf400e720 comp rx=0 tx=0).stop 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 -- 172.21.15.2:0/2653305993 shutdown_connections 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b4e660 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4cb40 0x55c953b4e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/2653305993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4b5d0 0x55c953b54f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 -- 172.21.15.2:0/2653305993 >> 172.21.15.2:0/2653305993 conn(0x55c953b14310 msgr2=0x55c953b54880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 -- 172.21.15.2:0/2653305993 shutdown_connections 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.802+0000 7efc0d0a5740 1 -- 172.21.15.2:0/2653305993 wait complete. 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 1 -- start start 2024-09-12T00:59:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 1 Processor -- start 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 0x55c953b5eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b4fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b50210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc041ae1d0 con 0x55c953b56370 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efc041af640 con 0x55c953b4b5d0 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc041ae8a0 con 0x55c953b4cb40 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efc0d0a5740 10 client.0 _ll_register_callbacks cb 0x7efbf400bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b50210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b50210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50418/0 (socket says 172.21.15.2:50418) 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.803+0000 7efbfbfff640 1 -- 172.21.15.2:0/882871401 learned_addr learned my addr 172.21.15.2:0/882871401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efc08a68640 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b4fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbfbfff640 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 0x55c953b5eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbfbfff640 1 -- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 msgr2=0x55c953b4fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbfbfff640 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b4fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbfbfff640 1 -- 172.21.15.2:0/882871401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 msgr2=0x55c953b5eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbfbfff640 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 0x55c953b5eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbfbfff640 1 -- 172.21.15.2:0/882871401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c953b508b0 con 0x55c953b56370 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efc08a68640 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b4fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbfbfff640 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b50210 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efbf4004900 tx=0x7efbf4005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e3bfadcced8067 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbe3fff640 1 -- 172.21.15.2:0/882871401 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400b900 con 0x55c953b56370 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbe3fff640 1 -- 172.21.15.2:0/882871401 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7efbf40051d0 con 0x55c953b56370 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efc0d0a5740 1 -- 172.21.15.2:0/882871401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbf4010b00 con 0x55c953b56370 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbe3fff640 1 -- 172.21.15.2:0/882871401 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efbf4049050 con 0x55c953b56370 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efc0d0a5740 10 client.17007 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efc0d0a5740 1 -- 172.21.15.2:0/882871401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c953bd08a0 con 0x55c953b56370 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.804+0000 7efbe3fff640 1 -- 172.21.15.2:0/882871401 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbf4010b00 con 0x55c953b56370 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efbe3fff640 1 -- 172.21.15.2:0/882871401 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7efbf400e790 con 0x55c953b56370 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efc0d0a5740 10 client.17007 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efc0d0a5740 10 client.17007 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efc0d0a5740 20 client.17007 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c953b65ec0 0x55c953bd2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efc0d0a5740 4 client.17007 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efc0d0a5740 1 -- 172.21.15.2:0/882871401 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c953ab8d70 con 0x55c953b65ec0 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efc08a68640 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c953b65ec0 0x55c953bd2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efc08a68640 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c953b65ec0 0x55c953bd2fc0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c57c4967af92be9 server_cookie=1d1d43e7643576ef in_seq=0 out_seq=0 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.805+0000 7efbe3fff640 10 client.17007 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efbe3fff640 1 -- 172.21.15.2:0/882871401 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c953ab8d70 con 0x55c953b65ec0 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efbe3fff640 10 client.17007 handle_command_reply: tid=0 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 client.17007 shutdown 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 -- 172.21.15.2:0/882871401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 msgr2=0x55c953b50210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b50210 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efbf4004900 tx=0x7efbf4005ec0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 -- 172.21.15.2:0/882871401 shutdown_connections 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c953b65ec0 0x55c953bd2fc0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c953b56370 0x55c953b50210 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c953b4cb40 0x55c953b4fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efbe3fff640 0 client.17007 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 --2- 172.21.15.2:0/882871401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c953b4b5d0 0x55c953b5eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 -- 172.21.15.2:0/882871401 >> 172.21.15.2:0/882871401 conn(0x55c953b14310 msgr2=0x55c953b61300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 -- 172.21.15.2:0/882871401 shutdown_connections 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 1 -- 172.21.15.2:0/882871401 wait complete. 2024-09-12T00:59:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.806+0000 7efc0d0a5740 20 client.17007 trim_cache size 0 max 16384 2024-09-12T00:59:46.811 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 -- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7efbec0a2d70 msgr2=0x7efbec0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7efbec0a2d70 0x7efbec0a5230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0bcd60 tx=0x7efbfc08ff60 comp rx=0 tx=0).stop 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 -- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 msgr2=0x7efc0419eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 0x7efc0419eee0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7efbfc031a60 tx=0x7efbfc031a90 comp rx=0 tx=0).stop 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 -- 172.21.15.2:0/4110936919 shutdown_connections 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7efbec0a2d70 0x7efbec0a5230 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc04106f10 0x7efc0419eee0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc04102790 0x7efc0419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 --2- 172.21.15.2:0/4110936919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc04101de0 0x7efc0419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 -- 172.21.15.2:0/4110936919 >> 172.21.15.2:0/4110936919 conn(0x7efc040fd8c0 msgr2=0x7efc040ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 -- 172.21.15.2:0/4110936919 shutdown_connections 2024-09-12T00:59:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:46.807+0000 7efc0accc640 1 -- 172.21.15.2:0/4110936919 wait complete. 2024-09-12T00:59:46.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:46 smithi071 ceph-mon[35276]: pgmap v208: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:47.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:46 smithi167 ceph-mon[35234]: pgmap v208: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:47.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:59:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 -- 172.21.15.2:0/13409502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 msgr2=0x7f329c1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 --2- 172.21.15.2:0/13409502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 0x7f329c1067d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3284009900 tx=0x7f328402a410 comp rx=0 tx=0).stop 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 -- 172.21.15.2:0/13409502 shutdown_connections 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 --2- 172.21.15.2:0/13409502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f329c106f00 0x7f329c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 --2- 172.21.15.2:0/13409502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 0x7f329c1067d0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 --2- 172.21.15.2:0/13409502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f329c101dd0 0x7f329c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 -- 172.21.15.2:0/13409502 >> 172.21.15.2:0/13409502 conn(0x7f329c0fd890 msgr2=0x7f329c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 -- 172.21.15.2:0/13409502 shutdown_connections 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 -- 172.21.15.2:0/13409502 wait complete. 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 Processor -- start 2024-09-12T00:59:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.283+0000 7f32a0856640 1 -- start start 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f32a0856640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f329c101dd0 0x7f329c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f32a0856640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 0x7f329c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f32a0856640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f329c106f00 0x7f329c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f32a0856640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f329c112000 con 0x7f329c102780 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f32a0856640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f329c111e80 con 0x7f329c101dd0 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f32a0856640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f329c112180 con 0x7f329c106f00 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f3293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 0x7f329c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f3293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 0x7f329c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50450/0 (socket says 172.21.15.2:50450) 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f3293fff640 1 -- 172.21.15.2:0/2727472780 learned_addr learned my addr 172.21.15.2:0/2727472780 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f329a59c640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f329c101dd0 0x7f329c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f329ad9d640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f329c106f00 0x7f329c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f3293fff640 1 -- 172.21.15.2:0/2727472780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f329c106f00 msgr2=0x7f329c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f3293fff640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f329c106f00 0x7f329c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f3293fff640 1 -- 172.21.15.2:0/2727472780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f329c101dd0 msgr2=0x7f329c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f3293fff640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f329c101dd0 0x7f329c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f3293fff640 1 -- 172.21.15.2:0/2727472780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c19d570 con 0x7f329c102780 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.284+0000 7f329ad9d640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f329c106f00 0x7f329c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.285+0000 7f3293fff640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 0x7f329c198b00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3284005ab0 tx=0x7f32840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.285+0000 7f32937fe640 1 -- 172.21.15.2:0/2727472780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328403f030 con 0x7f329c102780 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.285+0000 7f32937fe640 1 -- 172.21.15.2:0/2727472780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3284003ce0 con 0x7f329c102780 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.285+0000 7f32937fe640 1 -- 172.21.15.2:0/2727472780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284035070 con 0x7f329c102780 2024-09-12T00:59:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.285+0000 7f32a0856640 1 -- 172.21.15.2:0/2727472780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329c19d800 con 0x7f329c102780 2024-09-12T00:59:48.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.285+0000 7f32a0856640 1 -- 172.21.15.2:0/2727472780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f329c19dc90 con 0x7f329c102780 2024-09-12T00:59:48.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.287+0000 7f32937fe640 1 -- 172.21.15.2:0/2727472780 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f3284042030 con 0x7f329c102780 2024-09-12T00:59:48.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32a2c2f740 1 Processor -- start 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32a2c2f740 1 -- start start 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156dc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156dce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56401563e2f0 con 0x5640156e7780 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5640155e5cf0 con 0x5640156dc9e0 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56401563a2b0 con 0x5640156ddf50 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f3293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f329a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f3293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50458/0 (socket says 172.21.15.2:50458) 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f329a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156dce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:36082/0 (socket says 172.21.15.2:36082) 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f3293fff640 1 -- 172.21.15.2:0/1685878338 learned_addr learned my addr 172.21.15.2:0/1685878338 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f329ad9d640 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156dc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.288+0000 7f32937fe640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32880a2cf0 0x7f32880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f329ad9d640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32880a2cf0 0x7f32880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f32937fe640 1 -- 172.21.15.2:0/2727472780 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f32840efe70 con 0x7f329c102780 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3293fff640 1 -- 172.21.15.2:0/1685878338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 msgr2=0x5640156dc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3293fff640 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156dc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3293fff640 1 -- 172.21.15.2:0/1685878338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 msgr2=0x5640156dce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3293fff640 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156dce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3293fff640 1 -- 172.21.15.2:0/1685878338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640155ca3a0 con 0x5640156e7780 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f329ad9d640 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156dc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f329a59c640 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156dce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3293fff640 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e9b70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f32840bbfe0 tx=0x7f328402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7f17bd65e48cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3290ff9640 1 -- 172.21.15.2:0/1685878338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284049070 con 0x5640156e7780 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f329ad9d640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32880a2cf0 0x7f32880a51b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3294009fd0 tx=0x7f3294004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3290ff9640 1 -- 172.21.15.2:0/1685878338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32840bc9e0 con 0x5640156e7780 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.289+0000 7f3290ff9640 1 -- 172.21.15.2:0/1685878338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32840b8950 con 0x5640156e7780 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 -- 172.21.15.2:0/1685878338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 msgr2=0x5640156e9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e9b70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f32840bbfe0 tx=0x7f328402a410 comp rx=0 tx=0).stop 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 -- 172.21.15.2:0/1685878338 shutdown_connections 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e9b70 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156dce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/1685878338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156dc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 -- 172.21.15.2:0/1685878338 >> 172.21.15.2:0/1685878338 conn(0x5640156a1310 msgr2=0x5640156d9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 -- 172.21.15.2:0/1685878338 shutdown_connections 2024-09-12T00:59:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 -- 172.21.15.2:0/1685878338 wait complete. 2024-09-12T00:59:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.290+0000 7f32a2c2f740 1 -- start start 2024-09-12T00:59:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f32a2c2f740 1 Processor -- start 2024-09-12T00:59:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156dc9e0 0x5640156e7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156ddf50 0x5640156e4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 0x5640156e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56401563e2f0 con 0x5640156dc9e0 2024-09-12T00:59:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5640155f9060 con 0x5640156ddf50 2024-09-12T00:59:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5640156ea240 con 0x5640156e7780 2024-09-12T00:59:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f32a2c2f740 10 client.0 _ll_register_callbacks cb 0x56401534c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156dc9e0 0x5640156e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156dc9e0 0x5640156e7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50472/0 (socket says 172.21.15.2:50472) 2024-09-12T00:59:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329a59c640 1 -- 172.21.15.2:0/402959464 learned_addr learned my addr 172.21.15.2:0/402959464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329ad9d640 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 0x5640156e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f3293fff640 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156ddf50 0x5640156e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329a59c640 1 -- 172.21.15.2:0/402959464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 msgr2=0x5640156e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329a59c640 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 0x5640156e4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329a59c640 1 -- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156ddf50 msgr2=0x5640156e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329a59c640 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156ddf50 0x5640156e4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f329a59c640 1 -- 172.21.15.2:0/402959464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640153af3c0 con 0x5640156dc9e0 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.291+0000 7f3293fff640 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156ddf50 0x5640156e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f329a59c640 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156dc9e0 0x5640156e7170 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f328c011540 tx=0x7f328c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f86d6b2dcd973cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f3281ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f3281ffb640 1 -- 172.21.15.2:0/402959464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c00f6d0 con 0x5640156dc9e0 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f3281ffb640 1 -- 172.21.15.2:0/402959464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f328c00f870 con 0x5640156dc9e0 2024-09-12T00:59:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 1 -- 172.21.15.2:0/402959464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32840bc9e0 con 0x5640156dc9e0 2024-09-12T00:59:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f3281ffb640 1 -- 172.21.15.2:0/402959464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f328c00fa70 con 0x5640156dc9e0 2024-09-12T00:59:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 10 client.17019 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 1 -- 172.21.15.2:0/402959464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5640156f5bc0 con 0x5640156dc9e0 2024-09-12T00:59:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f3281ffb640 1 -- 172.21.15.2:0/402959464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32840bc9e0 con 0x5640156dc9e0 2024-09-12T00:59:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f3281ffb640 1 -- 172.21.15.2:0/402959464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f328c01d400 con 0x5640156dc9e0 2024-09-12T00:59:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 10 client.17019 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 20 client.17019 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5640156f7080 0x5640156f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 4 client.17019 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.292+0000 7f32a2c2f740 1 -- 172.21.15.2:0/402959464 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56401564b860 con 0x5640156f7080 2024-09-12T00:59:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.293+0000 7f3293fff640 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5640156f7080 0x5640156f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.293+0000 7f3293fff640 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5640156f7080 0x5640156f94b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67eb23c45d47557e server_cookie=b8087c4f0a1325cc in_seq=0 out_seq=0 2024-09-12T00:59:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.293+0000 7f3281ffb640 10 client.17019 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f3281ffb640 1 -- 172.21.15.2:0/402959464 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56401564b860 con 0x5640156f7080 2024-09-12T00:59:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f3281ffb640 10 client.17019 handle_command_reply: tid=0 2024-09-12T00:59:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 client.17019 shutdown 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 -- 172.21.15.2:0/402959464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156dc9e0 msgr2=0x5640156e7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156dc9e0 0x5640156e7170 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f328c011540 tx=0x7f328c011a00 comp rx=0 tx=0).stop 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 -- 172.21.15.2:0/402959464 shutdown_connections 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5640156f7080 0x5640156f94b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 0x5640156e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f3281ffb640 0 client.17019 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156ddf50 0x5640156e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/402959464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156dc9e0 0x5640156e7170 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 -- 172.21.15.2:0/402959464 >> 172.21.15.2:0/402959464 conn(0x5640156a1310 msgr2=0x5640156deda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 -- 172.21.15.2:0/402959464 shutdown_connections 2024-09-12T00:59:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 1 -- 172.21.15.2:0/402959464 wait complete. 2024-09-12T00:59:48.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.294+0000 7f32a2c2f740 20 client.17019 trim_cache size 0 max 16384 2024-09-12T00:59:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.307+0000 7f32a2c2f740 1 Processor -- start 2024-09-12T00:59:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.307+0000 7f32a2c2f740 1 -- start start 2024-09-12T00:59:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.307+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156f3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.307+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156ddf50 0x5640156df530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.307+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 0x5640156dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.307+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f329c1ae260 con 0x5640156ddf50 2024-09-12T00:59:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.307+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f329c1abaa0 con 0x5640156dc9e0 2024-09-12T00:59:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.307+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f329c1a98f0 con 0x5640156e7780 2024-09-12T00:59:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156ddf50 0x5640156df530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156ddf50 0x5640156df530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50488/0 (socket says 172.21.15.2:50488) 2024-09-12T00:59:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 -- 172.21.15.2:0/152910880 learned_addr learned my addr 172.21.15.2:0/152910880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f329a59c640 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f329ad9d640 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 0x5640156dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 -- 172.21.15.2:0/152910880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 msgr2=0x5640156dfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 0x5640156dfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 -- 172.21.15.2:0/152910880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 msgr2=0x5640156f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 -- 172.21.15.2:0/152910880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640156e74e0 con 0x5640156ddf50 2024-09-12T00:59:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f329a59c640 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3293fff640 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156ddf50 0x5640156df530 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f3284032c00 tx=0x7f32840b86b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a0bb143668ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3283fff640 1 -- 172.21.15.2:0/152910880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32840a5030 con 0x5640156ddf50 2024-09-12T00:59:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3283fff640 1 -- 172.21.15.2:0/152910880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32840b6e50 con 0x5640156ddf50 2024-09-12T00:59:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.308+0000 7f3283fff640 1 -- 172.21.15.2:0/152910880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284049040 con 0x5640156ddf50 2024-09-12T00:59:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 -- 172.21.15.2:0/152910880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156ddf50 msgr2=0x5640156df530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156ddf50 0x5640156df530 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f3284032c00 tx=0x7f32840b86b0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 -- 172.21.15.2:0/152910880 shutdown_connections 2024-09-12T00:59:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156e7780 0x5640156dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156ddf50 0x5640156df530 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/152910880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 -- 172.21.15.2:0/152910880 >> 172.21.15.2:0/152910880 conn(0x5640156a1310 msgr2=0x5640156e3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 -- 172.21.15.2:0/152910880 shutdown_connections 2024-09-12T00:59:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 -- 172.21.15.2:0/152910880 wait complete. 2024-09-12T00:59:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 -- start start 2024-09-12T00:59:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.309+0000 7f32a2c2f740 1 Processor -- start 2024-09-12T00:59:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156e1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156e1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f32a2c2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f329c1a9f60 con 0x5640156e7780 2024-09-12T00:59:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f329c1ab3d0 con 0x5640156dc9e0 2024-09-12T00:59:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f32a2c2f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f329c1aa630 con 0x5640156ddf50 2024-09-12T00:59:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f32a2c2f740 10 client.0 _ll_register_callbacks cb 0x7f328c0095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50500/0 (socket says 172.21.15.2:50500) 2024-09-12T00:59:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 -- 172.21.15.2:0/2514814064 learned_addr learned my addr 172.21.15.2:0/2514814064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f3293fff640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156e1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329a59c640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 -- 172.21.15.2:0/2514814064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 msgr2=0x5640156e1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156e1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 -- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 msgr2=0x5640156e1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156e1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 -- 172.21.15.2:0/2514814064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564015760d50 con 0x5640156e7780 2024-09-12T00:59:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f3293fff640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156e1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329a59c640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156e1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f329ad9d640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e1ec0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3294007db0 tx=0x7f3294004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eb08680341788d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.310+0000 7f3281ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f3281ffb640 1 -- 172.21.15.2:0/2514814064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294015050 con 0x5640156e7780 2024-09-12T00:59:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f3281ffb640 1 -- 172.21.15.2:0/2514814064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f329401d850 con 0x5640156e7780 2024-09-12T00:59:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 1 -- 172.21.15.2:0/2514814064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32840b6e50 con 0x5640156e7780 2024-09-12T00:59:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f3281ffb640 1 -- 172.21.15.2:0/2514814064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f329401da50 con 0x5640156e7780 2024-09-12T00:59:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 10 client.17025 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 1 -- 172.21.15.2:0/2514814064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564015762000 con 0x5640156e7780 2024-09-12T00:59:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f3281ffb640 1 -- 172.21.15.2:0/2514814064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32840b6e50 con 0x5640156e7780 2024-09-12T00:59:48.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f3281ffb640 1 -- 172.21.15.2:0/2514814064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f3294026070 con 0x5640156e7780 2024-09-12T00:59:48.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 10 client.17025 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:48.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:48.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 20 client.17025 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:48.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5640156f7080 0x564015764870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:48.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 4 client.17025 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:48.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.311+0000 7f32a2c2f740 1 -- 172.21.15.2:0/2514814064 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564015645d70 con 0x5640156f7080 2024-09-12T00:59:48.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f329a59c640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5640156f7080 0x564015764870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:48.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f329a59c640 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5640156f7080 0x564015764870 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8a3712902297b6f server_cookie=bd1c9839cc2c7df0 in_seq=0 out_seq=0 2024-09-12T00:59:48.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f3281ffb640 10 client.17025 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:48.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f3281ffb640 1 -- 172.21.15.2:0/2514814064 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564015645d70 con 0x5640156f7080 2024-09-12T00:59:48.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f3281ffb640 10 client.17025 handle_command_reply: tid=0 2024-09-12T00:59:48.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 client.17025 shutdown 2024-09-12T00:59:48.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 -- 172.21.15.2:0/2514814064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 msgr2=0x5640156e1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e1ec0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3294007db0 tx=0x7f3294004b50 comp rx=0 tx=0).stop 2024-09-12T00:59:48.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 -- 172.21.15.2:0/2514814064 shutdown_connections 2024-09-12T00:59:48.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5640156f7080 0x564015764870 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640156e7780 0x5640156e1ec0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f3281ffb640 0 client.17025 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640156ddf50 0x5640156e1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 --2- 172.21.15.2:0/2514814064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640156dc9e0 0x5640156e1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.312+0000 7f32a2c2f740 1 -- 172.21.15.2:0/2514814064 >> 172.21.15.2:0/2514814064 conn(0x5640156a1310 msgr2=0x5640156d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a2c2f740 1 -- 172.21.15.2:0/2514814064 shutdown_connections 2024-09-12T00:59:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a2c2f740 1 -- 172.21.15.2:0/2514814064 wait complete. 2024-09-12T00:59:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a2c2f740 20 client.17025 trim_cache size 0 max 16384 2024-09-12T00:59:48.331 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 -- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32880a2cf0 msgr2=0x7f32880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32880a2cf0 0x7f32880a51b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3294009fd0 tx=0x7f3294004a40 comp rx=0 tx=0).stop 2024-09-12T00:59:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 -- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 msgr2=0x7f329c198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 0x7f329c198b00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3284005ab0 tx=0x7f32840042f0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 -- 172.21.15.2:0/2727472780 shutdown_connections 2024-09-12T00:59:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f32880a2cf0 0x7f32880a51b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f329c106f00 0x7f329c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c102780 0x7f329c198b00 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 --2- 172.21.15.2:0/2727472780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f329c101dd0 0x7f329c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 -- 172.21.15.2:0/2727472780 >> 172.21.15.2:0/2727472780 conn(0x7f329c0fd890 msgr2=0x7f329c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 -- 172.21.15.2:0/2727472780 shutdown_connections 2024-09-12T00:59:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:48.313+0000 7f32a0856640 1 -- 172.21.15.2:0/2727472780 wait complete. 2024-09-12T00:59:48.886 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:48 smithi002 ceph-mon[31210]: pgmap v209: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T00:59:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:48 smithi071 ceph-mon[35276]: pgmap v209: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T00:59:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:48 smithi167 ceph-mon[35234]: pgmap v209: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T00:59:49.915 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:59:49.916 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:59:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 -- 172.21.15.2:0/981895689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102790 msgr2=0x7fc69c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/981895689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102790 0x7fc69c1067e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc690009900 tx=0x7fc69002a410 comp rx=0 tx=0).stop 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 -- 172.21.15.2:0/981895689 shutdown_connections 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/981895689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc69c106f10 0x7fc69c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/981895689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102790 0x7fc69c1067e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/981895689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc69c101de0 0x7fc69c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 -- 172.21.15.2:0/981895689 >> 172.21.15.2:0/981895689 conn(0x7fc69c0fd8c0 msgr2=0x7fc69c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 -- 172.21.15.2:0/981895689 shutdown_connections 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.609+0000 7fc6a1f21640 1 -- 172.21.15.2:0/981895689 wait complete. 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.610+0000 7fc6a1f21640 1 Processor -- start 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.610+0000 7fc6a1f21640 1 -- start start 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.610+0000 7fc6a1f21640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc69c101de0 0x7fc69c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.610+0000 7fc6a1f21640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc69c102790 0x7fc69c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc6a1f21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c106f10 0x7fc69c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc6a1f21640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c111f70 con 0x7fc69c106f10 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc6a1f21640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c111df0 con 0x7fc69c102790 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc6a1f21640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1120f0 con 0x7fc69c101de0 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c106f10 0x7fc69c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c106f10 0x7fc69c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50520/0 (socket says 172.21.15.2:50520) 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 -- 172.21.15.2:0/4064555028 learned_addr learned my addr 172.21.15.2:0/4064555028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc69c101de0 0x7fc69c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69affd640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc69c102790 0x7fc69c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 -- 172.21.15.2:0/4064555028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc69c101de0 msgr2=0x7fc69c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc69c101de0 0x7fc69c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 -- 172.21.15.2:0/4064555028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc69c102790 msgr2=0x7fc69c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc69c102790 0x7fc69c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 -- 172.21.15.2:0/4064555028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c19d400 con 0x7fc69c106f10 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69affd640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc69c102790 0x7fc69c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc69bfff640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c106f10 0x7fc69c19cd20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc69400eaa0 tx=0x7fc69400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc698ff9640 1 -- 172.21.15.2:0/4064555028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69400cdb0 con 0x7fc69c106f10 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc698ff9640 1 -- 172.21.15.2:0/4064555028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc694005020 con 0x7fc69c106f10 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc6a1f21640 1 -- 172.21.15.2:0/4064555028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c19d6f0 con 0x7fc69c106f10 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.611+0000 7fc698ff9640 1 -- 172.21.15.2:0/4064555028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6940116b0 con 0x7fc69c106f10 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.612+0000 7fc6a1f21640 1 -- 172.21.15.2:0/4064555028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c1a4fd0 con 0x7fc69c106f10 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc698ff9640 1 -- 172.21.15.2:0/4064555028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc694005560 con 0x7fc69c106f10 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc6a42fa740 1 Processor -- start 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc6a42fa740 1 -- start start 2024-09-12T00:59:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b74b60 0x55e731b74f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 0x55e731b7f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b7fd40 0x55e731b82130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e731ada280 con 0x55e731b7fd40 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e731a81b10 con 0x55e731b75480 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.614+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e731ad6240 con 0x55e731b74b60 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc698ff9640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc6840a2d70 0x7fc6840a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b7fd40 0x55e731b82130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b7fd40 0x55e731b82130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50524/0 (socket says 172.21.15.2:50524) 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 -- 172.21.15.2:0/1968536651 learned_addr learned my addr 172.21.15.2:0/1968536651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b74b60 0x55e731b74f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69bfff640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc6840a2d70 0x7fc6840a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 0x55e731b7f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc698ff9640 1 -- 172.21.15.2:0/4064555028 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc6940cf680 con 0x7fc69c106f10 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 -- 172.21.15.2:0/1968536651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b74b60 msgr2=0x55e731b74f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b74b60 0x55e731b74f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 -- 172.21.15.2:0/1968536651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 msgr2=0x55e731b7f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 0x55e731b7f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 -- 172.21.15.2:0/1968536651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e731a8e1f0 con 0x55e731b7fd40 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69bfff640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc6840a2d70 0x7fc6840a5230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc6940a4230 tx=0x7fc6940c6680 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc69affd640 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b7fd40 0x55e731b82130 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc6900057c0 tx=0x7fc690000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e7bbd9081d1565 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.615+0000 7fc681ffb640 1 -- 172.21.15.2:0/1968536651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690045070 con 0x55e731b7fd40 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc681ffb640 1 -- 172.21.15.2:0/1968536651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6900035f0 con 0x55e731b7fd40 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc681ffb640 1 -- 172.21.15.2:0/1968536651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690035040 con 0x55e731b7fd40 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1968536651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b7fd40 msgr2=0x55e731b82130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b7fd40 0x55e731b82130 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc6900057c0 tx=0x7fc690000bc0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1968536651 shutdown_connections 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b7fd40 0x55e731b82130 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 0x55e731b7f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1968536651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b74b60 0x55e731b74f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1968536651 >> 172.21.15.2:0/1968536651 conn(0x55e731b710f0 msgr2=0x55e731b714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1968536651 shutdown_connections 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.616+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1968536651 wait complete. 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 1 -- start start 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 1 Processor -- start 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b74b60 0x55e731b7cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b75480 0x55e731b7d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 0x55e731b7d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e731b82910 con 0x55e731b75480 2024-09-12T00:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e731a94f10 con 0x55e731b74b60 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e731b82a90 con 0x55e731b7fd40 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc6a42fa740 10 client.0 _ll_register_callbacks cb 0x55e731a5da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b75480 0x55e731b7d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b75480 0x55e731b7d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50534/0 (socket says 172.21.15.2:50534) 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc69b7fe640 1 -- 172.21.15.2:0/1976492484 learned_addr learned my addr 172.21.15.2:0/1976492484 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.617+0000 7fc69affd640 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b74b60 0x55e731b7cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc69affd640 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 0x55e731b7d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc69b7fe640 1 -- 172.21.15.2:0/1976492484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 msgr2=0x55e731b7d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 0x55e731b7d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc69b7fe640 1 -- 172.21.15.2:0/1976492484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b74b60 msgr2=0x55e731b7cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b74b60 0x55e731b7cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc69b7fe640 1 -- 172.21.15.2:0/1976492484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e73184b6a0 con 0x55e731b75480 2024-09-12T00:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b75480 0x55e731b7d160 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00bad0 tx=0x7fc68c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cb8073318ea13b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc67affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc67affd640 1 -- 172.21.15.2:0/1976492484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c005020 con 0x55e731b75480 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc67affd640 1 -- 172.21.15.2:0/1976492484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc68c0051c0 con 0x55e731b75480 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1976492484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6900035f0 con 0x55e731b75480 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc67affd640 1 -- 172.21.15.2:0/1976492484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc68c005400 con 0x55e731b75480 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc6a42fa740 10 client.17037 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1976492484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e731b8e570 con 0x55e731b75480 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc67affd640 1 -- 172.21.15.2:0/1976492484 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6900035f0 con 0x55e731b75480 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.618+0000 7fc67affd640 1 -- 172.21.15.2:0/1976492484 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc68c01b6d0 con 0x55e731b75480 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc6a42fa740 10 client.17037 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc6a42fa740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc6a42fa740 20 client.17037 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e731b8fa30 0x55e731b91e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc6a42fa740 4 client.17037 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1976492484 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e731ae77f0 con 0x55e731b8fa30 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc69affd640 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e731b8fa30 0x55e731b91e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc69affd640 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e731b8fa30 0x55e731b91e40 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=227a28d2fa346ca8 server_cookie=b9f846694dcf22f2 in_seq=0 out_seq=0 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.619+0000 7fc67affd640 10 client.17037 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc67affd640 1 -- 172.21.15.2:0/1976492484 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e731ae77f0 con 0x55e731b8fa30 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc67affd640 10 client.17037 handle_command_reply: tid=0 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 client.17037 shutdown 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1976492484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b75480 msgr2=0x55e731b7d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b75480 0x55e731b7d160 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00bad0 tx=0x7fc68c00bed0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1976492484 shutdown_connections 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e731b8fa30 0x55e731b91e40 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 0x55e731b7d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b75480 0x55e731b7d160 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/1976492484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b74b60 0x55e731b7cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1976492484 >> 172.21.15.2:0/1976492484 conn(0x55e731b710f0 msgr2=0x55e731b76dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc67affd640 0 client.17037 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1976492484 shutdown_connections 2024-09-12T00:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 1 -- 172.21.15.2:0/1976492484 wait complete. 2024-09-12T00:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.620+0000 7fc6a42fa740 20 client.17037 trim_cache size 0 max 16384 2024-09-12T00:59:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.638+0000 7fc6a42fa740 1 Processor -- start 2024-09-12T00:59:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.638+0000 7fc6a42fa740 1 -- start start 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b7ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b75480 0x55e731b97750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b7fd40 0x55e731b97c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1b0390 con 0x55e731b74b60 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1adbd0 con 0x55e731b7fd40 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1aba20 con 0x55e731b75480 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b7ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b7ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50536/0 (socket says 172.21.15.2:50536) 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 -- 172.21.15.2:0/4127604436 learned_addr learned my addr 172.21.15.2:0/4127604436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b75480 0x55e731b97750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b7fd40 0x55e731b97c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 -- 172.21.15.2:0/4127604436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b75480 msgr2=0x55e731b97750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b75480 0x55e731b97750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 -- 172.21.15.2:0/4127604436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b7fd40 msgr2=0x55e731b97c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b7fd40 0x55e731b97c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 -- 172.21.15.2:0/4127604436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e731b6c830 con 0x55e731b74b60 2024-09-12T00:59:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc69affd640 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b7ea80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc6900057c0 tx=0x7fc6900095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b8ff3534128b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.639+0000 7fc6817fa640 1 -- 172.21.15.2:0/4127604436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690035040 con 0x55e731b74b60 2024-09-12T00:59:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6817fa640 1 -- 172.21.15.2:0/4127604436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc690042040 con 0x55e731b74b60 2024-09-12T00:59:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6817fa640 1 -- 172.21.15.2:0/4127604436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690045040 con 0x55e731b74b60 2024-09-12T00:59:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 -- 172.21.15.2:0/4127604436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 msgr2=0x55e731b7ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b7ea80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc6900057c0 tx=0x7fc6900095e0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 -- 172.21.15.2:0/4127604436 shutdown_connections 2024-09-12T00:59:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b7fd40 0x55e731b97c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b75480 0x55e731b97750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/4127604436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b7ea80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 -- 172.21.15.2:0/4127604436 >> 172.21.15.2:0/4127604436 conn(0x55e731b710f0 msgr2=0x55e731b7e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 -- 172.21.15.2:0/4127604436 shutdown_connections 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.640+0000 7fc6a42fa740 1 -- 172.21.15.2:0/4127604436 wait complete. 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 1 -- start start 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 1 Processor -- start 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b83e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 0x55e731b843a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 0x55e731bf9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1ac090 con 0x55e731b74b60 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1ad500 con 0x55e731b75480 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1ac760 con 0x55e731b7fd40 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc6a42fa740 10 client.0 _ll_register_callbacks cb 0x7fc68c0040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc69affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b83e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc69affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b83e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50548/0 (socket says 172.21.15.2:50548) 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc69affd640 1 -- 172.21.15.2:0/3056617788 learned_addr learned my addr 172.21.15.2:0/3056617788 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.641+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 0x55e731b843a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc69affd640 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 0x55e731bf9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc69affd640 1 -- 172.21.15.2:0/3056617788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 msgr2=0x55e731bf9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc69affd640 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 0x55e731bf9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc69affd640 1 -- 172.21.15.2:0/3056617788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 msgr2=0x55e731b843a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc69affd640 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 0x55e731b843a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc69affd640 1 -- 172.21.15.2:0/3056617788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e731bf9c60 con 0x55e731b74b60 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc69affd640 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b83e60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc690004000 tx=0x7fc6900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b9b20483c826e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc67affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc67affd640 1 -- 172.21.15.2:0/3056617788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690060060 con 0x55e731b74b60 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc67affd640 1 -- 172.21.15.2:0/3056617788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7fc6900035f0 con 0x55e731b74b60 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc6a42fa740 1 -- 172.21.15.2:0/3056617788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc690042040 con 0x55e731b74b60 2024-09-12T00:59:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc67affd640 1 -- 172.21.15.2:0/3056617788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc690045070 con 0x55e731b74b60 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc6a42fa740 10 client.17043 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.642+0000 7fc6a42fa740 1 -- 172.21.15.2:0/3056617788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e731bfae60 con 0x55e731b74b60 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc67affd640 1 -- 172.21.15.2:0/3056617788 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc690042040 con 0x55e731b74b60 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc67affd640 1 -- 172.21.15.2:0/3056617788 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc69003a040 con 0x55e731b74b60 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc6a42fa740 10 client.17043 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc6a42fa740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc6a42fa740 20 client.17043 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e731bfb140 0x55e731bfd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc6a42fa740 4 client.17043 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc6a42fa740 1 -- 172.21.15.2:0/3056617788 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e731ae1d00 con 0x55e731bfb140 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e731bfb140 0x55e731bfd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc69b7fe640 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e731bfb140 0x55e731bfd530 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b596bfd3a1bf7517 server_cookie=a790d5b50d3c1e64 in_seq=0 out_seq=0 2024-09-12T00:59:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.643+0000 7fc67affd640 10 client.17043 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.644+0000 7fc67affd640 1 -- 172.21.15.2:0/3056617788 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e731ae1d00 con 0x55e731bfb140 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.644+0000 7fc67affd640 10 client.17043 handle_command_reply: tid=0 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.644+0000 7fc6a42fa740 1 client.17043 shutdown 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 -- 172.21.15.2:0/3056617788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 msgr2=0x55e731b83e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b83e60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc690004000 tx=0x7fc6900057f0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 -- 172.21.15.2:0/3056617788 shutdown_connections 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e731bfb140 0x55e731bfd530 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e731b7fd40 0x55e731bf9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e731b75480 0x55e731b843a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 --2- 172.21.15.2:0/3056617788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e731b74b60 0x55e731b83e60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 -- 172.21.15.2:0/3056617788 >> 172.21.15.2:0/3056617788 conn(0x55e731b710f0 msgr2=0x55e731b76dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc67affd640 0 client.17043 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 -- 172.21.15.2:0/3056617788 shutdown_connections 2024-09-12T00:59:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 1 -- 172.21.15.2:0/3056617788 wait complete. 2024-09-12T00:59:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a42fa740 20 client.17043 trim_cache size 0 max 16384 2024-09-12T00:59:50.649 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:50.649 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T00:59:50.649 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "9bcf3927-b527-4117-b1e5-c5c814a5290a", 2024-09-12T00:59:50.649 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T00:59:50.649 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a1f21640 1 -- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc6840a2d70 msgr2=0x7fc6840a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.645+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc6840a2d70 0x7fc6840a5230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc6940a4230 tx=0x7fc6940c6680 comp rx=0 tx=0).stop 2024-09-12T00:59:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 -- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c106f10 msgr2=0x7fc69c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c106f10 0x7fc69c19cd20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc69400eaa0 tx=0x7fc69400ef60 comp rx=0 tx=0).stop 2024-09-12T00:59:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 -- 172.21.15.2:0/4064555028 shutdown_connections 2024-09-12T00:59:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc6840a2d70 0x7fc6840a5230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c106f10 0x7fc69c19cd20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc69c102790 0x7fc69c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 --2- 172.21.15.2:0/4064555028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc69c101de0 0x7fc69c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 -- 172.21.15.2:0/4064555028 >> 172.21.15.2:0/4064555028 conn(0x7fc69c0fd8c0 msgr2=0x7fc69c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 -- 172.21.15.2:0/4064555028 shutdown_connections 2024-09-12T00:59:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:50.646+0000 7fc6a1f21640 1 -- 172.21.15.2:0/4064555028 wait complete. 2024-09-12T00:59:50.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:50 smithi071 ceph-mon[35276]: pgmap v210: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:50.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:50 smithi002 ceph-mon[31210]: pgmap v210: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:51.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:50 smithi167 ceph-mon[35234]: pgmap v210: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:51.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:59:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:51.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:51 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T00:59:51.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:51 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:51.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:51 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T00:59:51.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:51 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:51.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:51 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T00:59:51.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:51 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T00:59:51.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:51 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:51.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:51 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T00:59:51.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:51 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:51.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:51 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T00:59:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:51 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T00:59:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:51 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:51 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T00:59:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:51 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T00:59:52.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:51 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T00:59:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.110+0000 7f8c659a5640 1 -- 172.21.15.2:0/637811529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60106f50 msgr2=0x7f8c6010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.110+0000 7f8c659a5640 1 --2- 172.21.15.2:0/637811529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60106f50 0x7f8c6010eaf0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009cd0 tx=0x7f8c5802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.110+0000 7f8c659a5640 1 -- 172.21.15.2:0/637811529 shutdown_connections 2024-09-12T00:59:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.110+0000 7f8c659a5640 1 --2- 172.21.15.2:0/637811529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60106f50 0x7f8c6010eaf0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.110+0000 7f8c659a5640 1 --2- 172.21.15.2:0/637811529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c60100d00 0x7f8c60106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.111+0000 7f8c659a5640 1 --2- 172.21.15.2:0/637811529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c60100350 0x7f8c60100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.111+0000 7f8c659a5640 1 -- 172.21.15.2:0/637811529 >> 172.21.15.2:0/637811529 conn(0x7f8c60077210 msgr2=0x7f8c600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.111+0000 7f8c659a5640 1 -- 172.21.15.2:0/637811529 shutdown_connections 2024-09-12T00:59:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.111+0000 7f8c659a5640 1 -- 172.21.15.2:0/637811529 wait complete. 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.111+0000 7f8c659a5640 1 Processor -- start 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.111+0000 7f8c659a5640 1 -- start start 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c659a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c60100350 0x7f8c601012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c659a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60100d00 0x7f8c60101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c659a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c60106f50 0x7f8c60101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c659a5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8c60111fa0 con 0x7f8c60100d00 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c659a5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c60111e20 con 0x7f8c60106f50 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c659a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8c60112120 con 0x7f8c60100350 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60100d00 0x7f8c60101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60100d00 0x7f8c60101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50562/0 (socket says 172.21.15.2:50562) 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c567fc640 1 -- 172.21.15.2:0/2869295521 learned_addr learned my addr 172.21.15.2:0/2869295521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c5effd640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c60100350 0x7f8c601012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c5f7fe640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c60106f50 0x7f8c60101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c567fc640 1 -- 172.21.15.2:0/2869295521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c60100350 msgr2=0x7f8c601012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c567fc640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c60100350 0x7f8c601012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c567fc640 1 -- 172.21.15.2:0/2869295521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c60106f50 msgr2=0x7f8c60101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c567fc640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c60106f50 0x7f8c60101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c567fc640 1 -- 172.21.15.2:0/2869295521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c601a6940 con 0x7f8c60100d00 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.112+0000 7f8c5f7fe640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c60106f50 0x7f8c60101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.113+0000 7f8c567fc640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60100d00 0x7f8c60101810 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800d770 tx=0x7f8c4800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.113+0000 7f8c649a3640 1 -- 172.21.15.2:0/2869295521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48017070 con 0x7f8c60100d00 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.113+0000 7f8c649a3640 1 -- 172.21.15.2:0/2869295521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c48009c30 con 0x7f8c60100d00 2024-09-12T00:59:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.113+0000 7f8c659a5640 1 -- 172.21.15.2:0/2869295521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601a6c30 con 0x7f8c60100d00 2024-09-12T00:59:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.113+0000 7f8c649a3640 1 -- 172.21.15.2:0/2869295521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800f620 con 0x7f8c60100d00 2024-09-12T00:59:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.113+0000 7f8c659a5640 1 -- 172.21.15.2:0/2869295521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601a71c0 con 0x7f8c60100d00 2024-09-12T00:59:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.115+0000 7f8c649a3640 1 -- 172.21.15.2:0/2869295521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f8c4801a070 con 0x7f8c60100d00 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.115+0000 7f8c67d7e740 1 Processor -- start 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.115+0000 7f8c67d7e740 1 -- start start 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 0x55ca459cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459da140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459da680 0x55ca459dca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca459352e0 con 0x55ca459da680 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca458dcce0 con 0x55ca459cfdc0 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca459312a0 con 0x55ca459cf4a0 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459da680 0x55ca459dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459da680 0x55ca459dca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50566/0 (socket says 172.21.15.2:50566) 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c567fc640 1 -- 172.21.15.2:0/1968343751 learned_addr learned my addr 172.21.15.2:0/1968343751 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c5f7fe640 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 0x55ca459cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c649a3640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8c4c0a2d70 0x7f8c4c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c5effd640 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459da140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c5f7fe640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8c4c0a2d70 0x7f8c4c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c649a3640 1 -- 172.21.15.2:0/2869295521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8c480cf2b0 con 0x7f8c60100d00 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c567fc640 1 -- 172.21.15.2:0/1968343751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 msgr2=0x55ca459cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c567fc640 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 0x55ca459cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c567fc640 1 -- 172.21.15.2:0/1968343751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 msgr2=0x55ca459da140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c567fc640 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459da140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.116+0000 7f8c567fc640 1 -- 172.21.15.2:0/1968343751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca458c1440 con 0x55ca459da680 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.117+0000 7f8c567fc640 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459da680 0x55ca459dca70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8c4809b420 tx=0x7f8c48010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8720c75ed58152f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.117+0000 7f8c55ffb640 1 -- 172.21.15.2:0/1968343751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48021070 con 0x55ca459da680 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.117+0000 7f8c55ffb640 1 -- 172.21.15.2:0/1968343751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c48009de0 con 0x55ca459da680 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.117+0000 7f8c55ffb640 1 -- 172.21.15.2:0/1968343751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48097470 con 0x55ca459da680 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.117+0000 7f8c5f7fe640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8c4c0a2d70 0x7f8c4c0a5230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009430 tx=0x7f8c5802a8e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1968343751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459da680 msgr2=0x55ca459dca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459da680 0x55ca459dca70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8c4809b420 tx=0x7f8c48010cd0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1968343751 shutdown_connections 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459da680 0x55ca459dca70 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459da140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/1968343751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 0x55ca459cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1968343751 >> 172.21.15.2:0/1968343751 conn(0x55ca459cba30 msgr2=0x55ca459cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1968343751 shutdown_connections 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1968343751 wait complete. 2024-09-12T00:59:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 -- start start 2024-09-12T00:59:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.118+0000 7f8c67d7e740 1 Processor -- start 2024-09-12T00:59:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 0x55ca459d9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459d7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459da680 0x55ca459d7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca459dd250 con 0x55ca459cfdc0 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca458f0050 con 0x55ca459da680 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca459dd3d0 con 0x55ca459cf4a0 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c67d7e740 10 client.0 _ll_register_callbacks cb 0x55ca45930160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459d7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50576/0 (socket says 172.21.15.2:50576) 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 -- 172.21.15.2:0/3503197225 learned_addr learned my addr 172.21.15.2:0/3503197225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c5effd640 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 0x55ca459d9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c5f7fe640 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459da680 0x55ca459d7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 -- 172.21.15.2:0/3503197225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 msgr2=0x55ca459d9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 0x55ca459d9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 -- 172.21.15.2:0/3503197225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459da680 msgr2=0x55ca459d7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459da680 0x55ca459d7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 -- 172.21.15.2:0/3503197225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca456a63c0 con 0x55ca459cfdc0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c567fc640 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459d7250 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f8c48097400 tx=0x7f8c48098040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d47a0ac5ded7985 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c3effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c3effd640 1 -- 172.21.15.2:0/3503197225 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c480b4060 con 0x55ca459cfdc0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c3effd640 1 -- 172.21.15.2:0/3503197225 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8c480ccbd0 con 0x55ca459cfdc0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.119+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3503197225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c48009de0 con 0x55ca459cfdc0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c3effd640 1 -- 172.21.15.2:0/3503197225 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8c48021040 con 0x55ca459cfdc0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c67d7e740 10 client.17055 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3503197225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ca459e8c00 con 0x55ca459cfdc0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c3effd640 1 -- 172.21.15.2:0/3503197225 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c48009de0 con 0x55ca459cfdc0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c3effd640 1 -- 172.21.15.2:0/3503197225 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f8c480a3f00 con 0x55ca459cfdc0 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c67d7e740 10 client.17055 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c67d7e740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c67d7e740 20 client.17055 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca459e9f50 0x55ca459ec340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c67d7e740 4 client.17055 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3503197225 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca45942850 con 0x55ca459e9f50 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.120+0000 7f8c5effd640 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca459e9f50 0x55ca459ec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.121+0000 7f8c3effd640 10 client.17055 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.121+0000 7f8c5effd640 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca459e9f50 0x55ca459ec340 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db79b62ab96a1b0c server_cookie=bf39896f37f89a12 in_seq=0 out_seq=0 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.121+0000 7f8c3effd640 1 -- 172.21.15.2:0/3503197225 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca45942850 con 0x55ca459e9f50 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.121+0000 7f8c3effd640 10 client.17055 handle_command_reply: tid=0 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.121+0000 7f8c67d7e740 1 client.17055 shutdown 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3503197225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 msgr2=0x55ca459d7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459d7250 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f8c48097400 tx=0x7f8c48098040 comp rx=0 tx=0).stop 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3503197225 shutdown_connections 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca459e9f50 0x55ca459ec340 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459da680 0x55ca459d7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459d7250 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3503197225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459cf4a0 0x55ca459d9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3503197225 >> 172.21.15.2:0/3503197225 conn(0x55ca459cba30 msgr2=0x55ca459d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:52.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c3effd640 0 client.17055 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:52.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3503197225 shutdown_connections 2024-09-12T00:59:52.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3503197225 wait complete. 2024-09-12T00:59:52.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.122+0000 7f8c67d7e740 20 client.17055 trim_cache size 0 max 16384 2024-09-12T00:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.139+0000 7f8c67d7e740 1 Processor -- start 2024-09-12T00:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.139+0000 7f8c67d7e740 1 -- start start 2024-09-12T00:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.139+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cf4a0 0x55ca459cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.139+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.139+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 0x55ca459ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.139+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601b24b0 con 0x55ca459cf4a0 2024-09-12T00:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.139+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601afcf0 con 0x55ca459cfdc0 2024-09-12T00:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.139+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601adb40 con 0x55ca459da680 2024-09-12T00:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cf4a0 0x55ca459cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cf4a0 0x55ca459cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50588/0 (socket says 172.21.15.2:50588) 2024-09-12T00:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 -- 172.21.15.2:0/1759188882 learned_addr learned my addr 172.21.15.2:0/1759188882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5f7fe640 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 0x55ca459ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c567fc640 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 -- 172.21.15.2:0/1759188882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 msgr2=0x55ca459ef4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 0x55ca459ef4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 -- 172.21.15.2:0/1759188882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 msgr2=0x55ca459eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 -- 172.21.15.2:0/1759188882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca459d2e50 con 0x55ca459cf4a0 2024-09-12T00:59:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c567fc640 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c5effd640 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cf4a0 0x55ca459cae20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000ba60 tx=0x7f8c5000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116996311060d0ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c557fa640 1 -- 172.21.15.2:0/1759188882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50003e10 con 0x55ca459cf4a0 2024-09-12T00:59:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c557fa640 1 -- 172.21.15.2:0/1759188882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c50005500 con 0x55ca459cf4a0 2024-09-12T00:59:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.140+0000 7f8c557fa640 1 -- 172.21.15.2:0/1759188882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c500266c0 con 0x55ca459cf4a0 2024-09-12T00:59:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1759188882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cf4a0 msgr2=0x55ca459cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cf4a0 0x55ca459cae20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000ba60 tx=0x7f8c5000b390 comp rx=0 tx=0).stop 2024-09-12T00:59:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1759188882 shutdown_connections 2024-09-12T00:59:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 0x55ca459ef4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cfdc0 0x55ca459eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/1759188882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cf4a0 0x55ca459cae20 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1759188882 >> 172.21.15.2:0/1759188882 conn(0x55ca459cba30 msgr2=0x55ca459d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1759188882 shutdown_connections 2024-09-12T00:59:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 -- 172.21.15.2:0/1759188882 wait complete. 2024-09-12T00:59:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 -- start start 2024-09-12T00:59:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.141+0000 7f8c67d7e740 1 Processor -- start 2024-09-12T00:59:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cf4a0 0x55ca459ef740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459eca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c67d7e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 0x55ca459ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601ae1b0 con 0x55ca459cfdc0 2024-09-12T00:59:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601af620 con 0x55ca459cf4a0 2024-09-12T00:59:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c67d7e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601ae880 con 0x55ca459da680 2024-09-12T00:59:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c67d7e740 10 client.0 _ll_register_callbacks cb 0x7f8c50004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459eca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50594/0 (socket says 172.21.15.2:50594) 2024-09-12T00:59:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c567fc640 1 -- 172.21.15.2:0/3053013450 learned_addr learned my addr 172.21.15.2:0/3053013450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c5effd640 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cf4a0 0x55ca459ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c5f7fe640 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 0x55ca459ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c567fc640 1 -- 172.21.15.2:0/3053013450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 msgr2=0x55ca459ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c567fc640 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 0x55ca459ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c567fc640 1 -- 172.21.15.2:0/3053013450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cf4a0 msgr2=0x55ca459ef740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c567fc640 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cf4a0 0x55ca459ef740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.142+0000 7f8c567fc640 1 -- 172.21.15.2:0/3053013450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca459ed800 con 0x55ca459cfdc0 2024-09-12T00:59:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c567fc640 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459eca90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8c4809b420 tx=0x7f8c4809afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4539ca2495c10c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c3effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c3effd640 1 -- 172.21.15.2:0/3053013450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c480b4070 con 0x55ca459cfdc0 2024-09-12T00:59:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c3effd640 1 -- 172.21.15.2:0/3053013450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8c480ccbd0 con 0x55ca459cfdc0 2024-09-12T00:59:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3053013450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c50005500 con 0x55ca459cfdc0 2024-09-12T00:59:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c3effd640 1 -- 172.21.15.2:0/3053013450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8c480ccdd0 con 0x55ca459cfdc0 2024-09-12T00:59:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 10 client.17061 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3053013450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ca45a54870 con 0x55ca459cfdc0 2024-09-12T00:59:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c3effd640 1 -- 172.21.15.2:0/3053013450 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c50005500 con 0x55ca459cfdc0 2024-09-12T00:59:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c3effd640 1 -- 172.21.15.2:0/3053013450 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f8c480a0c60 con 0x55ca459cfdc0 2024-09-12T00:59:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 10 client.17061 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 20 client.17061 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca45a54d50 0x55ca45a57140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 4 client.17061 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:59:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.143+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3053013450 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ca4593cd60 con 0x55ca45a54d50 2024-09-12T00:59:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c5effd640 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca45a54d50 0x55ca45a57140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c5effd640 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca45a54d50 0x55ca45a57140 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d347d058d2632df0 server_cookie=222d2a79fdcb5b9f in_seq=0 out_seq=0 2024-09-12T00:59:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c3effd640 10 client.17061 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c3effd640 1 -- 172.21.15.2:0/3053013450 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ca4593cd60 con 0x55ca45a54d50 2024-09-12T00:59:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c3effd640 10 client.17061 handle_command_reply: tid=0 2024-09-12T00:59:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 client.17061 shutdown 2024-09-12T00:59:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3053013450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 msgr2=0x55ca459eca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459eca90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8c4809b420 tx=0x7f8c4809afd0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3053013450 shutdown_connections 2024-09-12T00:59:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca45a54d50 0x55ca45a57140 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca459da680 0x55ca459ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca459cfdc0 0x55ca459eca90 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 --2- 172.21.15.2:0/3053013450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca459cf4a0 0x55ca459ef740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3053013450 >> 172.21.15.2:0/3053013450 conn(0x55ca459cba30 msgr2=0x55ca459d59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.144+0000 7f8c3effd640 0 client.17061 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3053013450 shutdown_connections 2024-09-12T00:59:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c67d7e740 1 -- 172.21.15.2:0/3053013450 wait complete. 2024-09-12T00:59:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c67d7e740 20 client.17061 trim_cache size 0 max 16384 2024-09-12T00:59:52.161 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T00:59:52.161 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T00:59:52.161 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T00:59:52.161 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T00:59:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 -- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8c4c0a2d70 msgr2=0x7f8c4c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8c4c0a2d70 0x7f8c4c0a5230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009430 tx=0x7f8c5802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 -- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60100d00 msgr2=0x7f8c60101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60100d00 0x7f8c60101810 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800d770 tx=0x7f8c4800dc30 comp rx=0 tx=0).stop 2024-09-12T00:59:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 -- 172.21.15.2:0/2869295521 shutdown_connections 2024-09-12T00:59:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8c4c0a2d70 0x7f8c4c0a5230 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c60106f50 0x7f8c60101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c60100d00 0x7f8c60101810 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 --2- 172.21.15.2:0/2869295521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c60100350 0x7f8c601012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 -- 172.21.15.2:0/2869295521 >> 172.21.15.2:0/2869295521 conn(0x7f8c60077210 msgr2=0x7f8c60105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 -- 172.21.15.2:0/2869295521 shutdown_connections 2024-09-12T00:59:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:52.145+0000 7f8c659a5640 1 -- 172.21.15.2:0/2869295521 wait complete. 2024-09-12T00:59:52.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:52 smithi002 ceph-mon[31210]: pgmap v211: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-12T00:59:52.882 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:59:52.882 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:59:52.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:52 smithi071 ceph-mon[35276]: pgmap v211: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-12T00:59:53.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:52 smithi167 ceph-mon[35234]: pgmap v211: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-12T00:59:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.581+0000 7f8db2493640 1 -- 172.21.15.2:0/2558545827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac101420 msgr2=0x7f8dac10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.581+0000 7f8db2493640 1 --2- 172.21.15.2:0/2558545827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac101420 0x7f8dac10d950 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009cd0 tx=0x7f8da402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.581+0000 7f8db2493640 1 -- 172.21.15.2:0/2558545827 shutdown_connections 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.581+0000 7f8db2493640 1 --2- 172.21.15.2:0/2558545827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac101420 0x7f8dac10d950 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.581+0000 7f8db2493640 1 --2- 172.21.15.2:0/2558545827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dac100a80 0x7f8dac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.581+0000 7f8db2493640 1 --2- 172.21.15.2:0/2558545827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dac106a80 0x7f8dac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.582+0000 7f8db2493640 1 -- 172.21.15.2:0/2558545827 >> 172.21.15.2:0/2558545827 conn(0x7f8dac0fc7a0 msgr2=0x7f8dac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.582+0000 7f8db2493640 1 -- 172.21.15.2:0/2558545827 shutdown_connections 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.582+0000 7f8db2493640 1 -- 172.21.15.2:0/2558545827 wait complete. 2024-09-12T00:59:53.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.582+0000 7f8db2493640 1 Processor -- start 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.582+0000 7f8db2493640 1 -- start start 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db2493640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dac100a80 0x7f8dac198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db2493640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dac101420 0x7f8dac198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db2493640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac106a80 0x7f8dac19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db2493640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac111fa0 con 0x7f8dac106a80 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db2493640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac111e20 con 0x7f8dac101420 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db2493640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac112120 con 0x7f8dac100a80 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac106a80 0x7f8dac19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac106a80 0x7f8dac19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50612/0 (socket says 172.21.15.2:50612) 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 -- 172.21.15.2:0/2258541361 learned_addr learned my addr 172.21.15.2:0/2258541361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8da3fff640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dac101420 0x7f8dac198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8dabfff640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dac100a80 0x7f8dac198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 -- 172.21.15.2:0/2258541361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dac100a80 msgr2=0x7f8dac198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dac100a80 0x7f8dac198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 -- 172.21.15.2:0/2258541361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dac101420 msgr2=0x7f8dac198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dac101420 0x7f8dac198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 -- 172.21.15.2:0/2258541361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac19d3d0 con 0x7f8dac106a80 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.583+0000 7f8db0a30640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac106a80 0x7f8dac19ccf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005cc0 tx=0x7f8da4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.584+0000 7f8da9ffb640 1 -- 172.21.15.2:0/2258541361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4004040 con 0x7f8dac106a80 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.584+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac19d660 con 0x7f8dac106a80 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.584+0000 7f8da9ffb640 1 -- 172.21.15.2:0/2258541361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da40046c0 con 0x7f8dac106a80 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.584+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac1a4fa0 con 0x7f8dac106a80 2024-09-12T00:59:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.584+0000 7f8da9ffb640 1 -- 172.21.15.2:0/2258541361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4046480 con 0x7f8dac106a80 2024-09-12T00:59:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.585+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac100ee0 con 0x7f8dac106a80 2024-09-12T00:59:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.586+0000 7f8da9ffb640 1 -- 172.21.15.2:0/2258541361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f8da40305a0 con 0x7f8dac106a80 2024-09-12T00:59:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.587+0000 7f8da9ffb640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8d980a2d70 0x7f8d980a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.587+0000 7f8dabfff640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8d980a2d70 0x7f8d980a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.587+0000 7f8da9ffb640 1 -- 172.21.15.2:0/2258541361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f8da402e030 con 0x7f8dac106a80 2024-09-12T00:59:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.587+0000 7f8dabfff640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8d980a2d70 0x7f8d980a5230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00bb60 tx=0x7f8d9c00b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:53.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.591+0000 7f8da9ffb640 1 -- 172.21.15.2:0/2258541361 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8da404b060 con 0x7f8dac106a80 2024-09-12T00:59:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.804+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dac109010 con 0x7f8dac106a80 2024-09-12T00:59:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.804+0000 7f8da9ffb640 1 -- 172.21.15.2:0/2258541361 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7f8da40bd770 con 0x7f8dac106a80 2024-09-12T00:59:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T00:59:53.804 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T00:59:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T00:59:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8d980a2d70 msgr2=0x7f8d980a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8d980a2d70 0x7f8d980a5230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00bb60 tx=0x7f8d9c00b390 comp rx=0 tx=0).stop 2024-09-12T00:59:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac106a80 msgr2=0x7f8dac19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac106a80 0x7f8dac19ccf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005cc0 tx=0x7f8da4003970 comp rx=0 tx=0).stop 2024-09-12T00:59:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 shutdown_connections 2024-09-12T00:59:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8d980a2d70 0x7f8d980a5230 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac106a80 0x7f8dac19ccf0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dac101420 0x7f8dac198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 --2- 172.21.15.2:0/2258541361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dac100a80 0x7f8dac198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 >> 172.21.15.2:0/2258541361 conn(0x7f8dac0fc7a0 msgr2=0x7f8dac0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 shutdown_connections 2024-09-12T00:59:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:53.807+0000 7f8db2493640 1 -- 172.21.15.2:0/2258541361 wait complete. 2024-09-12T00:59:54.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:59:54.868 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:54.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:54 smithi071 ceph-mon[35276]: pgmap v212: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:54.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:54 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2258541361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:54.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:54 smithi002 ceph-mon[31210]: pgmap v212: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:54.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:54 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2258541361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:55.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:54 smithi167 ceph-mon[35234]: pgmap v212: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:55.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:54 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2258541361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 -- 172.21.15.2:0/1348513344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4100e20 msgr2=0x7faac4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 --2- 172.21.15.2:0/1348513344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4100e20 0x7faac4101200 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7faab4009900 tx=0x7faab402a480 comp rx=0 tx=0).stop 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 -- 172.21.15.2:0/1348513344 shutdown_connections 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 --2- 172.21.15.2:0/1348513344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4102ef0 0x7faac410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 --2- 172.21.15.2:0/1348513344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac4102570 0x7faac41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 --2- 172.21.15.2:0/1348513344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4100e20 0x7faac4101200 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 -- 172.21.15.2:0/1348513344 >> 172.21.15.2:0/1348513344 conn(0x7faac40fc7d0 msgr2=0x7faac40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 -- 172.21.15.2:0/1348513344 shutdown_connections 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 -- 172.21.15.2:0/1348513344 wait complete. 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.293+0000 7faac9f2b640 1 Processor -- start 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac9f2b640 1 -- start start 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac9f2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac9f2b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac9f2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac9f2b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faac4110fa0 con 0x7faac4102ef0 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac9f2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faac4110e20 con 0x7faac4100e20 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac9f2b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faac4111120 con 0x7faac4102570 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50632/0 (socket says 172.21.15.2:50632) 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac3fff640 1 -- 172.21.15.2:0/523534495 learned_addr learned my addr 172.21.15.2:0/523534495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac37fe640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac2ffd640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac3fff640 1 -- 172.21.15.2:0/523534495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4102570 msgr2=0x7faac40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac3fff640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac3fff640 1 -- 172.21.15.2:0/523534495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac4100e20 msgr2=0x7faac40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac3fff640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.294+0000 7faac3fff640 1 -- 172.21.15.2:0/523534495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac41a6aa0 con 0x7faac4102ef0 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.295+0000 7faac2ffd640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.295+0000 7faac3fff640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7faabc00b970 tx=0x7faabc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.295+0000 7faac0ff9640 1 -- 172.21.15.2:0/523534495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc019070 con 0x7faac4102ef0 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.295+0000 7faac0ff9640 1 -- 172.21.15.2:0/523534495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faabc00cb40 con 0x7faac4102ef0 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.295+0000 7faac0ff9640 1 -- 172.21.15.2:0/523534495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc007650 con 0x7faac4102ef0 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.295+0000 7faac9f2b640 1 -- 172.21.15.2:0/523534495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac41a6d90 con 0x7faac4102ef0 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.295+0000 7faac9f2b640 1 -- 172.21.15.2:0/523534495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac41a7280 con 0x7faac4102ef0 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.298+0000 7faacc304740 1 Processor -- start 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.298+0000 7faac0ff9640 1 -- 172.21.15.2:0/523534495 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7faabc01c070 con 0x7faac4102ef0 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.298+0000 7faacc304740 1 -- start start 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faacc304740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e3b40 0x5560627e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faacc304740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e25d0 0x5560627e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faacc304740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627ed370 0x5560627ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faacc304740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560627482f0 con 0x5560627ed370 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faacc304740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5560626efcf0 con 0x5560627e3b40 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faacc304740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5560627442b0 con 0x5560627e25d0 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627ed370 0x5560627ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627ed370 0x5560627ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50638/0 (socket says 172.21.15.2:50638) 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 -- 172.21.15.2:0/3397638436 learned_addr learned my addr 172.21.15.2:0/3397638436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e3b40 0x5560627e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac37fe640 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e25d0 0x5560627e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac0ff9640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faaac0a2d70 0x7faaac0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 -- 172.21.15.2:0/3397638436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e25d0 msgr2=0x5560627e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e25d0 0x5560627e2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 -- 172.21.15.2:0/3397638436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e3b40 msgr2=0x5560627e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e3b40 0x5560627e2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac2ffd640 1 -- 172.21.15.2:0/3397638436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560626d43a0 con 0x5560627ed370 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac0ff9640 1 -- 172.21.15.2:0/523534495 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7faabc0ce8a0 con 0x7faac4102ef0 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.299+0000 7faac3fff640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faaac0a2d70 0x7faaac0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.300+0000 7faac2ffd640 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627ed370 0x5560627ef760 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faab8012820 tx=0x7faab800d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d449fbdb3ac6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.300+0000 7faaa9ffb640 1 -- 172.21.15.2:0/3397638436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8012e60 con 0x5560627ed370 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.300+0000 7faaa9ffb640 1 -- 172.21.15.2:0/3397638436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab801d430 con 0x5560627ed370 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.300+0000 7faaa9ffb640 1 -- 172.21.15.2:0/3397638436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80105d0 con 0x5560627ed370 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.300+0000 7faac3fff640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faaac0a2d70 0x7faaac0a5230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faabc0cc160 tx=0x7faabc004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.300+0000 7faacc304740 1 -- 172.21.15.2:0/3397638436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627ed370 msgr2=0x5560627ef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627ed370 0x5560627ef760 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faab8012820 tx=0x7faab800d3c0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 -- 172.21.15.2:0/3397638436 shutdown_connections 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627ed370 0x5560627ef760 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e25d0 0x5560627e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 --2- 172.21.15.2:0/3397638436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e3b40 0x5560627e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 -- 172.21.15.2:0/3397638436 >> 172.21.15.2:0/3397638436 conn(0x5560627ab310 msgr2=0x5560627dec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 -- 172.21.15.2:0/3397638436 shutdown_connections 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 -- 172.21.15.2:0/3397638436 wait complete. 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 -- start start 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.301+0000 7faacc304740 1 Processor -- start 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faacc304740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faacc304740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faacc304740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627ed370 0x5560627ea600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faacc304740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560627f0070 con 0x5560627e25d0 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faacc304740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556062703060 con 0x5560627ed370 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faacc304740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5560627f01f0 con 0x5560627e3b40 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faacc304740 10 client.0 _ll_register_callbacks cb 0x5560624568c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627ecd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50652/0 (socket says 172.21.15.2:50652) 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 -- 172.21.15.2:0/1293594432 learned_addr learned my addr 172.21.15.2:0/1293594432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac37fe640 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 -- 172.21.15.2:0/1293594432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 msgr2=0x5560627ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 -- 172.21.15.2:0/1293594432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627ed370 msgr2=0x5560627ea600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627ed370 0x5560627ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 -- 172.21.15.2:0/1293594432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560624b93c0 con 0x5560627e25d0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac37fe640 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faac2ffd640 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627ecd60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faab800d390 tx=0x7faab800dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77540c52009b4859 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.302+0000 7faaa2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1293594432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab801d9f0 con 0x5560627e25d0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1293594432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7faab8012050 con 0x5560627e25d0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 1 -- 172.21.15.2:0/1293594432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab801d430 con 0x5560627e25d0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1293594432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faab8012250 con 0x5560627e25d0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 10 client.17079 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 1 -- 172.21.15.2:0/1293594432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5560627fbb40 con 0x5560627e25d0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1293594432 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab801d430 con 0x5560627e25d0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1293594432 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7faab8011820 con 0x5560627e25d0 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 10 client.17079 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 10 client.17079 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 20 client.17079 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5560627fce90 0x5560627ff280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 4 client.17079 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.303+0000 7faacc304740 1 -- 172.21.15.2:0/1293594432 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556062755860 con 0x5560627fce90 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.304+0000 7faac37fe640 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5560627fce90 0x5560627ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.304+0000 7faaa2ffd640 10 client.17079 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.304+0000 7faac37fe640 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5560627fce90 0x5560627ff280 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e4bf8db024e3c1a6 server_cookie=7b9354921cdf30da in_seq=0 out_seq=0 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1293594432 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556062755860 con 0x5560627fce90 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faaa2ffd640 10 client.17079 handle_command_reply: tid=0 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 client.17079 shutdown 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 -- 172.21.15.2:0/1293594432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 msgr2=0x5560627ecd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627ecd60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faab800d390 tx=0x7faab800dce0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 -- 172.21.15.2:0/1293594432 shutdown_connections 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5560627fce90 0x5560627ff280 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627ed370 0x5560627ea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 --2- 172.21.15.2:0/1293594432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627ecd60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 -- 172.21.15.2:0/1293594432 >> 172.21.15.2:0/1293594432 conn(0x5560627ab310 msgr2=0x5560627e4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faaa2ffd640 0 client.17079 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 -- 172.21.15.2:0/1293594432 shutdown_connections 2024-09-12T00:59:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 1 -- 172.21.15.2:0/1293594432 wait complete. 2024-09-12T00:59:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.305+0000 7faacc304740 20 client.17079 trim_cache size 0 max 16384 2024-09-12T00:59:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faacc304740 1 Processor -- start 2024-09-12T00:59:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faacc304740 1 -- start start 2024-09-12T00:59:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faacc304740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faacc304740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faacc304740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627ed370 0x556062801ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faacc304740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faac41b2640 con 0x5560627e25d0 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faacc304740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faac41afe80 con 0x5560627ed370 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faacc304740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faac41adcd0 con 0x5560627e3b40 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627e98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50656/0 (socket says 172.21.15.2:50656) 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac2ffd640 1 -- 172.21.15.2:0/150002507 learned_addr learned my addr 172.21.15.2:0/150002507 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac37fe640 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac2ffd640 1 -- 172.21.15.2:0/150002507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 msgr2=0x5560627ddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac2ffd640 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac2ffd640 1 -- 172.21.15.2:0/150002507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627ed370 msgr2=0x556062801ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac2ffd640 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627ed370 0x556062801ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac2ffd640 1 -- 172.21.15.2:0/150002507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560627e8560 con 0x5560627e25d0 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.319+0000 7faac37fe640 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.320+0000 7faac2ffd640 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627e98d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7faab800db00 tx=0x7faab8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156bb24e4d600dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.320+0000 7faaa97fa640 1 -- 172.21.15.2:0/150002507 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8034070 con 0x5560627e25d0 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.320+0000 7faaa97fa640 1 -- 172.21.15.2:0/150002507 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab801d430 con 0x5560627e25d0 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.320+0000 7faaa97fa640 1 -- 172.21.15.2:0/150002507 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab801da50 con 0x5560627e25d0 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 -- 172.21.15.2:0/150002507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 msgr2=0x5560627e98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627e98d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7faab800db00 tx=0x7faab8004730 comp rx=0 tx=0).stop 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 -- 172.21.15.2:0/150002507 shutdown_connections 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627ed370 0x556062801ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627e3b40 0x5560627ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 --2- 172.21.15.2:0/150002507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e25d0 0x5560627e98d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 -- 172.21.15.2:0/150002507 >> 172.21.15.2:0/150002507 conn(0x5560627ab310 msgr2=0x5560627dd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 -- 172.21.15.2:0/150002507 shutdown_connections 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 -- 172.21.15.2:0/150002507 wait complete. 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 -- start start 2024-09-12T00:59:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.321+0000 7faacc304740 1 Processor -- start 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faacc304740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e25d0 0x5560627ff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faacc304740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e3b40 0x5560627ff580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faacc304740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627ed370 0x5560628657c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faacc304740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faac41ae340 con 0x5560627e3b40 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faacc304740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faac41af7b0 con 0x5560627e25d0 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faacc304740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faac41aea10 con 0x5560627ed370 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faacc304740 10 client.0 _ll_register_callbacks cb 0x7faab800dde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e3b40 0x5560627ff580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e3b40 0x5560627ff580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50662/0 (socket says 172.21.15.2:50662) 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 -- 172.21.15.2:0/1785310170 learned_addr learned my addr 172.21.15.2:0/1785310170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac2ffd640 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627ed370 0x5560628657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac2ffd640 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e25d0 0x5560627ff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 -- 172.21.15.2:0/1785310170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627ed370 msgr2=0x5560628657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627ed370 0x5560628657c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 -- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e25d0 msgr2=0x5560627ff040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e25d0 0x5560627ff040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 -- 172.21.15.2:0/1785310170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556062865d00 con 0x5560627e3b40 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac2ffd640 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e25d0 0x5560627ff040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faac37fe640 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e3b40 0x5560627ff580 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7faab40092a0 tx=0x7faab4031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aa6bbada67a01b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faaa2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.322+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1785310170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4035040 con 0x5560627e3b40 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1785310170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7faab4031b80 con 0x5560627e3b40 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 1 -- 172.21.15.2:0/1785310170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab801d430 con 0x5560627e3b40 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1785310170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faab4053050 con 0x5560627e3b40 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 10 client.17085 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 1 -- 172.21.15.2:0/1785310170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556062866e50 con 0x5560627e3b40 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1785310170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab801d430 con 0x5560627e3b40 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1785310170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7faab4004bc0 con 0x5560627e3b40 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 10 client.17085 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 10 client.17085 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 20 client.17085 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x556062867660 0x556062869a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 4 client.17085 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.323+0000 7faacc304740 1 -- 172.21.15.2:0/1785310170 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55606274fd70 con 0x556062867660 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faac2ffd640 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x556062867660 0x556062869a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faac2ffd640 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x556062867660 0x556062869a80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6abfbb94f86b2dd0 server_cookie=3099a13ea9ec4cb7 in_seq=0 out_seq=0 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faaa2ffd640 10 client.17085 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faaa2ffd640 1 -- 172.21.15.2:0/1785310170 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55606274fd70 con 0x556062867660 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faaa2ffd640 10 client.17085 handle_command_reply: tid=0 2024-09-12T00:59:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 client.17085 shutdown 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 -- 172.21.15.2:0/1785310170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e3b40 msgr2=0x5560627ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e3b40 0x5560627ff580 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7faab40092a0 tx=0x7faab4031540 comp rx=0 tx=0).stop 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 -- 172.21.15.2:0/1785310170 shutdown_connections 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x556062867660 0x556062869a80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560627ed370 0x5560628657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560627e3b40 0x5560627ff580 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 --2- 172.21.15.2:0/1785310170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560627e25d0 0x5560627ff040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 -- 172.21.15.2:0/1785310170 >> 172.21.15.2:0/1785310170 conn(0x5560627ab310 msgr2=0x5560627ddd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faaa2ffd640 0 client.17085 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T00:59:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 -- 172.21.15.2:0/1785310170 shutdown_connections 2024-09-12T00:59:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.324+0000 7faacc304740 1 -- 172.21.15.2:0/1785310170 wait complete. 2024-09-12T00:59:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faacc304740 20 client.17085 trim_cache size 0 max 16384 2024-09-12T00:59:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 -- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faaac0a2d70 msgr2=0x7faaac0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faaac0a2d70 0x7faaac0a5230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faabc0cc160 tx=0x7faabc004a40 comp rx=0 tx=0).stop 2024-09-12T00:59:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 -- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4102ef0 msgr2=0x7faac40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7faabc00b970 tx=0x7faabc00be30 comp rx=0 tx=0).stop 2024-09-12T00:59:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 -- 172.21.15.2:0/523534495 shutdown_connections 2024-09-12T00:59:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7faaac0a2d70 0x7faaac0a5230 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 --2- 172.21.15.2:0/523534495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 -- 172.21.15.2:0/523534495 >> 172.21.15.2:0/523534495 conn(0x7faac40fc7d0 msgr2=0x7faac406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.325+0000 7faac9f2b640 1 -- 172.21.15.2:0/523534495 shutdown_connections 2024-09-12T00:59:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:55.326+0000 7faac9f2b640 1 -- 172.21.15.2:0/523534495 wait complete. 2024-09-12T00:59:56.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:59:56.309 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:56.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:56 smithi002 ceph-mon[31210]: pgmap v213: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 -- 172.21.15.2:0/3918493953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 msgr2=0x7f230410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 --2- 172.21.15.2:0/3918493953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 0x7f230410da40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009900 tx=0x7f22fc02a480 comp rx=0 tx=0).stop 2024-09-12T00:59:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 -- 172.21.15.2:0/3918493953 shutdown_connections 2024-09-12T00:59:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 --2- 172.21.15.2:0/3918493953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 0x7f230410da40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 --2- 172.21.15.2:0/3918493953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2304102570 0x7f23041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 --2- 172.21.15.2:0/3918493953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304100e20 0x7f2304101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 -- 172.21.15.2:0/3918493953 >> 172.21.15.2:0/3918493953 conn(0x7f23040fc7d0 msgr2=0x7f23040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 -- 172.21.15.2:0/3918493953 shutdown_connections 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.752+0000 7f230c090640 1 -- 172.21.15.2:0/3918493953 wait complete. 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230c090640 1 Processor -- start 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230c090640 1 -- start start 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230c090640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2304100e20 0x7f2304197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230c090640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304102570 0x7f2304197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230c090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 0x7f230419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230c090640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2304110f80 con 0x7f2304102ef0 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230c090640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2304110e00 con 0x7f2304102570 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230c090640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2304111100 con 0x7f2304100e20 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230a62d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 0x7f230419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230a62d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 0x7f230419bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34312/0 (socket says 172.21.15.2:34312) 2024-09-12T00:59:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230a62d640 1 -- 172.21.15.2:0/3932067922 learned_addr learned my addr 172.21.15.2:0/3932067922 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f2309e2c640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2304100e20 0x7f2304197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.753+0000 7f230962b640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304102570 0x7f2304197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230a62d640 1 -- 172.21.15.2:0/3932067922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2304100e20 msgr2=0x7f2304197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230a62d640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2304100e20 0x7f2304197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230a62d640 1 -- 172.21.15.2:0/3932067922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304102570 msgr2=0x7f2304197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230a62d640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304102570 0x7f2304197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230a62d640 1 -- 172.21.15.2:0/3932067922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230419c3b0 con 0x7f2304102ef0 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230962b640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304102570 0x7f2304197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230a62d640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 0x7f230419bcd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f22fc004770 tx=0x7f22fc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f2302ffd640 1 -- 172.21.15.2:0/3932067922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc035070 con 0x7f2304102ef0 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f2302ffd640 1 -- 172.21.15.2:0/3932067922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22fc031a20 con 0x7f2304102ef0 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f2302ffd640 1 -- 172.21.15.2:0/3932067922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc038a60 con 0x7f2304102ef0 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230c090640 1 -- 172.21.15.2:0/3932067922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230419c640 con 0x7f2304102ef0 2024-09-12T00:59:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.754+0000 7f230c090640 1 -- 172.21.15.2:0/3932067922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2304069f70 con 0x7f2304102ef0 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.757+0000 7f2302ffd640 1 -- 172.21.15.2:0/3932067922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f22fc031bd0 con 0x7f2304102ef0 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.757+0000 7f230e469740 1 Processor -- start 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.757+0000 7f230e469740 1 -- start start 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f230e469740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ac6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f230e469740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f230e469740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 0x5628f0ad7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f230e469740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5628f0a2c2f0 con 0x5628f0ac65d0 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f230e469740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5628f09d3cf0 con 0x5628f0ac7b40 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f230e469740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628f0a282b0 con 0x5628f0ad5780 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34324/0 (socket says 172.21.15.2:34324) 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 -- 172.21.15.2:0/2917505314 learned_addr learned my addr 172.21.15.2:0/2917505314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f230962b640 1 --2- 172.21.15.2:0/2917505314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ac6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 -- 172.21.15.2:0/2917505314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 msgr2=0x5628f0ad7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 --2- 172.21.15.2:0/2917505314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 0x5628f0ad7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 -- 172.21.15.2:0/2917505314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 msgr2=0x5628f0ac6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 --2- 172.21.15.2:0/2917505314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ac6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 -- 172.21.15.2:0/2917505314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f09b83a0 con 0x5628f0ac65d0 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2302ffd640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f22ec0a2d70 0x7f22ec0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f230962b640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f22ec0a2d70 0x7f22ec0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2309e2c640 1 --2- 172.21.15.2:0/2917505314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac6a10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f22f40114f0 tx=0x7f22f40119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d66fe75f439fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f2302ffd640 1 -- 172.21.15.2:0/3932067922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f22fc0f1510 con 0x7f2304102ef0 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.758+0000 7f22ebfff640 1 -- 172.21.15.2:0/2917505314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f401e070 con 0x5628f0ac65d0 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f22ebfff640 1 -- 172.21.15.2:0/2917505314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22f400fb00 con 0x5628f0ac65d0 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f22ebfff640 1 -- 172.21.15.2:0/2917505314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4019bf0 con 0x5628f0ac65d0 2024-09-12T00:59:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 -- 172.21.15.2:0/2917505314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 msgr2=0x5628f0ac6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 --2- 172.21.15.2:0/2917505314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac6a10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f22f40114f0 tx=0x7f22f40119b0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230962b640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f22ec0a2d70 0x7f22ec0a5230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5628f0ac7070 tx=0x7f22f800c470 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 -- 172.21.15.2:0/2917505314 shutdown_connections 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 --2- 172.21.15.2:0/2917505314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 0x5628f0ad7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 --2- 172.21.15.2:0/2917505314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac6a10 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 --2- 172.21.15.2:0/2917505314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ac6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 -- 172.21.15.2:0/2917505314 >> 172.21.15.2:0/2917505314 conn(0x5628f0a8f310 msgr2=0x5628f0ac2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 -- 172.21.15.2:0/2917505314 shutdown_connections 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.759+0000 7f230e469740 1 -- 172.21.15.2:0/2917505314 wait complete. 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 1 -- start start 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 1 Processor -- start 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ad5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0ad2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 0x5628f0ad29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5628f0ad8480 con 0x5628f0ac65d0 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5628f09e7060 con 0x5628f0ad5780 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628f0ad8600 con 0x5628f0ac7b40 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f230e469740 10 client.0 _ll_register_callbacks cb 0x5628f073a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f2309e2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ad5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f2309e2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ad5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34330/0 (socket says 172.21.15.2:34330) 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.760+0000 7f2309e2c640 1 -- 172.21.15.2:0/3272497981 learned_addr learned my addr 172.21.15.2:0/3272497981 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f230a62d640 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 0x5628f0ad29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f230962b640 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0ad2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f2309e2c640 1 -- 172.21.15.2:0/3272497981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 msgr2=0x5628f0ad2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f2309e2c640 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0ad2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f2309e2c640 1 -- 172.21.15.2:0/3272497981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 msgr2=0x5628f0ad29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f2309e2c640 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 0x5628f0ad29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f2309e2c640 1 -- 172.21.15.2:0/3272497981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f079d3c0 con 0x5628f0ac65d0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f2309e2c640 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ad5150 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f22f4019850 tx=0x7f22f4019410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca9714c3df5a723 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f22e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f22e97fa640 1 -- 172.21.15.2:0/3272497981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f401e070 con 0x5628f0ac65d0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f22e97fa640 1 -- 172.21.15.2:0/3272497981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f22f4004c50 con 0x5628f0ac65d0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f230e469740 1 -- 172.21.15.2:0/3272497981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22f400fb00 con 0x5628f0ac65d0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f22e97fa640 1 -- 172.21.15.2:0/3272497981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f22f4031050 con 0x5628f0ac65d0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f230e469740 10 client.17097 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.761+0000 7f230e469740 1 -- 172.21.15.2:0/3272497981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5628f0ae3ef0 con 0x5628f0ac65d0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f22e97fa640 1 -- 172.21.15.2:0/3272497981 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22f400fb00 con 0x5628f0ac65d0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f22e97fa640 1 -- 172.21.15.2:0/3272497981 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f22f402c030 con 0x5628f0ac65d0 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f230e469740 10 client.17097 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f230e469740 10 client.17097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f230e469740 20 client.17097 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f230e469740 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5628f0ae52f0 0x5628f0ae76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f230e469740 4 client.17097 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f230e469740 1 -- 172.21.15.2:0/3272497981 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628f0a39860 con 0x5628f0ae52f0 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.762+0000 7f230962b640 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5628f0ae52f0 0x5628f0ae76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.763+0000 7f22e97fa640 10 client.17097 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.763+0000 7f230962b640 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5628f0ae52f0 0x5628f0ae76e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc6ac5abba07483e server_cookie=784629ba2ba44307 in_seq=0 out_seq=0 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.763+0000 7f22e97fa640 1 -- 172.21.15.2:0/3272497981 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628f0a39860 con 0x5628f0ae52f0 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.763+0000 7f22e97fa640 10 client.17097 handle_command_reply: tid=0 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.763+0000 7f230e469740 1 client.17097 shutdown 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.763+0000 7f230e469740 1 -- 172.21.15.2:0/3272497981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 msgr2=0x5628f0ad5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ad5150 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f22f4019850 tx=0x7f22f4019410 comp rx=0 tx=0).stop 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 -- 172.21.15.2:0/3272497981 shutdown_connections 2024-09-12T00:59:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5628f0ae52f0 0x5628f0ae76e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 0x5628f0ad29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0ad2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 --2- 172.21.15.2:0/3272497981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ad5150 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f22e97fa640 0 client.17097 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 -- 172.21.15.2:0/3272497981 >> 172.21.15.2:0/3272497981 conn(0x5628f0a8f310 msgr2=0x5628f0ac8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 -- 172.21.15.2:0/3272497981 shutdown_connections 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 1 -- 172.21.15.2:0/3272497981 wait complete. 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.764+0000 7f230e469740 20 client.17097 trim_cache size 0 max 16384 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230e469740 1 Processor -- start 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230e469740 1 -- start start 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230e469740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230e469740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ae1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230e469740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 0x5628f0aeceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230e469740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23041ae140 con 0x5628f0ac65d0 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230e469740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23041ab980 con 0x5628f0ac7b40 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230e469740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23041a97d0 con 0x5628f0ad5780 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34346/0 (socket says 172.21.15.2:34346) 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 -- 172.21.15.2:0/9539514 learned_addr learned my addr 172.21.15.2:0/9539514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230a62d640 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 0x5628f0aeceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 -- 172.21.15.2:0/9539514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 msgr2=0x5628f0aeceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 0x5628f0aeceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 -- 172.21.15.2:0/9539514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 msgr2=0x5628f0ae1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230962b640 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ae1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ae1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 -- 172.21.15.2:0/9539514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f0ad4d70 con 0x5628f0ac65d0 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f230962b640 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ae1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.777+0000 7f2309e2c640 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac2e10 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f22f4005420 tx=0x7f22f4004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df5d3f2f4860438 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f22eb7fe640 1 -- 172.21.15.2:0/9539514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f401e070 con 0x5628f0ac65d0 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f22eb7fe640 1 -- 172.21.15.2:0/9539514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22f4009b50 con 0x5628f0ac65d0 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f22eb7fe640 1 -- 172.21.15.2:0/9539514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4019480 con 0x5628f0ac65d0 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 -- 172.21.15.2:0/9539514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 msgr2=0x5628f0ac2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac2e10 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f22f4005420 tx=0x7f22f4004980 comp rx=0 tx=0).stop 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 -- 172.21.15.2:0/9539514 shutdown_connections 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ad5780 0x5628f0aeceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ac7b40 0x5628f0ae1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 --2- 172.21.15.2:0/9539514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ac2e10 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 -- 172.21.15.2:0/9539514 >> 172.21.15.2:0/9539514 conn(0x5628f0a8f310 msgr2=0x5628f0ac2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 -- 172.21.15.2:0/9539514 shutdown_connections 2024-09-12T00:59:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.778+0000 7f230e469740 1 -- 172.21.15.2:0/9539514 wait complete. 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 1 -- start start 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 1 Processor -- start 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ade0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0acf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 0x5628f0acf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23041a9e40 con 0x5628f0ac65d0 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23041ab2b0 con 0x5628f0ad5780 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23041aa510 con 0x5628f0ac7b40 2024-09-12T00:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230e469740 10 client.0 _ll_register_callbacks cb 0x7f22f401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f2309e2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ade0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f2309e2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ade0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34354/0 (socket says 172.21.15.2:34354) 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f2309e2c640 1 -- 172.21.15.2:0/3804326166 learned_addr learned my addr 172.21.15.2:0/3804326166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230962b640 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0acf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.779+0000 7f230a62d640 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 0x5628f0acf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f2309e2c640 1 -- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 msgr2=0x5628f0acf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f2309e2c640 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0acf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f2309e2c640 1 -- 172.21.15.2:0/3804326166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 msgr2=0x5628f0acf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f2309e2c640 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 0x5628f0acf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f2309e2c640 1 -- 172.21.15.2:0/3804326166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f0ad0060 con 0x5628f0ac65d0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f230962b640 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0acf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f2309e2c640 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ade0e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f22f40119f0 tx=0x7f22f4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dd07e436ee8ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f22e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f22e97fa640 1 -- 172.21.15.2:0/3804326166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f401e050 con 0x5628f0ac65d0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f22e97fa640 1 -- 172.21.15.2:0/3804326166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f22f4024440 con 0x5628f0ac65d0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f230e469740 1 -- 172.21.15.2:0/3804326166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22f4009b50 con 0x5628f0ac65d0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f22e97fa640 1 -- 172.21.15.2:0/3804326166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f22f4004e60 con 0x5628f0ac65d0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f230e469740 10 client.17103 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f230e469740 1 -- 172.21.15.2:0/3804326166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5628f0b4fef0 con 0x5628f0ac65d0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f22e97fa640 1 -- 172.21.15.2:0/3804326166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22f4009b50 con 0x5628f0ac65d0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f22e97fa640 1 -- 172.21.15.2:0/3804326166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f22f402c040 con 0x5628f0ac65d0 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f230e469740 10 client.17103 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f230e469740 10 client.17103 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T00:59:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.780+0000 7f230e469740 20 client.17103 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f230e469740 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5628f0b504f0 0x5628f0b528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f230e469740 4 client.17103 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f230e469740 1 -- 172.21.15.2:0/3804326166 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628f0a33d70 con 0x5628f0b504f0 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f230962b640 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5628f0b504f0 0x5628f0b528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f230962b640 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5628f0b504f0 0x5628f0b528e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ef51191dad52b9c server_cookie=a88093380082f038 in_seq=0 out_seq=0 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f22e97fa640 10 client.17103 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f22e97fa640 1 -- 172.21.15.2:0/3804326166 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628f0a33d70 con 0x5628f0b504f0 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f22e97fa640 10 client.17103 handle_command_reply: tid=0 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.781+0000 7f230e469740 1 client.17103 shutdown 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 -- 172.21.15.2:0/3804326166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 msgr2=0x5628f0ade0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ade0e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f22f40119f0 tx=0x7f22f4005bd0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 -- 172.21.15.2:0/3804326166 shutdown_connections 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5628f0b504f0 0x5628f0b528e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f0ad5780 0x5628f0acf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f0ac7b40 0x5628f0acf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 --2- 172.21.15.2:0/3804326166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628f0ac65d0 0x5628f0ade0e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f22e97fa640 0 client.17103 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 -- 172.21.15.2:0/3804326166 >> 172.21.15.2:0/3804326166 conn(0x5628f0a8f310 msgr2=0x5628f0ac8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 -- 172.21.15.2:0/3804326166 shutdown_connections 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 1 -- 172.21.15.2:0/3804326166 wait complete. 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230e469740 20 client.17103 trim_cache size 0 max 16384 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 -- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f22ec0a2d70 msgr2=0x7f22ec0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f22ec0a2d70 0x7f22ec0a5230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5628f0ac7070 tx=0x7f22f800c470 comp rx=0 tx=0).stop 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 -- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 msgr2=0x7f230419bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 0x7f230419bcd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f22fc004770 tx=0x7f22fc003b90 comp rx=0 tx=0).stop 2024-09-12T00:59:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 -- 172.21.15.2:0/3932067922 shutdown_connections 2024-09-12T00:59:56.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f22ec0a2d70 0x7f22ec0a5230 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2304102ef0 0x7f230419bcd0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304102570 0x7f2304197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 --2- 172.21.15.2:0/3932067922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2304100e20 0x7f2304197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:56.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 -- 172.21.15.2:0/3932067922 >> 172.21.15.2:0/3932067922 conn(0x7f23040fc7d0 msgr2=0x7f2304106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:56.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 -- 172.21.15.2:0/3932067922 shutdown_connections 2024-09-12T00:59:56.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:56.782+0000 7f230c090640 1 -- 172.21.15.2:0/3932067922 wait complete. 2024-09-12T00:59:56.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:56 smithi071 ceph-mon[35276]: pgmap v213: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:57.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:56 smithi167 ceph-mon[35234]: pgmap v213: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T00:59:57.533 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:59:57.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:59:58.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 -- 172.21.15.2:0/3250839553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 msgr2=0x7f48d8107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/3250839553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 0x7f48d8107b80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009930 tx=0x7f48c002a420 comp rx=0 tx=0).stop 2024-09-12T00:59:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 -- 172.21.15.2:0/3250839553 shutdown_connections 2024-09-12T00:59:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/3250839553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8108290 0x7f48d810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/3250839553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 0x7f48d8107b80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/3250839553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d8102d90 0x7f48d8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 -- 172.21.15.2:0/3250839553 >> 172.21.15.2:0/3250839553 conn(0x7f48d80fc7d0 msgr2=0x7f48d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 -- 172.21.15.2:0/3250839553 shutdown_connections 2024-09-12T00:59:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 -- 172.21.15.2:0/3250839553 wait complete. 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 Processor -- start 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.183+0000 7f48ddc3a640 1 -- start start 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48ddc3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8102d90 0x7f48d81a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48ddc3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 0x7f48d81a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48ddc3a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d8108290 0x7f48d819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48ddc3a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8112090 con 0x7f48d8103740 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48ddc3a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8111f10 con 0x7f48d8108290 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48ddc3a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8112210 con 0x7f48d8102d90 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 0x7f48d81a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 0x7f48d81a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34360/0 (socket says 172.21.15.2:34360) 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d6ffd640 1 -- 172.21.15.2:0/1698556737 learned_addr learned my addr 172.21.15.2:0/1698556737 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d77fe640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8102d90 0x7f48d81a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d7fff640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d8108290 0x7f48d819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d6ffd640 1 -- 172.21.15.2:0/1698556737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8102d90 msgr2=0x7f48d81a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8102d90 0x7f48d81a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d6ffd640 1 -- 172.21.15.2:0/1698556737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d8108290 msgr2=0x7f48d819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d8108290 0x7f48d819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.184+0000 7f48d6ffd640 1 -- 172.21.15.2:0/1698556737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d819ad30 con 0x7f48d8103740 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.185+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 0x7f48d81a0980 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005940 tx=0x7f48c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.185+0000 7f48d4ff9640 1 -- 172.21.15.2:0/1698556737 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c003f030 con 0x7f48d8103740 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.185+0000 7f48d4ff9640 1 -- 172.21.15.2:0/1698556737 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48c0003ce0 con 0x7f48d8103740 2024-09-12T00:59:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.185+0000 7f48ddc3a640 1 -- 172.21.15.2:0/1698556737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d819afc0 con 0x7f48d8103740 2024-09-12T00:59:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.185+0000 7f48d4ff9640 1 -- 172.21.15.2:0/1698556737 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0035070 con 0x7f48d8103740 2024-09-12T00:59:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.185+0000 7f48ddc3a640 1 -- 172.21.15.2:0/1698556737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d81a7310 con 0x7f48d8103740 2024-09-12T00:59:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.187+0000 7f48d4ff9640 1 -- 172.21.15.2:0/1698556737 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f48c0042030 con 0x7f48d8103740 2024-09-12T00:59:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48e0013740 1 Processor -- start 2024-09-12T00:59:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48e0013740 1 -- start start 2024-09-12T00:59:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48e0013740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a7f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48e0013740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a7fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48e0013740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a8a370 0x560311a8c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48e0013740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5603119e52f0 con 0x560311a80b40 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48e0013740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56031198ccf0 con 0x560311a8a370 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48e0013740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5603119e12b0 con 0x560311a7f5d0 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a7f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a7f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34372/0 (socket says 172.21.15.2:34372) 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48d7fff640 1 -- 172.21.15.2:0/1261338128 learned_addr learned my addr 172.21.15.2:0/1261338128 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48d77fe640 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a7fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a8a370 0x560311a8c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48d7fff640 1 -- 172.21.15.2:0/1261338128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 msgr2=0x560311a7fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48d7fff640 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a7fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.188+0000 7f48d7fff640 1 -- 172.21.15.2:0/1261338128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a8a370 msgr2=0x560311a8c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48d7fff640 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a8a370 0x560311a8c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48d7fff640 1 -- 172.21.15.2:0/1261338128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603119713a0 con 0x560311a80b40 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48d77fe640 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a7fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a8a370 0x560311a8c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48d4ff9640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f48c40a2cf0 0x7f48c40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48d7fff640 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a7f090 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f48d000bba0 tx=0x7f48d000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f1612bda831a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48d77fe640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f48c40a2cf0 0x7f48c40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48d4ff9640 1 -- 172.21.15.2:0/1698556737 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f48c00ef6b0 con 0x7f48d8103740 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48cdffb640 1 -- 172.21.15.2:0/1261338128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0015070 con 0x560311a80b40 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48cdffb640 1 -- 172.21.15.2:0/1261338128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48d0005500 con 0x560311a80b40 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.189+0000 7f48cdffb640 1 -- 172.21.15.2:0/1261338128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d00116a0 con 0x560311a80b40 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 -- 172.21.15.2:0/1261338128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 msgr2=0x560311a7f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48d77fe640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f48c40a2cf0 0x7f48c40a51b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x560311a7cac0 tx=0x7f48c800a590 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a7f090 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f48d000bba0 tx=0x7f48d000f730 comp rx=0 tx=0).stop 2024-09-12T00:59:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 -- 172.21.15.2:0/1261338128 shutdown_connections 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a8a370 0x560311a8c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a7fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 --2- 172.21.15.2:0/1261338128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a7f090 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 -- 172.21.15.2:0/1261338128 >> 172.21.15.2:0/1261338128 conn(0x560311a48310 msgr2=0x560311a7bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 -- 172.21.15.2:0/1261338128 shutdown_connections 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 -- 172.21.15.2:0/1261338128 wait complete. 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.190+0000 7f48e0013740 1 -- start start 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48e0013740 1 Processor -- start 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48e0013740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a7f5d0 0x560311a89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48e0013740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48e0013740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a874d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48e0013740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560311a8d070 con 0x560311a80b40 2024-09-12T00:59:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48e0013740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5603119a0060 con 0x560311a7f5d0 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48e0013740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560311a8d1f0 con 0x560311a8a370 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a86f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34380/0 (socket says 172.21.15.2:34380) 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48d6ffd640 1 -- 172.21.15.2:0/1223045018 learned_addr learned my addr 172.21.15.2:0/1223045018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48e0013740 10 client.0 _ll_register_callbacks cb 0x5603116f38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48d77fe640 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a7f5d0 0x560311a89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48d7fff640 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a874d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48d6ffd640 1 -- 172.21.15.2:0/1223045018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 msgr2=0x560311a874d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a874d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.191+0000 7f48d6ffd640 1 -- 172.21.15.2:0/1223045018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a7f5d0 msgr2=0x560311a89cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a7f5d0 0x560311a89cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48d6ffd640 1 -- 172.21.15.2:0/1223045018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603117563c0 con 0x560311a80b40 2024-09-12T00:59:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48d7fff640 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a874d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a86f70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009900 tx=0x7f48c00bb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429d6b83cf86a970 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48b6ffd640 1 -- 172.21.15.2:0/1223045018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0049040 con 0x560311a80b40 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48b6ffd640 1 -- 172.21.15.2:0/1223045018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f48c00b81f0 con 0x560311a80b40 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48e0013740 1 -- 172.21.15.2:0/1223045018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d0005500 con 0x560311a80b40 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48b6ffd640 1 -- 172.21.15.2:0/1223045018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f48c00bc280 con 0x560311a80b40 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48e0013740 10 client.17115 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48e0013740 1 -- 172.21.15.2:0/1223045018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560311a98a20 con 0x560311a80b40 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48b6ffd640 1 -- 172.21.15.2:0/1223045018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48d0005500 con 0x560311a80b40 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.192+0000 7f48b6ffd640 1 -- 172.21.15.2:0/1223045018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f48c0031bd0 con 0x560311a80b40 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48e0013740 10 client.17115 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48e0013740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48e0013740 20 client.17115 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48e0013740 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560311a99e80 0x560311a9c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48e0013740 4 client.17115 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48e0013740 1 -- 172.21.15.2:0/1223045018 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603119f2860 con 0x560311a99e80 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48d77fe640 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560311a99e80 0x560311a9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48b6ffd640 10 client.17115 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.193+0000 7f48d77fe640 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560311a99e80 0x560311a9c270 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cd113abf182eef server_cookie=a89390d3bdc6d1be in_seq=0 out_seq=0 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48b6ffd640 1 -- 172.21.15.2:0/1223045018 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603119f2860 con 0x560311a99e80 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48b6ffd640 10 client.17115 handle_command_reply: tid=0 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 client.17115 shutdown 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 -- 172.21.15.2:0/1223045018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 msgr2=0x560311a86f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a86f70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009900 tx=0x7f48c00bb6c0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 -- 172.21.15.2:0/1223045018 shutdown_connections 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560311a99e80 0x560311a9c270 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a874d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a80b40 0x560311a86f70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 --2- 172.21.15.2:0/1223045018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a7f5d0 0x560311a89cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48b6ffd640 0 client.17115 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.194+0000 7f48e0013740 1 -- 172.21.15.2:0/1223045018 >> 172.21.15.2:0/1223045018 conn(0x560311a48310 msgr2=0x560311a81930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.195+0000 7f48e0013740 1 -- 172.21.15.2:0/1223045018 shutdown_connections 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.195+0000 7f48e0013740 1 -- 172.21.15.2:0/1223045018 wait complete. 2024-09-12T00:59:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.195+0000 7f48e0013740 20 client.17115 trim_cache size 0 max 16384 2024-09-12T00:59:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48e0013740 1 Processor -- start 2024-09-12T00:59:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48e0013740 1 -- start start 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48e0013740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a96340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48e0013740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 0x560311a88ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48e0013740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a8a370 0x560311aa1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48e0013740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81b25b0 con 0x560311a8a370 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48e0013740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81afdf0 con 0x560311a80b40 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48e0013740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81adc40 con 0x560311a7f5d0 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a8a370 0x560311aa1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a8a370 0x560311aa1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34390/0 (socket says 172.21.15.2:34390) 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 -- 172.21.15.2:0/754385849 learned_addr learned my addr 172.21.15.2:0/754385849 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d77fe640 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a96340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 0x560311a88ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 -- 172.21.15.2:0/754385849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 msgr2=0x560311a96340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a96340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 -- 172.21.15.2:0/754385849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 msgr2=0x560311a88ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 0x560311a88ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 -- 172.21.15.2:0/754385849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560311a7a310 con 0x560311a8a370 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d77fe640 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a96340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.208+0000 7f48d7fff640 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a8a370 0x560311aa1b80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f48d0018000 tx=0x7f48d000b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7eeefb8eff7e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48cd7fa640 1 -- 172.21.15.2:0/754385849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0027070 con 0x560311a8a370 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48cd7fa640 1 -- 172.21.15.2:0/754385849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48d000bc90 con 0x560311a8a370 2024-09-12T00:59:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48cd7fa640 1 -- 172.21.15.2:0/754385849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0015050 con 0x560311a8a370 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 -- 172.21.15.2:0/754385849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a8a370 msgr2=0x560311aa1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a8a370 0x560311aa1b80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f48d0018000 tx=0x7f48d000b450 comp rx=0 tx=0).stop 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 -- 172.21.15.2:0/754385849 shutdown_connections 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a8a370 0x560311aa1b80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 0x560311a88ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 --2- 172.21.15.2:0/754385849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a7f5d0 0x560311a96340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 -- 172.21.15.2:0/754385849 >> 172.21.15.2:0/754385849 conn(0x560311a48310 msgr2=0x560311a887d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 -- 172.21.15.2:0/754385849 shutdown_connections 2024-09-12T00:59:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.209+0000 7f48e0013740 1 -- 172.21.15.2:0/754385849 wait complete. 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 1 -- start start 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 1 Processor -- start 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a7f5d0 0x560311a8e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 0x560311a8e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a8ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81ae2b0 con 0x560311a7f5d0 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81af720 con 0x560311a80b40 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81ae980 con 0x560311a8a370 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48e0013740 10 client.0 _ll_register_callbacks cb 0x7f48c0031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a7f5d0 0x560311a8e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a7f5d0 0x560311a8e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34402/0 (socket says 172.21.15.2:34402) 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48d6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 0x560311a8e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48d77fe640 1 -- 172.21.15.2:0/3586618746 learned_addr learned my addr 172.21.15.2:0/3586618746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.210+0000 7f48d7fff640 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a8ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48d77fe640 1 -- 172.21.15.2:0/3586618746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 msgr2=0x560311a8ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48d77fe640 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a8ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48d77fe640 1 -- 172.21.15.2:0/3586618746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 msgr2=0x560311a8e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48d77fe640 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 0x560311a8e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48d77fe640 1 -- 172.21.15.2:0/3586618746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560311a7cdd0 con 0x560311a7f5d0 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48d77fe640 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a7f5d0 0x560311a8e3d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f48c8005c40 tx=0x7f48c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abff632b67b09e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48b6ffd640 1 -- 172.21.15.2:0/3586618746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c802c070 con 0x560311a7f5d0 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48b6ffd640 1 -- 172.21.15.2:0/3586618746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f48c8027450 con 0x560311a7f5d0 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48e0013740 1 -- 172.21.15.2:0/3586618746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d000bc90 con 0x560311a7f5d0 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48b6ffd640 1 -- 172.21.15.2:0/3586618746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f48c8034050 con 0x560311a7f5d0 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48e0013740 10 client.17121 fetch_fsmap learned FSMap version 32 2024-09-12T00:59:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.211+0000 7f48e0013740 1 -- 172.21.15.2:0/3586618746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560311b04e80 con 0x560311a7f5d0 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48b6ffd640 1 -- 172.21.15.2:0/3586618746 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48d000bc90 con 0x560311a7f5d0 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48b6ffd640 1 -- 172.21.15.2:0/3586618746 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f48c802f030 con 0x560311a7f5d0 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48e0013740 10 client.17121 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48e0013740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48e0013740 20 client.17121 populate_metadata read hostname 'smithi002' 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48e0013740 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560311b05600 0x560311b07a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48e0013740 4 client.17121 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48e0013740 1 -- 172.21.15.2:0/3586618746 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603119ecd70 con 0x560311b05600 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560311b05600 0x560311b07a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48d6ffd640 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560311b05600 0x560311b07a20 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642b00def5e561f server_cookie=23d3a3ea280ec7b0 in_seq=0 out_seq=0 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.212+0000 7f48b6ffd640 10 client.17121 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48b6ffd640 1 -- 172.21.15.2:0/3586618746 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603119ecd70 con 0x560311b05600 2024-09-12T00:59:58.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48b6ffd640 10 client.17121 handle_command_reply: tid=0 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 client.17121 shutdown 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 -- 172.21.15.2:0/3586618746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a7f5d0 msgr2=0x560311a8e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a7f5d0 0x560311a8e3d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f48c8005c40 tx=0x7f48c8004a40 comp rx=0 tx=0).stop 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 -- 172.21.15.2:0/3586618746 shutdown_connections 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x560311b05600 0x560311b07a20 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560311a8a370 0x560311a8ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560311a80b40 0x560311a8e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 --2- 172.21.15.2:0/3586618746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560311a7f5d0 0x560311a8e3d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 -- 172.21.15.2:0/3586618746 >> 172.21.15.2:0/3586618746 conn(0x560311a48310 msgr2=0x560311a7ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48b6ffd640 0 client.17121 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 -- 172.21.15.2:0/3586618746 shutdown_connections 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 1 -- 172.21.15.2:0/3586618746 wait complete. 2024-09-12T00:59:58.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.213+0000 7f48e0013740 20 client.17121 trim_cache size 0 max 16384 2024-09-12T00:59:58.218 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T00:59:58.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 -- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f48c40a2cf0 msgr2=0x7f48c40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f48c40a2cf0 0x7f48c40a51b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x560311a7cac0 tx=0x7f48c800a590 comp rx=0 tx=0).stop 2024-09-12T00:59:58.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 -- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 msgr2=0x7f48d81a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:59:58.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 0x7f48d81a0980 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005940 tx=0x7f48c00042f0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 -- 172.21.15.2:0/1698556737 shutdown_connections 2024-09-12T00:59:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f48c40a2cf0 0x7f48c40a51b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48d8108290 0x7f48d819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d8103740 0x7f48d81a0980 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 --2- 172.21.15.2:0/1698556737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8102d90 0x7f48d81a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:59:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 -- 172.21.15.2:0/1698556737 >> 172.21.15.2:0/1698556737 conn(0x7f48d80fc7d0 msgr2=0x7f48d8100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:59:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 -- 172.21.15.2:0/1698556737 shutdown_connections 2024-09-12T00:59:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T00:59:58.214+0000 7f48ddc3a640 1 -- 172.21.15.2:0/1698556737 wait complete. 2024-09-12T00:59:58.935 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 00:59:58 smithi002 ceph-mon[31210]: pgmap v214: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T00:59:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 00:59:58 smithi071 ceph-mon[35276]: pgmap v214: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T00:59:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 00:59:58 smithi167 ceph-mon[35234]: pgmap v214: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T00:59:59.967 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:59:59.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:00:00.241 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 -- 172.21.15.2:0/810850068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b40106f20 msgr2=0x7f4b4010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 --2- 172.21.15.2:0/810850068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b40106f20 0x7f4b4010eaa0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009ca0 tx=0x7f4b3802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 -- 172.21.15.2:0/810850068 shutdown_connections 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 --2- 172.21.15.2:0/810850068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b40106f20 0x7f4b4010eaa0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 --2- 172.21.15.2:0/810850068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b401027a0 0x7f4b401067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 --2- 172.21.15.2:0/810850068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b40101df0 0x7f4b401021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 -- 172.21.15.2:0/810850068 >> 172.21.15.2:0/810850068 conn(0x7f4b400fd8b0 msgr2=0x7f4b400ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 -- 172.21.15.2:0/810850068 shutdown_connections 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.697+0000 7f4b44f15640 1 -- 172.21.15.2:0/810850068 wait complete. 2024-09-12T01:00:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.698+0000 7f4b44f15640 1 Processor -- start 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.698+0000 7f4b44f15640 1 -- start start 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.698+0000 7f4b44f15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b40101df0 0x7f4b401983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.698+0000 7f4b44f15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b401027a0 0x7f4b401988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b44f15640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b40106f20 0x7f4b4019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b44f15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b40111f80 con 0x7f4b401027a0 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b44f15640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b40111e00 con 0x7f4b40106f20 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b44f15640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4b40112100 con 0x7f4b40101df0 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b40101df0 0x7f4b401983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b401027a0 0x7f4b401988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b40106f20 0x7f4b4019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b40101df0 0x7f4b401983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:38734/0 (socket says 172.21.15.2:38734) 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b401027a0 0x7f4b401988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34418/0 (socket says 172.21.15.2:34418) 2024-09-12T01:00:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3774965883 learned_addr learned my addr 172.21.15.2:0/3774965883 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3774965883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b40106f20 msgr2=0x7f4b4019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b40106f20 0x7f4b4019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b401027a0 msgr2=0x7f4b401988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b401027a0 0x7f4b401988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3774965883 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4019d350 con 0x7f4b40101df0 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.699+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b40101df0 0x7f4b401983a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e9f0 tx=0x7f4b3000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.700+0000 7f4b377fe640 1 -- 172.21.15.2:0/3774965883 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000cd80 con 0x7f4b40101df0 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.700+0000 7f4b377fe640 1 -- 172.21.15.2:0/3774965883 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b30005500 con 0x7f4b40101df0 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.700+0000 7f4b44f15640 1 -- 172.21.15.2:0/3774965883 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4019d640 con 0x7f4b40101df0 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.700+0000 7f4b377fe640 1 -- 172.21.15.2:0/3774965883 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30010690 con 0x7f4b40101df0 2024-09-12T01:00:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.700+0000 7f4b44f15640 1 -- 172.21.15.2:0/3774965883 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b401a4f20 con 0x7f4b40101df0 2024-09-12T01:00:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.702+0000 7f4b377fe640 1 -- 172.21.15.2:0/3774965883 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f4b300046c0 con 0x7f4b40101df0 2024-09-12T01:00:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.702+0000 7f4b472ee740 1 Processor -- start 2024-09-12T01:00:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b472ee740 1 -- start start 2024-09-12T01:00:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fb7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b377fe640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4b2c0a2cf0 0x7f4b2c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b472ee740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cc2f1d280 con 0x561cc2fb7b60 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b472ee740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561cc2ec4b10 con 0x561cc2fc2d40 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b472ee740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561cc2f19240 con 0x561cc2fb8480 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fb7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fb7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34426/0 (socket says 172.21.15.2:34426) 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3770349345 learned_addr learned my addr 172.21.15.2:0/3770349345 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b37fff640 1 --2- 172.21.15.2:0/3770349345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.703+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4b2c0a2cf0 0x7f4b2c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b377fe640 1 -- 172.21.15.2:0/3774965883 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f4b300cf900 con 0x7f4b40101df0 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3770349345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 msgr2=0x561cc2fc5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3770349345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3770349345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 msgr2=0x561cc2fb7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3770349345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fb7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3770349345 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc2ed11f0 con 0x561cc2fb8480 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4b2c0a2cf0 0x7f4b2c0a51b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009a60 tx=0x7f4b38004a80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3770349345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc2800 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4b300ccfa0 tx=0x7f4b30004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb19c3f6c4bfa9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b34ff9640 1 -- 172.21.15.2:0/3770349345 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300a0120 con 0x561cc2fb8480 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b34ff9640 1 -- 172.21.15.2:0/3770349345 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b300a49e0 con 0x561cc2fb8480 2024-09-12T01:00:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.704+0000 7f4b34ff9640 1 -- 172.21.15.2:0/3770349345 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3009b1c0 con 0x561cc2fb8480 2024-09-12T01:00:00.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 -- 172.21.15.2:0/3770349345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 msgr2=0x561cc2fc2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3770349345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc2800 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4b300ccfa0 tx=0x7f4b30004a40 comp rx=0 tx=0).stop 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 -- 172.21.15.2:0/3770349345 shutdown_connections 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3770349345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3770349345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc2800 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3770349345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fb7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 -- 172.21.15.2:0/3770349345 >> 172.21.15.2:0/3770349345 conn(0x561cc2fb40f0 msgr2=0x561cc2fb44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 -- 172.21.15.2:0/3770349345 shutdown_connections 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 -- 172.21.15.2:0/3770349345 wait complete. 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.705+0000 7f4b472ee740 1 -- start start 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b472ee740 1 Processor -- start 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fbfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fc0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b472ee740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cc2fc5910 con 0x561cc2fc2d40 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b472ee740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561cc2ed7f10 con 0x561cc2fb7b60 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b472ee740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561cc2fc5a90 con 0x561cc2fb8480 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b472ee740 10 client.0 _ll_register_callbacks cb 0x561cc2ea0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fc0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fbfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fc0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34430/0 (socket says 172.21.15.2:34430) 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3327082736 learned_addr learned my addr 172.21.15.2:0/3327082736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b37fff640 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3327082736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 msgr2=0x561cc2fc0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3327082736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 msgr2=0x561cc2fbfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fbfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3327082736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc2c8e6a0 con 0x561cc2fc2d40 2024-09-12T01:00:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.706+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fbfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fc0740 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4b38031a70 tx=0x7f4b380095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be66f76dba63a04b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3327082736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b380309d0 con 0x561cc2fc2d40 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b472ee740 1 -- 172.21.15.2:0/3327082736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b300a49e0 con 0x561cc2fc2d40 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3327082736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f4b38030b70 con 0x561cc2fc2d40 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3327082736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4b3802f390 con 0x561cc2fc2d40 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b472ee740 10 client.17133 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b472ee740 1 -- 172.21.15.2:0/3327082736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561cc2fd15c0 con 0x561cc2fc2d40 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3327082736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b300a49e0 con 0x561cc2fc2d40 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3327082736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f4b38048040 con 0x561cc2fc2d40 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.707+0000 7f4b472ee740 10 client.17133 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.708+0000 7f4b472ee740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:00.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.708+0000 7f4b472ee740 20 client.17133 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.708+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561cc2fd2a20 0x561cc2fd4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.708+0000 7f4b472ee740 4 client.17133 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.708+0000 7f4b472ee740 1 -- 172.21.15.2:0/3327082736 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cc2f2a7f0 con 0x561cc2fd2a20 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.708+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561cc2fd2a20 0x561cc2fd4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.708+0000 7f4b25ffb640 10 client.17133 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.708+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561cc2fd2a20 0x561cc2fd4ea0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aec0434ee607a247 server_cookie=f896fa119d9f0eaf in_seq=0 out_seq=0 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3327082736 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cc2f2a7f0 con 0x561cc2fd2a20 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b25ffb640 10 client.17133 handle_command_reply: tid=0 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 client.17133 shutdown 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 -- 172.21.15.2:0/3327082736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 msgr2=0x561cc2fc0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fc0740 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4b38031a70 tx=0x7f4b380095c0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 -- 172.21.15.2:0/3327082736 shutdown_connections 2024-09-12T01:00:00.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561cc2fd2a20 0x561cc2fd4ea0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fc0740 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3327082736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fbfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 -- 172.21.15.2:0/3327082736 >> 172.21.15.2:0/3327082736 conn(0x561cc2fb40f0 msgr2=0x561cc2fb9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b25ffb640 0 client.17133 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 -- 172.21.15.2:0/3327082736 shutdown_connections 2024-09-12T01:00:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 1 -- 172.21.15.2:0/3327082736 wait complete. 2024-09-12T01:00:00.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.709+0000 7f4b472ee740 20 client.17133 trim_cache size 0 max 16384 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b472ee740 1 Processor -- start 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b472ee740 1 -- start start 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fba610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fda7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b472ee740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401b02c0 con 0x561cc2fc2d40 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b472ee740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401adb00 con 0x561cc2fb7b60 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b472ee740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401ab950 con 0x561cc2fb8480 2024-09-12T01:00:00.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.727+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fda7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fda7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34440/0 (socket says 172.21.15.2:34440) 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fba610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/271309151 learned_addr learned my addr 172.21.15.2:0/271309151 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b37fff640 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/271309151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 msgr2=0x561cc2fc1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/271309151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 msgr2=0x561cc2fba610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fba610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/271309151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc2fbec70 con 0x561cc2fc2d40 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b37fff640 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fba610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fda7b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4b38004af0 tx=0x7f4b38005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d851d72a68dc2c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b27fff640 1 -- 172.21.15.2:0/271309151 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3803b6d0 con 0x561cc2fc2d40 2024-09-12T01:00:00.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b27fff640 1 -- 172.21.15.2:0/271309151 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b38036070 con 0x561cc2fc2d40 2024-09-12T01:00:00.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.728+0000 7f4b27fff640 1 -- 172.21.15.2:0/271309151 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38030dc0 con 0x561cc2fc2d40 2024-09-12T01:00:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 -- 172.21.15.2:0/271309151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 msgr2=0x561cc2fda7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fda7b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4b38004af0 tx=0x7f4b38005ef0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 -- 172.21.15.2:0/271309151 shutdown_connections 2024-09-12T01:00:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fc2d40 0x561cc2fda7b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 --2- 172.21.15.2:0/271309151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fb7b60 0x561cc2fba610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 -- 172.21.15.2:0/271309151 >> 172.21.15.2:0/271309151 conn(0x561cc2fb40f0 msgr2=0x561cc2fc1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 -- 172.21.15.2:0/271309151 shutdown_connections 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 -- 172.21.15.2:0/271309151 wait complete. 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 -- start start 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.729+0000 7f4b472ee740 1 Processor -- start 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fc6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b472ee740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b472ee740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401abfc0 con 0x561cc2fb7b60 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b472ee740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401ad430 con 0x561cc2fc2d40 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b472ee740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401ac690 con 0x561cc2fb8480 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b472ee740 10 client.0 _ll_register_callbacks cb 0x7f4b38009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fc6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fc6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34446/0 (socket says 172.21.15.2:34446) 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3554875767 learned_addr learned my addr 172.21.15.2:0/3554875767 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b37fff640 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3554875767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 msgr2=0x561cc2fc6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 msgr2=0x561cc2fc73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 -- 172.21.15.2:0/3554875767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc303c780 con 0x561cc2fb7b60 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fc6950 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4b300981d0 tx=0x7f4b300a0120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d947b467000e4a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3554875767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300ba070 con 0x561cc2fb7b60 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3554875767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f4b300a4550 con 0x561cc2fb7b60 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.730+0000 7f4b472ee740 1 -- 172.21.15.2:0/3554875767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b38036070 con 0x561cc2fb7b60 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3554875767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4b300a49e0 con 0x561cc2fb7b60 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b472ee740 10 client.17139 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b472ee740 1 -- 172.21.15.2:0/3554875767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561cc303d9c0 con 0x561cc2fb7b60 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3554875767 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b38036070 con 0x561cc2fb7b60 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3554875767 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f4b3009ac30 con 0x561cc2fb7b60 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b472ee740 10 client.17139 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b472ee740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b472ee740 20 client.17139 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561cc303dca0 0x561cc3040090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b472ee740 4 client.17139 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b472ee740 1 -- 172.21.15.2:0/3554875767 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561cc2f24d00 con 0x561cc303dca0 2024-09-12T01:00:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.731+0000 7f4b37fff640 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561cc303dca0 0x561cc3040090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.732+0000 7f4b37fff640 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561cc303dca0 0x561cc3040090 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f30ee5ca61e8d77d server_cookie=8a4864970468b209 in_seq=0 out_seq=0 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.732+0000 7f4b25ffb640 10 client.17139 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b25ffb640 1 -- 172.21.15.2:0/3554875767 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561cc2f24d00 con 0x561cc303dca0 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b25ffb640 10 client.17139 handle_command_reply: tid=0 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 client.17139 shutdown 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 -- 172.21.15.2:0/3554875767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 msgr2=0x561cc2fc6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fc6950 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4b300981d0 tx=0x7f4b300a0120 comp rx=0 tx=0).stop 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 -- 172.21.15.2:0/3554875767 shutdown_connections 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561cc303dca0 0x561cc3040090 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc2fc2d40 0x561cc2fc73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561cc2fb8480 0x561cc2fc6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 --2- 172.21.15.2:0/3554875767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc2fb7b60 0x561cc2fc6950 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b25ffb640 0 client.17139 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 -- 172.21.15.2:0/3554875767 >> 172.21.15.2:0/3554875767 conn(0x561cc2fb40f0 msgr2=0x561cc2fb3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 -- 172.21.15.2:0/3554875767 shutdown_connections 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 1 -- 172.21.15.2:0/3554875767 wait complete. 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.733+0000 7f4b472ee740 20 client.17139 trim_cache size 0 max 16384 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "4dc3cff0-6c73-418d-9288-d55f74214732", 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T01:00:00.737 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:00:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 -- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4b2c0a2cf0 msgr2=0x7f4b2c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4b2c0a2cf0 0x7f4b2c0a51b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009a60 tx=0x7f4b38004a80 comp rx=0 tx=0).stop 2024-09-12T01:00:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 -- 172.21.15.2:0/3774965883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b40101df0 msgr2=0x7f4b401983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b40101df0 0x7f4b401983a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e9f0 tx=0x7f4b3000edf0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 -- 172.21.15.2:0/3774965883 shutdown_connections 2024-09-12T01:00:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4b2c0a2cf0 0x7f4b2c0a51b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b40106f20 0x7f4b4019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b401027a0 0x7f4b401988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 --2- 172.21.15.2:0/3774965883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b40101df0 0x7f4b401983a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 -- 172.21.15.2:0/3774965883 >> 172.21.15.2:0/3774965883 conn(0x7f4b400fd8b0 msgr2=0x7f4b400fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 -- 172.21.15.2:0/3774965883 shutdown_connections 2024-09-12T01:00:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:00.734+0000 7f4b44f15640 1 -- 172.21.15.2:0/3774965883 wait complete. 2024-09-12T01:00:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:00 smithi071 ceph-mon[35276]: pgmap v215: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:00:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:00 smithi071 ceph-mon[35276]: overall HEALTH_OK 2024-09-12T01:00:00.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:00 smithi002 ceph-mon[31210]: pgmap v215: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:00:00.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:00 smithi002 ceph-mon[31210]: overall HEALTH_OK 2024-09-12T01:00:01.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:00 smithi167 ceph-mon[35234]: pgmap v215: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:00:01.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:00 smithi167 ceph-mon[35234]: overall HEALTH_OK 2024-09-12T01:00:01.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:00:01.884 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:01 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T01:00:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:01 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:01 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T01:00:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:01 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:01.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:01 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T01:00:01.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:01 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T01:00:01.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:01 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:01.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:01 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T01:00:01.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:01 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:01.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:01 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T01:00:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:01 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T01:00:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:01 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:01 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T01:00:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:01 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:01 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T01:00:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 -- 172.21.15.2:0/1174304151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 msgr2=0x7f9c3810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/1174304151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 0x7f9c3810e610 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009900 tx=0x7f9c2802a480 comp rx=0 tx=0).stop 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 -- 172.21.15.2:0/1174304151 shutdown_connections 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/1174304151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 0x7f9c3810e610 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/1174304151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38103660 0x7f9c3810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/1174304151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38102d40 0x7f9c38103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 -- 172.21.15.2:0/1174304151 >> 172.21.15.2:0/1174304151 conn(0x7f9c380fc7a0 msgr2=0x7f9c380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 -- 172.21.15.2:0/1174304151 shutdown_connections 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 -- 172.21.15.2:0/1174304151 wait complete. 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.366+0000 7f9c3d27c640 1 Processor -- start 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c3d27c640 1 -- start start 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c3d27c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38102d40 0x7f9c381983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c3d27c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38103660 0x7f9c38198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c3d27c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 0x7f9c3819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c3d27c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38111fb0 con 0x7f9c3810c170 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c3d27c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38111e30 con 0x7f9c38103660 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c3d27c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38112130 con 0x7f9c38102d40 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 0x7f9c3819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 0x7f9c3819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34454/0 (socket says 172.21.15.2:34454) 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c377fe640 1 -- 172.21.15.2:0/3850106278 learned_addr learned my addr 172.21.15.2:0/3850106278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c367fc640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38103660 0x7f9c38198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.367+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38102d40 0x7f9c381983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c377fe640 1 -- 172.21.15.2:0/3850106278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38102d40 msgr2=0x7f9c381983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c377fe640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38102d40 0x7f9c381983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c377fe640 1 -- 172.21.15.2:0/3850106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38103660 msgr2=0x7f9c38198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c377fe640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38103660 0x7f9c38198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c377fe640 1 -- 172.21.15.2:0/3850106278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3819d380 con 0x7f9c3810c170 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c377fe640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 0x7f9c3819cca0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009230 tx=0x7f9c280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c2ffff640 1 -- 172.21.15.2:0/3850106278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2803f030 con 0x7f9c3810c170 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c3d27c640 1 -- 172.21.15.2:0/3850106278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3819d610 con 0x7f9c3810c170 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c2ffff640 1 -- 172.21.15.2:0/3850106278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c28003ce0 con 0x7f9c3810c170 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c2ffff640 1 -- 172.21.15.2:0/3850106278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28035070 con 0x7f9c3810c170 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.368+0000 7f9c3d27c640 1 -- 172.21.15.2:0/3850106278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c381a4f50 con 0x7f9c3810c170 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.371+0000 7f9c3f655740 1 Processor -- start 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.371+0000 7f9c2ffff640 1 -- 172.21.15.2:0/3850106278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f9c28042030 con 0x7f9c3810c170 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.371+0000 7f9c3f655740 1 -- start start 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607f4a0 0x561b4607f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607fdc0 0x561b4608a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4608a680 0x561b4608ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c3f655740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b45fe52e0 con 0x561b4607fdc0 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c3f655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561b45f8cce0 con 0x561b4607f4a0 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c3f655740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b45fe12a0 con 0x561b4608a680 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607fdc0 0x561b4608a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607fdc0 0x561b4608a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34460/0 (socket says 172.21.15.2:34460) 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 -- 172.21.15.2:0/3339155873 learned_addr learned my addr 172.21.15.2:0/3339155873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c367fc640 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607f4a0 0x561b4607f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c367fc640 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4608a680 0x561b4608ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 -- 172.21.15.2:0/3339155873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4608a680 msgr2=0x561b4608ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4608a680 0x561b4608ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 -- 172.21.15.2:0/3339155873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607f4a0 msgr2=0x561b4607f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:02.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607f4a0 0x561b4607f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 -- 172.21.15.2:0/3339155873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b45f71440 con 0x561b4607fdc0 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c367fc640 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607f4a0 0x561b4607f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c2ffff640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607fdc0 0x561b4608a140 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9c30007f90 tx=0x7f9c3000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51974da60279be46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c367fc640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c2d7fa640 1 -- 172.21.15.2:0/3339155873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30004d20 con 0x561b4607fdc0 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c2ffff640 1 -- 172.21.15.2:0/3850106278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9c280efcd0 con 0x7f9c3810c170 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.372+0000 7f9c2d7fa640 1 -- 172.21.15.2:0/3339155873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c30010be0 con 0x561b4607fdc0 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c2d7fa640 1 -- 172.21.15.2:0/3339155873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300057e0 con 0x561b4607fdc0 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 -- 172.21.15.2:0/3339155873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607fdc0 msgr2=0x561b4608a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c367fc640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x561b4607cdb0 tx=0x7f9c200046c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:02.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607fdc0 0x561b4608a140 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9c30007f90 tx=0x7f9c3000f850 comp rx=0 tx=0).stop 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 -- 172.21.15.2:0/3339155873 shutdown_connections 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4608a680 0x561b4608ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607fdc0 0x561b4608a140 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 --2- 172.21.15.2:0/3339155873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607f4a0 0x561b4607f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 -- 172.21.15.2:0/3339155873 >> 172.21.15.2:0/3339155873 conn(0x561b4607ba30 msgr2=0x561b4607be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 -- 172.21.15.2:0/3339155873 shutdown_connections 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.373+0000 7f9c3f655740 1 -- 172.21.15.2:0/3339155873 wait complete. 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 1 -- start start 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 1 Processor -- start 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607f4a0 0x561b46089f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607fdc0 0x561b46087220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4608a680 0x561b46087760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b4608d250 con 0x561b4608a680 2024-09-12T01:00:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561b45fa0050 con 0x561b4607fdc0 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b4608d3d0 con 0x561b4607f4a0 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c3f655740 10 client.0 _ll_register_callbacks cb 0x561b45fe0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4608a680 0x561b46087760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4608a680 0x561b46087760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34468/0 (socket says 172.21.15.2:34468) 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c377fe640 1 -- 172.21.15.2:0/547997381 learned_addr learned my addr 172.21.15.2:0/547997381 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c367fc640 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607fdc0 0x561b46087220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.374+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607f4a0 0x561b46089f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c367fc640 1 -- 172.21.15.2:0/547997381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607f4a0 msgr2=0x561b46089f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c367fc640 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607f4a0 0x561b46089f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c367fc640 1 -- 172.21.15.2:0/547997381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4608a680 msgr2=0x561b46087760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c367fc640 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4608a680 0x561b46087760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c367fc640 1 -- 172.21.15.2:0/547997381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b45d563c0 con 0x561b4607fdc0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c377fe640 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4608a680 0x561b46087760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c367fc640 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607fdc0 0x561b46087220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9c200136b0 tx=0x7f9c20009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc123521ae779687 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/547997381 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20024070 con 0x561b4607fdc0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c3f655740 1 -- 172.21.15.2:0/547997381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c30010be0 con 0x561b4607fdc0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/547997381 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9c20012860 con 0x561b4607fdc0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/547997381 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9c20012a60 con 0x561b4607fdc0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c3f655740 10 client.26567 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c3f655740 1 -- 172.21.15.2:0/547997381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561b46098be0 con 0x561b4607fdc0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.375+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/547997381 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c30010be0 con 0x561b4607fdc0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.376+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/547997381 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f9c2001f070 con 0x561b4607fdc0 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.376+0000 7f9c3f655740 10 client.26567 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:02.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.376+0000 7f9c3f655740 10 client.26567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.376+0000 7f9c3f655740 20 client.26567 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.376+0000 7f9c3f655740 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b46099ff0 0x561b4609c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.376+0000 7f9c3f655740 4 client.26567 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.376+0000 7f9c3f655740 1 -- 172.21.15.2:0/547997381 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b45ff2850 con 0x561b46099ff0 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.376+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b46099ff0 0x561b4609c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c1e7fc640 10 client.26567 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b46099ff0 0x561b4609c430 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cb3648e98509d6e server_cookie=dde34e9ff4f40e57 in_seq=0 out_seq=0 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/547997381 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b45ff2850 con 0x561b46099ff0 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c1e7fc640 10 client.26567 handle_command_reply: tid=0 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 client.26567 shutdown 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 -- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607fdc0 msgr2=0x561b46087220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607fdc0 0x561b46087220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9c200136b0 tx=0x7f9c20009060 comp rx=0 tx=0).stop 2024-09-12T01:00:02.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 -- 172.21.15.2:0/547997381 shutdown_connections 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b46099ff0 0x561b4609c430 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4608a680 0x561b46087760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c1e7fc640 0 client.26567 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4607fdc0 0x561b46087220 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 --2- 172.21.15.2:0/547997381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607f4a0 0x561b46089f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 -- 172.21.15.2:0/547997381 >> 172.21.15.2:0/547997381 conn(0x561b4607ba30 msgr2=0x561b4607ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.377+0000 7f9c3f655740 1 -- 172.21.15.2:0/547997381 shutdown_connections 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.378+0000 7f9c3f655740 1 -- 172.21.15.2:0/547997381 wait complete. 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.378+0000 7f9c3f655740 20 client.26567 trim_cache size 0 max 16384 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c3f655740 1 Processor -- start 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c3f655740 1 -- start start 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b460964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 0x561b460a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b460a2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c3f655740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381b24c0 con 0x561b4607f4a0 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c3f655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381afd00 con 0x561b4608a680 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c3f655740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381adb50 con 0x561b4607fdc0 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b460964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b460964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34482/0 (socket says 172.21.15.2:34482) 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c36ffd640 1 -- 172.21.15.2:0/212402138 learned_addr learned my addr 172.21.15.2:0/212402138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c367fc640 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 0x561b460a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c377fe640 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b460a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c36ffd640 1 -- 172.21.15.2:0/212402138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 msgr2=0x561b460a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 0x561b460a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c36ffd640 1 -- 172.21.15.2:0/212402138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 msgr2=0x561b460a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:02.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b460a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.395+0000 7f9c36ffd640 1 -- 172.21.15.2:0/212402138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b460861d0 con 0x561b4607f4a0 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.396+0000 7f9c377fe640 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b460a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.396+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b460964b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9c30007f90 tx=0x7f9c300075b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4560349ec8bd9f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.396+0000 7f9c2cff9640 1 -- 172.21.15.2:0/212402138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30030070 con 0x561b4607f4a0 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.396+0000 7f9c2cff9640 1 -- 172.21.15.2:0/212402138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c30028070 con 0x561b4607f4a0 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.396+0000 7f9c2cff9640 1 -- 172.21.15.2:0/212402138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3001d040 con 0x561b4607f4a0 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.396+0000 7f9c3f655740 1 -- 172.21.15.2:0/212402138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 msgr2=0x561b460964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.396+0000 7f9c3f655740 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b460964b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9c30007f90 tx=0x7f9c300075b0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 -- 172.21.15.2:0/212402138 shutdown_connections 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b460a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 0x561b460a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 --2- 172.21.15.2:0/212402138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b460964b0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 -- 172.21.15.2:0/212402138 >> 172.21.15.2:0/212402138 conn(0x561b4607ba30 msgr2=0x561b460892a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 -- 172.21.15.2:0/212402138 shutdown_connections 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 -- 172.21.15.2:0/212402138 wait complete. 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 -- start start 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 Processor -- start 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b4608e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 0x561b4608e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b4608ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381ae1c0 con 0x561b4607f4a0 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381af630 con 0x561b4608a680 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381ae890 con 0x561b4607fdc0 2024-09-12T01:00:02.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.397+0000 7f9c3f655740 10 client.0 _ll_register_callbacks cb 0x7f9c20009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b4608e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b4608e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34498/0 (socket says 172.21.15.2:34498) 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 -- 172.21.15.2:0/1769434198 learned_addr learned my addr 172.21.15.2:0/1769434198 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c367fc640 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 0x561b4608e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c377fe640 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b4608ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 -- 172.21.15.2:0/1769434198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 msgr2=0x561b4608e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 0x561b4608e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 -- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 msgr2=0x561b4608ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b4608ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 -- 172.21.15.2:0/1769434198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b46103d20 con 0x561b4607f4a0 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c377fe640 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b4608ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:02.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c36ffd640 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b4608e3b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9c30012010 tx=0x7f9c30007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ed8cf883d0b436 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/1769434198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30030070 con 0x561b4607f4a0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/1769434198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f9c30004cc0 con 0x561b4607f4a0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c3f655740 1 -- 172.21.15.2:0/1769434198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c30028070 con 0x561b4607f4a0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/1769434198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9c30004ec0 con 0x561b4607f4a0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c3f655740 10 client.17157 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.398+0000 7f9c3f655740 1 -- 172.21.15.2:0/1769434198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561b46104f60 con 0x561b4607f4a0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/1769434198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c30028070 con 0x561b4607f4a0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/1769434198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f9c3002a5c0 con 0x561b4607f4a0 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c3f655740 10 client.17157 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c3f655740 10 client.17157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c3f655740 20 client.17157 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:02.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c3f655740 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b46105420 0x561b46107810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c3f655740 4 client.17157 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c3f655740 1 -- 172.21.15.2:0/1769434198 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b45fecd60 con 0x561b46105420 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.399+0000 7f9c367fc640 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b46105420 0x561b46107810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c367fc640 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b46105420 0x561b46107810 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6194f2016d20dd2 server_cookie=4e206773aa4f589f in_seq=0 out_seq=0 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c1e7fc640 10 client.17157 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c1e7fc640 1 -- 172.21.15.2:0/1769434198 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561b45fecd60 con 0x561b46105420 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c1e7fc640 10 client.17157 handle_command_reply: tid=0 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 client.17157 shutdown 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 -- 172.21.15.2:0/1769434198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 msgr2=0x561b4608e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b4608e3b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9c30012010 tx=0x7f9c30007c30 comp rx=0 tx=0).stop 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 -- 172.21.15.2:0/1769434198 shutdown_connections 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561b46105420 0x561b46107810 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561b4608a680 0x561b4608ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4607fdc0 0x561b4608e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c1e7fc640 0 client.17157 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:02.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 --2- 172.21.15.2:0/1769434198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4607f4a0 0x561b4608e3b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 -- 172.21.15.2:0/1769434198 >> 172.21.15.2:0/1769434198 conn(0x561b4607ba30 msgr2=0x561b46080f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 -- 172.21.15.2:0/1769434198 shutdown_connections 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 1 -- 172.21.15.2:0/1769434198 wait complete. 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3f655740 20 client.17157 trim_cache size 0 max 16384 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.400+0000 7f9c3d27c640 1 -- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 msgr2=0x7f9c240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x561b4607cdb0 tx=0x7f9c200046c0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 -- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 msgr2=0x7f9c3819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 0x7f9c3819cca0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009230 tx=0x7f9c280042f0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 -- 172.21.15.2:0/3850106278 shutdown_connections 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810c170 0x7f9c3819cca0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38103660 0x7f9c38198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 --2- 172.21.15.2:0/3850106278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38102d40 0x7f9c381983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 -- 172.21.15.2:0/3850106278 >> 172.21.15.2:0/3850106278 conn(0x7f9c380fc7a0 msgr2=0x7f9c380fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 -- 172.21.15.2:0/3850106278 shutdown_connections 2024-09-12T01:00:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:02.401+0000 7f9c3d27c640 1 -- 172.21.15.2:0/3850106278 wait complete. 2024-09-12T01:00:02.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:02 smithi071 ceph-mon[35276]: pgmap v216: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:00:02.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:02 smithi002 ceph-mon[31210]: pgmap v216: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:00:03.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:02 smithi167 ceph-mon[35234]: pgmap v216: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:00:03.334 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:00:03.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:00:03.593 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 -- 172.21.15.2:0/204915075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102ef0 msgr2=0x7f993010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 --2- 172.21.15.2:0/204915075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102ef0 0x7f993010da40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9928009ca0 tx=0x7f992802a950 comp rx=0 tx=0).stop 2024-09-12T01:00:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 -- 172.21.15.2:0/204915075 shutdown_connections 2024-09-12T01:00:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 --2- 172.21.15.2:0/204915075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102ef0 0x7f993010da40 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 --2- 172.21.15.2:0/204915075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930102570 0x7f99301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 --2- 172.21.15.2:0/204915075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9930100e20 0x7f9930101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 -- 172.21.15.2:0/204915075 >> 172.21.15.2:0/204915075 conn(0x7f99300fc7d0 msgr2=0x7f99300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 -- 172.21.15.2:0/204915075 shutdown_connections 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.089+0000 7f9934f15640 1 -- 172.21.15.2:0/204915075 wait complete. 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.090+0000 7f9934f15640 1 Processor -- start 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.090+0000 7f9934f15640 1 -- start start 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.090+0000 7f9934f15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930100e20 0x7f99301984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.090+0000 7f9934f15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102570 0x7f9930198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.090+0000 7f9934f15640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9930102ef0 0x7f993019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.090+0000 7f9934f15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9930110ff0 con 0x7f9930102570 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.090+0000 7f9934f15640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9930110e70 con 0x7f9930102ef0 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.090+0000 7f9934f15640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9930111170 con 0x7f9930100e20 2024-09-12T01:00:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102570 0x7f9930198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102570 0x7f9930198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34526/0 (socket says 172.21.15.2:34526) 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 -- 172.21.15.2:0/2101864973 learned_addr learned my addr 172.21.15.2:0/2101864973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992e59c640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930100e20 0x7f99301984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992ed9d640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9930102ef0 0x7f993019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 -- 172.21.15.2:0/2101864973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930100e20 msgr2=0x7f99301984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930100e20 0x7f99301984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 -- 172.21.15.2:0/2101864973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9930102ef0 msgr2=0x7f993019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9930102ef0 0x7f993019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 -- 172.21.15.2:0/2101864973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993019d490 con 0x7f9930102570 2024-09-12T01:00:04.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f992dd9b640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102570 0x7f9930198a20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f992400b4a0 tx=0x7f992400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f991f7fe640 1 -- 172.21.15.2:0/2101864973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924015020 con 0x7f9930102570 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f991f7fe640 1 -- 172.21.15.2:0/2101864973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9924011d10 con 0x7f9930102570 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993019d780 con 0x7f9930102570 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f991f7fe640 1 -- 172.21.15.2:0/2101864973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992400f2e0 con 0x7f9930102570 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.091+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99301a5060 con 0x7f9930102570 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.093+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9930101200 con 0x7f9930102570 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.094+0000 7f991f7fe640 1 -- 172.21.15.2:0/2101864973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f9924018020 con 0x7f9930102570 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.094+0000 7f991f7fe640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f99180a2d70 0x7f99180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.094+0000 7f992e59c640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f99180a2d70 0x7f99180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.094+0000 7f991f7fe640 1 -- 172.21.15.2:0/2101864973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f99240ceb70 con 0x7f9930102570 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.095+0000 7f992e59c640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f99180a2d70 0x7f99180a5230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f992000abe0 tx=0x7f992000a2d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.099+0000 7f991f7fe640 1 -- 172.21.15.2:0/2101864973 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f992401f020 con 0x7f9930102570 2024-09-12T01:00:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.307+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f993010a0a0 con 0x7f9930102570 2024-09-12T01:00:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.308+0000 7f991f7fe640 1 -- 172.21.15.2:0/2101864973 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7f992409b850 con 0x7f9930102570 2024-09-12T01:00:04.309 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:00:04.309 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T01:00:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T01:00:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.310+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f99180a2d70 msgr2=0x7f99180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.310+0000 7f9934f15640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f99180a2d70 0x7f99180a5230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f992000abe0 tx=0x7f992000a2d0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.310+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102570 msgr2=0x7f9930198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.310+0000 7f9934f15640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102570 0x7f9930198a20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f992400b4a0 tx=0x7f992400b8a0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.311+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 shutdown_connections 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.311+0000 7f9934f15640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f99180a2d70 0x7f99180a5230 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.311+0000 7f9934f15640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9930102ef0 0x7f993019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.311+0000 7f9934f15640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9930102570 0x7f9930198a20 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.311+0000 7f9934f15640 1 --2- 172.21.15.2:0/2101864973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930100e20 0x7f99301984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.311+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 >> 172.21.15.2:0/2101864973 conn(0x7f99300fc7d0 msgr2=0x7f993006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.311+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 shutdown_connections 2024-09-12T01:00:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:04.311+0000 7f9934f15640 1 -- 172.21.15.2:0/2101864973 wait complete. 2024-09-12T01:00:04.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:04 smithi071 ceph-mon[35276]: pgmap v217: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:00:04.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:04 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2101864973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:00:04.951 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:04 smithi002 ceph-mon[31210]: pgmap v217: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:00:04.952 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:04 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2101864973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:00:04.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:00:05.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:04 smithi167 ceph-mon[35234]: pgmap v217: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:00:05.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:04 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2101864973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:00:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 -- 172.21.15.2:0/2361945934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc106f10 msgr2=0x7f58cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 --2- 172.21.15.2:0/2361945934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc106f10 0x7f58cc10ea90 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009ca0 tx=0x7f58c402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 -- 172.21.15.2:0/2361945934 shutdown_connections 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 --2- 172.21.15.2:0/2361945934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc106f10 0x7f58cc10ea90 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 --2- 172.21.15.2:0/2361945934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc102790 0x7f58cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 --2- 172.21.15.2:0/2361945934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58cc101de0 0x7f58cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 -- 172.21.15.2:0/2361945934 >> 172.21.15.2:0/2361945934 conn(0x7f58cc0fd8c0 msgr2=0x7f58cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 -- 172.21.15.2:0/2361945934 shutdown_connections 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.755+0000 7f58d1071640 1 -- 172.21.15.2:0/2361945934 wait complete. 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.756+0000 7f58d1071640 1 Processor -- start 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.756+0000 7f58d1071640 1 -- start start 2024-09-12T01:00:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58d1071640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101de0 0x7f58cc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58d1071640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc102790 0x7f58cc198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58d1071640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58cc106f10 0x7f58cc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58d1071640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc111f90 con 0x7f58cc101de0 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58d1071640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc111e10 con 0x7f58cc106f10 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58d1071640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc112110 con 0x7f58cc102790 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101de0 0x7f58cc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101de0 0x7f58cc198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34554/0 (socket says 172.21.15.2:34554) 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 -- 172.21.15.2:0/4056261993 learned_addr learned my addr 172.21.15.2:0/4056261993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cb59e640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58cc106f10 0x7f58cc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58ca59c640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc102790 0x7f58cc198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 -- 172.21.15.2:0/4056261993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc102790 msgr2=0x7f58cc198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc102790 0x7f58cc198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 -- 172.21.15.2:0/4056261993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58cc106f10 msgr2=0x7f58cc19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58cc106f10 0x7f58cc19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 -- 172.21.15.2:0/4056261993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc19d3c0 con 0x7f58cc101de0 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58ca59c640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc102790 0x7f58cc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cb59e640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58cc106f10 0x7f58cc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58cad9d640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101de0 0x7f58cc198410 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00c920 tx=0x7f58bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.757+0000 7f58b3fff640 1 -- 172.21.15.2:0/4056261993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc007c70 con 0x7f58cc101de0 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.758+0000 7f58d1071640 1 -- 172.21.15.2:0/4056261993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58cc19d6b0 con 0x7f58cc101de0 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.758+0000 7f58b3fff640 1 -- 172.21.15.2:0/4056261993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58bc007e10 con 0x7f58cc101de0 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.758+0000 7f58b3fff640 1 -- 172.21.15.2:0/4056261993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc018890 con 0x7f58cc101de0 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.758+0000 7f58d1071640 1 -- 172.21.15.2:0/4056261993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58cc1a4f90 con 0x7f58cc101de0 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.760+0000 7f58b3fff640 1 -- 172.21.15.2:0/4056261993 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f58bc018a70 con 0x7f58cc101de0 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.760+0000 7f58d344a740 1 Processor -- start 2024-09-12T01:00:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.760+0000 7f58d344a740 1 -- start start 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58d344a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a91f7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58d344a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f75d0 0x55f2a91f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58d344a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a9206780 0x55f2a9208b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58d344a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f2a915d2f0 con 0x55f2a91f8b40 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58d344a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f2a9104cf0 con 0x55f2a91f75d0 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58d344a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f2a91592b0 con 0x55f2a9206780 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a91f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a91f7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34564/0 (socket says 172.21.15.2:34564) 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 -- 172.21.15.2:0/1827074147 learned_addr learned my addr 172.21.15.2:0/1827074147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58b3fff640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58b40a2cf0 0x7f58b40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cad9d640 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f75d0 0x55f2a91f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58ca59c640 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a9206780 0x55f2a9208b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 -- 172.21.15.2:0/1827074147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a9206780 msgr2=0x55f2a9208b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a9206780 0x55f2a9208b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 -- 172.21.15.2:0/1827074147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f75d0 msgr2=0x55f2a91f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f75d0 0x55f2a91f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58b3fff640 1 -- 172.21.15.2:0/4056261993 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f58bc0cf700 con 0x7f58cc101de0 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 -- 172.21.15.2:0/1827074147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a90e93a0 con 0x55f2a91f8b40 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cad9d640 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f75d0 0x55f2a91f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58b40a2cf0 0x7f58b40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.761+0000 7f58cb59e640 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a91f7090 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009dc0 tx=0x7f58c4031c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c17b92a02c7986 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.762+0000 7f58b17fa640 1 -- 172.21.15.2:0/1827074147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c40319a0 con 0x55f2a91f8b40 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.762+0000 7f58b17fa640 1 -- 172.21.15.2:0/1827074147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c4036070 con 0x55f2a91f8b40 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.762+0000 7f58b17fa640 1 -- 172.21.15.2:0/1827074147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c402fbe0 con 0x55f2a91f8b40 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.762+0000 7f58cb59e640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58b40a2cf0 0x7f58b40a51b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f58c404b000 tx=0x7f58c4048000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:05.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.762+0000 7f58d344a740 1 -- 172.21.15.2:0/1827074147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 msgr2=0x55f2a91f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.762+0000 7f58d344a740 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a91f7090 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009dc0 tx=0x7f58c4031c30 comp rx=0 tx=0).stop 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 -- 172.21.15.2:0/1827074147 shutdown_connections 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a9206780 0x55f2a9208b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f75d0 0x55f2a91f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 --2- 172.21.15.2:0/1827074147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a91f7090 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 -- 172.21.15.2:0/1827074147 >> 172.21.15.2:0/1827074147 conn(0x55f2a91c0310 msgr2=0x55f2a91f3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 -- 172.21.15.2:0/1827074147 shutdown_connections 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 -- 172.21.15.2:0/1827074147 wait complete. 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 -- start start 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 Processor -- start 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a9206120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a92033d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 0x55f2a9203970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f2a9209300 con 0x55f2a91f8b40 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f2a9118060 con 0x55f2a9206780 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f2a9209480 con 0x55f2a91f75d0 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.763+0000 7f58d344a740 10 client.0 _ll_register_callbacks cb 0x55f2a8e6b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a92033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a92033d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34572/0 (socket says 172.21.15.2:34572) 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 -- 172.21.15.2:0/1528390524 learned_addr learned my addr 172.21.15.2:0/1528390524 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58cad9d640 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a9206120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58cb59e640 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 0x55f2a9203970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 -- 172.21.15.2:0/1528390524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 msgr2=0x55f2a9206120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a9206120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 -- 172.21.15.2:0/1528390524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 msgr2=0x55f2a9203970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 0x55f2a9203970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 -- 172.21.15.2:0/1528390524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a8ece3c0 con 0x55f2a91f8b40 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58ca59c640 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a92033d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f58c000d270 tx=0x7f58c000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11df724602112e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58aeff5640 1 -- 172.21.15.2:0/1528390524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0016070 con 0x55f2a91f8b40 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58aeff5640 1 -- 172.21.15.2:0/1528390524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f58c0012870 con 0x55f2a91f8b40 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.764+0000 7f58d344a740 1 -- 172.21.15.2:0/1528390524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58c4036070 con 0x55f2a91f8b40 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58aeff5640 1 -- 172.21.15.2:0/1528390524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f58c0022050 con 0x55f2a91f8b40 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58d344a740 10 client.17175 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58d344a740 1 -- 172.21.15.2:0/1528390524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f2a9214d20 con 0x55f2a91f8b40 2024-09-12T01:00:05.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58aeff5640 1 -- 172.21.15.2:0/1528390524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c4036070 con 0x55f2a91f8b40 2024-09-12T01:00:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58aeff5640 1 -- 172.21.15.2:0/1528390524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f58c0011b10 con 0x55f2a91f8b40 2024-09-12T01:00:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58d344a740 10 client.17175 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58d344a740 10 client.17175 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:00:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58d344a740 20 client.17175 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58d344a740 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55f2a9216220 0x55f2a9218680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58d344a740 4 client.17175 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.765+0000 7f58d344a740 1 -- 172.21.15.2:0/1528390524 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2a916a860 con 0x55f2a9216220 2024-09-12T01:00:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.766+0000 7f58cad9d640 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55f2a9216220 0x55f2a9218680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.766+0000 7f58cad9d640 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55f2a9216220 0x55f2a9218680 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=440f5cee08fff335 server_cookie=63adcf05c12f5694 in_seq=0 out_seq=0 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.766+0000 7f58aeff5640 10 client.17175 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58aeff5640 1 -- 172.21.15.2:0/1528390524 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2a916a860 con 0x55f2a9216220 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58aeff5640 10 client.17175 handle_command_reply: tid=0 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 client.17175 shutdown 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 -- 172.21.15.2:0/1528390524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 msgr2=0x55f2a92033d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a92033d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f58c000d270 tx=0x7f58c000bf90 comp rx=0 tx=0).stop 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 -- 172.21.15.2:0/1528390524 shutdown_connections 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55f2a9216220 0x55f2a9218680 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 0x55f2a9203970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f8b40 0x55f2a92033d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 --2- 172.21.15.2:0/1528390524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a9206120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 -- 172.21.15.2:0/1528390524 >> 172.21.15.2:0/1528390524 conn(0x55f2a91c0310 msgr2=0x55f2a91f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58aeff5640 0 client.17175 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:00:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 -- 172.21.15.2:0/1528390524 shutdown_connections 2024-09-12T01:00:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 1 -- 172.21.15.2:0/1528390524 wait complete. 2024-09-12T01:00:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.767+0000 7f58d344a740 20 client.17175 trim_cache size 0 max 16384 2024-09-12T01:00:05.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.780+0000 7f58d344a740 1 Processor -- start 2024-09-12T01:00:05.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.780+0000 7f58d344a740 1 -- start start 2024-09-12T01:00:05.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.780+0000 7f58d344a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a92125a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.780+0000 7f58d344a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f8b40 0x55f2a91f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.780+0000 7f58d344a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a9206780 0x55f2a92023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.780+0000 7f58d344a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1adfe0 con 0x55f2a9206780 2024-09-12T01:00:05.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.780+0000 7f58d344a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1ab820 con 0x55f2a91f8b40 2024-09-12T01:00:05.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.780+0000 7f58d344a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1a9670 con 0x55f2a91f75d0 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a9206780 0x55f2a92023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a9206780 0x55f2a92023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34586/0 (socket says 172.21.15.2:34586) 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 -- 172.21.15.2:0/639903118 learned_addr learned my addr 172.21.15.2:0/639903118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58ca59c640 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f8b40 0x55f2a91f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cad9d640 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a92125a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 -- 172.21.15.2:0/639903118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 msgr2=0x55f2a92125a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a92125a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 -- 172.21.15.2:0/639903118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f8b40 msgr2=0x55f2a91f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f8b40 0x55f2a91f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 -- 172.21.15.2:0/639903118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a9205d40 con 0x55f2a9206780 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cad9d640 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a92125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58ca59c640 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f8b40 0x55f2a91f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58cb59e640 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a9206780 0x55f2a92023b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f58c402f540 tx=0x7f58c402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702a3efa0a71dd90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58b0ff9640 1 -- 172.21.15.2:0/639903118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c40319a0 con 0x55f2a9206780 2024-09-12T01:00:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58b0ff9640 1 -- 172.21.15.2:0/639903118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c4036040 con 0x55f2a9206780 2024-09-12T01:00:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.781+0000 7f58b0ff9640 1 -- 172.21.15.2:0/639903118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c40047f0 con 0x55f2a9206780 2024-09-12T01:00:05.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 -- 172.21.15.2:0/639903118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a9206780 msgr2=0x55f2a92023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a9206780 0x55f2a92023b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f58c402f540 tx=0x7f58c402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 -- 172.21.15.2:0/639903118 shutdown_connections 2024-09-12T01:00:05.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a9206780 0x55f2a92023b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a91f8b40 0x55f2a91f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 --2- 172.21.15.2:0/639903118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f75d0 0x55f2a92125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 -- 172.21.15.2:0/639903118 >> 172.21.15.2:0/639903118 conn(0x55f2a91c0310 msgr2=0x55f2a9201ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 -- 172.21.15.2:0/639903118 shutdown_connections 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 -- 172.21.15.2:0/639903118 wait complete. 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 -- start start 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.782+0000 7f58d344a740 1 Processor -- start 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58d344a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f75d0 0x55f2a920ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58d344a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f8b40 0x55f2a9200060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58d344a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 0x55f2a92005a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58d344a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1a9ce0 con 0x55f2a91f75d0 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58d344a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1ab150 con 0x55f2a9206780 2024-09-12T01:00:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58d344a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1aa3b0 con 0x55f2a91f8b40 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58d344a740 10 client.0 _ll_register_callbacks cb 0x7f58c0006f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f75d0 0x55f2a920ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f75d0 0x55f2a920ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34602/0 (socket says 172.21.15.2:34602) 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 -- 172.21.15.2:0/4020024440 learned_addr learned my addr 172.21.15.2:0/4020024440 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cb59e640 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 0x55f2a92005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58ca59c640 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f8b40 0x55f2a9200060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 -- 172.21.15.2:0/4020024440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f8b40 msgr2=0x55f2a9200060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f8b40 0x55f2a9200060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 -- 172.21.15.2:0/4020024440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 msgr2=0x55f2a92005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 0x55f2a92005a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 -- 172.21.15.2:0/4020024440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a9200ce0 con 0x55f2a91f75d0 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58cad9d640 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f75d0 0x55f2a920ed30 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f58bc09b870 tx=0x7f58bc014400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c266c157c6a701b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.783+0000 7f58aeff5640 1 -- 172.21.15.2:0/4020024440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc09bb70 con 0x55f2a91f75d0 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58aeff5640 1 -- 172.21.15.2:0/4020024440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8599+0+0 (secure 0 0 0) 0x7f58bc0963a0 con 0x55f2a91f75d0 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 1 -- 172.21.15.2:0/4020024440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58c4036040 con 0x55f2a91f75d0 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58aeff5640 1 -- 172.21.15.2:0/4020024440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f58bc09ff20 con 0x55f2a91f75d0 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 10 client.17181 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 1 -- 172.21.15.2:0/4020024440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f2a9280e40 con 0x55f2a91f75d0 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58aeff5640 1 -- 172.21.15.2:0/4020024440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c4036040 con 0x55f2a91f75d0 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58aeff5640 1 -- 172.21.15.2:0/4020024440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f58bc0981e0 con 0x55f2a91f75d0 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 10 client.17181 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 10 client.17181 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 20 client.17181 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55f2a9281520 0x55f2a9283940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 4 client.17181 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:00:05.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58d344a740 1 -- 172.21.15.2:0/4020024440 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2a9164d70 con 0x55f2a9281520 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.784+0000 7f58ca59c640 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55f2a9281520 0x55f2a9283940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58ca59c640 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55f2a9281520 0x55f2a9283940 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b515f70a15c64dd4 server_cookie=4f7742247f532429 in_seq=0 out_seq=0 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58aeff5640 10 client.17181 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58aeff5640 1 -- 172.21.15.2:0/4020024440 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2a9164d70 con 0x55f2a9281520 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58aeff5640 10 client.17181 handle_command_reply: tid=0 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 client.17181 shutdown 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 -- 172.21.15.2:0/4020024440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f75d0 msgr2=0x55f2a920ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f75d0 0x55f2a920ed30 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f58bc09b870 tx=0x7f58bc014400 comp rx=0 tx=0).stop 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 -- 172.21.15.2:0/4020024440 shutdown_connections 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55f2a9281520 0x55f2a9283940 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2a9206780 0x55f2a92005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a91f8b40 0x55f2a9200060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 --2- 172.21.15.2:0/4020024440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2a91f75d0 0x55f2a920ed30 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58aeff5640 0 client.17181 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:00:05.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 -- 172.21.15.2:0/4020024440 >> 172.21.15.2:0/4020024440 conn(0x55f2a91c0310 msgr2=0x55f2a92024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:05.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 -- 172.21.15.2:0/4020024440 shutdown_connections 2024-09-12T01:00:05.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.785+0000 7f58d344a740 1 -- 172.21.15.2:0/4020024440 wait complete. 2024-09-12T01:00:05.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d344a740 20 client.17181 trim_cache size 0 max 16384 2024-09-12T01:00:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 -- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58b40a2cf0 msgr2=0x7f58b40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58b40a2cf0 0x7f58b40a51b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f58c404b000 tx=0x7f58c4048000 comp rx=0 tx=0).stop 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 -- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101de0 msgr2=0x7f58cc198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101de0 0x7f58cc198410 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00c920 tx=0x7f58bc00cde0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 -- 172.21.15.2:0/4056261993 shutdown_connections 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f58b40a2cf0 0x7f58b40a51b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58cc106f10 0x7f58cc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc102790 0x7f58cc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 --2- 172.21.15.2:0/4056261993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101de0 0x7f58cc198410 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:05.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 -- 172.21.15.2:0/4056261993 >> 172.21.15.2:0/4056261993 conn(0x7f58cc0fd8c0 msgr2=0x7f58cc0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:05.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 -- 172.21.15.2:0/4056261993 shutdown_connections 2024-09-12T01:00:05.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:05.786+0000 7f58d1071640 1 -- 172.21.15.2:0/4056261993 wait complete. 2024-09-12T01:00:06.454 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:00:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:06 smithi071 ceph-mon[35276]: pgmap v218: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:00:06.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:06 smithi002 ceph-mon[31210]: pgmap v218: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:00:07.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:06 smithi167 ceph-mon[35234]: pgmap v218: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:00:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.204+0000 7f259aa6a640 1 -- 172.21.15.2:0/140597418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 msgr2=0x7f2594106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.204+0000 7f259aa6a640 1 --2- 172.21.15.2:0/140597418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 0x7f2594106e60 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f2584009930 tx=0x7f258402a420 comp rx=0 tx=0).stop 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.204+0000 7f259aa6a640 1 -- 172.21.15.2:0/140597418 shutdown_connections 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.204+0000 7f259aa6a640 1 --2- 172.21.15.2:0/140597418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2594101420 0x7f259410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 --2- 172.21.15.2:0/140597418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594100a80 0x7f2594100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 --2- 172.21.15.2:0/140597418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 0x7f2594106e60 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 -- 172.21.15.2:0/140597418 >> 172.21.15.2:0/140597418 conn(0x7f25940fc7a0 msgr2=0x7f25940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 -- 172.21.15.2:0/140597418 shutdown_connections 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 -- 172.21.15.2:0/140597418 wait complete. 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 Processor -- start 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 -- start start 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594100a80 0x7f2594198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2594101420 0x7f2594198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 0x7f259419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2594110ea0 con 0x7f2594106a80 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2594110d20 con 0x7f2594100a80 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.205+0000 7f259aa6a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2594111020 con 0x7f2594101420 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 0x7f259419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 0x7f259419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42736/0 (socket says 172.21.15.2:42736) 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 -- 172.21.15.2:0/3327854817 learned_addr learned my addr 172.21.15.2:0/3327854817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2593fff640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2594101420 0x7f2594198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2598806640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594100a80 0x7f2594198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 -- 172.21.15.2:0/3327854817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2594101420 msgr2=0x7f2594198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2594101420 0x7f2594198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 -- 172.21.15.2:0/3327854817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594100a80 msgr2=0x7f2594198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594100a80 0x7f2594198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 -- 172.21.15.2:0/3327854817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259419d3e0 con 0x7f2594106a80 2024-09-12T01:00:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2599007640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 0x7f259419cd00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b970 tx=0x7f258c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2591ffb640 1 -- 172.21.15.2:0/3327854817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c019070 con 0x7f2594106a80 2024-09-12T01:00:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2591ffb640 1 -- 172.21.15.2:0/3327854817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f258c014440 con 0x7f2594106a80 2024-09-12T01:00:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f259aa6a640 1 -- 172.21.15.2:0/3327854817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259419d6d0 con 0x7f2594106a80 2024-09-12T01:00:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.206+0000 7f2591ffb640 1 -- 172.21.15.2:0/3327854817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0075d0 con 0x7f2594106a80 2024-09-12T01:00:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.207+0000 7f259aa6a640 1 -- 172.21.15.2:0/3327854817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25941a4fb0 con 0x7f2594106a80 2024-09-12T01:00:07.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.209+0000 7f2591ffb640 1 -- 172.21.15.2:0/3327854817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f258c01c070 con 0x7f2594106a80 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.209+0000 7f259ce43740 1 Processor -- start 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.209+0000 7f259ce43740 1 -- start start 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.209+0000 7f2591ffb640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25800a2d70 0x7f25800a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2591ffb640 1 -- 172.21.15.2:0/3327854817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7f258c0ce970 con 0x7f2594106a80 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25800a2d70 0x7f25800a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f259ce43740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740773b40 0x556740772090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f259ce43740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567407725d0 0x556740772a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f259ce43740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740781780 0x556740783b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f259ce43740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567406d82f0 con 0x5567407725d0 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f259ce43740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55674067fcf0 con 0x556740781780 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f259ce43740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5567406d42b0 con 0x556740773b40 2024-09-12T01:00:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567407725d0 0x556740772a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567407725d0 0x556740772a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42738/0 (socket says 172.21.15.2:42738) 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 -- 172.21.15.2:0/1568922701 learned_addr learned my addr 172.21.15.2:0/1568922701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2598806640 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740773b40 0x556740772090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2599007640 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740781780 0x556740783b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 -- 172.21.15.2:0/1568922701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740773b40 msgr2=0x556740772090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740773b40 0x556740772090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 -- 172.21.15.2:0/1568922701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740781780 msgr2=0x556740783b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740781780 0x556740783b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 -- 172.21.15.2:0/1568922701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567406643a0 con 0x5567407725d0 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25800a2d70 0x7f25800a5230 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f257c00afd0 tx=0x7f257c013590 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.210+0000 7f2593fff640 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567407725d0 0x556740772a10 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f257c011c20 tx=0x7f257c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f9c83443a879d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f258affd640 1 -- 172.21.15.2:0/1568922701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c00ddd0 con 0x5567407725d0 2024-09-12T01:00:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f258affd640 1 -- 172.21.15.2:0/1568922701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f257c00a910 con 0x5567407725d0 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f258affd640 1 -- 172.21.15.2:0/1568922701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c00e610 con 0x5567407725d0 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 -- 172.21.15.2:0/1568922701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567407725d0 msgr2=0x556740772a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567407725d0 0x556740772a10 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f257c011c20 tx=0x7f257c01b000 comp rx=0 tx=0).stop 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 -- 172.21.15.2:0/1568922701 shutdown_connections 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740781780 0x556740783b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567407725d0 0x556740772a10 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 --2- 172.21.15.2:0/1568922701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740773b40 0x556740772090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 -- 172.21.15.2:0/1568922701 >> 172.21.15.2:0/1568922701 conn(0x55674073b310 msgr2=0x55674076ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 -- 172.21.15.2:0/1568922701 shutdown_connections 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.211+0000 7f259ce43740 1 -- 172.21.15.2:0/1568922701 wait complete. 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 1 -- start start 2024-09-12T01:00:07.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 1 Processor -- start 2024-09-12T01:00:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 0x556740781180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674077e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674077ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556740784420 con 0x556740781780 2024-09-12T01:00:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556740693060 con 0x556740773b40 2024-09-12T01:00:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5567407845a0 con 0x5567407725d0 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f259ce43740 10 client.0 _ll_register_callbacks cb 0x5567403e68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f2599007640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674077ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f2599007640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674077ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42754/0 (socket says 172.21.15.2:42754) 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.212+0000 7f2599007640 1 -- 172.21.15.2:0/879893361 learned_addr learned my addr 172.21.15.2:0/879893361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2598806640 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 0x556740781180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2593fff640 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674077e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2599007640 1 -- 172.21.15.2:0/879893361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 msgr2=0x556740781180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2599007640 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 0x556740781180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2599007640 1 -- 172.21.15.2:0/879893361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 msgr2=0x55674077e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2599007640 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674077e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2599007640 1 -- 172.21.15.2:0/879893361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567404493c0 con 0x556740781780 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2593fff640 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674077e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2599007640 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674077ea20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f258c00bea0 tx=0x7f258c09b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd25eda055bc8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2573fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2573fff640 1 -- 172.21.15.2:0/879893361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0a3b70 con 0x556740781780 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2573fff640 1 -- 172.21.15.2:0/879893361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7f258c0145f0 con 0x556740781780 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f259ce43740 1 -- 172.21.15.2:0/879893361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5567406e5860 con 0x556740781780 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2573fff640 1 -- 172.21.15.2:0/879893361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f258c0a36e0 con 0x556740781780 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f259ce43740 10 client.17193 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f259ce43740 1 -- 172.21.15.2:0/879893361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55674078ff70 con 0x556740781780 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.213+0000 7f2573fff640 1 -- 172.21.15.2:0/879893361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5567406e5860 con 0x556740781780 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f2573fff640 1 -- 172.21.15.2:0/879893361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f258c09a350 con 0x556740781780 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f259ce43740 10 client.17193 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f259ce43740 10 client.17193 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f259ce43740 20 client.17193 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f259ce43740 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556740791480 0x5567407938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f259ce43740 4 client.17193 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f259ce43740 1 -- 172.21.15.2:0/879893361 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567406dfd70 con 0x556740791480 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f2598806640 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556740791480 0x5567407938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f2573fff640 10 client.17193 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.214+0000 7f2598806640 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556740791480 0x5567407938b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c9f330ffd27bab3 server_cookie=f71f579f78e9c23a in_seq=0 out_seq=0 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f2573fff640 1 -- 172.21.15.2:0/879893361 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567406dfd70 con 0x556740791480 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f2573fff640 10 client.17193 handle_command_reply: tid=0 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 client.17193 shutdown 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 -- 172.21.15.2:0/879893361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 msgr2=0x55674077ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674077ea20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f258c00bea0 tx=0x7f258c09b6c0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 -- 172.21.15.2:0/879893361 shutdown_connections 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x556740791480 0x5567407938b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674077ea20 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674077e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 --2- 172.21.15.2:0/879893361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 0x556740781180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f259ce43740 1 -- 172.21.15.2:0/879893361 >> 172.21.15.2:0/879893361 conn(0x55674073b310 msgr2=0x556740774960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:07.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.215+0000 7f2573fff640 0 client.17193 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:00:07.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.216+0000 7f259ce43740 1 -- 172.21.15.2:0/879893361 shutdown_connections 2024-09-12T01:00:07.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.216+0000 7f259ce43740 1 -- 172.21.15.2:0/879893361 wait complete. 2024-09-12T01:00:07.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.216+0000 7f259ce43740 20 client.17193 trim_cache size 0 max 16384 2024-09-12T01:00:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.228+0000 7f259ce43740 1 Processor -- start 2024-09-12T01:00:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f259ce43740 1 -- start start 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f259ce43740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 0x55674078d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f259ce43740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674076e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f259ce43740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674076ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f259ce43740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25941ae280 con 0x556740781780 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f259ce43740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25941abac0 con 0x556740773b40 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f259ce43740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25941a9930 con 0x5567407725d0 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2599007640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674076ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2599007640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674076ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42770/0 (socket says 172.21.15.2:42770) 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2599007640 1 -- 172.21.15.2:0/2055573869 learned_addr learned my addr 172.21.15.2:0/2055573869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2598806640 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 0x55674078d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2593fff640 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674076e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2599007640 1 -- 172.21.15.2:0/2055573869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 msgr2=0x55674078d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2599007640 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 0x55674078d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2599007640 1 -- 172.21.15.2:0/2055573869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 msgr2=0x55674076e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2599007640 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674076e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2599007640 1 -- 172.21.15.2:0/2055573869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674078dc50 con 0x556740781780 2024-09-12T01:00:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.229+0000 7f2593fff640 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674076e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.230+0000 7f2599007640 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674076ec40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f258c0978d0 tx=0x7f258c09f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be7587f732931a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.230+0000 7f258a7fc640 1 -- 172.21.15.2:0/2055573869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0a3b70 con 0x556740781780 2024-09-12T01:00:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.230+0000 7f258a7fc640 1 -- 172.21.15.2:0/2055573869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f258c0b9b40 con 0x556740781780 2024-09-12T01:00:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.230+0000 7f258a7fc640 1 -- 172.21.15.2:0/2055573869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0971a0 con 0x556740781780 2024-09-12T01:00:07.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 -- 172.21.15.2:0/2055573869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 msgr2=0x55674076ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674076ec40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f258c0978d0 tx=0x7f258c09f430 comp rx=0 tx=0).stop 2024-09-12T01:00:07.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 -- 172.21.15.2:0/2055573869 shutdown_connections 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740781780 0x55674076ec40 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556740773b40 0x55674076e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 --2- 172.21.15.2:0/2055573869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567407725d0 0x55674078d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 -- 172.21.15.2:0/2055573869 >> 172.21.15.2:0/2055573869 conn(0x55674073b310 msgr2=0x55674077e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 -- 172.21.15.2:0/2055573869 shutdown_connections 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 -- 172.21.15.2:0/2055573869 wait complete. 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 -- start start 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.231+0000 7f259ce43740 1 Processor -- start 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f259ce43740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5567407725d0 0x556740784fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f259ce43740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740773b40 0x556740785500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f259ce43740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740781780 0x5567407f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f259ce43740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25941a9f80 con 0x556740773b40 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f259ce43740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25941ab3f0 con 0x5567407725d0 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f259ce43740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25941aa650 con 0x556740781780 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f259ce43740 10 client.0 _ll_register_callbacks cb 0x7f258c09ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2593fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740773b40 0x556740785500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2593fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740773b40 0x556740785500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42784/0 (socket says 172.21.15.2:42784) 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2593fff640 1 -- 172.21.15.2:0/675641437 learned_addr learned my addr 172.21.15.2:0/675641437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2599007640 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740781780 0x5567407f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2598806640 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5567407725d0 0x556740784fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2599007640 1 -- 172.21.15.2:0/675641437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5567407725d0 msgr2=0x556740784fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2599007640 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5567407725d0 0x556740784fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2599007640 1 -- 172.21.15.2:0/675641437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740773b40 msgr2=0x556740785500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2599007640 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740773b40 0x556740785500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2599007640 1 -- 172.21.15.2:0/675641437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567407f4800 con 0x556740781780 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2593fff640 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740773b40 0x556740785500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2599007640 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740781780 0x5567407f41c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f258c097360 tx=0x7f258c09b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27363de4975a7d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.232+0000 7f2573fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f2573fff640 1 -- 172.21.15.2:0/675641437 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0971a0 con 0x556740781780 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f2573fff640 1 -- 172.21.15.2:0/675641437 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7f258c0090a0 con 0x556740781780 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 1 -- 172.21.15.2:0/675641437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f258c0b9b40 con 0x556740781780 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f2573fff640 1 -- 172.21.15.2:0/675641437 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f258c0a3b70 con 0x556740781780 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 10 client.26506 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 1 -- 172.21.15.2:0/675641437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5567407f4800 con 0x556740781780 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f2573fff640 1 -- 172.21.15.2:0/675641437 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f258c0b9b40 con 0x556740781780 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f2573fff640 1 -- 172.21.15.2:0/675641437 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f258c0aa060 con 0x556740781780 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 10 client.26506 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 10 client.26506 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:00:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 20 client.26506 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5567407fbd90 0x5567407fe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 4 client.26506 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.233+0000 7f259ce43740 1 -- 172.21.15.2:0/675641437 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55674065c170 con 0x5567407fbd90 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f2598806640 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5567407fbd90 0x5567407fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f2598806640 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5567407fbd90 0x5567407fe180 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19627184b68d837 server_cookie=ca214517f3fca0c3 in_seq=0 out_seq=0 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f2573fff640 10 client.26506 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f2573fff640 1 -- 172.21.15.2:0/675641437 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55674065c170 con 0x5567407fbd90 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f2573fff640 10 client.26506 handle_command_reply: tid=0 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 client.26506 shutdown 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 -- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740781780 msgr2=0x5567407f41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740781780 0x5567407f41c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f258c097360 tx=0x7f258c09b770 comp rx=0 tx=0).stop 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 -- 172.21.15.2:0/675641437 shutdown_connections 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x5567407fbd90 0x5567407fe180 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556740781780 0x5567407f41c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556740773b40 0x556740785500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f2573fff640 0 client.26506 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:00:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 --2- 172.21.15.2:0/675641437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5567407725d0 0x556740784fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.234+0000 7f259ce43740 1 -- 172.21.15.2:0/675641437 >> 172.21.15.2:0/675641437 conn(0x55674073b310 msgr2=0x55674076e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259ce43740 1 -- 172.21.15.2:0/675641437 shutdown_connections 2024-09-12T01:00:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259ce43740 1 -- 172.21.15.2:0/675641437 wait complete. 2024-09-12T01:00:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259ce43740 20 client.26506 trim_cache size 0 max 16384 2024-09-12T01:00:07.239 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:00:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259aa6a640 1 -- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25800a2d70 msgr2=0x7f25800a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259aa6a640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25800a2d70 0x7f25800a5230 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f257c00afd0 tx=0x7f257c013590 comp rx=0 tx=0).stop 2024-09-12T01:00:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259aa6a640 1 -- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 msgr2=0x7f259419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259aa6a640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 0x7f259419cd00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b970 tx=0x7f258c00bd70 comp rx=0 tx=0).stop 2024-09-12T01:00:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259aa6a640 1 -- 172.21.15.2:0/3327854817 shutdown_connections 2024-09-12T01:00:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259aa6a640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25800a2d70 0x7f25800a5230 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.235+0000 7f259aa6a640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594106a80 0x7f259419cd00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.236+0000 7f259aa6a640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2594101420 0x7f2594198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.236+0000 7f259aa6a640 1 --2- 172.21.15.2:0/3327854817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594100a80 0x7f2594198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.236+0000 7f259aa6a640 1 -- 172.21.15.2:0/3327854817 >> 172.21.15.2:0/3327854817 conn(0x7f25940fc7a0 msgr2=0x7f259406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.236+0000 7f259aa6a640 1 -- 172.21.15.2:0/3327854817 shutdown_connections 2024-09-12T01:00:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:07.236+0000 7f259aa6a640 1 -- 172.21.15.2:0/3327854817 wait complete. 2024-09-12T01:00:07.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:07 smithi071 ceph-mon[35276]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:00:07.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:07 smithi002 ceph-mon[31210]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:00:07.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:00:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:07 smithi167 ceph-mon[35234]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:00:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.705+0000 7ff1dbce7640 1 -- 172.21.15.2:0/968484979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 msgr2=0x7ff1d410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.705+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/968484979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 0x7ff1d410e610 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009ca0 tx=0x7ff1cc02a950 comp rx=0 tx=0).stop 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 -- 172.21.15.2:0/968484979 shutdown_connections 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/968484979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 0x7ff1d410e610 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/968484979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4103660 0x7ff1d410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/968484979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1d4102d40 0x7ff1d4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 -- 172.21.15.2:0/968484979 >> 172.21.15.2:0/968484979 conn(0x7ff1d40fc7a0 msgr2=0x7ff1d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 -- 172.21.15.2:0/968484979 shutdown_connections 2024-09-12T01:00:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 -- 172.21.15.2:0/968484979 wait complete. 2024-09-12T01:00:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 Processor -- start 2024-09-12T01:00:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.706+0000 7ff1dbce7640 1 -- start start 2024-09-12T01:00:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1dbce7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4102d40 0x7ff1d4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1dbce7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1d4103660 0x7ff1d4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1dbce7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 0x7ff1d419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1dbce7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4111f70 con 0x7ff1d410c170 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1dbce7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4111df0 con 0x7ff1d4102d40 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1dbce7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41120f0 con 0x7ff1d4103660 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1da284640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 0x7ff1d419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1da284640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 0x7ff1d419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42802/0 (socket says 172.21.15.2:42802) 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1da284640 1 -- 172.21.15.2:0/2190155188 learned_addr learned my addr 172.21.15.2:0/2190155188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4102d40 0x7ff1d4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1d9282640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1d4103660 0x7ff1d4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1da284640 1 -- 172.21.15.2:0/2190155188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1d4103660 msgr2=0x7ff1d4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1da284640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1d4103660 0x7ff1d4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1da284640 1 -- 172.21.15.2:0/2190155188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4102d40 msgr2=0x7ff1d4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1da284640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4102d40 0x7ff1d4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1da284640 1 -- 172.21.15.2:0/2190155188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d419d3c0 con 0x7ff1d410c170 2024-09-12T01:00:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.707+0000 7ff1d9282640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1d4103660 0x7ff1d4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.708+0000 7ff1da284640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 0x7ff1d419cce0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc02ae70 tx=0x7ff1cc02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.708+0000 7ff1caffd640 1 -- 172.21.15.2:0/2190155188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc034040 con 0x7ff1d410c170 2024-09-12T01:00:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.708+0000 7ff1dbce7640 1 -- 172.21.15.2:0/2190155188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d419d650 con 0x7ff1d410c170 2024-09-12T01:00:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.708+0000 7ff1caffd640 1 -- 172.21.15.2:0/2190155188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1cc030920 con 0x7ff1d410c170 2024-09-12T01:00:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.708+0000 7ff1caffd640 1 -- 172.21.15.2:0/2190155188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc045480 con 0x7ff1d410c170 2024-09-12T01:00:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.708+0000 7ff1dbce7640 1 -- 172.21.15.2:0/2190155188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d41a4f90 con 0x7ff1d410c170 2024-09-12T01:00:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.710+0000 7ff1caffd640 1 -- 172.21.15.2:0/2190155188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7ff1cc037020 con 0x7ff1d410c170 2024-09-12T01:00:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.710+0000 7ff1de0c0740 1 Processor -- start 2024-09-12T01:00:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1de0c0740 1 -- start start 2024-09-12T01:00:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebeda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 0x55f86ebfa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f86eb532f0 con 0x55f86ebeeb40 2024-09-12T01:00:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f86eafacf0 con 0x55f86ebf8370 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f86eb4f2b0 con 0x55f86ebed5d0 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1d9282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1d9282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42806/0 (socket says 172.21.15.2:42806) 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1d9282640 1 -- 172.21.15.2:0/1343308380 learned_addr learned my addr 172.21.15.2:0/1343308380 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1caffd640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1c00a2cf0 0x7ff1c00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebeda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1d9282640 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 0x55f86ebfa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.711+0000 7ff1da284640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1c00a2cf0 0x7ff1c00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1d9282640 1 -- 172.21.15.2:0/1343308380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 msgr2=0x55f86ebeda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1d9282640 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebeda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1d9282640 1 -- 172.21.15.2:0/1343308380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 msgr2=0x55f86ebfa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1d9282640 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 0x55f86ebfa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1d9282640 1 -- 172.21.15.2:0/1343308380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86eadf3a0 con 0x55f86ebeeb40 2024-09-12T01:00:08.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1caffd640 1 -- 172.21.15.2:0/2190155188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7ff1cc0f0400 con 0x7ff1d410c170 2024-09-12T01:00:08.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebeda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:08.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1da284640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1c00a2cf0 0x7ff1c00a51b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0edc70 tx=0x7ff1cc0b8c30 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:08.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1d9282640 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebed090 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4005fd0 tx=0x7ff1c4008550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3080f724094ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:08.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1bffff640 1 -- 172.21.15.2:0/1343308380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4018030 con 0x55f86ebeeb40 2024-09-12T01:00:08.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1bffff640 1 -- 172.21.15.2:0/1343308380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c4005500 con 0x55f86ebeeb40 2024-09-12T01:00:08.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.712+0000 7ff1bffff640 1 -- 172.21.15.2:0/1343308380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400c790 con 0x55f86ebeeb40 2024-09-12T01:00:08.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 -- 172.21.15.2:0/1343308380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 msgr2=0x55f86ebed090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebed090 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4005fd0 tx=0x7ff1c4008550 comp rx=0 tx=0).stop 2024-09-12T01:00:08.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 -- 172.21.15.2:0/1343308380 shutdown_connections 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 0x55f86ebfa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebeda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/1343308380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebed090 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 -- 172.21.15.2:0/1343308380 >> 172.21.15.2:0/1343308380 conn(0x55f86ebb6310 msgr2=0x55f86ebe9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 -- 172.21.15.2:0/1343308380 shutdown_connections 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 -- 172.21.15.2:0/1343308380 wait complete. 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.713+0000 7ff1de0c0740 1 -- start start 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1de0c0740 1 Processor -- start 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebed5d0 0x55f86ebf7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 0x55f86ebf57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f86ebfb070 con 0x55f86ebeeb40 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f86eb0e060 con 0x55f86ebed5d0 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f86ebfb1f0 con 0x55f86ebf8370 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1de0c0740 10 client.0 _ll_register_callbacks cb 0x55f86e8618c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1d9a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1d9a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42818/0 (socket says 172.21.15.2:42818) 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1d9282640 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebed5d0 0x55f86ebf7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1d9a83640 1 -- 172.21.15.2:0/3123126149 learned_addr learned my addr 172.21.15.2:0/3123126149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.714+0000 7ff1d9282640 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 0x55f86ebf57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1d9a83640 1 -- 172.21.15.2:0/3123126149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 msgr2=0x55f86ebf57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 0x55f86ebf57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1d9a83640 1 -- 172.21.15.2:0/3123126149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebed5d0 msgr2=0x55f86ebf7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebed5d0 0x55f86ebf7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1d9a83640 1 -- 172.21.15.2:0/3123126149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86e8c43c0 con 0x55f86ebeeb40 2024-09-12T01:00:08.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1d9282640 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 0x55f86ebf57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf50a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000bed0 tx=0x7ff1d00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe90686e7b3292b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3123126149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0012650 con 0x55f86ebeeb40 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3123126149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1c4005500 con 0x55f86ebeeb40 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3123126149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7ff1d00127f0 con 0x55f86ebeeb40 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3123126149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff1d00129f0 con 0x55f86ebeeb40 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1de0c0740 10 client.17211 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3123126149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f86ec06bf0 con 0x55f86ebeeb40 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3123126149 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c4005500 con 0x55f86ebeeb40 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3123126149 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7ff1d001a3d0 con 0x55f86ebeeb40 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1de0c0740 10 client.17211 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1de0c0740 10 client.17211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.715+0000 7ff1de0c0740 20 client.17211 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.716+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f86ec08000 0x55f86ec0a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.716+0000 7ff1de0c0740 4 client.17211 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.716+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3123126149 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f86eb60860 con 0x55f86ec08000 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.716+0000 7ff1d9282640 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f86ec08000 0x55f86ec0a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.716+0000 7ff1bd7fa640 10 client.17211 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.716+0000 7ff1d9282640 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f86ec08000 0x55f86ec0a460 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40086c9fd2064ce2 server_cookie=3f018e0482201eba in_seq=0 out_seq=0 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3123126149 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f86eb60860 con 0x55f86ec08000 2024-09-12T01:00:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1bd7fa640 10 client.17211 handle_command_reply: tid=0 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 client.17211 shutdown 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3123126149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 msgr2=0x55f86ebf50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf50a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000bed0 tx=0x7ff1d00117b0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3123126149 shutdown_connections 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f86ec08000 0x55f86ec0a460 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 0x55f86ebf57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf50a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3123126149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebed5d0 0x55f86ebf7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1bd7fa640 0 client.17211 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3123126149 >> 172.21.15.2:0/3123126149 conn(0x55f86ebb6310 msgr2=0x55f86ebef960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3123126149 shutdown_connections 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3123126149 wait complete. 2024-09-12T01:00:08.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.717+0000 7ff1de0c0740 20 client.17211 trim_cache size 0 max 16384 2024-09-12T01:00:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.730+0000 7ff1de0c0740 1 Processor -- start 2024-09-12T01:00:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.730+0000 7ff1de0c0740 1 -- start start 2024-09-12T01:00:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.730+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebf0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 0x55f86ec0fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41b03b0 con 0x55f86ebeeb40 2024-09-12T01:00:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41adbf0 con 0x55f86ebf8370 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41aba60 con 0x55f86ebed5d0 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42830/0 (socket says 172.21.15.2:42830) 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 -- 172.21.15.2:0/2203395045 learned_addr learned my addr 172.21.15.2:0/2203395045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9282640 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebf0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 -- 172.21.15.2:0/2203395045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 msgr2=0x55f86ebf0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebf0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 -- 172.21.15.2:0/2203395045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 msgr2=0x55f86ec0fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 0x55f86ec0fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 -- 172.21.15.2:0/2203395045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86ebf0ba0 con 0x55f86ebeeb40 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9282640 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebf0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf0660 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff1d001a870 tx=0x7ff1d0005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74399b5713262b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1bf7fe640 1 -- 172.21.15.2:0/2203395045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d001ac60 con 0x55f86ebeeb40 2024-09-12T01:00:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1bf7fe640 1 -- 172.21.15.2:0/2203395045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d001a3d0 con 0x55f86ebeeb40 2024-09-12T01:00:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.731+0000 7ff1bf7fe640 1 -- 172.21.15.2:0/2203395045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00052a0 con 0x55f86ebeeb40 2024-09-12T01:00:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 -- 172.21.15.2:0/2203395045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 msgr2=0x55f86ebf0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf0660 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff1d001a870 tx=0x7ff1d0005c50 comp rx=0 tx=0).stop 2024-09-12T01:00:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 -- 172.21.15.2:0/2203395045 shutdown_connections 2024-09-12T01:00:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebf8370 0x55f86ec0fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebeeb40 0x55f86ebf0660 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/2203395045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebed5d0 0x55f86ebf0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 -- 172.21.15.2:0/2203395045 >> 172.21.15.2:0/2203395045 conn(0x55f86ebb6310 msgr2=0x55f86ebf7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 -- 172.21.15.2:0/2203395045 shutdown_connections 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 -- 172.21.15.2:0/2203395045 wait complete. 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 -- start start 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.732+0000 7ff1de0c0740 1 Processor -- start 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebed5d0 0x55f86ec00480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebeeb40 0x55f86ec009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1de0c0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 0x55f86ebfd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41ac0b0 con 0x55f86ebed5d0 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41ad520 con 0x55f86ebeeb40 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1de0c0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41ac780 con 0x55f86ebf8370 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1de0c0740 10 client.0 _ll_register_callbacks cb 0x7ff1d000b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebed5d0 0x55f86ec00480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebed5d0 0x55f86ec00480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42834/0 (socket says 172.21.15.2:42834) 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9282640 1 -- 172.21.15.2:0/3507589784 learned_addr learned my addr 172.21.15.2:0/3507589784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebeeb40 0x55f86ec009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9282640 1 -- 172.21.15.2:0/3507589784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 msgr2=0x55f86ebfd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9282640 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 0x55f86ebfd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9282640 1 -- 172.21.15.2:0/3507589784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebeeb40 msgr2=0x55f86ec009c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9282640 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebeeb40 0x55f86ec009c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.733+0000 7ff1d9282640 1 -- 172.21.15.2:0/3507589784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86ec01000 con 0x55f86ebed5d0 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1d9282640 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebed5d0 0x55f86ec00480 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4005d90 tx=0x7ff1c4008a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e4aac1617d293a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3507589784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c402d060 con 0x55f86ebed5d0 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3507589784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7ff1c4004ca0 con 0x55f86ebed5d0 2024-09-12T01:00:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3507589784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1d001a3d0 con 0x55f86ebed5d0 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3507589784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff1c4004a70 con 0x55f86ebed5d0 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1de0c0740 10 client.17217 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3507589784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f86ec73210 con 0x55f86ebed5d0 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3507589784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d001a3d0 con 0x55f86ebed5d0 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3507589784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7ff1c400c940 con 0x55f86ebed5d0 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.734+0000 7ff1de0c0740 10 client.17217 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.735+0000 7ff1de0c0740 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.735+0000 7ff1de0c0740 20 client.17217 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.735+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f86ec737b0 0x55f86ec75bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.735+0000 7ff1de0c0740 4 client.17217 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.735+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3507589784 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f86eb5ad70 con 0x55f86ec737b0 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.735+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f86ec737b0 0x55f86ec75bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.735+0000 7ff1bd7fa640 10 client.17217 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.735+0000 7ff1d9a83640 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f86ec737b0 0x55f86ec75bd0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee9474c8eeb063f6 server_cookie=3947287a784920f6 in_seq=0 out_seq=0 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1bd7fa640 1 -- 172.21.15.2:0/3507589784 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f86eb5ad70 con 0x55f86ec737b0 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1bd7fa640 10 client.17217 handle_command_reply: tid=0 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 client.17217 shutdown 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3507589784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebed5d0 msgr2=0x55f86ec00480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebed5d0 0x55f86ec00480 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4005d90 tx=0x7ff1c4008a30 comp rx=0 tx=0).stop 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3507589784 shutdown_connections 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f86ec737b0 0x55f86ec75bd0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f86ebf8370 0x55f86ebfd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86ebeeb40 0x55f86ec009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 --2- 172.21.15.2:0/3507589784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f86ebed5d0 0x55f86ec00480 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1bd7fa640 0 client.17217 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3507589784 >> 172.21.15.2:0/3507589784 conn(0x55f86ebb6310 msgr2=0x55f86ebe8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3507589784 shutdown_connections 2024-09-12T01:00:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 1 -- 172.21.15.2:0/3507589784 wait complete. 2024-09-12T01:00:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.736+0000 7ff1de0c0740 20 client.17217 trim_cache size 0 max 16384 2024-09-12T01:00:08.741 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 -- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1c00a2cf0 msgr2=0x7ff1c00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1c00a2cf0 0x7ff1c00a51b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0edc70 tx=0x7ff1cc0b8c30 comp rx=0 tx=0).stop 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 -- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 msgr2=0x7ff1d419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 0x7ff1d419cce0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc02ae70 tx=0x7ff1cc02f5b0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 -- 172.21.15.2:0/2190155188 shutdown_connections 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1c00a2cf0 0x7ff1c00a51b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d410c170 0x7ff1d419cce0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1d4103660 0x7ff1d4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 --2- 172.21.15.2:0/2190155188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4102d40 0x7ff1d4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 -- 172.21.15.2:0/2190155188 >> 172.21.15.2:0/2190155188 conn(0x7ff1d40fc7a0 msgr2=0x7ff1d40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 -- 172.21.15.2:0/2190155188 shutdown_connections 2024-09-12T01:00:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:08.737+0000 7ff1dbce7640 1 -- 172.21.15.2:0/2190155188 wait complete. 2024-09-12T01:00:08.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:08 smithi071 ceph-mon[35276]: pgmap v220: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:00:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:08 smithi002 ceph-mon[31210]: pgmap v220: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:00:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:08 smithi167 ceph-mon[35234]: pgmap v220: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:00:09.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:09 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:00:09.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:09 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:00:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:09 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:00:10.523 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:00:10.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:00:10.783 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:10.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:10 smithi002 ceph-mon[31210]: pgmap v221: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:00:10.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:10 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:00:10.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:10 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:00:10.903 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:10 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:00:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:10 smithi071 ceph-mon[35276]: pgmap v221: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:00:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:10 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:00:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:10 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:00:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:10 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:00:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:10 smithi167 ceph-mon[35234]: pgmap v221: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:00:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:10 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:00:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:10 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:00:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:10 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 -- 172.21.15.2:0/3426255898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85681008d0 msgr2=0x7f8568100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 --2- 172.21.15.2:0/3426255898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85681008d0 0x7f8568100cb0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8558009900 tx=0x7f855802a410 comp rx=0 tx=0).stop 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 -- 172.21.15.2:0/3426255898 shutdown_connections 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 --2- 172.21.15.2:0/3426255898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f856810e480 0x7f8568110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 --2- 172.21.15.2:0/3426255898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8568101280 0x7f856810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 --2- 172.21.15.2:0/3426255898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85681008d0 0x7f8568100cb0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 -- 172.21.15.2:0/3426255898 >> 172.21.15.2:0/3426255898 conn(0x7f85680fc7a0 msgr2=0x7f85680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 -- 172.21.15.2:0/3426255898 shutdown_connections 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 -- 172.21.15.2:0/3426255898 wait complete. 2024-09-12T01:00:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.267+0000 7f856ca75640 1 Processor -- start 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856ca75640 1 -- start start 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856ca75640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85681008d0 0x7f856819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856ca75640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8568101280 0x7f856819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856ca75640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856810e480 0x7f856819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856ca75640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85681141b0 con 0x7f856810e480 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856ca75640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8568114030 con 0x7f85681008d0 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856ca75640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8568114330 con 0x7f8568101280 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856810e480 0x7f856819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856810e480 0x7f856819ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42856/0 (socket says 172.21.15.2:42856) 2024-09-12T01:00:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 -- 172.21.15.2:0/3095996359 learned_addr learned my addr 172.21.15.2:0/3095996359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8568101280 0x7f856819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856659c640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85681008d0 0x7f856819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 -- 172.21.15.2:0/3095996359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8568101280 msgr2=0x7f856819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8568101280 0x7f856819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 -- 172.21.15.2:0/3095996359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85681008d0 msgr2=0x7f856819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85681008d0 0x7f856819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 -- 172.21.15.2:0/3095996359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856819f640 con 0x7f856810e480 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8568101280 0x7f856819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f856659c640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85681008d0 0x7f856819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.268+0000 7f8566d9d640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856810e480 0x7f856819ef60 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8560009fd0 tx=0x7f856000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.269+0000 7f85577fe640 1 -- 172.21.15.2:0/3095996359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560004d20 con 0x7f856810e480 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.269+0000 7f85577fe640 1 -- 172.21.15.2:0/3095996359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8560005020 con 0x7f856810e480 2024-09-12T01:00:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.269+0000 7f856ca75640 1 -- 172.21.15.2:0/3095996359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856819f930 con 0x7f856810e480 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.269+0000 7f85577fe640 1 -- 172.21.15.2:0/3095996359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85600116d0 con 0x7f856810e480 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.269+0000 7f856ca75640 1 -- 172.21.15.2:0/3095996359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85681a7210 con 0x7f856810e480 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.271+0000 7f856ee4e740 1 Processor -- start 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.271+0000 7f85577fe640 1 -- 172.21.15.2:0/3095996359 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f85600051d0 con 0x7f856810e480 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.271+0000 7f856ee4e740 1 -- start start 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 0x561297ecbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ed6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f856ee4e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561297e31280 con 0x561297ed6d40 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f856ee4e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561297dd8b10 con 0x561297ecbb60 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f856ee4e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561297e2d240 con 0x561297ecc480 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42858/0 (socket says 172.21.15.2:42858) 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 -- 172.21.15.2:0/3058315327 learned_addr learned my addr 172.21.15.2:0/3058315327 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 0x561297ecbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f856659c640 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ed6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 -- 172.21.15.2:0/3058315327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 msgr2=0x561297ed6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ed6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 -- 172.21.15.2:0/3058315327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 msgr2=0x561297ecbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 0x561297ecbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f85577fe640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85500a2d70 0x7f85500a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 -- 172.21.15.2:0/3058315327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561297de51f0 con 0x561297ed6d40 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8566d9d640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85500a2d70 0x7f85500a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed9130 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f855c0124f0 tx=0x7f855c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f378de3d3ac07c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.272+0000 7f85577fe640 1 -- 172.21.15.2:0/3095996359 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7f85600cfa30 con 0x7f856810e480 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f8554ff9640 1 -- 172.21.15.2:0/3058315327 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c018070 con 0x561297ed6d40 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f8554ff9640 1 -- 172.21.15.2:0/3058315327 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c010910 con 0x561297ed6d40 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f8554ff9640 1 -- 172.21.15.2:0/3058315327 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00e900 con 0x561297ed6d40 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f8566d9d640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85500a2d70 0x7f85500a5230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f85600cd190 tx=0x7f856006de70 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f856ee4e740 1 -- 172.21.15.2:0/3058315327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 msgr2=0x561297ed9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed9130 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f855c0124f0 tx=0x7f855c00b600 comp rx=0 tx=0).stop 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f856ee4e740 1 -- 172.21.15.2:0/3058315327 shutdown_connections 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed9130 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ed6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3058315327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 0x561297ecbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.273+0000 7f856ee4e740 1 -- 172.21.15.2:0/3058315327 >> 172.21.15.2:0/3058315327 conn(0x561297ec80f0 msgr2=0x561297ec84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 -- 172.21.15.2:0/3058315327 shutdown_connections 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 -- 172.21.15.2:0/3058315327 wait complete. 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 -- start start 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 Processor -- start 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecbb60 0x561297ed3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecc480 0x561297ed41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561297ed9910 con 0x561297ed6d40 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561297debf10 con 0x561297ecc480 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.274+0000 7f856ee4e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561297ed9a90 con 0x561297ecbb60 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f856ee4e740 10 client.0 _ll_register_callbacks cb 0x561297db4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42862/0 (socket says 172.21.15.2:42862) 2024-09-12T01:00:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 -- 172.21.15.2:0/3790367564 learned_addr learned my addr 172.21.15.2:0/3790367564 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecbb60 0x561297ed3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f856659c640 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecc480 0x561297ed41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 -- 172.21.15.2:0/3790367564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecbb60 msgr2=0x561297ed3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecbb60 0x561297ed3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 -- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecc480 msgr2=0x561297ed41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecc480 0x561297ed41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 -- 172.21.15.2:0/3790367564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561297ba26a0 con 0x561297ed6d40 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f856659c640 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecc480 0x561297ed41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f8565d9b640 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed4720 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f855c0108c0 tx=0x7f855c012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6210db98fad7ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f854dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f854dffb640 1 -- 172.21.15.2:0/3790367564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c018030 con 0x561297ed6d40 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f854dffb640 1 -- 172.21.15.2:0/3790367564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7f855c004020 con 0x561297ed6d40 2024-09-12T01:00:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.275+0000 7f856ee4e740 1 -- 172.21.15.2:0/3790367564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c010910 con 0x561297ed6d40 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f854dffb640 1 -- 172.21.15.2:0/3790367564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f855c004220 con 0x561297ed6d40 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856ee4e740 10 client.17229 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856ee4e740 1 -- 172.21.15.2:0/3790367564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561297ee5590 con 0x561297ed6d40 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f854dffb640 1 -- 172.21.15.2:0/3790367564 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c010910 con 0x561297ed6d40 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f854dffb640 1 -- 172.21.15.2:0/3790367564 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f855c029020 con 0x561297ed6d40 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856ee4e740 10 client.17229 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856ee4e740 10 client.17229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856ee4e740 20 client.17229 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561297ee68e0 0x561297ee8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856ee4e740 4 client.17229 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856ee4e740 1 -- 172.21.15.2:0/3790367564 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561297e3e7f0 con 0x561297ee68e0 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.276+0000 7f856659c640 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561297ee68e0 0x561297ee8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.277+0000 7f856659c640 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561297ee68e0 0x561297ee8cd0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db678217e381547b server_cookie=88145a1cc000f8dd in_seq=0 out_seq=0 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.277+0000 7f854dffb640 10 client.17229 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f854dffb640 1 -- 172.21.15.2:0/3790367564 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561297e3e7f0 con 0x561297ee68e0 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f854dffb640 10 client.17229 handle_command_reply: tid=0 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 client.17229 shutdown 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 -- 172.21.15.2:0/3790367564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 msgr2=0x561297ed4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed4720 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f855c0108c0 tx=0x7f855c012f90 comp rx=0 tx=0).stop 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 -- 172.21.15.2:0/3790367564 shutdown_connections 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561297ee68e0 0x561297ee8cd0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297ed4720 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f854dffb640 0 client.17229 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecc480 0x561297ed41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 --2- 172.21.15.2:0/3790367564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecbb60 0x561297ed3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 -- 172.21.15.2:0/3790367564 >> 172.21.15.2:0/3790367564 conn(0x561297ec80f0 msgr2=0x561297ecddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 -- 172.21.15.2:0/3790367564 shutdown_connections 2024-09-12T01:00:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 1 -- 172.21.15.2:0/3790367564 wait complete. 2024-09-12T01:00:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.278+0000 7f856ee4e740 20 client.17229 trim_cache size 0 max 16384 2024-09-12T01:00:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.295+0000 7f856ee4e740 1 Processor -- start 2024-09-12T01:00:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.295+0000 7f856ee4e740 1 -- start start 2024-09-12T01:00:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 0x561297ed2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ec7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297eee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f856ee4e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85681b2840 con 0x561297ed6d40 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f856ee4e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85681b0080 con 0x561297ecbb60 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f856ee4e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f85681adef0 con 0x561297ecc480 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297eee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297eee3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42876/0 (socket says 172.21.15.2:42876) 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 -- 172.21.15.2:0/4032480388 learned_addr learned my addr 172.21.15.2:0/4032480388 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 0x561297ed2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f856659c640 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ec7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 -- 172.21.15.2:0/4032480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 msgr2=0x561297ec7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ec7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 -- 172.21.15.2:0/4032480388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 msgr2=0x561297ed2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 0x561297ed2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 -- 172.21.15.2:0/4032480388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561297ed6570 con 0x561297ed6d40 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f856659c640 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ec7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f8565d9b640 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297eee3c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f855c00bee0 tx=0x7f855c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83091e5f8b59832 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.296+0000 7f854ffff640 1 -- 172.21.15.2:0/4032480388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c018070 con 0x561297ed6d40 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f854ffff640 1 -- 172.21.15.2:0/4032480388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c010be0 con 0x561297ed6d40 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f854ffff640 1 -- 172.21.15.2:0/4032480388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c004680 con 0x561297ed6d40 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 -- 172.21.15.2:0/4032480388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 msgr2=0x561297eee3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297eee3c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f855c00bee0 tx=0x7f855c000bc0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 -- 172.21.15.2:0/4032480388 shutdown_connections 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ed6d40 0x561297eee3c0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ec7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 --2- 172.21.15.2:0/4032480388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ecbb60 0x561297ed2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 -- 172.21.15.2:0/4032480388 >> 172.21.15.2:0/4032480388 conn(0x561297ec80f0 msgr2=0x561297ec6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 -- 172.21.15.2:0/4032480388 shutdown_connections 2024-09-12T01:00:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.297+0000 7f856ee4e740 1 -- 172.21.15.2:0/4032480388 wait complete. 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 1 -- start start 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 1 Processor -- start 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ecbb60 0x561297ed0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ed13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ed6d40 0x561297ed18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85681ae540 con 0x561297ecbb60 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85681af9b0 con 0x561297ed6d40 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f85681aec10 con 0x561297ecc480 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856ee4e740 10 client.0 _ll_register_callbacks cb 0x7f855c00bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f8565d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ecbb60 0x561297ed0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f8565d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ecbb60 0x561297ed0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42878/0 (socket says 172.21.15.2:42878) 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f8565d9b640 1 -- 172.21.15.2:0/1091424325 learned_addr learned my addr 172.21.15.2:0/1091424325 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f8565d9b640 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ed6d40 0x561297ed18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f8565d9b640 1 -- 172.21.15.2:0/1091424325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 msgr2=0x561297ed13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.298+0000 7f856659c640 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ed13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f8565d9b640 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ed13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f8565d9b640 1 -- 172.21.15.2:0/1091424325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ed6d40 msgr2=0x561297ed18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f8565d9b640 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ed6d40 0x561297ed18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f8565d9b640 1 -- 172.21.15.2:0/1091424325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561297f50590 con 0x561297ecbb60 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f8565d9b640 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ecbb60 0x561297ed0e70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x561297e313b0 tx=0x7f855c005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a82e478c4c169d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f854dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f854dffb640 1 -- 172.21.15.2:0/1091424325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c018040 con 0x561297ecbb60 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f854dffb640 1 -- 172.21.15.2:0/1091424325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7f855c026040 con 0x561297ecbb60 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 1 -- 172.21.15.2:0/1091424325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c010be0 con 0x561297ecbb60 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f854dffb640 1 -- 172.21.15.2:0/1091424325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f855c00b340 con 0x561297ecbb60 2024-09-12T01:00:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 10 client.17235 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 1 -- 172.21.15.2:0/1091424325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561297f51820 con 0x561297ecbb60 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f854dffb640 1 -- 172.21.15.2:0/1091424325 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c010be0 con 0x561297ecbb60 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f854dffb640 1 -- 172.21.15.2:0/1091424325 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f855c029040 con 0x561297ecbb60 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 10 client.17235 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 20 client.17235 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561297ee68e0 0x561297f53ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 4 client.17235 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:00:11.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.299+0000 7f856ee4e740 1 -- 172.21.15.2:0/1091424325 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561297e38d00 con 0x561297ee68e0 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.300+0000 7f856659c640 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561297ee68e0 0x561297f53ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.300+0000 7f854dffb640 10 client.17235 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.300+0000 7f856659c640 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561297ee68e0 0x561297f53ea0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceac3e6861bce831 server_cookie=99806d8f17324155 in_seq=0 out_seq=0 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f854dffb640 1 -- 172.21.15.2:0/1091424325 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561297e38d00 con 0x561297ee68e0 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f854dffb640 10 client.17235 handle_command_reply: tid=0 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 client.17235 shutdown 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 -- 172.21.15.2:0/1091424325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ecbb60 msgr2=0x561297ed0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ecbb60 0x561297ed0e70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x561297e313b0 tx=0x7f855c005f40 comp rx=0 tx=0).stop 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 -- 172.21.15.2:0/1091424325 shutdown_connections 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x561297ee68e0 0x561297f53ea0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297ed6d40 0x561297ed18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f854dffb640 0 client.17235 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561297ecc480 0x561297ed13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 --2- 172.21.15.2:0/1091424325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561297ecbb60 0x561297ed0e70 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 -- 172.21.15.2:0/1091424325 >> 172.21.15.2:0/1091424325 conn(0x561297ec80f0 msgr2=0x561297ed4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 -- 172.21.15.2:0/1091424325 shutdown_connections 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 1 -- 172.21.15.2:0/1091424325 wait complete. 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.301+0000 7f856ee4e740 20 client.17235 trim_cache size 0 max 16384 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "3f297f3f-8f35-4b76-a454-6c256b493a9a", 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T01:00:11.311 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 -- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85500a2d70 msgr2=0x7f85500a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85500a2d70 0x7f85500a5230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f85600cd190 tx=0x7f856006de70 comp rx=0 tx=0).stop 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 -- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856810e480 msgr2=0x7f856819ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856810e480 0x7f856819ef60 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8560009fd0 tx=0x7f856000ee60 comp rx=0 tx=0).stop 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 -- 172.21.15.2:0/3095996359 shutdown_connections 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f85500a2d70 0x7f85500a5230 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856810e480 0x7f856819ef60 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8568101280 0x7f856819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 --2- 172.21.15.2:0/3095996359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85681008d0 0x7f856819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 -- 172.21.15.2:0/3095996359 >> 172.21.15.2:0/3095996359 conn(0x7f85680fc7a0 msgr2=0x7f85680feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 -- 172.21.15.2:0/3095996359 shutdown_connections 2024-09-12T01:00:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:11.302+0000 7f856ca75640 1 -- 172.21.15.2:0/3095996359 wait complete. 2024-09-12T01:00:11.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:00:12.205 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:12.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:12 smithi002 ceph-mon[31210]: pgmap v222: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:12.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:12 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T01:00:12.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:12 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:12.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:12 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T01:00:12.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:12 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 -- 172.21.15.2:0/2995177086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c0102d40 msgr2=0x7fc2c0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 --2- 172.21.15.2:0/2995177086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c0102d40 0x7fc2c0103120 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009900 tx=0x7fc2bc02a480 comp rx=0 tx=0).stop 2024-09-12T01:00:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 -- 172.21.15.2:0/2995177086 shutdown_connections 2024-09-12T01:00:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 --2- 172.21.15.2:0/2995177086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c010c170 0x7fc2c010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 --2- 172.21.15.2:0/2995177086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c0103660 0x7fc2c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 --2- 172.21.15.2:0/2995177086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c0102d40 0x7fc2c0103120 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 -- 172.21.15.2:0/2995177086 >> 172.21.15.2:0/2995177086 conn(0x7fc2c00fc7a0 msgr2=0x7fc2c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 -- 172.21.15.2:0/2995177086 shutdown_connections 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 -- 172.21.15.2:0/2995177086 wait complete. 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 Processor -- start 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.714+0000 7fc2c7880640 1 -- start start 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c7880640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c0102d40 0x7fc2c01a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c7880640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c0103660 0x7fc2c01a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c7880640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c010c170 0x7fc2c019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c7880640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0112030 con 0x7fc2c010c170 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c7880640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0111eb0 con 0x7fc2c0102d40 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c7880640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01121b0 con 0x7fc2c0103660 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c010c170 0x7fc2c019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c010c170 0x7fc2c019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42904/0 (socket says 172.21.15.2:42904) 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 -- 172.21.15.2:0/3932890354 learned_addr learned my addr 172.21.15.2:0/3932890354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c561c640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c0102d40 0x7fc2c01a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c0103660 0x7fc2c01a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 -- 172.21.15.2:0/3932890354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c0103660 msgr2=0x7fc2c01a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c0103660 0x7fc2c01a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 -- 172.21.15.2:0/3932890354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c0102d40 msgr2=0x7fc2c01a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c0102d40 0x7fc2c01a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 -- 172.21.15.2:0/3932890354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c019aed0 con 0x7fc2c010c170 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.715+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c010c170 0x7fc2c019a660 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800b970 tx=0x7fc2b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.716+0000 7fc2b67fc640 1 -- 172.21.15.2:0/3932890354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8019070 con 0x7fc2c010c170 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.716+0000 7fc2b67fc640 1 -- 172.21.15.2:0/3932890354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b800cb40 con 0x7fc2c010c170 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.716+0000 7fc2c7880640 1 -- 172.21.15.2:0/3932890354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c019b1c0 con 0x7fc2c010c170 2024-09-12T01:00:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.716+0000 7fc2b67fc640 1 -- 172.21.15.2:0/3932890354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8007650 con 0x7fc2c010c170 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.716+0000 7fc2c7880640 1 -- 172.21.15.2:0/3932890354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c01a7340 con 0x7fc2c010c170 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c9c59740 1 Processor -- start 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2b67fc640 1 -- 172.21.15.2:0/3932890354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc2b801c070 con 0x7fc2c010c170 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c9c59740 1 -- start start 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e80880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e8b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15e8da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a15de62e0 con 0x557a15e804a0 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a15d8dce0 con 0x557a15e80dc0 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557a15de22a0 con 0x557a15e8b680 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c4e1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e80880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c4e1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e80880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42918/0 (socket says 172.21.15.2:42918) 2024-09-12T01:00:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c4e1b640 1 -- 172.21.15.2:0/3786554949 learned_addr learned my addr 172.21.15.2:0/3786554949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.719+0000 7fc2c561c640 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e8b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15e8da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2c4e1b640 1 -- 172.21.15.2:0/3786554949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 msgr2=0x557a15e8da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15e8da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2c4e1b640 1 -- 172.21.15.2:0/3786554949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 msgr2=0x557a15e8b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e8b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2c4e1b640 1 -- 172.21.15.2:0/3786554949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a15d72440 con 0x557a15e804a0 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2b67fc640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2ac0a2cf0 0x7fc2ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e80880 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0006aa0 tx=0x7fc2b00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcac37352a0ebbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2c561c640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2ac0a2cf0 0x7fc2ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2b67fc640 1 -- 172.21.15.2:0/3932890354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7fc2b80cea30 con 0x7fc2c010c170 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2ab7fe640 1 -- 172.21.15.2:0/3786554949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0017610 con 0x557a15e804a0 2024-09-12T01:00:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2ab7fe640 1 -- 172.21.15.2:0/3786554949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b001c070 con 0x557a15e804a0 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.720+0000 7fc2ab7fe640 1 -- 172.21.15.2:0/3786554949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00159d0 con 0x557a15e804a0 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 -- 172.21.15.2:0/3786554949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 msgr2=0x557a15e80880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e80880 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0006aa0 tx=0x7fc2b00095c0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c561c640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2ac0a2cf0 0x7fc2ac0a51b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc000c00 tx=0x7fc2bc0058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 -- 172.21.15.2:0/3786554949 shutdown_connections 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15e8da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e8b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/3786554949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e80880 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 -- 172.21.15.2:0/3786554949 >> 172.21.15.2:0/3786554949 conn(0x557a15e7ca30 msgr2=0x557a15e7ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 -- 172.21.15.2:0/3786554949 shutdown_connections 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 -- 172.21.15.2:0/3786554949 wait complete. 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 -- start start 2024-09-12T01:00:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.721+0000 7fc2c9c59740 1 Processor -- start 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e804a0 0x557a15e8aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e88190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e8b680 0x557a15e886d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a15e8e250 con 0x557a15e8b680 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a15da1050 con 0x557a15e80dc0 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557a15e8e3d0 con 0x557a15e804a0 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c9c59740 10 client.0 _ll_register_callbacks cb 0x557a15de1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e8b680 0x557a15e886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e8b680 0x557a15e886d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42924/0 (socket says 172.21.15.2:42924) 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 -- 172.21.15.2:0/1963364373 learned_addr learned my addr 172.21.15.2:0/1963364373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e88190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c561c640 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e804a0 0x557a15e8aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 -- 172.21.15.2:0/1963364373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e804a0 msgr2=0x557a15e8aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e804a0 0x557a15e8aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 -- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 msgr2=0x557a15e88190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e88190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 -- 172.21.15.2:0/1963364373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a15b573c0 con 0x557a15e8b680 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e88190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e8b680 0x557a15e886d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80a36a0 tx=0x7fc2b809b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164ab3d3ab9dcfcd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.722+0000 7fc2a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/1963364373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80a3bd0 con 0x557a15e8b680 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/1963364373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7fc2b80a3740 con 0x557a15e8b680 2024-09-12T01:00:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 1 -- 172.21.15.2:0/1963364373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b001c070 con 0x557a15e8b680 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/1963364373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc2b80a3980 con 0x557a15e8b680 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 10 client.17247 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 1 -- 172.21.15.2:0/1963364373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557a15e99bd0 con 0x557a15e8b680 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/1963364373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b001c070 con 0x557a15e8b680 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/1963364373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc2b809e070 con 0x557a15e8b680 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 10 client.17247 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 10 client.17247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 20 client.17247 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557a15e9b090 0x557a15e9d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 4 client.17247 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c9c59740 1 -- 172.21.15.2:0/1963364373 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a15df3850 con 0x557a15e9b090 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.723+0000 7fc2c561c640 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557a15e9b090 0x557a15e9d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.724+0000 7fc2a8ff9640 10 client.17247 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:12.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.724+0000 7fc2c561c640 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557a15e9b090 0x557a15e9d510 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=221e0db63db4bee7 server_cookie=df31663bcb9bb6c6 in_seq=0 out_seq=0 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/1963364373 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a15df3850 con 0x557a15e9b090 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2a8ff9640 10 client.17247 handle_command_reply: tid=0 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 client.17247 shutdown 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 -- 172.21.15.2:0/1963364373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e8b680 msgr2=0x557a15e886d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e8b680 0x557a15e886d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80a36a0 tx=0x7fc2b809b0d0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 -- 172.21.15.2:0/1963364373 shutdown_connections 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557a15e9b090 0x557a15e9d510 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e8b680 0x557a15e886d0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e88190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/1963364373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e804a0 0x557a15e8aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 -- 172.21.15.2:0/1963364373 >> 172.21.15.2:0/1963364373 conn(0x557a15e7ca30 msgr2=0x557a15e82760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2a8ff9640 0 client.17247 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 -- 172.21.15.2:0/1963364373 shutdown_connections 2024-09-12T01:00:12.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 1 -- 172.21.15.2:0/1963364373 wait complete. 2024-09-12T01:00:12.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.725+0000 7fc2c9c59740 20 client.17247 trim_cache size 0 max 16384 2024-09-12T01:00:12.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c9c59740 1 Processor -- start 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c9c59740 1 -- start start 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e804a0 0x557a15e88380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e80dc0 0x557a15e8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15ea2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01b2630 con 0x557a15e80dc0 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01afe70 con 0x557a15e804a0 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01adce0 con 0x557a15e8b680 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c4e1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e80dc0 0x557a15e8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c4e1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e80dc0 0x557a15e8a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42932/0 (socket says 172.21.15.2:42932) 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c4e1b640 1 -- 172.21.15.2:0/2867440112 learned_addr learned my addr 172.21.15.2:0/2867440112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:12.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.743+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15ea2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2c561c640 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e804a0 0x557a15e88380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2c4e1b640 1 -- 172.21.15.2:0/2867440112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 msgr2=0x557a15ea2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:12.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15ea2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2c4e1b640 1 -- 172.21.15.2:0/2867440112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e804a0 msgr2=0x557a15e88380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:12.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e804a0 0x557a15e88380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2c4e1b640 1 -- 172.21.15.2:0/2867440112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a15e87140 con 0x557a15e80dc0 2024-09-12T01:00:12.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e80dc0 0x557a15e8a100 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0010a50 tx=0x7fc2b0010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65897e64356d654d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:12.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2aaffd640 1 -- 172.21.15.2:0/2867440112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0017610 con 0x557a15e80dc0 2024-09-12T01:00:12.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2aaffd640 1 -- 172.21.15.2:0/2867440112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b001c050 con 0x557a15e80dc0 2024-09-12T01:00:12.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.744+0000 7fc2aaffd640 1 -- 172.21.15.2:0/2867440112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0020b00 con 0x557a15e80dc0 2024-09-12T01:00:12.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2867440112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e80dc0 msgr2=0x557a15e8a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e80dc0 0x557a15e8a100 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0010a50 tx=0x7fc2b0010f50 comp rx=0 tx=0).stop 2024-09-12T01:00:12.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2867440112 shutdown_connections 2024-09-12T01:00:12.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15ea2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e80dc0 0x557a15e8a100 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2867440112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e804a0 0x557a15e88380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2867440112 >> 172.21.15.2:0/2867440112 conn(0x557a15e7ca30 msgr2=0x557a15e899f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2867440112 shutdown_connections 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2867440112 wait complete. 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.745+0000 7fc2c9c59740 1 -- start start 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c9c59740 1 Processor -- start 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e90e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e913c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c9c59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15efcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01ae330 con 0x557a15e804a0 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01af7a0 con 0x557a15e80dc0 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c9c59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01aea00 con 0x557a15e8b680 2024-09-12T01:00:12.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c9c59740 10 client.0 _ll_register_callbacks cb 0x7fc2c006b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c561c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e90e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c561c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e90e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42938/0 (socket says 172.21.15.2:42938) 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c561c640 1 -- 172.21.15.2:0/2510602153 learned_addr learned my addr 172.21.15.2:0/2510602153 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15efcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.746+0000 7fc2c561c640 1 -- 172.21.15.2:0/2510602153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 msgr2=0x557a15efcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c561c640 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15efcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c561c640 1 -- 172.21.15.2:0/2510602153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 msgr2=0x557a15e913c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c561c640 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e913c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c561c640 1 -- 172.21.15.2:0/2510602153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a15efd3b0 con 0x557a15e804a0 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c5e1d640 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15efcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c561c640 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e90e80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc02a9a0 tx=0x7fc2bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceaf3ac169e21de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:12.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/2510602153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc035040 con 0x557a15e804a0 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/2510602153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8687+0+0 (secure 0 0 0) 0x7fc2bc003b80 con 0x557a15e804a0 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2510602153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b001c050 con 0x557a15e804a0 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/2510602153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc003d80 con 0x557a15e804a0 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c9c59740 10 client.17253 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2510602153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557a15f059d0 con 0x557a15e804a0 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.747+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/2510602153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b001c050 con 0x557a15e804a0 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/2510602153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fc2bc04a4b0 con 0x557a15e804a0 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2c9c59740 10 client.17253 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2c9c59740 10 client.17253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2c9c59740 20 client.17253 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557a15f060d0 0x557a15f084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2c9c59740 4 client.17253 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:00:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2510602153 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a15e88a60 con 0x557a15f060d0 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557a15f060d0 0x557a15f084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2c4e1b640 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557a15f060d0 0x557a15f084f0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=597b95069afd0b69 server_cookie=b488533471feb10c in_seq=0 out_seq=0 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.748+0000 7fc2a8ff9640 10 client.17253 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2a8ff9640 1 -- 172.21.15.2:0/2510602153 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557a15e88a60 con 0x557a15f060d0 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2a8ff9640 10 client.17253 handle_command_reply: tid=0 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 client.17253 shutdown 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2510602153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 msgr2=0x557a15e90e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e90e80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc02a9a0 tx=0x7fc2bc009260 comp rx=0 tx=0).stop 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2510602153 shutdown_connections 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557a15f060d0 0x557a15f084f0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a15e8b680 0x557a15efcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a15e80dc0 0x557a15e913c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 --2- 172.21.15.2:0/2510602153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a15e804a0 0x557a15e90e80 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2a8ff9640 0 client.17253 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2510602153 >> 172.21.15.2:0/2510602153 conn(0x557a15e7ca30 msgr2=0x557a15e8a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2510602153 shutdown_connections 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 1 -- 172.21.15.2:0/2510602153 wait complete. 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.749+0000 7fc2c9c59740 20 client.17253 trim_cache size 0 max 16384 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "3f297f3f-8f35-4b76-a454-6c256b493a9a": { 2024-09-12T01:00:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T01:00:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "3f297f3f-8f35-4b76-a454-6c256b493a9a", 2024-09-12T01:00:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T01:00:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:00:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:00:12.755 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:00:12.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 -- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2ac0a2cf0 msgr2=0x7fc2ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2ac0a2cf0 0x7fc2ac0a51b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc000c00 tx=0x7fc2bc0058d0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 -- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c010c170 msgr2=0x7fc2c019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c010c170 0x7fc2c019a660 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800b970 tx=0x7fc2b800be30 comp rx=0 tx=0).stop 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 -- 172.21.15.2:0/3932890354 shutdown_connections 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc2ac0a2cf0 0x7fc2ac0a51b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c010c170 0x7fc2c019a660 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c0103660 0x7fc2c01a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 --2- 172.21.15.2:0/3932890354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c0102d40 0x7fc2c01a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 -- 172.21.15.2:0/3932890354 >> 172.21.15.2:0/3932890354 conn(0x7fc2c00fc7a0 msgr2=0x7fc2c0101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 -- 172.21.15.2:0/3932890354 shutdown_connections 2024-09-12T01:00:12.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:12.750+0000 7fc2c7880640 1 -- 172.21.15.2:0/3932890354 wait complete. 2024-09-12T01:00:12.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:12 smithi071 ceph-mon[35276]: pgmap v222: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:12.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:12 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T01:00:12.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:12 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:12.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:12 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T01:00:12.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:12 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:12 smithi167 ceph-mon[35234]: pgmap v222: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:12 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T01:00:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:12 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:12 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T01:00:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:12 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:13.370 INFO:tasks.cephfs.filesystem:scrub status for tag:3f297f3f-8f35-4b76-a454-6c256b493a9a - {'path': '/', 'tag': '3f297f3f-8f35-4b76-a454-6c256b493a9a', 'options': 'recursive,force'} 2024-09-12T01:00:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:14 smithi071 ceph-mon[35276]: pgmap v223: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:14 smithi071 ceph-mon[35276]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:00:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:14 smithi002 ceph-mon[31210]: pgmap v223: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:14 smithi002 ceph-mon[31210]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:00:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:14 smithi167 ceph-mon[35234]: pgmap v223: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:14 smithi167 ceph-mon[35234]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:00:16.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:16 smithi071 ceph-mon[35276]: pgmap v225: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 123 B/s wr, 3 op/s 2024-09-12T01:00:16.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:16 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T01:00:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:16 smithi002 ceph-mon[31210]: pgmap v225: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 123 B/s wr, 3 op/s 2024-09-12T01:00:16.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:16 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T01:00:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:16 smithi167 ceph-mon[35234]: pgmap v225: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 123 B/s wr, 3 op/s 2024-09-12T01:00:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:16 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T01:00:18.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:18 smithi071 ceph-mon[35276]: pgmap v226: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:18 smithi002 ceph-mon[31210]: pgmap v226: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:18 smithi167 ceph-mon[35234]: pgmap v226: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:20.839 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:20 smithi167 ceph-mon[35234]: pgmap v227: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:20.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:20 smithi071 ceph-mon[35276]: pgmap v227: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:20.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:20 smithi002 ceph-mon[31210]: pgmap v227: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:00:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:22 smithi071 ceph-mon[35276]: pgmap v228: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:00:22.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:22 smithi002 ceph-mon[31210]: pgmap v228: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:00:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:22 smithi167 ceph-mon[35234]: pgmap v228: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:00:24.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:24 smithi071 ceph-mon[35276]: pgmap v229: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:00:24.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:24 smithi002 ceph-mon[31210]: pgmap v229: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:00:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:24 smithi167 ceph-mon[35234]: pgmap v229: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:00:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:26 smithi071 ceph-mon[35276]: pgmap v230: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:00:26.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:26 smithi002 ceph-mon[31210]: pgmap v230: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:00:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:26 smithi167 ceph-mon[35234]: pgmap v230: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:00:28.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:28 smithi071 ceph-mon[35276]: pgmap v231: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:00:28.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:28 smithi002 ceph-mon[31210]: pgmap v231: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:00:29.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:28 smithi167 ceph-mon[35234]: pgmap v231: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:00:30.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:30 smithi071 ceph-mon[35276]: pgmap v232: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:30.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:30 smithi002 ceph-mon[31210]: pgmap v232: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:30 smithi167 ceph-mon[35234]: pgmap v232: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:32.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:32 smithi071 ceph-mon[35276]: pgmap v233: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:32.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:32 smithi002 ceph-mon[31210]: pgmap v233: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:32 smithi167 ceph-mon[35234]: pgmap v233: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:34.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:34 smithi071 ceph-mon[35276]: pgmap v234: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:34.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:34 smithi002 ceph-mon[31210]: pgmap v234: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:34 smithi167 ceph-mon[35234]: pgmap v234: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:36.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:36 smithi071 ceph-mon[35276]: pgmap v235: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:36.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:36 smithi002 ceph-mon[31210]: pgmap v235: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:36 smithi167 ceph-mon[35234]: pgmap v235: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:38.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:38 smithi071 ceph-mon[35276]: pgmap v236: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:38.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:38 smithi002 ceph-mon[31210]: pgmap v236: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:39.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:38 smithi167 ceph-mon[35234]: pgmap v236: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:40.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:40 smithi071 ceph-mon[35276]: pgmap v237: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:40.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:40 smithi002 ceph-mon[31210]: pgmap v237: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:41.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:40 smithi167 ceph-mon[35234]: pgmap v237: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:42.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:42 smithi071 ceph-mon[35276]: pgmap v238: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:42 smithi002 ceph-mon[31210]: pgmap v238: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:43.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:42 smithi167 ceph-mon[35234]: pgmap v238: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:43.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:00:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:44.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 -- 172.21.15.2:0/3275086732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 msgr2=0x7f04dc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 --2- 172.21.15.2:0/3275086732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 0x7f04dc10bb50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009900 tx=0x7f04cc02a480 comp rx=0 tx=0).stop 2024-09-12T01:00:44.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 -- 172.21.15.2:0/3275086732 shutdown_connections 2024-09-12T01:00:44.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 --2- 172.21.15.2:0/3275086732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04dc10c170 0x7f04dc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 --2- 172.21.15.2:0/3275086732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 0x7f04dc10bb50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 --2- 172.21.15.2:0/3275086732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04dc102d40 0x7f04dc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 -- 172.21.15.2:0/3275086732 >> 172.21.15.2:0/3275086732 conn(0x7f04dc0fc7a0 msgr2=0x7f04dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 -- 172.21.15.2:0/3275086732 shutdown_connections 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.080+0000 7f04e37d1640 1 -- 172.21.15.2:0/3275086732 wait complete. 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e37d1640 1 Processor -- start 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e37d1640 1 -- start start 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e37d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04dc102d40 0x7f04dc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e37d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 0x7f04dc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e37d1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04dc10c170 0x7f04dc19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e37d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc111f70 con 0x7f04dc103660 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e37d1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc111df0 con 0x7f04dc10c170 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e37d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1120f0 con 0x7f04dc102d40 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e0d6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 0x7f04dc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e0d6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 0x7f04dc19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50270/0 (socket says 172.21.15.2:50270) 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e0d6c640 1 -- 172.21.15.2:0/1639644073 learned_addr learned my addr 172.21.15.2:0/1639644073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.081+0000 7f04e156d640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04dc102d40 0x7f04dc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04dc10c170 0x7f04dc19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e0d6c640 1 -- 172.21.15.2:0/1639644073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04dc102d40 msgr2=0x7f04dc19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04dc102d40 0x7f04dc19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e0d6c640 1 -- 172.21.15.2:0/1639644073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04dc10c170 msgr2=0x7f04dc19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04dc10c170 0x7f04dc19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e0d6c640 1 -- 172.21.15.2:0/1639644073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc19f5d0 con 0x7f04dc103660 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04dc10c170 0x7f04dc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 0x7f04dc19ab60 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f04cc005ab0 tx=0x7f04cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04d27fc640 1 -- 172.21.15.2:0/1639644073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc03f030 con 0x7f04dc103660 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04d27fc640 1 -- 172.21.15.2:0/1639644073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04cc003ce0 con 0x7f04dc103660 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e37d1640 1 -- 172.21.15.2:0/1639644073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04dc19f860 con 0x7f04dc103660 2024-09-12T01:00:44.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04d27fc640 1 -- 172.21.15.2:0/1639644073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc035070 con 0x7f04dc103660 2024-09-12T01:00:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.082+0000 7f04e37d1640 1 -- 172.21.15.2:0/1639644073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04dc1a71a0 con 0x7f04dc103660 2024-09-12T01:00:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.085+0000 7f04d27fc640 1 -- 172.21.15.2:0/1639644073 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f04cc042030 con 0x7f04dc103660 2024-09-12T01:00:44.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.085+0000 7f04e5baa740 1 Processor -- start 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.085+0000 7f04e5baa740 1 -- start start 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a4b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a56140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a58a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e5baa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f2b79b12e0 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e5baa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f2b7958ce0 con 0x55f2b7a56680 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e5baa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f2b79ad2a0 con 0x55f2b7a4bdc0 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a4b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a4b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50282/0 (socket says 172.21.15.2:50282) 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04d27fc640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f04c80a2d70 0x7f04c80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 -- 172.21.15.2:0/1223915263 learned_addr learned my addr 172.21.15.2:0/1223915263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e156d640 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a56140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a58a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f04c80a2d70 0x7f04c80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04d27fc640 1 -- 172.21.15.2:0/1639644073 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f04cc0efcb0 con 0x7f04dc103660 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 -- 172.21.15.2:0/1223915263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 msgr2=0x55f2b7a56140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a56140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 -- 172.21.15.2:0/1223915263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 msgr2=0x55f2b7a58a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a58a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 -- 172.21.15.2:0/1223915263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b793d440 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a58a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.086+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a4b880 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f04d4012940 tx=0x7f04d4012e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6642e3f7ca3abba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.087+0000 7f04c77fe640 1 -- 172.21.15.2:0/1223915263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4022070 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.087+0000 7f04c77fe640 1 -- 172.21.15.2:0/1223915263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04d4012250 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.087+0000 7f04c77fe640 1 -- 172.21.15.2:0/1223915263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d40040b0 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.087+0000 7f04e5baa740 1 -- 172.21.15.2:0/1223915263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 msgr2=0x55f2b7a4b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.087+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f04c80a2d70 0x7f04c80a5230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04d401f000 tx=0x7f04d401d000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.087+0000 7f04e5baa740 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a4b880 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f04d4012940 tx=0x7f04d4012e00 comp rx=0 tx=0).stop 2024-09-12T01:00:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 -- 172.21.15.2:0/1223915263 shutdown_connections 2024-09-12T01:00:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a58a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a56140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 --2- 172.21.15.2:0/1223915263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a4b880 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 -- 172.21.15.2:0/1223915263 >> 172.21.15.2:0/1223915263 conn(0x55f2b7a47a30 msgr2=0x55f2b7a47e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 -- 172.21.15.2:0/1223915263 shutdown_connections 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 -- 172.21.15.2:0/1223915263 wait complete. 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 -- start start 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 Processor -- start 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a55fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a53270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a537b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f2b7a59250 con 0x55f2b7a56680 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f2b796c050 con 0x55f2b7a4bdc0 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.088+0000 7f04e5baa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f2b7a593d0 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e5baa740 10 client.0 _ll_register_callbacks cb 0x55f2b79ac160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50288/0 (socket says 172.21.15.2:50288) 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 -- 172.21.15.2:0/2811906666 learned_addr learned my addr 172.21.15.2:0/2811906666 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e156d640 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a55fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a53270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 -- 172.21.15.2:0/2811906666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4b4a0 msgr2=0x55f2b7a55fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a55fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 -- 172.21.15.2:0/2811906666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4bdc0 msgr2=0x55f2b7a53270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a53270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 -- 172.21.15.2:0/2811906666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b77223c0 con 0x55f2b7a56680 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a537b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f04d401df00 tx=0x7f04d4004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53c03d5f9535b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04c4ff9640 1 -- 172.21.15.2:0/2811906666 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4022030 con 0x55f2b7a56680 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04c4ff9640 1 -- 172.21.15.2:0/2811906666 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f04d401d890 con 0x55f2b7a56680 2024-09-12T01:00:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04e5baa740 1 -- 172.21.15.2:0/2811906666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04d4012250 con 0x55f2b7a56680 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.089+0000 7f04c4ff9640 1 -- 172.21.15.2:0/2811906666 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f04d4012400 con 0x55f2b7a56680 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e5baa740 10 client.17265 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e5baa740 1 -- 172.21.15.2:0/2811906666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f2b7a64b70 con 0x55f2b7a56680 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04c4ff9640 1 -- 172.21.15.2:0/2811906666 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04d4012250 con 0x55f2b7a56680 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04c4ff9640 1 -- 172.21.15.2:0/2811906666 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f04d403a070 con 0x55f2b7a56680 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e5baa740 10 client.17265 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e5baa740 10 client.17265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e5baa740 20 client.17265 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f2b7a65f20 0x55f2b7a68310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e5baa740 4 client.17265 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e5baa740 1 -- 172.21.15.2:0/2811906666 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2b79be850 con 0x55f2b7a65f20 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.090+0000 7f04e156d640 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f2b7a65f20 0x55f2b7a68310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.091+0000 7f04e156d640 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f2b7a65f20 0x55f2b7a68310 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b95cd3f0154debf server_cookie=15454dff9cf2a1d3 in_seq=0 out_seq=0 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.091+0000 7f04c4ff9640 10 client.17265 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.091+0000 7f04c4ff9640 1 -- 172.21.15.2:0/2811906666 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2b79be850 con 0x55f2b7a65f20 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.091+0000 7f04c4ff9640 10 client.17265 handle_command_reply: tid=0 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.091+0000 7f04e5baa740 1 client.17265 shutdown 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 -- 172.21.15.2:0/2811906666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 msgr2=0x55f2b7a537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a537b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f04d401df00 tx=0x7f04d4004e50 comp rx=0 tx=0).stop 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 -- 172.21.15.2:0/2811906666 shutdown_connections 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f2b7a65f20 0x55f2b7a68310 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a537b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a53270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2811906666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a55fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 -- 172.21.15.2:0/2811906666 >> 172.21.15.2:0/2811906666 conn(0x55f2b7a47a30 msgr2=0x55f2b7a4d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04c4ff9640 0 client.17265 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 -- 172.21.15.2:0/2811906666 shutdown_connections 2024-09-12T01:00:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 1 -- 172.21.15.2:0/2811906666 wait complete. 2024-09-12T01:00:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.092+0000 7f04e5baa740 20 client.17265 trim_cache size 0 max 16384 2024-09-12T01:00:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.109+0000 7f04e5baa740 1 Processor -- start 2024-09-12T01:00:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.109+0000 7f04e5baa740 1 -- start start 2024-09-12T01:00:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a53460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a6daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e5baa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1b25b0 con 0x55f2b7a56680 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e5baa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1afdf0 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e5baa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1adc60 con 0x55f2b7a4bdc0 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a6daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a6daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50304/0 (socket says 172.21.15.2:50304) 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 -- 172.21.15.2:0/2744543844 learned_addr learned my addr 172.21.15.2:0/2744543844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e156d640 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a53460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 -- 172.21.15.2:0/2744543844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 msgr2=0x55f2b7a551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 -- 172.21.15.2:0/2744543844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4b4a0 msgr2=0x55f2b7a53460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a53460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 -- 172.21.15.2:0/2744543844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b7a687e0 con 0x55f2b7a56680 2024-09-12T01:00:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e156d640 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a53460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a6daa0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f04d401dfa0 tx=0x7f04d4012260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7e1f34726da1f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04c6ffd640 1 -- 172.21.15.2:0/2744543844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4040070 con 0x55f2b7a56680 2024-09-12T01:00:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.110+0000 7f04c6ffd640 1 -- 172.21.15.2:0/2744543844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04d401db70 con 0x55f2b7a56680 2024-09-12T01:00:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04c6ffd640 1 -- 172.21.15.2:0/2744543844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d40277c0 con 0x55f2b7a56680 2024-09-12T01:00:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 -- 172.21.15.2:0/2744543844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 msgr2=0x55f2b7a6daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a6daa0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f04d401dfa0 tx=0x7f04d4012260 comp rx=0 tx=0).stop 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 -- 172.21.15.2:0/2744543844 shutdown_connections 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a56680 0x55f2b7a6daa0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7a551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 --2- 172.21.15.2:0/2744543844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7a53460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 -- 172.21.15.2:0/2744543844 >> 172.21.15.2:0/2744543844 conn(0x55f2b7a47a30 msgr2=0x55f2b7a54ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 -- 172.21.15.2:0/2744543844 shutdown_connections 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 -- 172.21.15.2:0/2744543844 wait complete. 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.111+0000 7f04e5baa740 1 -- start start 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e5baa740 1 Processor -- start 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7ac7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7ac8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e5baa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a5bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e5baa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1ae2b0 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e5baa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1af720 con 0x55f2b7a56680 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e5baa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1ae980 con 0x55f2b7a4bdc0 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e5baa740 10 client.0 _ll_register_callbacks cb 0x7f04d4020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e156d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7ac7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e156d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7ac7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50310/0 (socket says 172.21.15.2:50310) 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e156d640 1 -- 172.21.15.2:0/4274315123 learned_addr learned my addr 172.21.15.2:0/4274315123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a5bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e156d640 1 -- 172.21.15.2:0/4274315123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 msgr2=0x55f2b7ac8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e156d640 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7ac8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e156d640 1 -- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 msgr2=0x55f2b7a5bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e156d640 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a5bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e156d640 1 -- 172.21.15.2:0/4274315123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b7a5c4e0 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.112+0000 7f04e1d6e640 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a5bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e156d640 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7ac7e30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f04d800ad10 tx=0x7f04d800afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d6d04fb4b398ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04c4ff9640 1 -- 172.21.15.2:0/4274315123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8004220 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04c4ff9640 1 -- 172.21.15.2:0/4274315123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f04d80043c0 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 1 -- 172.21.15.2:0/4274315123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04d401db70 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04c4ff9640 1 -- 172.21.15.2:0/4274315123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f04d801e610 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 10 client.17271 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 1 -- 172.21.15.2:0/4274315123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f2b7ad0680 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04c4ff9640 1 -- 172.21.15.2:0/4274315123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04d401db70 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04c4ff9640 1 -- 172.21.15.2:0/4274315123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f04d8003ce0 con 0x55f2b7a4b4a0 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 10 client.17271 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 20 client.17271 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f2b7ad0df0 0x55f2b7ad3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 4 client.17271 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.113+0000 7f04e5baa740 1 -- 172.21.15.2:0/4274315123 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f2b7a53b40 con 0x55f2b7ad0df0 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f2b7ad0df0 0x55f2b7ad3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e0d6c640 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f2b7ad0df0 0x55f2b7ad3220 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b93ca3691328c28c server_cookie=ea399e47b0aa198f in_seq=0 out_seq=0 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04c4ff9640 10 client.17271 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04c4ff9640 1 -- 172.21.15.2:0/4274315123 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f2b7a53b40 con 0x55f2b7ad0df0 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04c4ff9640 10 client.17271 handle_command_reply: tid=0 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 client.17271 shutdown 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 -- 172.21.15.2:0/4274315123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 msgr2=0x55f2b7ac7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7ac7e30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f04d800ad10 tx=0x7f04d800afd0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 -- 172.21.15.2:0/4274315123 shutdown_connections 2024-09-12T01:00:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55f2b7ad0df0 0x55f2b7ad3220 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f2b7a56680 0x55f2b7a5bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2b7a4bdc0 0x55f2b7ac8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 --2- 172.21.15.2:0/4274315123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2b7a4b4a0 0x55f2b7ac7e30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04e5baa740 1 -- 172.21.15.2:0/4274315123 >> 172.21.15.2:0/4274315123 conn(0x55f2b7a47a30 msgr2=0x55f2b7a552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.114+0000 7f04c4ff9640 0 client.17271 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e5baa740 1 -- 172.21.15.2:0/4274315123 shutdown_connections 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e5baa740 1 -- 172.21.15.2:0/4274315123 wait complete. 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e5baa740 20 client.17271 trim_cache size 0 max 16384 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T01:00:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T01:00:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:00:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 -- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f04c80a2d70 msgr2=0x7f04c80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f04c80a2d70 0x7f04c80a5230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04d401f000 tx=0x7f04d401d000 comp rx=0 tx=0).stop 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 -- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 msgr2=0x7f04dc19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 0x7f04dc19ab60 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f04cc005ab0 tx=0x7f04cc0042f0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 -- 172.21.15.2:0/1639644073 shutdown_connections 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f04c80a2d70 0x7f04c80a5230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04dc10c170 0x7f04dc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04dc103660 0x7f04dc19ab60 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 --2- 172.21.15.2:0/1639644073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04dc102d40 0x7f04dc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 -- 172.21.15.2:0/1639644073 >> 172.21.15.2:0/1639644073 conn(0x7f04dc0fc7a0 msgr2=0x7f04dc10d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.115+0000 7f04e37d1640 1 -- 172.21.15.2:0/1639644073 shutdown_connections 2024-09-12T01:00:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:44.116+0000 7f04e37d1640 1 -- 172.21.15.2:0/1639644073 wait complete. 2024-09-12T01:00:44.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:44 smithi002 ceph-mon[31210]: pgmap v239: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:44.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:44 smithi071 ceph-mon[35276]: pgmap v239: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:44.963 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:00:44.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:00:45.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:44 smithi167 ceph-mon[35234]: pgmap v239: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:45.231 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4287731310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0101de0 msgr2=0x7fb0c01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4287731310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0101de0 0x7fb0c01021c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009900 tx=0x7fb0bc02a410 comp rx=0 tx=0).stop 2024-09-12T01:00:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4287731310 shutdown_connections 2024-09-12T01:00:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4287731310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c0106f10 0x7fb0c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4287731310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0102790 0x7fb0c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4287731310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0101de0 0x7fb0c01021c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4287731310 >> 172.21.15.2:0/4287731310 conn(0x7fb0c00fd8c0 msgr2=0x7fb0c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4287731310 shutdown_connections 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4287731310 wait complete. 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 Processor -- start 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.688+0000 7fb0c87c9640 1 -- start start 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c87c9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0101de0 0x7fb0c01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c87c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0102790 0x7fb0c0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c87c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c0106f10 0x7fb0c019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c87c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0111f70 con 0x7fb0c0102790 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c87c9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0111df0 con 0x7fb0c0101de0 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c87c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01120f0 con 0x7fb0c0106f10 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0102790 0x7fb0c0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0102790 0x7fb0c0198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50336/0 (socket says 172.21.15.2:50336) 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 -- 172.21.15.2:0/4055730621 learned_addr learned my addr 172.21.15.2:0/4055730621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:45.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c6565640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0101de0 0x7fb0c01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c6d66640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c0106f10 0x7fb0c019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 -- 172.21.15.2:0/4055730621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c0106f10 msgr2=0x7fb0c019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c0106f10 0x7fb0c019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 -- 172.21.15.2:0/4055730621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0101de0 msgr2=0x7fb0c01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0101de0 0x7fb0c01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 -- 172.21.15.2:0/4055730621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c019d480 con 0x7fb0c0102790 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0c5d64640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0102790 0x7fb0c0198a10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400d950 tx=0x7fb0b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.689+0000 7fb0b37fe640 1 -- 172.21.15.2:0/4055730621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4017030 con 0x7fb0c0102790 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.690+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c019d770 con 0x7fb0c0102790 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.690+0000 7fb0b37fe640 1 -- 172.21.15.2:0/4055730621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0b4004020 con 0x7fb0c0102790 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.690+0000 7fb0b37fe640 1 -- 172.21.15.2:0/4055730621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b40047a0 con 0x7fb0c0102790 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.690+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c01a5050 con 0x7fb0c0102790 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.690+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c01021c0 con 0x7fb0c0102790 2024-09-12T01:00:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.692+0000 7fb0b37fe640 1 -- 172.21.15.2:0/4055730621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fb0b40041d0 con 0x7fb0c0102790 2024-09-12T01:00:45.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.693+0000 7fb0b37fe640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb0ac0a2cf0 0x7fb0ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:45.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.693+0000 7fb0b37fe640 1 -- 172.21.15.2:0/4055730621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb0b40cf4a0 con 0x7fb0c0102790 2024-09-12T01:00:45.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.693+0000 7fb0c6565640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb0ac0a2cf0 0x7fb0ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:45.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.694+0000 7fb0c6565640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb0ac0a2cf0 0x7fb0ac0a51b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009230 tx=0x7fb0bc0058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:45.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.697+0000 7fb0b37fe640 1 -- 172.21.15.2:0/4055730621 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0b409c040 con 0x7fb0c0102790 2024-09-12T01:00:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.910+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0c0199830 con 0x7fb0c0102790 2024-09-12T01:00:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.910+0000 7fb0b37fe640 1 -- 172.21.15.2:0/4055730621 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11903 (secure 0 0 0) 0x7fb0b409b940 con 0x7fb0c0102790 2024-09-12T01:00:45.909 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:00:45.909 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-12T00:58:58:506883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T00:58:57.792791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24470,24487,24494]},"id":1}]} 2024-09-12T01:00:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-12T01:00:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb0ac0a2cf0 msgr2=0x7fb0ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb0ac0a2cf0 0x7fb0ac0a51b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009230 tx=0x7fb0bc0058d0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0102790 msgr2=0x7fb0c0198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0102790 0x7fb0c0198a10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400d950 tx=0x7fb0b400de10 comp rx=0 tx=0).stop 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 shutdown_connections 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb0ac0a2cf0 0x7fb0ac0a51b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c0106f10 0x7fb0c019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c0102790 0x7fb0c0198a10 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 --2- 172.21.15.2:0/4055730621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0101de0 0x7fb0c01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 >> 172.21.15.2:0/4055730621 conn(0x7fb0c00fd8c0 msgr2=0x7fb0c00fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 shutdown_connections 2024-09-12T01:00:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:45.914+0000 7fb0c87c9640 1 -- 172.21.15.2:0/4055730621 wait complete. 2024-09-12T01:00:46.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:00:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:46.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:46 smithi002 ceph-mon[31210]: pgmap v240: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:46.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:46 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4055730621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:00:46.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:46 smithi071 ceph-mon[35276]: pgmap v240: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:46.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:46 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4055730621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:00:47.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:46 smithi167 ceph-mon[35234]: pgmap v240: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:47.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:46 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4055730621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:00:47.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 -- 172.21.15.2:0/4289272934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 msgr2=0x7f8b88101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 --2- 172.21.15.2:0/4289272934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 0x7f8b88101200 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009900 tx=0x7f8b7802a480 comp rx=0 tx=0).stop 2024-09-12T01:00:47.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 -- 172.21.15.2:0/4289272934 shutdown_connections 2024-09-12T01:00:47.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 --2- 172.21.15.2:0/4289272934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b88102ef0 0x7f8b8810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 --2- 172.21.15.2:0/4289272934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b88102570 0x7f8b881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 --2- 172.21.15.2:0/4289272934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 0x7f8b88101200 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 -- 172.21.15.2:0/4289272934 >> 172.21.15.2:0/4289272934 conn(0x7f8b880fc7d0 msgr2=0x7f8b880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 -- 172.21.15.2:0/4289272934 shutdown_connections 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.236+0000 7f8b8d630640 1 -- 172.21.15.2:0/4289272934 wait complete. 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b8d630640 1 Processor -- start 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b8d630640 1 -- start start 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b8d630640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 0x7f8b881992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b8d630640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b88102570 0x7f8b88199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b8d630640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b88102ef0 0x7f8b881a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b8d630640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b88110f80 con 0x7f8b88100e20 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b8d630640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b88110e00 con 0x7f8b88102570 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b8d630640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8b88111100 con 0x7f8b88102ef0 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 0x7f8b881992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 0x7f8b881992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43552/0 (socket says 172.21.15.2:43552) 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.237+0000 7f8b86ffd640 1 -- 172.21.15.2:0/3918296483 learned_addr learned my addr 172.21.15.2:0/3918296483 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b877fe640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b88102ef0 0x7f8b881a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b88102570 0x7f8b88199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b86ffd640 1 -- 172.21.15.2:0/3918296483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b88102ef0 msgr2=0x7f8b881a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b88102ef0 0x7f8b881a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b86ffd640 1 -- 172.21.15.2:0/3918296483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b88102570 msgr2=0x7f8b88199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b88102570 0x7f8b88199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b86ffd640 1 -- 172.21.15.2:0/3918296483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b881a48b0 con 0x7f8b88100e20 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 0x7f8b881992f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8b78006010 tx=0x7f8b78003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b84ff9640 1 -- 172.21.15.2:0/3918296483 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7803f070 con 0x7f8b88100e20 2024-09-12T01:00:47.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b8d630640 1 -- 172.21.15.2:0/3918296483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b881a4a80 con 0x7f8b88100e20 2024-09-12T01:00:47.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b84ff9640 1 -- 172.21.15.2:0/3918296483 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b78031c30 con 0x7f8b88100e20 2024-09-12T01:00:47.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b84ff9640 1 -- 172.21.15.2:0/3918296483 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78035030 con 0x7f8b88100e20 2024-09-12T01:00:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.238+0000 7f8b8d630640 1 -- 172.21.15.2:0/3918296483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b881a4f60 con 0x7f8b88100e20 2024-09-12T01:00:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.240+0000 7f8b84ff9640 1 -- 172.21.15.2:0/3918296483 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f8b78042070 con 0x7f8b88100e20 2024-09-12T01:00:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b8fa09740 1 Processor -- start 2024-09-12T01:00:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b8fa09740 1 -- start start 2024-09-12T01:00:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b5b40 0x55daa99b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99c3780 0x55daa99c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55daa991a2f0 con 0x55daa99b45d0 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55daa98c1cf0 con 0x55daa99b5b40 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55daa99162b0 con 0x55daa99c3780 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43562/0 (socket says 172.21.15.2:43562) 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b84ff9640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8b740a2cf0 0x7f8b740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.241+0000 7f8b86ffd640 1 -- 172.21.15.2:0/1490464250 learned_addr learned my addr 172.21.15.2:0/1490464250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99c3780 0x55daa99c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b877fe640 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b5b40 0x55daa99b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b877fe640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8b740a2cf0 0x7f8b740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b84ff9640 1 -- 172.21.15.2:0/3918296483 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8b780efdc0 con 0x7f8b88100e20 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7ffff640 1 -- 172.21.15.2:0/1490464250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b5b40 msgr2=0x55daa99b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b5b40 0x55daa99b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7ffff640 1 -- 172.21.15.2:0/1490464250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 msgr2=0x55daa99b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7ffff640 1 -- 172.21.15.2:0/1490464250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daa98a63a0 con 0x55daa99c3780 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b877fe640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8b740a2cf0 0x7f8b740a51b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009fd0 tx=0x7f8b80009600 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99c3780 0x55daa99c5b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8b700058c0 tx=0x7f8b7000e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a041a6a9eb459b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7d7fa640 1 -- 172.21.15.2:0/1490464250 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70004020 con 0x55daa99c3780 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.242+0000 7f8b7d7fa640 1 -- 172.21.15.2:0/1490464250 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b700041c0 con 0x55daa99c3780 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b7d7fa640 1 -- 172.21.15.2:0/1490464250 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70010720 con 0x55daa99c3780 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 -- 172.21.15.2:0/1490464250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99c3780 msgr2=0x55daa99c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99c3780 0x55daa99c5b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8b700058c0 tx=0x7f8b7000e350 comp rx=0 tx=0).stop 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 -- 172.21.15.2:0/1490464250 shutdown_connections 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99c3780 0x55daa99c5b70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/1490464250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b5b40 0x55daa99b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 -- 172.21.15.2:0/1490464250 >> 172.21.15.2:0/1490464250 conn(0x55daa997d310 msgr2=0x55daa99b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 -- 172.21.15.2:0/1490464250 shutdown_connections 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.243+0000 7f8b8fa09740 1 -- 172.21.15.2:0/1490464250 wait complete. 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 1 -- start start 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 1 Processor -- start 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99c3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55daa99c6480 con 0x55daa99b45d0 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55daa98d5060 con 0x55daa99c3780 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55daa99c6600 con 0x55daa99b5b40 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b8fa09740 10 client.0 _ll_register_callbacks cb 0x55daa96288c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99c3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43574/0 (socket says 172.21.15.2:43574) 2024-09-12T01:00:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b86ffd640 1 -- 172.21.15.2:0/2878474645 learned_addr learned my addr 172.21.15.2:0/2878474645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b877fe640 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b86ffd640 1 -- 172.21.15.2:0/2878474645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 msgr2=0x55daa99c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b86ffd640 1 -- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 msgr2=0x55daa99c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.244+0000 7f8b86ffd640 1 -- 172.21.15.2:0/2878474645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daa968b3c0 con 0x55daa99b45d0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b877fe640 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99c3050 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8b78000c00 tx=0x7f8b780bbe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f81f315fb0b276 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/2878474645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78049070 con 0x55daa99b45d0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/2878474645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8b780ed6b0 con 0x55daa99b45d0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b8fa09740 1 -- 172.21.15.2:0/2878474645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b700041c0 con 0x55daa99b45d0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/2878474645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8b780ed8b0 con 0x55daa99b45d0 2024-09-12T01:00:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b8fa09740 10 client.17289 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b8fa09740 1 -- 172.21.15.2:0/2878474645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55daa99d1e40 con 0x55daa99b45d0 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/2878474645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b700041c0 con 0x55daa99b45d0 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/2878474645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f8b780f3020 con 0x55daa99b45d0 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.245+0000 7f8b8fa09740 10 client.17289 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.246+0000 7f8b8fa09740 10 client.17289 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.246+0000 7f8b8fa09740 20 client.17289 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.246+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55daa99d3380 0x55daa99d5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.246+0000 7f8b8fa09740 4 client.17289 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.246+0000 7f8b8fa09740 1 -- 172.21.15.2:0/2878474645 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daa9927860 con 0x55daa99d3380 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.246+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55daa99d3380 0x55daa99d5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.246+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55daa99d3380 0x55daa99d5820 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fdca3a9e5877e3c7 server_cookie=7219ea0bbe4388c1 in_seq=0 out_seq=0 2024-09-12T01:00:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.246+0000 7f8b6e7fc640 10 client.17289 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:00:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/2878474645 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55daa9927860 con 0x55daa99d3380 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b6e7fc640 10 client.17289 handle_command_reply: tid=0 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 client.17289 shutdown 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 -- 172.21.15.2:0/2878474645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 msgr2=0x55daa99c3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99c3050 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8b78000c00 tx=0x7f8b780bbe70 comp rx=0 tx=0).stop 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 -- 172.21.15.2:0/2878474645 shutdown_connections 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55daa99d3380 0x55daa99d5820 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/2878474645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99c3050 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 -- 172.21.15.2:0/2878474645 >> 172.21.15.2:0/2878474645 conn(0x55daa997d310 msgr2=0x55daa99b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b6e7fc640 0 client.17289 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 -- 172.21.15.2:0/2878474645 shutdown_connections 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 1 -- 172.21.15.2:0/2878474645 wait complete. 2024-09-12T01:00:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.247+0000 7f8b8fa09740 20 client.17289 trim_cache size 0 max 16384 2024-09-12T01:00:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.260+0000 7f8b8fa09740 1 Processor -- start 2024-09-12T01:00:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.260+0000 7f8b8fa09740 1 -- start start 2024-09-12T01:00:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b45d0 0x55daa99cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99bec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99c3780 0x55daa99bf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b881ae180 con 0x55daa99c3780 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b881ab9c0 con 0x55daa99b45d0 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8b881a9830 con 0x55daa99b5b40 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99c3780 0x55daa99bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99c3780 0x55daa99bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43578/0 (socket says 172.21.15.2:43578) 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 -- 172.21.15.2:0/3265498665 learned_addr learned my addr 172.21.15.2:0/3265498665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b45d0 0x55daa99cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 -- 172.21.15.2:0/3265498665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 msgr2=0x55daa99bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99bec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 -- 172.21.15.2:0/3265498665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b45d0 msgr2=0x55daa99cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b45d0 0x55daa99cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 -- 172.21.15.2:0/3265498665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daa99b1960 con 0x55daa99c3780 2024-09-12T01:00:47.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b45d0 0x55daa99cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:47.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b877fe640 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99c3780 0x55daa99bf160 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f8b800129d0 tx=0x7f8b8000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90fe610a1570587 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:47.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.261+0000 7f8b7cff9640 1 -- 172.21.15.2:0/3265498665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000ae50 con 0x55daa99c3780 2024-09-12T01:00:47.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b7cff9640 1 -- 172.21.15.2:0/3265498665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b8001e8f0 con 0x55daa99c3780 2024-09-12T01:00:47.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b7cff9640 1 -- 172.21.15.2:0/3265498665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b800054d0 con 0x55daa99c3780 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 -- 172.21.15.2:0/3265498665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99c3780 msgr2=0x55daa99bf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99c3780 0x55daa99bf160 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f8b800129d0 tx=0x7f8b8000c000 comp rx=0 tx=0).stop 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 -- 172.21.15.2:0/3265498665 shutdown_connections 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99c3780 0x55daa99bf160 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/3265498665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99b45d0 0x55daa99cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 -- 172.21.15.2:0/3265498665 >> 172.21.15.2:0/3265498665 conn(0x55daa997d310 msgr2=0x55daa99c0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 -- 172.21.15.2:0/3265498665 shutdown_connections 2024-09-12T01:00:47.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.262+0000 7f8b8fa09740 1 -- 172.21.15.2:0/3265498665 wait complete. 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 1 -- start start 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 1 Processor -- start 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b881a9e80 con 0x55daa99b45d0 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b881ab2f0 con 0x55daa99c3780 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8b881aa550 con 0x55daa99b5b40 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b8fa09740 10 client.0 _ll_register_callbacks cb 0x7f8b780ed3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43586/0 (socket says 172.21.15.2:43586) 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b86ffd640 1 -- 172.21.15.2:0/823700065 learned_addr learned my addr 172.21.15.2:0/823700065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:47.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b877fe640 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b86ffd640 1 -- 172.21.15.2:0/823700065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 msgr2=0x55daa99c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b86ffd640 1 -- 172.21.15.2:0/823700065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 msgr2=0x55daa99c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.263+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b86ffd640 1 -- 172.21.15.2:0/823700065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daa99c7fd0 con 0x55daa99b45d0 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b86ffd640 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99cbf80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8b780c4940 tx=0x7f8b780bbd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b59d812218bb39f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/823700065 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b780ed8b0 con 0x55daa99b45d0 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/823700065 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8b780c0120 con 0x55daa99b45d0 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 1 -- 172.21.15.2:0/823700065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b8001e8f0 con 0x55daa99b45d0 2024-09-12T01:00:47.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/823700065 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8b78031de0 con 0x55daa99b45d0 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 10 client.17295 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 1 -- 172.21.15.2:0/823700065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55daa9a3e020 con 0x55daa99b45d0 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/823700065 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b8001e8f0 con 0x55daa99b45d0 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/823700065 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f8b780bc460 con 0x55daa99b45d0 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 10 client.17295 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 10 client.17295 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 20 client.17295 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55daa9a3e5e0 0x55daa9a40a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 4 client.17295 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.264+0000 7f8b8fa09740 1 -- 172.21.15.2:0/823700065 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55daa9921d70 con 0x55daa9a3e5e0 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55daa9a3e5e0 0x55daa9a40a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b6e7fc640 10 client.17295 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b7ffff640 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55daa9a3e5e0 0x55daa9a40a00 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3574c37a33cb39f server_cookie=f7cdceef7266300d in_seq=0 out_seq=0 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b6e7fc640 1 -- 172.21.15.2:0/823700065 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55daa9921d70 con 0x55daa9a3e5e0 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b6e7fc640 10 client.17295 handle_command_reply: tid=0 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b8fa09740 1 client.17295 shutdown 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b8fa09740 1 -- 172.21.15.2:0/823700065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 msgr2=0x55daa99cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99cbf80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8b780c4940 tx=0x7f8b780bbd40 comp rx=0 tx=0).stop 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b8fa09740 1 -- 172.21.15.2:0/823700065 shutdown_connections 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55daa9a3e5e0 0x55daa9a40a00 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55daa99c3780 0x55daa99c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daa99b5b40 0x55daa99c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.265+0000 7f8b8fa09740 1 --2- 172.21.15.2:0/823700065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55daa99b45d0 0x55daa99cbf80 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8fa09740 1 -- 172.21.15.2:0/823700065 >> 172.21.15.2:0/823700065 conn(0x55daa997d310 msgr2=0x55daa99beb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:47.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b6e7fc640 0 client.17295 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:00:47.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8fa09740 1 -- 172.21.15.2:0/823700065 shutdown_connections 2024-09-12T01:00:47.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8fa09740 1 -- 172.21.15.2:0/823700065 wait complete. 2024-09-12T01:00:47.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8fa09740 20 client.17295 trim_cache size 0 max 16384 2024-09-12T01:00:47.271 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 -- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8b740a2cf0 msgr2=0x7f8b740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8b740a2cf0 0x7f8b740a51b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009fd0 tx=0x7f8b80009600 comp rx=0 tx=0).stop 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 -- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 msgr2=0x7f8b881992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 0x7f8b881992f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8b78006010 tx=0x7f8b78003c10 comp rx=0 tx=0).stop 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 -- 172.21.15.2:0/3918296483 shutdown_connections 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f8b740a2cf0 0x7f8b740a51b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b88102ef0 0x7f8b881a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b88102570 0x7f8b88199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 --2- 172.21.15.2:0/3918296483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b88100e20 0x7f8b881992f0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 -- 172.21.15.2:0/3918296483 >> 172.21.15.2:0/3918296483 conn(0x7f8b880fc7d0 msgr2=0x7f8b880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 -- 172.21.15.2:0/3918296483 shutdown_connections 2024-09-12T01:00:47.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:47.266+0000 7f8b8d630640 1 -- 172.21.15.2:0/3918296483 wait complete. 2024-09-12T01:00:47.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:00:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 -- 172.21.15.2:0/3232088418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1082a0 msgr2=0x7fed4c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 --2- 172.21.15.2:0/3232088418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1082a0 0x7fed4c10ec40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fed44009cd0 tx=0x7fed4402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 -- 172.21.15.2:0/3232088418 shutdown_connections 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 --2- 172.21.15.2:0/3232088418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1082a0 0x7fed4c10ec40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 --2- 172.21.15.2:0/3232088418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c1036e0 0x7fed4c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 --2- 172.21.15.2:0/3232088418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed4c102d30 0x7fed4c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 -- 172.21.15.2:0/3232088418 >> 172.21.15.2:0/3232088418 conn(0x7fed4c0fc7d0 msgr2=0x7fed4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 -- 172.21.15.2:0/3232088418 shutdown_connections 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 -- 172.21.15.2:0/3232088418 wait complete. 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.645+0000 7fed51703640 1 Processor -- start 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed51703640 1 -- start start 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed51703640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c102d30 0x7fed4c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed51703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1036e0 0x7fed4c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed51703640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed4c1082a0 0x7fed4c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed51703640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c1120a0 con 0x7fed4c1036e0 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed51703640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c111f20 con 0x7fed4c1082a0 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed51703640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c112220 con 0x7fed4c102d30 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed4a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1036e0 0x7fed4c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed4a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1036e0 0x7fed4c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43604/0 (socket says 172.21.15.2:43604) 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed4a7fc640 1 -- 172.21.15.2:0/715380507 learned_addr learned my addr 172.21.15.2:0/715380507 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed4affd640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c102d30 0x7fed4c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.646+0000 7fed4b7fe640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed4c1082a0 0x7fed4c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed4a7fc640 1 -- 172.21.15.2:0/715380507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c102d30 msgr2=0x7fed4c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c102d30 0x7fed4c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed4a7fc640 1 -- 172.21.15.2:0/715380507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed4c1082a0 msgr2=0x7fed4c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed4c1082a0 0x7fed4c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed4a7fc640 1 -- 172.21.15.2:0/715380507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c1a6980 con 0x7fed4c1036e0 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed4b7fe640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed4c1082a0 0x7fed4c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:48.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1036e0 0x7fed4c100ed0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fed4000c8c0 tx=0x7fed4000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed33fff640 1 -- 172.21.15.2:0/715380507 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40007bb0 con 0x7fed4c1036e0 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed51703640 1 -- 172.21.15.2:0/715380507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4c1a6c70 con 0x7fed4c1036e0 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed33fff640 1 -- 172.21.15.2:0/715380507 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed40007d50 con 0x7fed4c1036e0 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed33fff640 1 -- 172.21.15.2:0/715380507 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40018830 con 0x7fed4c1036e0 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.647+0000 7fed51703640 1 -- 172.21.15.2:0/715380507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4c1a71b0 con 0x7fed4c1036e0 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed53adc740 1 Processor -- start 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed33fff640 1 -- 172.21.15.2:0/715380507 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fed40018a10 con 0x7fed4c1036e0 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed53adc740 1 -- start start 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed53adc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea9954b40 0x564ea9953090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed53adc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea9953a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed53adc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 0x564ea9960760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed53adc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564ea98b92f0 con 0x564ea99535d0 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed53adc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564ea9860cf0 con 0x564ea995e370 2024-09-12T01:00:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.650+0000 7fed53adc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564ea98b52b0 con 0x564ea9954b40 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea9953a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea9953a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43618/0 (socket says 172.21.15.2:43618) 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 -- 172.21.15.2:0/2072744704 learned_addr learned my addr 172.21.15.2:0/2072744704 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4b7fe640 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea9954b40 0x564ea9953090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 0x564ea9960760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 -- 172.21.15.2:0/2072744704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea9954b40 msgr2=0x564ea9953090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea9954b40 0x564ea9953090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 -- 172.21.15.2:0/2072744704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 msgr2=0x564ea9960760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 0x564ea9960760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 -- 172.21.15.2:0/2072744704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ea98453a0 con 0x564ea99535d0 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed33fff640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed340a2cf0 0x7fed340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4affd640 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea9953a10 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00ac20 tx=0x7fed3c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3ace61149c4fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed4b7fe640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed340a2cf0 0x7fed340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed33fff640 1 -- 172.21.15.2:0/715380507 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fed400cf550 con 0x7fed4c1036e0 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed317fa640 1 -- 172.21.15.2:0/2072744704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c01d070 con 0x564ea99535d0 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed317fa640 1 -- 172.21.15.2:0/2072744704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed3c018b20 con 0x564ea99535d0 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.651+0000 7fed317fa640 1 -- 172.21.15.2:0/2072744704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c010c00 con 0x564ea99535d0 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 -- 172.21.15.2:0/2072744704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 msgr2=0x564ea9953a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed4b7fe640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed340a2cf0 0x7fed340a51b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed44009430 tx=0x7fed44009360 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea9953a10 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00ac20 tx=0x7fed3c00f790 comp rx=0 tx=0).stop 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 -- 172.21.15.2:0/2072744704 shutdown_connections 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 0x564ea9960760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea9953a10 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 --2- 172.21.15.2:0/2072744704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea9954b40 0x564ea9953090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 -- 172.21.15.2:0/2072744704 >> 172.21.15.2:0/2072744704 conn(0x564ea991c310 msgr2=0x564ea994fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 -- 172.21.15.2:0/2072744704 shutdown_connections 2024-09-12T01:00:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.652+0000 7fed53adc740 1 -- 172.21.15.2:0/2072744704 wait complete. 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 1 -- start start 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 1 Processor -- start 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea995dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea9954b40 0x564ea995b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 0x564ea995b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564ea9961070 con 0x564ea99535d0 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564ea9874060 con 0x564ea9954b40 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564ea99611f0 con 0x564ea995e370 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed53adc740 10 client.0 _ll_register_callbacks cb 0x564ea95c78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea995dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea995dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43634/0 (socket says 172.21.15.2:43634) 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4affd640 1 -- 172.21.15.2:0/456303136 learned_addr learned my addr 172.21.15.2:0/456303136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea9954b40 0x564ea995b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4affd640 1 -- 172.21.15.2:0/456303136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 msgr2=0x564ea995b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4affd640 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 0x564ea995b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4affd640 1 -- 172.21.15.2:0/456303136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea9954b40 msgr2=0x564ea995b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4affd640 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea9954b40 0x564ea995b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.653+0000 7fed4affd640 1 -- 172.21.15.2:0/456303136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ea962a3c0 con 0x564ea99535d0 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed4affd640 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea995dd60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fed3c010700 tx=0x7fed3c0104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba0503205643639 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed2eff5640 1 -- 172.21.15.2:0/456303136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c01d050 con 0x564ea99535d0 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed2eff5640 1 -- 172.21.15.2:0/456303136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fed3c010b00 con 0x564ea99535d0 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 1 -- 172.21.15.2:0/456303136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed3c018b20 con 0x564ea99535d0 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed2eff5640 1 -- 172.21.15.2:0/456303136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fed3c032050 con 0x564ea99535d0 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 10 client.17307 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:48.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 1 -- 172.21.15.2:0/456303136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564ea996cb10 con 0x564ea99535d0 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed2eff5640 1 -- 172.21.15.2:0/456303136 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed3c018b20 con 0x564ea99535d0 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed2eff5640 1 -- 172.21.15.2:0/456303136 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fed3c0046c0 con 0x564ea99535d0 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 10 client.17307 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 10 client.17307 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 20 client.17307 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x564ea996df10 0x564ea9970300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 4 client.17307 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.654+0000 7fed53adc740 1 -- 172.21.15.2:0/456303136 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ea98c6860 con 0x564ea996df10 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.655+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x564ea996df10 0x564ea9970300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.655+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x564ea996df10 0x564ea9970300 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=23e07b6cbe0cdaf6 server_cookie=111911ef456d10ec in_seq=0 out_seq=0 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.655+0000 7fed2eff5640 10 client.17307 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed2eff5640 1 -- 172.21.15.2:0/456303136 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ea98c6860 con 0x564ea996df10 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed2eff5640 10 client.17307 handle_command_reply: tid=0 2024-09-12T01:00:48.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 client.17307 shutdown 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 -- 172.21.15.2:0/456303136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 msgr2=0x564ea995dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea995dd60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fed3c010700 tx=0x7fed3c0104a0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 -- 172.21.15.2:0/456303136 shutdown_connections 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x564ea996df10 0x564ea9970300 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 0x564ea995b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed2eff5640 0 client.17307 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea9954b40 0x564ea995b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 --2- 172.21.15.2:0/456303136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea99535d0 0x564ea995dd60 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 -- 172.21.15.2:0/456303136 >> 172.21.15.2:0/456303136 conn(0x564ea991c310 msgr2=0x564ea9955960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 -- 172.21.15.2:0/456303136 shutdown_connections 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 1 -- 172.21.15.2:0/456303136 wait complete. 2024-09-12T01:00:48.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.656+0000 7fed53adc740 20 client.17307 trim_cache size 0 max 16384 2024-09-12T01:00:48.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed53adc740 1 Processor -- start 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed53adc740 1 -- start start 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed53adc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea99535d0 0x564ea996a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed53adc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9975930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed53adc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 0x564ea9975e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed53adc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c1b25e0 con 0x564ea9954b40 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed53adc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c1afe20 con 0x564ea995e370 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed53adc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c1adc90 con 0x564ea99535d0 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9975930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9975930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43648/0 (socket says 172.21.15.2:43648) 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 -- 172.21.15.2:0/1255576621 learned_addr learned my addr 172.21.15.2:0/1255576621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4affd640 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea99535d0 0x564ea996a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4b7fe640 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 0x564ea9975e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 -- 172.21.15.2:0/1255576621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea99535d0 msgr2=0x564ea996a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea99535d0 0x564ea996a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 -- 172.21.15.2:0/1255576621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 msgr2=0x564ea9975e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 0x564ea9975e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 -- 172.21.15.2:0/1255576621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ea9959560 con 0x564ea9954b40 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.670+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9975930 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fed400983c0 tx=0x7fed40086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fd57c2bf2730f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed30ff9640 1 -- 172.21.15.2:0/1255576621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4009c0f0 con 0x564ea9954b40 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed30ff9640 1 -- 172.21.15.2:0/1255576621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed4009b9f0 con 0x564ea9954b40 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed30ff9640 1 -- 172.21.15.2:0/1255576621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed400ccea0 con 0x564ea9954b40 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed53adc740 1 -- 172.21.15.2:0/1255576621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 msgr2=0x564ea9975930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed53adc740 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9975930 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fed400983c0 tx=0x7fed40086040 comp rx=0 tx=0).stop 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed53adc740 1 -- 172.21.15.2:0/1255576621 shutdown_connections 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed53adc740 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea995e370 0x564ea9975e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed53adc740 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9975930 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed53adc740 1 --2- 172.21.15.2:0/1255576621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea99535d0 0x564ea996a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed53adc740 1 -- 172.21.15.2:0/1255576621 >> 172.21.15.2:0/1255576621 conn(0x564ea991c310 msgr2=0x564ea995a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.671+0000 7fed53adc740 1 -- 172.21.15.2:0/1255576621 shutdown_connections 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 -- 172.21.15.2:0/1255576621 wait complete. 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 -- start start 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 Processor -- start 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea99535d0 0x564ea9966cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9961ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 0x564ea99625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c1ae2e0 con 0x564ea9954b40 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c1af750 con 0x564ea99535d0 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c1ae9b0 con 0x564ea995e370 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed53adc740 10 client.0 _ll_register_callbacks cb 0x7fed3c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:48.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed4a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9961ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed4a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9961ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43650/0 (socket says 172.21.15.2:43650) 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed4a7fc640 1 -- 172.21.15.2:0/4165254096 learned_addr learned my addr 172.21.15.2:0/4165254096 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed4affd640 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea99535d0 0x564ea9966cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.672+0000 7fed4b7fe640 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 0x564ea99625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed4a7fc640 1 -- 172.21.15.2:0/4165254096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 msgr2=0x564ea99625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 0x564ea99625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed4a7fc640 1 -- 172.21.15.2:0/4165254096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea99535d0 msgr2=0x564ea9966cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea99535d0 0x564ea9966cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed4a7fc640 1 -- 172.21.15.2:0/4165254096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ea9962de0 con 0x564ea9954b40 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed4a7fc640 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9961ff0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fed40097e50 tx=0x7fed4009fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff332a08735057dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed2eff5640 1 -- 172.21.15.2:0/4165254096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed400b8070 con 0x564ea9954b40 2024-09-12T01:00:48.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed2eff5640 1 -- 172.21.15.2:0/4165254096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fed400ba310 con 0x564ea9954b40 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed53adc740 1 -- 172.21.15.2:0/4165254096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed4009b9f0 con 0x564ea9954b40 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed2eff5640 1 -- 172.21.15.2:0/4165254096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fed400a4660 con 0x564ea9954b40 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed53adc740 10 client.17313 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed53adc740 1 -- 172.21.15.2:0/4165254096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564ea99d89e0 con 0x564ea9954b40 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.673+0000 7fed2eff5640 1 -- 172.21.15.2:0/4165254096 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed4009b9f0 con 0x564ea9954b40 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed2eff5640 1 -- 172.21.15.2:0/4165254096 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fed40066070 con 0x564ea9954b40 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed53adc740 10 client.17313 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed53adc740 10 client.17313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed53adc740 20 client.17313 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed53adc740 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x564ea996df10 0x564ea99db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed53adc740 4 client.17313 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed53adc740 1 -- 172.21.15.2:0/4165254096 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ea98c0d70 con 0x564ea996df10 2024-09-12T01:00:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed4affd640 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x564ea996df10 0x564ea99db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:48.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed4affd640 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x564ea996df10 0x564ea99db0a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2eee556b069b255e server_cookie=35c8cad0cbd44de2 in_seq=0 out_seq=0 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.674+0000 7fed2eff5640 10 client.17313 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed2eff5640 1 -- 172.21.15.2:0/4165254096 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ea98c0d70 con 0x564ea996df10 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed2eff5640 10 client.17313 handle_command_reply: tid=0 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 client.17313 shutdown 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 -- 172.21.15.2:0/4165254096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 msgr2=0x564ea9961ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9961ff0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fed40097e50 tx=0x7fed4009fda0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 -- 172.21.15.2:0/4165254096 shutdown_connections 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x564ea996df10 0x564ea99db0a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ea995e370 0x564ea99625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ea9954b40 0x564ea9961ff0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 --2- 172.21.15.2:0/4165254096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ea99535d0 0x564ea9966cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 -- 172.21.15.2:0/4165254096 >> 172.21.15.2:0/4165254096 conn(0x564ea991c310 msgr2=0x564ea994e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed2eff5640 0 client.17313 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:00:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 -- 172.21.15.2:0/4165254096 shutdown_connections 2024-09-12T01:00:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 1 -- 172.21.15.2:0/4165254096 wait complete. 2024-09-12T01:00:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed53adc740 20 client.17313 trim_cache size 0 max 16384 2024-09-12T01:00:48.680 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 -- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed340a2cf0 msgr2=0x7fed340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed340a2cf0 0x7fed340a51b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed44009430 tx=0x7fed44009360 comp rx=0 tx=0).stop 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 -- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1036e0 msgr2=0x7fed4c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1036e0 0x7fed4c100ed0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fed4000c8c0 tx=0x7fed4000cd80 comp rx=0 tx=0).stop 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 -- 172.21.15.2:0/715380507 shutdown_connections 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fed340a2cf0 0x7fed340a51b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed4c1082a0 0x7fed4c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4c1036e0 0x7fed4c100ed0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.675+0000 7fed51703640 1 --2- 172.21.15.2:0/715380507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c102d30 0x7fed4c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.676+0000 7fed51703640 1 -- 172.21.15.2:0/715380507 >> 172.21.15.2:0/715380507 conn(0x7fed4c0fc7d0 msgr2=0x7fed4c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.676+0000 7fed51703640 1 -- 172.21.15.2:0/715380507 shutdown_connections 2024-09-12T01:00:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:48.676+0000 7fed51703640 1 -- 172.21.15.2:0/715380507 wait complete. 2024-09-12T01:00:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:48 smithi071 ceph-mon[35276]: pgmap v241: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:48 smithi002 ceph-mon[31210]: pgmap v241: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:48 smithi167 ceph-mon[35234]: pgmap v241: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:00:49.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:00:49.657 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:50.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 -- 172.21.15.2:0/89748776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac102df0 msgr2=0x7fbdac1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 --2- 172.21.15.2:0/89748776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac102df0 0x7fbdac1031d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009900 tx=0x7fbd9c02a410 comp rx=0 tx=0).stop 2024-09-12T01:00:50.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 -- 172.21.15.2:0/89748776 shutdown_connections 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 --2- 172.21.15.2:0/89748776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdac10c2f0 0x7fbdac10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 --2- 172.21.15.2:0/89748776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac1037a0 0x7fbdac10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 --2- 172.21.15.2:0/89748776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac102df0 0x7fbdac1031d0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 -- 172.21.15.2:0/89748776 >> 172.21.15.2:0/89748776 conn(0x7fbdac0fc7d0 msgr2=0x7fbdac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 -- 172.21.15.2:0/89748776 shutdown_connections 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.135+0000 7fbdb255f640 1 -- 172.21.15.2:0/89748776 wait complete. 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdb255f640 1 Processor -- start 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdb255f640 1 -- start start 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdb255f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdac102df0 0x7fbdac198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdb255f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1037a0 0x7fbdac198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdb255f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac10c2f0 0x7fbdac19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdb255f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac112150 con 0x7fbdac1037a0 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdb255f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac111fd0 con 0x7fbdac102df0 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdb255f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1122d0 con 0x7fbdac10c2f0 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1037a0 0x7fbdac198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1037a0 0x7fbdac198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43662/0 (socket says 172.21.15.2:43662) 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 -- 172.21.15.2:0/536949605 learned_addr learned my addr 172.21.15.2:0/536949605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbdabfff640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdac102df0 0x7fbdac198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 -- 172.21.15.2:0/536949605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac10c2f0 msgr2=0x7fbdac19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac10c2f0 0x7fbdac19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 -- 172.21.15.2:0/536949605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdac102df0 msgr2=0x7fbdac198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdac102df0 0x7fbdac198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 -- 172.21.15.2:0/536949605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac19d620 con 0x7fbdac1037a0 2024-09-12T01:00:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.136+0000 7fbda3fff640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1037a0 0x7fbdac198bb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbd94006fd0 tx=0x7fbd9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.137+0000 7fbda9ffb640 1 -- 172.21.15.2:0/536949605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94011830 con 0x7fbdac1037a0 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.137+0000 7fbda9ffb640 1 -- 172.21.15.2:0/536949605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd94016070 con 0x7fbdac1037a0 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.137+0000 7fbdb255f640 1 -- 172.21.15.2:0/536949605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac19d910 con 0x7fbdac1037a0 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.137+0000 7fbda9ffb640 1 -- 172.21.15.2:0/536949605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400f2e0 con 0x7fbdac1037a0 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.137+0000 7fbdb255f640 1 -- 172.21.15.2:0/536949605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac1a51f0 con 0x7fbdac1037a0 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.139+0000 7fbda9ffb640 1 -- 172.21.15.2:0/536949605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fbd9401b460 con 0x7fbdac1037a0 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.139+0000 7fbdb4938740 1 Processor -- start 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.139+0000 7fbdb4938740 1 -- start start 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3afb40 0x5649fb3ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 0x5649fb3bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdb4938740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649fb3142f0 con 0x5649fb3ae5d0 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdb4938740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5649fb2bbcf0 con 0x5649fb3afb40 2024-09-12T01:00:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdb4938740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5649fb3102b0 con 0x5649fb3b9370 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbda9ffb640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd980a2cf0 0x7fbd980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43672/0 (socket says 172.21.15.2:43672) 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdabfff640 1 -- 172.21.15.2:0/2426345995 learned_addr learned my addr 172.21.15.2:0/2426345995 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbda3fff640 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 0x5649fb3bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd980a2cf0 0x7fbd980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3afb40 0x5649fb3ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbda9ffb640 1 -- 172.21.15.2:0/536949605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbd940ceb00 con 0x7fbdac1037a0 2024-09-12T01:00:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdabfff640 1 -- 172.21.15.2:0/2426345995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 msgr2=0x5649fb3bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdabfff640 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 0x5649fb3bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdabfff640 1 -- 172.21.15.2:0/2426345995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3afb40 msgr2=0x5649fb3ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdabfff640 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3afb40 0x5649fb3ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.140+0000 7fbdabfff640 1 -- 172.21.15.2:0/2426345995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fb2a03a0 con 0x5649fb3ae5d0 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.141+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd980a2cf0 0x7fbd980a51b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbda4013970 tx=0x7fbda4009b10 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.141+0000 7fbdabfff640 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aea10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c033000 tx=0x7fbd9c031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825d242a58704367 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.141+0000 7fbda27fc640 1 -- 172.21.15.2:0/2426345995 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c035050 con 0x5649fb3ae5d0 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.141+0000 7fbda27fc640 1 -- 172.21.15.2:0/2426345995 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd9c0317d0 con 0x5649fb3ae5d0 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.141+0000 7fbda27fc640 1 -- 172.21.15.2:0/2426345995 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c03bda0 con 0x5649fb3ae5d0 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.141+0000 7fbdb4938740 1 -- 172.21.15.2:0/2426345995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 msgr2=0x5649fb3aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.141+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aea10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c033000 tx=0x7fbd9c031660 comp rx=0 tx=0).stop 2024-09-12T01:00:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 -- 172.21.15.2:0/2426345995 shutdown_connections 2024-09-12T01:00:50.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 0x5649fb3bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aea10 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2426345995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3afb40 0x5649fb3ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 -- 172.21.15.2:0/2426345995 >> 172.21.15.2:0/2426345995 conn(0x5649fb377310 msgr2=0x5649fb3aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:50.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 -- 172.21.15.2:0/2426345995 shutdown_connections 2024-09-12T01:00:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 -- 172.21.15.2:0/2426345995 wait complete. 2024-09-12T01:00:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 -- start start 2024-09-12T01:00:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 Processor -- start 2024-09-12T01:00:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 0x5649fb3b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3b9370 0x5649fb3b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649fb3bbfb0 con 0x5649fb3b9370 2024-09-12T01:00:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5649fb2cf060 con 0x5649fb3ae5d0 2024-09-12T01:00:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5649fb3bc130 con 0x5649fb3afb40 2024-09-12T01:00:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.142+0000 7fbdb4938740 10 client.0 _ll_register_callbacks cb 0x5649fb0228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3b9370 0x5649fb3b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3b9370 0x5649fb3b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43674/0 (socket says 172.21.15.2:43674) 2024-09-12T01:00:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 -- 172.21.15.2:0/4288406605 learned_addr learned my addr 172.21.15.2:0/4288406605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbda3fff640 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdabfff640 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 0x5649fb3b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 -- 172.21.15.2:0/4288406605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 msgr2=0x5649fb3b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 -- 172.21.15.2:0/4288406605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 msgr2=0x5649fb3b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 0x5649fb3b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 -- 172.21.15.2:0/4288406605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fb0853c0 con 0x5649fb3b9370 2024-09-12T01:00:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbda3fff640 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:00:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3b9370 0x5649fb3b6640 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fbda40099c0 tx=0x7fbda4005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6df524403a94c04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbd8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/4288406605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda4024070 con 0x5649fb3b9370 2024-09-12T01:00:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/4288406605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbda4003970 con 0x5649fb3b9370 2024-09-12T01:00:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb4938740 1 -- 172.21.15.2:0/4288406605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd9c0317d0 con 0x5649fb3b9370 2024-09-12T01:00:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/4288406605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbda402f050 con 0x5649fb3b9370 2024-09-12T01:00:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.143+0000 7fbdb4938740 10 client.17325 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbdb4938740 1 -- 172.21.15.2:0/4288406605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5649fb3c7a80 con 0x5649fb3b9370 2024-09-12T01:00:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/4288406605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd9c0317d0 con 0x5649fb3b9370 2024-09-12T01:00:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/4288406605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fbda401d070 con 0x5649fb3b9370 2024-09-12T01:00:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbdb4938740 10 client.17325 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbdb4938740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbdb4938740 20 client.17325 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbdb4938740 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5649fb3c8e90 0x5649fb3cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbdb4938740 4 client.17325 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbdb4938740 1 -- 172.21.15.2:0/4288406605 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649fb321860 con 0x5649fb3c8e90 2024-09-12T01:00:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.144+0000 7fbdabfff640 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5649fb3c8e90 0x5649fb3cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.145+0000 7fbdabfff640 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5649fb3c8e90 0x5649fb3cb330 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8143b03100f6878 server_cookie=7b393ca76897058f in_seq=0 out_seq=0 2024-09-12T01:00:50.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.145+0000 7fbd8b7fe640 10 client.17325 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:50.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.145+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/4288406605 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649fb321860 con 0x5649fb3c8e90 2024-09-12T01:00:50.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.145+0000 7fbd8b7fe640 10 client.17325 handle_command_reply: tid=0 2024-09-12T01:00:50.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.145+0000 7fbdb4938740 1 client.17325 shutdown 2024-09-12T01:00:50.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.145+0000 7fbdb4938740 1 -- 172.21.15.2:0/4288406605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3b9370 msgr2=0x5649fb3b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.145+0000 7fbdb4938740 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3b9370 0x5649fb3b6640 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fbda40099c0 tx=0x7fbda4005e00 comp rx=0 tx=0).stop 2024-09-12T01:00:50.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 1 -- 172.21.15.2:0/4288406605 shutdown_connections 2024-09-12T01:00:50.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5649fb3c8e90 0x5649fb3cb330 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3b9370 0x5649fb3b6640 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 1 --2- 172.21.15.2:0/4288406605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 0x5649fb3b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbd8b7fe640 0 client.17325 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:50.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 1 -- 172.21.15.2:0/4288406605 >> 172.21.15.2:0/4288406605 conn(0x5649fb377310 msgr2=0x5649fb3b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:50.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 1 -- 172.21.15.2:0/4288406605 shutdown_connections 2024-09-12T01:00:50.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 1 -- 172.21.15.2:0/4288406605 wait complete. 2024-09-12T01:00:50.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.146+0000 7fbdb4938740 20 client.17325 trim_cache size 0 max 16384 2024-09-12T01:00:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb4938740 1 Processor -- start 2024-09-12T01:00:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb4938740 1 -- start start 2024-09-12T01:00:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3b9370 0x5649fb3b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb4938740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1ae270 con 0x5649fb3ae5d0 2024-09-12T01:00:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb4938740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1abab0 con 0x5649fb3b9370 2024-09-12T01:00:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb4938740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1a9920 con 0x5649fb3afb40 2024-09-12T01:00:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43680/0 (socket says 172.21.15.2:43680) 2024-09-12T01:00:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdabfff640 1 -- 172.21.15.2:0/3021659228 learned_addr learned my addr 172.21.15.2:0/3021659228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3b9370 0x5649fb3b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbda3fff640 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdabfff640 1 -- 172.21.15.2:0/3021659228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 msgr2=0x5649fb3c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdabfff640 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdabfff640 1 -- 172.21.15.2:0/3021659228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3b9370 msgr2=0x5649fb3b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdabfff640 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3b9370 0x5649fb3b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdabfff640 1 -- 172.21.15.2:0/3021659228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fb3b4fe0 con 0x5649fb3ae5d0 2024-09-12T01:00:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3b9370 0x5649fb3b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.159+0000 7fbda3fff640 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:00:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbdabfff640 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aae10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c03b970 tx=0x7fbd9c03ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109811869ced370d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbda1ffb640 1 -- 172.21.15.2:0/3021659228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c035070 con 0x5649fb3ae5d0 2024-09-12T01:00:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbda1ffb640 1 -- 172.21.15.2:0/3021659228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd9c0316d0 con 0x5649fb3ae5d0 2024-09-12T01:00:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbda1ffb640 1 -- 172.21.15.2:0/3021659228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c005220 con 0x5649fb3ae5d0 2024-09-12T01:00:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbdb4938740 1 -- 172.21.15.2:0/3021659228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 msgr2=0x5649fb3aae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbdb4938740 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aae10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c03b970 tx=0x7fbd9c03ba40 comp rx=0 tx=0).stop 2024-09-12T01:00:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbdb4938740 1 -- 172.21.15.2:0/3021659228 shutdown_connections 2024-09-12T01:00:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbdb4938740 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3b9370 0x5649fb3b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbdb4938740 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3afb40 0x5649fb3c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbdb4938740 1 --2- 172.21.15.2:0/3021659228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3ae5d0 0x5649fb3aae10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.160+0000 7fbdb4938740 1 -- 172.21.15.2:0/3021659228 >> 172.21.15.2:0/3021659228 conn(0x5649fb377310 msgr2=0x5649fb3aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 -- 172.21.15.2:0/3021659228 shutdown_connections 2024-09-12T01:00:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 -- 172.21.15.2:0/3021659228 wait complete. 2024-09-12T01:00:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 -- start start 2024-09-12T01:00:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 Processor -- start 2024-09-12T01:00:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 0x5649fb3c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3afb40 0x5649fb3c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 0x5649fb3b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1a9f70 con 0x5649fb3afb40 2024-09-12T01:00:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1ab3e0 con 0x5649fb3ae5d0 2024-09-12T01:00:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1aa640 con 0x5649fb3b9370 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbdb4938740 10 client.0 _ll_register_callbacks cb 0x7fbda4013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.161+0000 7fbda3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3afb40 0x5649fb3c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbda3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3afb40 0x5649fb3c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43696/0 (socket says 172.21.15.2:43696) 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbda3fff640 1 -- 172.21.15.2:0/2678552300 learned_addr learned my addr 172.21.15.2:0/2678552300 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbdabfff640 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 0x5649fb3c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbdb0afc640 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 0x5649fb3b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbda3fff640 1 -- 172.21.15.2:0/2678552300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 msgr2=0x5649fb3b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbda3fff640 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 0x5649fb3b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbda3fff640 1 -- 172.21.15.2:0/2678552300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 msgr2=0x5649fb3c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbda3fff640 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 0x5649fb3c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbda3fff640 1 -- 172.21.15.2:0/2678552300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fb3b31c0 con 0x5649fb3afb40 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbda3fff640 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3afb40 0x5649fb3c1be0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fbd94010890 tx=0x7fbd94010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ac65c599ea3905 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbd8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/2678552300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9409b0b0 con 0x5649fb3afb40 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/2678552300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbd940bb0b0 con 0x5649fb3afb40 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbdb4938740 1 -- 172.21.15.2:0/2678552300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd9c0316d0 con 0x5649fb3afb40 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/2678552300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbd9409f460 con 0x5649fb3afb40 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbdb4938740 10 client.17331 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbdb4938740 1 -- 172.21.15.2:0/2678552300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5649fb433750 con 0x5649fb3afb40 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.162+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/2678552300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd9c0316d0 con 0x5649fb3afb40 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/2678552300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fbd94097720 con 0x5649fb3afb40 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbdb4938740 10 client.17331 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbdb4938740 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbdb4938740 20 client.17331 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5649fb433e70 0x5649fb436260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbdb4938740 4 client.17331 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbdb4938740 1 -- 172.21.15.2:0/2678552300 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649fb31bd70 con 0x5649fb433e70 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbdabfff640 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5649fb433e70 0x5649fb436260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbdabfff640 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5649fb433e70 0x5649fb436260 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a686cec61ec9cf3d server_cookie=a2e863cf8242bcc6 in_seq=0 out_seq=0 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbd8b7fe640 10 client.17331 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.163+0000 7fbd8b7fe640 1 -- 172.21.15.2:0/2678552300 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649fb31bd70 con 0x5649fb433e70 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbd8b7fe640 10 client.17331 handle_command_reply: tid=0 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 client.17331 shutdown 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 -- 172.21.15.2:0/2678552300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3afb40 msgr2=0x5649fb3c1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3afb40 0x5649fb3c1be0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fbd94010890 tx=0x7fbd94010740 comp rx=0 tx=0).stop 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 -- 172.21.15.2:0/2678552300 shutdown_connections 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x5649fb433e70 0x5649fb436260 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5649fb3b9370 0x5649fb3b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649fb3afb40 0x5649fb3c1be0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbd8b7fe640 0 client.17331 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 --2- 172.21.15.2:0/2678552300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649fb3ae5d0 0x5649fb3c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 -- 172.21.15.2:0/2678552300 >> 172.21.15.2:0/2678552300 conn(0x5649fb377310 msgr2=0x5649fb3b80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 -- 172.21.15.2:0/2678552300 shutdown_connections 2024-09-12T01:00:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 1 -- 172.21.15.2:0/2678552300 wait complete. 2024-09-12T01:00:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb4938740 20 client.17331 trim_cache size 0 max 16384 2024-09-12T01:00:50.185 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:00:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb255f640 1 -- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd980a2cf0 msgr2=0x7fbd980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb255f640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd980a2cf0 0x7fbd980a51b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbda4013970 tx=0x7fbda4009b10 comp rx=0 tx=0).stop 2024-09-12T01:00:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb255f640 1 -- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1037a0 msgr2=0x7fbdac198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.164+0000 7fbdb255f640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1037a0 0x7fbdac198bb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbd94006fd0 tx=0x7fbd9400b8e0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.165+0000 7fbdb255f640 1 -- 172.21.15.2:0/536949605 shutdown_connections 2024-09-12T01:00:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.165+0000 7fbdb255f640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fbd980a2cf0 0x7fbd980a51b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.165+0000 7fbdb255f640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac10c2f0 0x7fbdac19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.165+0000 7fbdb255f640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdac1037a0 0x7fbdac198bb0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.165+0000 7fbdb255f640 1 --2- 172.21.15.2:0/536949605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdac102df0 0x7fbdac198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.165+0000 7fbdb255f640 1 -- 172.21.15.2:0/536949605 >> 172.21.15.2:0/536949605 conn(0x7fbdac0fc7d0 msgr2=0x7fbdac0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.165+0000 7fbdb255f640 1 -- 172.21.15.2:0/536949605 shutdown_connections 2024-09-12T01:00:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:50.165+0000 7fbdb255f640 1 -- 172.21.15.2:0/536949605 wait complete. 2024-09-12T01:00:50.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:50 smithi002 ceph-mon[31210]: pgmap v242: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:50.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:50 smithi071 ceph-mon[35276]: pgmap v242: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:51.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:50 smithi167 ceph-mon[35234]: pgmap v242: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:00:51.896 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:00:51.896 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:00:52.168 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:52.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 -- 172.21.15.2:0/413574156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b0102d40 msgr2=0x7fd3b0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/413574156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b0102d40 0x7fd3b0103120 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009ca0 tx=0x7fd3a002a950 comp rx=0 tx=0).stop 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 -- 172.21.15.2:0/413574156 shutdown_connections 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/413574156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3b010c170 0x7fd3b010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/413574156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b0103660 0x7fd3b010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/413574156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b0102d40 0x7fd3b0103120 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 -- 172.21.15.2:0/413574156 >> 172.21.15.2:0/413574156 conn(0x7fd3b00fc7a0 msgr2=0x7fd3b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 -- 172.21.15.2:0/413574156 shutdown_connections 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 -- 172.21.15.2:0/413574156 wait complete. 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 Processor -- start 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.612+0000 7fd3b82f5640 1 -- start start 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b82f5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3b0102d40 0x7fd3b019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b82f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b0103660 0x7fd3b019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b82f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b010c170 0x7fd3b019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b82f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b0111f70 con 0x7fd3b010c170 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b82f5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b0111df0 con 0x7fd3b0102d40 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b82f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b01120f0 con 0x7fd3b0103660 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b010c170 0x7fd3b019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b010c170 0x7fd3b019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43708/0 (socket says 172.21.15.2:43708) 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 -- 172.21.15.2:0/1755448534 learned_addr learned my addr 172.21.15.2:0/1755448534 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b5890640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b0103660 0x7fd3b019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6091640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3b0102d40 0x7fd3b019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 -- 172.21.15.2:0/1755448534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b0103660 msgr2=0x7fd3b019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b0103660 0x7fd3b019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 -- 172.21.15.2:0/1755448534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3b0102d40 msgr2=0x7fd3b019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3b0102d40 0x7fd3b019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 -- 172.21.15.2:0/1755448534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b019f5d0 con 0x7fd3b010c170 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.613+0000 7fd3b6892640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b010c170 0x7fd3b019eef0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c970 tx=0x7fd3a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.614+0000 7fd3af7fe640 1 -- 172.21.15.2:0/1755448534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8007bb0 con 0x7fd3b010c170 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.614+0000 7fd3b82f5640 1 -- 172.21.15.2:0/1755448534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b019f8c0 con 0x7fd3b010c170 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.614+0000 7fd3af7fe640 1 -- 172.21.15.2:0/1755448534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a8007d50 con 0x7fd3b010c170 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.614+0000 7fd3af7fe640 1 -- 172.21.15.2:0/1755448534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8018800 con 0x7fd3b010c170 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.614+0000 7fd3b82f5640 1 -- 172.21.15.2:0/1755448534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b01a71a0 con 0x7fd3b010c170 2024-09-12T01:00:52.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.616+0000 7fd3af7fe640 1 -- 172.21.15.2:0/1755448534 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fd3a800fa50 con 0x7fd3b010c170 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.616+0000 7fd3ba6ce740 1 Processor -- start 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.616+0000 7fd3ba6ce740 1 -- start start 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489eef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 0x55e2489fc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e248954280 con 0x55e2489ef480 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e2488fbb10 con 0x55e2489f9d40 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e248950240 con 0x55e2489eeb60 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43724/0 (socket says 172.21.15.2:43724) 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 -- 172.21.15.2:0/2824898048 learned_addr learned my addr 172.21.15.2:0/2824898048 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3af7fe640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3980a2cf0 0x7fd3980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b5890640 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b5890640 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 0x55e2489fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 -- 172.21.15.2:0/2824898048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 msgr2=0x55e2489eef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489eef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 -- 172.21.15.2:0/2824898048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 msgr2=0x55e2489fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 0x55e2489fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 -- 172.21.15.2:0/2824898048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2489081f0 con 0x55e2489ef480 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6892640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3980a2cf0 0x7fd3980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b5890640 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3af7fe640 1 -- 172.21.15.2:0/1755448534 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd3a80cf530 con 0x7fd3b010c170 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.617+0000 7fd3b6091640 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f9800 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0030030 tx=0x7fd3a002f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e693d9305171c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.618+0000 7fd3acdea640 1 -- 172.21.15.2:0/2824898048 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0034040 con 0x55e2489ef480 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.618+0000 7fd3acdea640 1 -- 172.21.15.2:0/2824898048 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a0003970 con 0x55e2489ef480 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.618+0000 7fd3b6892640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3980a2cf0 0x7fd3980a51b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd3a809b670 tx=0x7fd3a806d930 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.618+0000 7fd3acdea640 1 -- 172.21.15.2:0/2824898048 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0004630 con 0x55e2489ef480 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.618+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2824898048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 msgr2=0x55e2489f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.618+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f9800 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0030030 tx=0x7fd3a002f940 comp rx=0 tx=0).stop 2024-09-12T01:00:52.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2824898048 shutdown_connections 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 0x55e2489fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f9800 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2824898048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2824898048 >> 172.21.15.2:0/2824898048 conn(0x55e2489eb0f0 msgr2=0x55e2489eb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2824898048 shutdown_connections 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2824898048 wait complete. 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 -- start start 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 Processor -- start 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 0x55e2489f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489f9d40 0x55e2489f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e2489fc910 con 0x55e2489ef480 2024-09-12T01:00:52.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e24890ef10 con 0x55e2489eeb60 2024-09-12T01:00:52.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e2489fca90 con 0x55e2489f9d40 2024-09-12T01:00:52.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3ba6ce740 10 client.0 _ll_register_callbacks cb 0x55e2488d7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:52.660 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:00:52.660 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T01:00:52.660 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "deda41b2-cfab-4c51-8425-29af41da0402", 2024-09-12T01:00:52.661 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T01:00:52.661 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:00:52.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3b6091640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3b6091640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43732/0 (socket says 172.21.15.2:43732) 2024-09-12T01:00:52.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.619+0000 7fd3b6091640 1 -- 172.21.15.2:0/2611232313 learned_addr learned my addr 172.21.15.2:0/2611232313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:52.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3b5890640 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 0x55e2489f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3b6091640 1 -- 172.21.15.2:0/2611232313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489f9d40 msgr2=0x55e2489f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3b6091640 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489f9d40 0x55e2489f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3b6091640 1 -- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 msgr2=0x55e2489f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3b6091640 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 0x55e2489f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3b6091640 1 -- 172.21.15.2:0/2611232313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2486c56a0 con 0x55e2489ef480 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3b5890640 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 0x55e2489f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3b6091640 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f70c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009800 tx=0x7fd3a002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b65726374e397a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd395ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd395ffb640 1 -- 172.21.15.2:0/2611232313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0053060 con 0x55e2489ef480 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd395ffb640 1 -- 172.21.15.2:0/2611232313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd3a00043b0 con 0x55e2489ef480 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2611232313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a0003970 con 0x55e2489ef480 2024-09-12T01:00:52.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd395ffb640 1 -- 172.21.15.2:0/2611232313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd3a0034050 con 0x55e2489ef480 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3ba6ce740 10 client.17343 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2611232313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e2489fc910 con 0x55e2489ef480 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.620+0000 7fd395ffb640 1 -- 172.21.15.2:0/2611232313 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a0003970 con 0x55e2489ef480 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd395ffb640 1 -- 172.21.15.2:0/2611232313 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fd3a0042070 con 0x55e2489ef480 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd3ba6ce740 10 client.17343 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd3ba6ce740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd3ba6ce740 20 client.17343 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e248a09600 0x55e248a0b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd3ba6ce740 4 client.17343 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2611232313 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2489617f0 con 0x55e248a09600 2024-09-12T01:00:52.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd3b5890640 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e248a09600 0x55e248a0b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd395ffb640 10 client.17343 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.621+0000 7fd3b5890640 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e248a09600 0x55e248a0b9f0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b156fbb3c5f4a121 server_cookie=215747614cc1ea89 in_seq=0 out_seq=0 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd395ffb640 1 -- 172.21.15.2:0/2611232313 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2489617f0 con 0x55e248a09600 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd395ffb640 10 client.17343 handle_command_reply: tid=0 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 client.17343 shutdown 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2611232313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 msgr2=0x55e2489f70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f70c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009800 tx=0x7fd3a002a950 comp rx=0 tx=0).stop 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2611232313 shutdown_connections 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e248a09600 0x55e248a0b9f0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489f9d40 0x55e2489f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd395ffb640 0 client.17343 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e2489f70c0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/2611232313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 0x55e2489f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2611232313 >> 172.21.15.2:0/2611232313 conn(0x55e2489eb0f0 msgr2=0x55e2489ea270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2611232313 shutdown_connections 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/2611232313 wait complete. 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.622+0000 7fd3ba6ce740 20 client.17343 trim_cache size 0 max 16384 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3ba6ce740 1 Processor -- start 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3ba6ce740 1 -- start start 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e248a11110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 0x55e248a11650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b01b2520 con 0x55e2489ef480 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b01afd60 con 0x55e2489f9d40 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b01adbd0 con 0x55e2489eeb60 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3b6091640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e248a11110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3b6091640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e248a11110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43746/0 (socket says 172.21.15.2:43746) 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3b6091640 1 -- 172.21.15.2:0/385811429 learned_addr learned my addr 172.21.15.2:0/385811429 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.640+0000 7fd3b5890640 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 0x55e248a11650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd3b5890640 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd3b6091640 1 -- 172.21.15.2:0/385811429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 msgr2=0x55e2489f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd3b6091640 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd3b6091640 1 -- 172.21.15.2:0/385811429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 msgr2=0x55e248a11650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd3b6091640 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 0x55e248a11650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd3b6091640 1 -- 172.21.15.2:0/385811429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2489eaf20 con 0x55e2489ef480 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd3b6091640 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e248a11110 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00042a0 tx=0x7fd3a0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5691d5eb26a0b7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd397fff640 1 -- 172.21.15.2:0/385811429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0053070 con 0x55e2489ef480 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd397fff640 1 -- 172.21.15.2:0/385811429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a0003970 con 0x55e2489ef480 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.641+0000 7fd397fff640 1 -- 172.21.15.2:0/385811429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0030a60 con 0x55e2489ef480 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/385811429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 msgr2=0x55e248a11110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e248a11110 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00042a0 tx=0x7fd3a0000f40 comp rx=0 tx=0).stop 2024-09-12T01:00:52.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/385811429 shutdown_connections 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489f9d40 0x55e248a11650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489ef480 0x55e248a11110 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/385811429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489eeb60 0x55e2489f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/385811429 >> 172.21.15.2:0/385811429 conn(0x55e2489eb0f0 msgr2=0x55e2489f5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/385811429 shutdown_connections 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/385811429 wait complete. 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 -- start start 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.642+0000 7fd3ba6ce740 1 Processor -- start 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 0x55e248a01cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489ef480 0x55e248a02230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3ba6ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489f9d40 0x55e2489fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b01ae220 con 0x55e2489f9d40 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b01af690 con 0x55e2489eeb60 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3ba6ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b01ae8f0 con 0x55e2489ef480 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3ba6ce740 10 client.0 _ll_register_callbacks cb 0x7fd3a002ff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489f9d40 0x55e2489fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489f9d40 0x55e2489fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43752/0 (socket says 172.21.15.2:43752) 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 -- 172.21.15.2:0/725945211 learned_addr learned my addr 172.21.15.2:0/725945211 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b6091640 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489ef480 0x55e248a02230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 -- 172.21.15.2:0/725945211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489ef480 msgr2=0x55e248a02230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489ef480 0x55e248a02230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 -- 172.21.15.2:0/725945211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 msgr2=0x55e248a01cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 0x55e248a01cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 -- 172.21.15.2:0/725945211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2489ef9f0 con 0x55e2489f9d40 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3b5890640 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489f9d40 0x55e2489fcca0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd3b010eb00 tx=0x7fd3a401e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eed4ff5c0861b9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd395ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd395ffb640 1 -- 172.21.15.2:0/725945211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4003a00 con 0x55e2489f9d40 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd395ffb640 1 -- 172.21.15.2:0/725945211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd3a4003ba0 con 0x55e2489f9d40 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.643+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/725945211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a0003970 con 0x55e2489f9d40 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd395ffb640 1 -- 172.21.15.2:0/725945211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd3a4003da0 con 0x55e2489f9d40 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3ba6ce740 10 client.17349 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/725945211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e248a746c0 con 0x55e2489f9d40 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd395ffb640 1 -- 172.21.15.2:0/725945211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a0003970 con 0x55e2489f9d40 2024-09-12T01:00:52.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd395ffb640 1 -- 172.21.15.2:0/725945211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fd3a4028420 con 0x55e2489f9d40 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3ba6ce740 10 client.17349 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3ba6ce740 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3ba6ce740 20 client.17349 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e248a09600 0x55e248a76e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3ba6ce740 4 client.17349 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/725945211 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e24895bd00 con 0x55e248a09600 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.644+0000 7fd3b6091640 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e248a09600 0x55e248a76e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.645+0000 7fd3b6091640 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e248a09600 0x55e248a76e60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8a022995007c0b server_cookie=15de9ee53da9b6ed in_seq=0 out_seq=0 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.645+0000 7fd395ffb640 10 client.17349 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd395ffb640 1 -- 172.21.15.2:0/725945211 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e24895bd00 con 0x55e248a09600 2024-09-12T01:00:52.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd395ffb640 10 client.17349 handle_command_reply: tid=0 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 client.17349 shutdown 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/725945211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489f9d40 msgr2=0x55e2489fcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489f9d40 0x55e2489fcca0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd3b010eb00 tx=0x7fd3a401e820 comp rx=0 tx=0).stop 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/725945211 shutdown_connections 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55e248a09600 0x55e248a76e60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2489f9d40 0x55e2489fcca0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2489ef480 0x55e248a02230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 --2- 172.21.15.2:0/725945211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e2489eeb60 0x55e248a01cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd395ffb640 0 client.17349 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:52.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/725945211 >> 172.21.15.2:0/725945211 conn(0x55e2489eb0f0 msgr2=0x55e2489f5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/725945211 shutdown_connections 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 1 -- 172.21.15.2:0/725945211 wait complete. 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.646+0000 7fd3ba6ce740 20 client.17349 trim_cache size 0 max 16384 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 -- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3980a2cf0 msgr2=0x7fd3980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3980a2cf0 0x7fd3980a51b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd3a809b670 tx=0x7fd3a806d930 comp rx=0 tx=0).stop 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 -- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b010c170 msgr2=0x7fd3b019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b010c170 0x7fd3b019eef0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c970 tx=0x7fd3a800ce30 comp rx=0 tx=0).stop 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 -- 172.21.15.2:0/1755448534 shutdown_connections 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd3980a2cf0 0x7fd3980a51b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3b010c170 0x7fd3b019eef0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b0103660 0x7fd3b019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 --2- 172.21.15.2:0/1755448534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3b0102d40 0x7fd3b019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:52.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 -- 172.21.15.2:0/1755448534 >> 172.21.15.2:0/1755448534 conn(0x7fd3b00fc7a0 msgr2=0x7fd3b010d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:52.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 -- 172.21.15.2:0/1755448534 shutdown_connections 2024-09-12T01:00:52.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:52.647+0000 7fd3b82f5640 1 -- 172.21.15.2:0/1755448534 wait complete. 2024-09-12T01:00:52.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:52 smithi071 ceph-mon[35276]: pgmap v243: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-12T01:00:52.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:52 smithi002 ceph-mon[31210]: pgmap v243: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-12T01:00:53.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:52 smithi167 ceph-mon[35234]: pgmap v243: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-12T01:00:53.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:00:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:00:53.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:53 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T01:00:53.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:53 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:53.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:53 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T01:00:53.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:53 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:53.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:53 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T01:00:53.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:53 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:53.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:53 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T01:00:53.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:53 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:54.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:53 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T01:00:54.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:53 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:54.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:53 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T01:00:54.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:53 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:00:54.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 -- 172.21.15.2:0/2232177078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 msgr2=0x7f17741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 --2- 172.21.15.2:0/2232177078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 0x7f17741021c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1764009900 tx=0x7f176402a410 comp rx=0 tx=0).stop 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 -- 172.21.15.2:0/2232177078 shutdown_connections 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 --2- 172.21.15.2:0/2232177078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1774106f10 0x7f177410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 --2- 172.21.15.2:0/2232177078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774102790 0x7f17741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 --2- 172.21.15.2:0/2232177078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 0x7f17741021c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 -- 172.21.15.2:0/2232177078 >> 172.21.15.2:0/2232177078 conn(0x7f17740fd8c0 msgr2=0x7f17740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 -- 172.21.15.2:0/2232177078 shutdown_connections 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.041+0000 7f177909e640 1 -- 172.21.15.2:0/2232177078 wait complete. 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177909e640 1 Processor -- start 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177909e640 1 -- start start 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177909e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 0x7f17740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177909e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1774102790 0x7f1774074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177909e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774106f10 0x7f1774074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177909e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1774111f30 con 0x7f1774101de0 2024-09-12T01:00:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177909e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1774111db0 con 0x7f1774102790 2024-09-12T01:00:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177909e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17741120b0 con 0x7f1774106f10 2024-09-12T01:00:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f1772d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 0x7f17740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f1772d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 0x7f17740744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43764/0 (socket says 172.21.15.2:43764) 2024-09-12T01:00:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f1772d9d640 1 -- 172.21.15.2:0/1995700708 learned_addr learned my addr 172.21.15.2:0/1995700708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.042+0000 7f177259c640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1774102790 0x7f1774074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f177359e640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774106f10 0x7f1774074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f1772d9d640 1 -- 172.21.15.2:0/1995700708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774106f10 msgr2=0x7f1774074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f1772d9d640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774106f10 0x7f1774074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f1772d9d640 1 -- 172.21.15.2:0/1995700708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1774102790 msgr2=0x7f1774074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f1772d9d640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1774102790 0x7f1774074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f1772d9d640 1 -- 172.21.15.2:0/1995700708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17741a6850 con 0x7f1774101de0 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f177259c640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1774102790 0x7f1774074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f1772d9d640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 0x7f17740744f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1764006010 tx=0x7f17640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f175bfff640 1 -- 172.21.15.2:0/1995700708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176403f030 con 0x7f1774101de0 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f177909e640 1 -- 172.21.15.2:0/1995700708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17741a6ae0 con 0x7f1774101de0 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f175bfff640 1 -- 172.21.15.2:0/1995700708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1764003ce0 con 0x7f1774101de0 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f175bfff640 1 -- 172.21.15.2:0/1995700708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764035070 con 0x7f1774101de0 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.043+0000 7f177909e640 1 -- 172.21.15.2:0/1995700708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17741a7010 con 0x7f1774101de0 2024-09-12T01:00:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f177b477740 1 Processor -- start 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f175bfff640 1 -- 172.21.15.2:0/1995700708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f1764042030 con 0x7f1774101de0 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f177b477740 1 -- start start 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f177b477740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab46880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f177b477740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab46dc0 0x55802ab51140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f177b477740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab51680 0x55802ab53a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f177b477740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55802aaac2e0 con 0x55802ab464a0 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f177b477740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55802aa53ce0 con 0x55802ab46dc0 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.046+0000 7f177b477740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55802aaa82a0 con 0x55802ab51680 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab46880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab46880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43778/0 (socket says 172.21.15.2:43778) 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 -- 172.21.15.2:0/1589000242 learned_addr learned my addr 172.21.15.2:0/1589000242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177259c640 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab51680 0x55802ab53a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f1772d9d640 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab46dc0 0x55802ab51140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 -- 172.21.15.2:0/1589000242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab51680 msgr2=0x55802ab53a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab51680 0x55802ab53a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 -- 172.21.15.2:0/1589000242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab46dc0 msgr2=0x55802ab51140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab46dc0 0x55802ab51140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 -- 172.21.15.2:0/1589000242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802aa38440 con 0x55802ab464a0 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f177359e640 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab46880 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f176c009f40 tx=0x7f176c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d310cb889b2839d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f175bfff640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f175c0a2cf0 0x7f175c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f1772d9d640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f175c0a2cf0 0x7f175c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f17597fa640 1 -- 172.21.15.2:0/1589000242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c003b70 con 0x55802ab464a0 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f17597fa640 1 -- 172.21.15.2:0/1589000242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f176c003d10 con 0x55802ab464a0 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f175bfff640 1 -- 172.21.15.2:0/1995700708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f17640efb60 con 0x7f1774101de0 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.047+0000 7f17597fa640 1 -- 172.21.15.2:0/1589000242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c011a40 con 0x55802ab464a0 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 -- 172.21.15.2:0/1589000242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 msgr2=0x55802ab46880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f1772d9d640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f175c0a2cf0 0x7f175c0a51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f17640ed2e0 tx=0x7f17640f36b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab46880 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f176c009f40 tx=0x7f176c010860 comp rx=0 tx=0).stop 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 -- 172.21.15.2:0/1589000242 shutdown_connections 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab51680 0x55802ab53a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab46dc0 0x55802ab51140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 --2- 172.21.15.2:0/1589000242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab46880 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 -- 172.21.15.2:0/1589000242 >> 172.21.15.2:0/1589000242 conn(0x55802ab42a30 msgr2=0x55802ab42e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 -- 172.21.15.2:0/1589000242 shutdown_connections 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.048+0000 7f177b477740 1 -- 172.21.15.2:0/1589000242 wait complete. 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 1 -- start start 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 1 Processor -- start 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab464a0 0x55802ab51010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 0x55802ab4e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab51680 0x55802ab4e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55802ab54250 con 0x55802ab51680 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55802aa67050 con 0x55802ab464a0 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55802ab543d0 con 0x55802ab46dc0 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177b477740 10 client.0 _ll_register_callbacks cb 0x55802aaa7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab51680 0x55802ab4e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab51680 0x55802ab4e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43788/0 (socket says 172.21.15.2:43788) 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177359e640 1 -- 172.21.15.2:0/1103317313 learned_addr learned my addr 172.21.15.2:0/1103317313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177359e640 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab464a0 0x55802ab51010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177259c640 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 0x55802ab4e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177359e640 1 -- 172.21.15.2:0/1103317313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 msgr2=0x55802ab4e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177359e640 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 0x55802ab4e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177359e640 1 -- 172.21.15.2:0/1103317313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab464a0 msgr2=0x55802ab51010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.049+0000 7f177359e640 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab464a0 0x55802ab51010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f177359e640 1 -- 172.21.15.2:0/1103317313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802a81d3c0 con 0x55802ab51680 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f177359e640 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab51680 0x55802ab4e840 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f176c0116a0 tx=0x7f176c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6872e51cffc968 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f1756ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f1756ff5640 1 -- 172.21.15.2:0/1103317313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c024040 con 0x55802ab51680 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f1756ff5640 1 -- 172.21.15.2:0/1103317313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f176c0045c0 con 0x55802ab51680 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f177b477740 1 -- 172.21.15.2:0/1103317313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176c003d10 con 0x55802ab51680 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f1756ff5640 1 -- 172.21.15.2:0/1103317313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f176c031050 con 0x55802ab51680 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f177b477740 10 client.17361 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f177b477740 1 -- 172.21.15.2:0/1103317313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55802ab5fc40 con 0x55802ab51680 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f1756ff5640 1 -- 172.21.15.2:0/1103317313 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f176c003d10 con 0x55802ab51680 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.050+0000 7f1756ff5640 1 -- 172.21.15.2:0/1103317313 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f176c02a720 con 0x55802ab51680 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f177b477740 10 client.17361 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f177b477740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f177b477740 20 client.17361 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f177b477740 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55802ab61050 0x55802ab63440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f177b477740 4 client.17361 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f177b477740 1 -- 172.21.15.2:0/1103317313 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55802aab9850 con 0x55802ab61050 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f177259c640 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55802ab61050 0x55802ab63440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f177259c640 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55802ab61050 0x55802ab63440 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3673249ca906ae3 server_cookie=c4fddc8ed944562 in_seq=0 out_seq=0 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.051+0000 7f1756ff5640 10 client.17361 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f1756ff5640 1 -- 172.21.15.2:0/1103317313 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55802aab9850 con 0x55802ab61050 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f1756ff5640 10 client.17361 handle_command_reply: tid=0 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 client.17361 shutdown 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 -- 172.21.15.2:0/1103317313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab51680 msgr2=0x55802ab4e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab51680 0x55802ab4e840 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f176c0116a0 tx=0x7f176c0115a0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 -- 172.21.15.2:0/1103317313 shutdown_connections 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55802ab61050 0x55802ab63440 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab51680 0x55802ab4e840 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 0x55802ab4e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f1756ff5640 0 client.17361 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 --2- 172.21.15.2:0/1103317313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab464a0 0x55802ab51010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 -- 172.21.15.2:0/1103317313 >> 172.21.15.2:0/1103317313 conn(0x55802ab42a30 msgr2=0x55802ab48760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 -- 172.21.15.2:0/1103317313 shutdown_connections 2024-09-12T01:00:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.052+0000 7f177b477740 1 -- 172.21.15.2:0/1103317313 wait complete. 2024-09-12T01:00:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.053+0000 7f177b477740 20 client.17361 trim_cache size 0 max 16384 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177b477740 1 Processor -- start 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177b477740 1 -- start start 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177b477740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab4cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177b477740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 0x55802ab68b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177b477740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177b477740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17741b2570 con 0x55802ab464a0 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177b477740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17741afdb0 con 0x55802ab51680 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177b477740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17741adc20 con 0x55802ab46dc0 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab4cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab4cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43794/0 (socket says 172.21.15.2:43794) 2024-09-12T01:00:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177359e640 1 -- 172.21.15.2:0/4283578576 learned_addr learned my addr 172.21.15.2:0/4283578576 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177259c640 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 0x55802ab68b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177359e640 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177359e640 1 -- 172.21.15.2:0/4283578576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 msgr2=0x55802ab68b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177359e640 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 0x55802ab68b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177359e640 1 -- 172.21.15.2:0/4283578576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 msgr2=0x55802ab690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.070+0000 7f177359e640 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.071+0000 7f177359e640 1 -- 172.21.15.2:0/4283578576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802ab51380 con 0x55802ab464a0 2024-09-12T01:00:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.071+0000 7f177359e640 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab4cb90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f176c011570 tx=0x7f176c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a22f1a20fc173f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.071+0000 7f1758ff9640 1 -- 172.21.15.2:0/4283578576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c03c070 con 0x55802ab464a0 2024-09-12T01:00:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.071+0000 7f1758ff9640 1 -- 172.21.15.2:0/4283578576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f176c0099c0 con 0x55802ab464a0 2024-09-12T01:00:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.071+0000 7f1758ff9640 1 -- 172.21.15.2:0/4283578576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c02a3c0 con 0x55802ab464a0 2024-09-12T01:00:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- 172.21.15.2:0/4283578576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 msgr2=0x55802ab4cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab4cb90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f176c011570 tx=0x7f176c009610 comp rx=0 tx=0).stop 2024-09-12T01:00:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- 172.21.15.2:0/4283578576 shutdown_connections 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab46dc0 0x55802ab68b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 --2- 172.21.15.2:0/4283578576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab464a0 0x55802ab4cb90 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- 172.21.15.2:0/4283578576 >> 172.21.15.2:0/4283578576 conn(0x55802ab42a30 msgr2=0x55802ab50340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- 172.21.15.2:0/4283578576 shutdown_connections 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- 172.21.15.2:0/4283578576 wait complete. 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- start start 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 Processor -- start 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab464a0 0x55802ab572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab46dc0 0x55802ab57830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab57d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17741ae270 con 0x55802ab46dc0 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17741af6e0 con 0x55802ab51680 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17741ae940 con 0x55802ab464a0 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.072+0000 7f177b477740 10 client.0 _ll_register_callbacks cb 0x7f17640f3580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab46dc0 0x55802ab57830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab46dc0 0x55802ab57830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43802/0 (socket says 172.21.15.2:43802) 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 -- 172.21.15.2:0/2193394818 learned_addr learned my addr 172.21.15.2:0/2193394818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177359e640 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab464a0 0x55802ab572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177359e640 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab57d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 -- 172.21.15.2:0/2193394818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab464a0 msgr2=0x55802ab572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab464a0 0x55802ab572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 -- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 msgr2=0x55802ab57d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab57d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 -- 172.21.15.2:0/2193394818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802abcab60 con 0x55802ab46dc0 2024-09-12T01:00:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177359e640 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab57d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177259c640 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab46dc0 0x55802ab57830 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1768005fd0 tx=0x7f1768012b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aea395aa31154c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f1756ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f1756ff5640 1 -- 172.21.15.2:0/2193394818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768004230 con 0x55802ab46dc0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f1756ff5640 1 -- 172.21.15.2:0/2193394818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f17680043d0 con 0x55802ab46dc0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177b477740 1 -- 172.21.15.2:0/2193394818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176c0099c0 con 0x55802ab46dc0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f1756ff5640 1 -- 172.21.15.2:0/2193394818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f176802c050 con 0x55802ab46dc0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177b477740 10 client.17367 fetch_fsmap learned FSMap version 32 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.073+0000 7f177b477740 1 -- 172.21.15.2:0/2193394818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55802abcbe40 con 0x55802ab46dc0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f1756ff5640 1 -- 172.21.15.2:0/2193394818 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f176c0099c0 con 0x55802ab46dc0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f1756ff5640 1 -- 172.21.15.2:0/2193394818 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f1768003b80 con 0x55802ab46dc0 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f177b477740 10 client.17367 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f177b477740 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f177b477740 20 client.17367 populate_metadata read hostname 'smithi002' 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f177b477740 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55802abcc5f0 0x55802abcea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f177b477740 4 client.17367 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f177b477740 1 -- 172.21.15.2:0/2193394818 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55802aab3d60 con 0x55802abcc5f0 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.074+0000 7f177359e640 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55802abcc5f0 0x55802abcea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177359e640 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55802abcc5f0 0x55802abcea10 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c2b316b5ec6fc2e server_cookie=fd0e72ec8b001392 in_seq=0 out_seq=0 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f1756ff5640 10 client.17367 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f1756ff5640 1 -- 172.21.15.2:0/2193394818 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55802aab3d60 con 0x55802abcc5f0 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f1756ff5640 10 client.17367 handle_command_reply: tid=0 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 client.17367 shutdown 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 -- 172.21.15.2:0/2193394818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab46dc0 msgr2=0x55802ab57830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab46dc0 0x55802ab57830 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1768005fd0 tx=0x7f1768012b10 comp rx=0 tx=0).stop 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 -- 172.21.15.2:0/2193394818 shutdown_connections 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55802abcc5f0 0x55802abcea10 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55802ab51680 0x55802ab57d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55802ab46dc0 0x55802ab57830 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f1756ff5640 0 client.17367 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 --2- 172.21.15.2:0/2193394818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55802ab464a0 0x55802ab572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.075+0000 7f177b477740 1 -- 172.21.15.2:0/2193394818 >> 172.21.15.2:0/2193394818 conn(0x55802ab42a30 msgr2=0x55802ab41350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177b477740 1 -- 172.21.15.2:0/2193394818 shutdown_connections 2024-09-12T01:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177b477740 1 -- 172.21.15.2:0/2193394818 wait complete. 2024-09-12T01:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177b477740 20 client.17367 trim_cache size 0 max 16384 2024-09-12T01:00:54.085 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "deda41b2-cfab-4c51-8425-29af41da0402": { 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "deda41b2-cfab-4c51-8425-29af41da0402", 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:00:54.086 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:00:54.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 -- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f175c0a2cf0 msgr2=0x7f175c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f175c0a2cf0 0x7f175c0a51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f17640ed2e0 tx=0x7f17640f36b0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 -- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 msgr2=0x7f17740744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:00:54.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 0x7f17740744f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1764006010 tx=0x7f17640042f0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 -- 172.21.15.2:0/1995700708 shutdown_connections 2024-09-12T01:00:54.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f175c0a2cf0 0x7f175c0a51b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774106f10 0x7f1774074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1774102790 0x7f1774074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 --2- 172.21.15.2:0/1995700708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1774101de0 0x7f17740744f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:00:54.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.076+0000 7f177909e640 1 -- 172.21.15.2:0/1995700708 >> 172.21.15.2:0/1995700708 conn(0x7f17740fd8c0 msgr2=0x7f17740fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:00:54.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.077+0000 7f177909e640 1 -- 172.21.15.2:0/1995700708 shutdown_connections 2024-09-12T01:00:54.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:00:54.077+0000 7f177909e640 1 -- 172.21.15.2:0/1995700708 wait complete. 2024-09-12T01:00:54.725 INFO:tasks.cephfs.filesystem:scrub status for tag:deda41b2-cfab-4c51-8425-29af41da0402 - {'path': '/', 'tag': 'deda41b2-cfab-4c51-8425-29af41da0402', 'options': 'recursive,force'} 2024-09-12T01:00:54.906 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:54 smithi002 ceph-mon[31210]: pgmap v244: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:00:54.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:54 smithi071 ceph-mon[35276]: pgmap v244: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:00:55.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:54 smithi167 ceph-mon[35234]: pgmap v244: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:00:56.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:56 smithi002 ceph-mon[31210]: pgmap v245: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:00:56.792 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:56 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T01:00:56.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:56 smithi071 ceph-mon[35276]: pgmap v245: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:00:56.945 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:56 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T01:00:57.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:56 smithi167 ceph-mon[35234]: pgmap v245: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:00:57.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:56 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T01:00:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:00:58 smithi071 ceph-mon[35276]: pgmap v246: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-12T01:00:58.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:00:58 smithi002 ceph-mon[31210]: pgmap v246: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-12T01:00:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:00:58 smithi167 ceph-mon[35234]: pgmap v246: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-12T01:01:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:00 smithi071 ceph-mon[35276]: pgmap v247: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:01:00.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:00 smithi002 ceph-mon[31210]: pgmap v247: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:01:01.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:00 smithi167 ceph-mon[35234]: pgmap v247: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:01:02.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:02 smithi071 ceph-mon[35276]: pgmap v248: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:01:02.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:02 smithi002 ceph-mon[31210]: pgmap v248: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:01:03.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:02 smithi167 ceph-mon[35234]: pgmap v248: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:01:04.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:04 smithi071 ceph-mon[35276]: pgmap v249: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:01:04.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:04 smithi002 ceph-mon[31210]: pgmap v249: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:01:05.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:04 smithi167 ceph-mon[35234]: pgmap v249: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:01:06.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:06 smithi071 ceph-mon[35276]: pgmap v250: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:01:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:06 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:06.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:06 smithi002 ceph-mon[31210]: pgmap v250: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:01:06.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:06 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:07.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:06 smithi167 ceph-mon[35234]: pgmap v250: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:01:07.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:06 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:07.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:07 smithi071 ceph-mon[35276]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:01:07.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:07 smithi002 ceph-mon[31210]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:01:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:07 smithi167 ceph-mon[35234]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:01:08.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:08 smithi071 ceph-mon[35276]: pgmap v252: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:01:08.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:08 smithi002 ceph-mon[31210]: pgmap v252: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:01:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:08 smithi167 ceph-mon[35234]: pgmap v252: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:01:10.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:10 smithi071 ceph-mon[35276]: pgmap v253: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:01:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:10 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:01:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:10 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:01:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:10 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:01:10.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:10 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:01:10.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:10 smithi002 ceph-mon[31210]: pgmap v253: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:01:10.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:10 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:01:10.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:10 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:01:10.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:10 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:01:10.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:10 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:01:11.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:10 smithi167 ceph-mon[35234]: pgmap v253: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:01:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:10 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:01:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:10 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:01:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:10 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:01:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:10 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:01:12.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:12 smithi071 ceph-mon[35276]: pgmap v254: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:12.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:12 smithi002 ceph-mon[31210]: pgmap v254: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:13.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:12 smithi167 ceph-mon[35234]: pgmap v254: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:14 smithi071 ceph-mon[35276]: pgmap v255: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:14 smithi071 ceph-mon[35276]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:01:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:14 smithi002 ceph-mon[31210]: pgmap v255: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:14.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:14 smithi002 ceph-mon[31210]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:01:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:14 smithi167 ceph-mon[35234]: pgmap v255: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:14 smithi167 ceph-mon[35234]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:01:16.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:16 smithi071 ceph-mon[35276]: pgmap v257: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 122 B/s wr, 3 op/s 2024-09-12T01:01:16.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:16 smithi002 ceph-mon[31210]: pgmap v257: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 122 B/s wr, 3 op/s 2024-09-12T01:01:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:16 smithi167 ceph-mon[35234]: pgmap v257: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 122 B/s wr, 3 op/s 2024-09-12T01:01:18.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:18 smithi071 ceph-mon[35276]: pgmap v258: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:18.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:18 smithi002 ceph-mon[31210]: pgmap v258: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:18 smithi167 ceph-mon[35234]: pgmap v258: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:20.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:20 smithi071 ceph-mon[35276]: pgmap v259: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:20.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:20 smithi002 ceph-mon[31210]: pgmap v259: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:21.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:20 smithi167 ceph-mon[35234]: pgmap v259: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:01:22.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:22 smithi071 ceph-mon[35276]: pgmap v260: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:01:22.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:22 smithi002 ceph-mon[31210]: pgmap v260: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:01:23.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:22 smithi167 ceph-mon[35234]: pgmap v260: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:01:24.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:01:24.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:24 smithi071 ceph-mon[35276]: pgmap v261: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:01:24.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:24 smithi002 ceph-mon[31210]: pgmap v261: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:01:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:01:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:24 smithi167 ceph-mon[35234]: pgmap v261: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 -- 172.21.15.2:0/476279701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1281037a0 msgr2=0x7ff12810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 --2- 172.21.15.2:0/476279701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1281037a0 0x7ff12810bc00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ff118009900 tx=0x7ff11802a410 comp rx=0 tx=0).stop 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 -- 172.21.15.2:0/476279701 shutdown_connections 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 --2- 172.21.15.2:0/476279701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff12810c2f0 0x7ff12810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 --2- 172.21.15.2:0/476279701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1281037a0 0x7ff12810bc00 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 --2- 172.21.15.2:0/476279701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff128102df0 0x7ff1281031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 -- 172.21.15.2:0/476279701 >> 172.21.15.2:0/476279701 conn(0x7ff1280fc7d0 msgr2=0x7ff1280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 -- 172.21.15.2:0/476279701 shutdown_connections 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.435+0000 7ff1306be640 1 -- 172.21.15.2:0/476279701 wait complete. 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff1306be640 1 Processor -- start 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff1306be640 1 -- start start 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff1306be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff128102df0 0x7ff128198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff1306be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1281037a0 0x7ff128198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff1306be640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12810c2f0 0x7ff12819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff1306be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff128112150 con 0x7ff128102df0 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff1306be640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff128111fd0 con 0x7ff12810c2f0 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff1306be640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281122d0 con 0x7ff1281037a0 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff12e45a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff128102df0 0x7ff128198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff12e45a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff128102df0 0x7ff128198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33190/0 (socket says 172.21.15.2:33190) 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.436+0000 7ff12e45a640 1 -- 172.21.15.2:0/3569639938 learned_addr learned my addr 172.21.15.2:0/3569639938 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12810c2f0 0x7ff12819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff12dc59640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1281037a0 0x7ff128198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff12e45a640 1 -- 172.21.15.2:0/3569639938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1281037a0 msgr2=0x7ff128198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff12e45a640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1281037a0 0x7ff128198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff12e45a640 1 -- 172.21.15.2:0/3569639938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12810c2f0 msgr2=0x7ff12819cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff12e45a640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12810c2f0 0x7ff12819cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff12e45a640 1 -- 172.21.15.2:0/3569639938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12819d640 con 0x7ff128102df0 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff12e45a640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff128102df0 0x7ff128198690 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ff12400b4a0 tx=0x7ff12400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff11f7fe640 1 -- 172.21.15.2:0/3569639938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124014070 con 0x7ff128102df0 2024-09-12T01:01:25.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff11f7fe640 1 -- 172.21.15.2:0/3569639938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124010af0 con 0x7ff128102df0 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff11f7fe640 1 -- 172.21.15.2:0/3569639938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124017d10 con 0x7ff128102df0 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff1306be640 1 -- 172.21.15.2:0/3569639938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12819d930 con 0x7ff128102df0 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.437+0000 7ff1306be640 1 -- 172.21.15.2:0/3569639938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1281a5210 con 0x7ff128102df0 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.440+0000 7ff11f7fe640 1 -- 172.21.15.2:0/3569639938 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7ff124017070 con 0x7ff128102df0 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.440+0000 7ff132a97740 1 Processor -- start 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.440+0000 7ff132a97740 1 -- start start 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff132a97740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245570c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff132a97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x562455717140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff132a97740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x562455719a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff132a97740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5624556722e0 con 0x56245570c4a0 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff132a97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562455619ce0 con 0x56245570cdc0 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff132a97740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56245566e2a0 con 0x562455717680 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245570c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245570c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33196/0 (socket says 172.21.15.2:33196) 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 -- 172.21.15.2:0/3724052207 learned_addr learned my addr 172.21.15.2:0/3724052207 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff11f7fe640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1140a2cf0 0x7ff1140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12dc59640 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x562455719a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 -- 172.21.15.2:0/3724052207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 msgr2=0x562455719a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x562455719a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12e45a640 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x562455717140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 -- 172.21.15.2:0/3724052207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 msgr2=0x562455717140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x562455717140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 -- 172.21.15.2:0/3724052207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624555fe440 con 0x56245570c4a0 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12e45a640 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x562455717140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff11f7fe640 1 -- 172.21.15.2:0/3569639938 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7ff1240ce740 con 0x7ff128102df0 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.441+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1140a2cf0 0x7ff1140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.442+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245570c880 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ff120010510 tx=0x7ff120009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8f685843d9e271 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.442+0000 7ff11cff9640 1 -- 172.21.15.2:0/3724052207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120023070 con 0x56245570c4a0 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.442+0000 7ff11cff9640 1 -- 172.21.15.2:0/3724052207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff12001dba0 con 0x56245570c4a0 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.442+0000 7ff11cff9640 1 -- 172.21.15.2:0/3724052207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12001ca90 con 0x56245570c4a0 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 -- 172.21.15.2:0/3724052207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 msgr2=0x56245570c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245570c880 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ff120010510 tx=0x7ff120009f90 comp rx=0 tx=0).stop 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1140a2cf0 0x7ff1140a51b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff120020000 tx=0x7ff12001b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 -- 172.21.15.2:0/3724052207 shutdown_connections 2024-09-12T01:01:25.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x562455719a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x562455717140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 --2- 172.21.15.2:0/3724052207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245570c880 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 -- 172.21.15.2:0/3724052207 >> 172.21.15.2:0/3724052207 conn(0x562455708a30 msgr2=0x562455708e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 -- 172.21.15.2:0/3724052207 shutdown_connections 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.443+0000 7ff132a97740 1 -- 172.21.15.2:0/3724052207 wait complete. 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 1 -- start start 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 1 Processor -- start 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56245570c4a0 0x562455716fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x562455714270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562455717680 0x5624557147b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56245571a250 con 0x56245570cdc0 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56245562d050 con 0x562455717680 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56245571a3d0 con 0x56245570c4a0 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff132a97740 10 client.0 _ll_register_callbacks cb 0x56245566d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff12dc59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x562455714270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff12dc59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x562455714270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33202/0 (socket says 172.21.15.2:33202) 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff12dc59640 1 -- 172.21.15.2:0/2814434511 learned_addr learned my addr 172.21.15.2:0/2814434511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff12e45a640 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56245570c4a0 0x562455716fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.444+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562455717680 0x5624557147b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff12dc59640 1 -- 172.21.15.2:0/2814434511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56245570c4a0 msgr2=0x562455716fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff12dc59640 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56245570c4a0 0x562455716fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff12dc59640 1 -- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562455717680 msgr2=0x5624557147b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff12dc59640 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562455717680 0x5624557147b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff12dc59640 1 -- 172.21.15.2:0/2814434511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624553e33c0 con 0x56245570cdc0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562455717680 0x5624557147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff12dc59640 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x562455714270 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff1280697d0 tx=0x7ff118031420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4f9b87e19a4d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff111ffb640 1 -- 172.21.15.2:0/2814434511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118040070 con 0x56245570cdc0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff111ffb640 1 -- 172.21.15.2:0/2814434511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7ff118004240 con 0x56245570cdc0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff132a97740 1 -- 172.21.15.2:0/2814434511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff12001dba0 con 0x56245570cdc0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff111ffb640 1 -- 172.21.15.2:0/2814434511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff118035040 con 0x56245570cdc0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff132a97740 10 client.17379 fetch_fsmap learned FSMap version 33 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff132a97740 1 -- 172.21.15.2:0/2814434511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562455725b70 con 0x56245570cdc0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.445+0000 7ff111ffb640 1 -- 172.21.15.2:0/2814434511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff12001dba0 con 0x56245570cdc0 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.446+0000 7ff111ffb640 1 -- 172.21.15.2:0/2814434511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7ff118004a50 con 0x56245570cdc0 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.446+0000 7ff132a97740 10 client.17379 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.446+0000 7ff132a97740 10 client.17379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.446+0000 7ff132a97740 20 client.17379 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.446+0000 7ff132a97740 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x562455727030 0x562455729470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.446+0000 7ff132a97740 4 client.17379 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.446+0000 7ff132a97740 1 -- 172.21.15.2:0/2814434511 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56245567f850 con 0x562455727030 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.446+0000 7ff12e45a640 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x562455727030 0x562455729470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.447+0000 7ff111ffb640 10 client.17379 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.447+0000 7ff12e45a640 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x562455727030 0x562455729470 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d91b3569af9c9f server_cookie=60adfdb6fb2165aa in_seq=0 out_seq=0 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.447+0000 7ff111ffb640 1 -- 172.21.15.2:0/2814434511 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56245567f850 con 0x562455727030 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.447+0000 7ff111ffb640 10 client.17379 handle_command_reply: tid=0 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.447+0000 7ff132a97740 1 client.17379 shutdown 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 -- 172.21.15.2:0/2814434511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 msgr2=0x562455714270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x562455714270 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff1280697d0 tx=0x7ff118031420 comp rx=0 tx=0).stop 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 -- 172.21.15.2:0/2814434511 shutdown_connections 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x562455727030 0x562455729470 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562455717680 0x5624557147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff111ffb640 0 client.17379 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x562455714270 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 --2- 172.21.15.2:0/2814434511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56245570c4a0 0x562455716fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 -- 172.21.15.2:0/2814434511 >> 172.21.15.2:0/2814434511 conn(0x562455708a30 msgr2=0x562455707b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 -- 172.21.15.2:0/2814434511 shutdown_connections 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 1 -- 172.21.15.2:0/2814434511 wait complete. 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.448+0000 7ff132a97740 20 client.17379 trim_cache size 0 max 16384 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.465+0000 7ff132a97740 1 Processor -- start 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.465+0000 7ff132a97740 1 -- start start 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.465+0000 7ff132a97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570c4a0 0x5624557234b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.465+0000 7ff132a97740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x56245572ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.465+0000 7ff132a97740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x56245572f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.465+0000 7ff132a97740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281b0500 con 0x56245570cdc0 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.465+0000 7ff132a97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281add70 con 0x56245570c4a0 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.465+0000 7ff132a97740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281abbe0 con 0x562455717680 2024-09-12T01:01:25.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x56245572ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x56245572ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33216/0 (socket says 172.21.15.2:33216) 2024-09-12T01:01:25.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 -- 172.21.15.2:0/1986256099 learned_addr learned my addr 172.21.15.2:0/1986256099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:25.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12e45a640 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570c4a0 0x5624557234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x56245572f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 -- 172.21.15.2:0/1986256099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 msgr2=0x56245572f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:25.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x56245572f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 -- 172.21.15.2:0/1986256099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570c4a0 msgr2=0x5624557234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:25.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570c4a0 0x5624557234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 -- 172.21.15.2:0/1986256099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56245570c2d0 con 0x56245570cdc0 2024-09-12T01:01:25.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12e45a640 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570c4a0 0x5624557234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:25.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff12dc59640 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x56245572ed40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff118004e50 tx=0x7ff11802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10d5dbc64d80553 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:25.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.466+0000 7ff113fff640 1 -- 172.21.15.2:0/1986256099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118040070 con 0x56245570cdc0 2024-09-12T01:01:25.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.467+0000 7ff113fff640 1 -- 172.21.15.2:0/1986256099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff118004c30 con 0x56245570cdc0 2024-09-12T01:01:25.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.467+0000 7ff113fff640 1 -- 172.21.15.2:0/1986256099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11803c6a0 con 0x56245570cdc0 2024-09-12T01:01:25.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 -- 172.21.15.2:0/1986256099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 msgr2=0x56245572ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x56245572ed40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff118004e50 tx=0x7ff11802a410 comp rx=0 tx=0).stop 2024-09-12T01:01:25.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 -- 172.21.15.2:0/1986256099 shutdown_connections 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x56245572f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570cdc0 0x56245572ed40 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 --2- 172.21.15.2:0/1986256099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570c4a0 0x5624557234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 -- 172.21.15.2:0/1986256099 >> 172.21.15.2:0/1986256099 conn(0x562455708a30 msgr2=0x56245570f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 -- 172.21.15.2:0/1986256099 shutdown_connections 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 -- 172.21.15.2:0/1986256099 wait complete. 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 -- start start 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 Processor -- start 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245571fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.468+0000 7ff132a97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x56245571b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff132a97740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x56245571b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff132a97740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281ac230 con 0x56245570c4a0 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff132a97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281ad6a0 con 0x56245570cdc0 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff132a97740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281ac900 con 0x562455717680 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff132a97740 10 client.0 _ll_register_callbacks cb 0x7ff118009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245571fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245571fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33232/0 (socket says 172.21.15.2:33232) 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 -- 172.21.15.2:0/671442938 learned_addr learned my addr 172.21.15.2:0/671442938 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12ec5b640 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x56245571b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12dc59640 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x56245571b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 -- 172.21.15.2:0/671442938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 msgr2=0x56245571b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x56245571b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 -- 172.21.15.2:0/671442938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 msgr2=0x56245571b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x56245571b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 -- 172.21.15.2:0/671442938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56245571bf00 con 0x56245570c4a0 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff12e45a640 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245571fe20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff124009420 tx=0x7ff12406cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae39d31ff3fd9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff111ffb640 1 -- 172.21.15.2:0/671442938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12401e040 con 0x56245570c4a0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff111ffb640 1 -- 172.21.15.2:0/671442938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7ff1240973b0 con 0x56245570c4a0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.469+0000 7ff132a97740 1 -- 172.21.15.2:0/671442938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff118004c30 con 0x56245570c4a0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff111ffb640 1 -- 172.21.15.2:0/671442938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff124099100 con 0x56245570c4a0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff132a97740 10 client.17385 fetch_fsmap learned FSMap version 33 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff132a97740 1 -- 172.21.15.2:0/671442938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562455791dc0 con 0x56245570c4a0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff111ffb640 1 -- 172.21.15.2:0/671442938 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff118004c30 con 0x56245570c4a0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff111ffb640 1 -- 172.21.15.2:0/671442938 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7ff1240ceb30 con 0x56245570c4a0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff132a97740 10 client.17385 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff132a97740 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff132a97740 20 client.17385 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff132a97740 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x562455792490 0x562455794880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff132a97740 4 client.17385 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff132a97740 1 -- 172.21.15.2:0/671442938 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562455679d60 con 0x562455792490 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.470+0000 7ff12dc59640 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x562455792490 0x562455794880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff12dc59640 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x562455792490 0x562455794880 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66bef252e93436a1 server_cookie=a2409765f4276775 in_seq=0 out_seq=0 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff111ffb640 10 client.17385 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff111ffb640 1 -- 172.21.15.2:0/671442938 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562455679d60 con 0x562455792490 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff111ffb640 10 client.17385 handle_command_reply: tid=0 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 client.17385 shutdown 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 -- 172.21.15.2:0/671442938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 msgr2=0x56245571fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245571fe20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff124009420 tx=0x7ff12406cd00 comp rx=0 tx=0).stop 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 -- 172.21.15.2:0/671442938 shutdown_connections 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x562455792490 0x562455794880 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562455717680 0x56245571b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56245570cdc0 0x56245571b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 --2- 172.21.15.2:0/671442938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245570c4a0 0x56245571fe20 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 -- 172.21.15.2:0/671442938 >> 172.21.15.2:0/671442938 conn(0x562455708a30 msgr2=0x562455715ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff111ffb640 0 client.17385 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 -- 172.21.15.2:0/671442938 shutdown_connections 2024-09-12T01:01:25.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 1 -- 172.21.15.2:0/671442938 wait complete. 2024-09-12T01:01:25.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.471+0000 7ff132a97740 20 client.17385 trim_cache size 0 max 16384 2024-09-12T01:01:25.491 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:01:25.491 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T01:01:25.491 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T01:01:25.491 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:01:25.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 -- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1140a2cf0 msgr2=0x7ff1140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1140a2cf0 0x7ff1140a51b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff120020000 tx=0x7ff12001b000 comp rx=0 tx=0).stop 2024-09-12T01:01:25.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 -- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff128102df0 msgr2=0x7ff128198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff128102df0 0x7ff128198690 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ff12400b4a0 tx=0x7ff12400b960 comp rx=0 tx=0).stop 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 -- 172.21.15.2:0/3569639938 shutdown_connections 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff1140a2cf0 0x7ff1140a51b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12810c2f0 0x7ff12819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1281037a0 0x7ff128198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 --2- 172.21.15.2:0/3569639938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff128102df0 0x7ff128198690 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 -- 172.21.15.2:0/3569639938 >> 172.21.15.2:0/3569639938 conn(0x7ff1280fc7d0 msgr2=0x7ff1280fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 -- 172.21.15.2:0/3569639938 shutdown_connections 2024-09-12T01:01:25.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:25.472+0000 7ff1306be640 1 -- 172.21.15.2:0/3569639938 wait complete. 2024-09-12T01:01:26.257 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:01:26.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:01:26.515 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:01:26.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:26 smithi002 ceph-mon[31210]: pgmap v262: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:01:26.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:26 smithi071 ceph-mon[35276]: pgmap v262: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:01:26.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 -- 172.21.15.2:0/2596743189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 msgr2=0x7f361c10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:26.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 --2- 172.21.15.2:0/2596743189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 0x7f361c10eaf0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3614009cd0 tx=0x7f361402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:01:26.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 -- 172.21.15.2:0/2596743189 shutdown_connections 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 --2- 172.21.15.2:0/2596743189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 0x7f361c10eaf0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 --2- 172.21.15.2:0/2596743189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c100ca0 0x7f361c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 --2- 172.21.15.2:0/2596743189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f361c1002f0 0x7f361c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 -- 172.21.15.2:0/2596743189 >> 172.21.15.2:0/2596743189 conn(0x7f361c077210 msgr2=0x7f361c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 -- 172.21.15.2:0/2596743189 shutdown_connections 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.965+0000 7f3624508640 1 -- 172.21.15.2:0/2596743189 wait complete. 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3624508640 1 Processor -- start 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3624508640 1 -- start start 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3624508640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f361c1002f0 0x7f361c101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3624508640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c100ca0 0x7f361c1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3624508640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 0x7f361c101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3624508640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f361c111fa0 con 0x7f361c106f50 2024-09-12T01:01:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3624508640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f361c111e20 con 0x7f361c100ca0 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3624508640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f361c112120 con 0x7f361c1002f0 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3622aa5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 0x7f361c101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3622aa5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 0x7f361c101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38322/0 (socket says 172.21.15.2:38322) 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.966+0000 7f3622aa5640 1 -- 172.21.15.2:0/3683550998 learned_addr learned my addr 172.21.15.2:0/3683550998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f3621aa3640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c100ca0 0x7f361c1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f36222a4640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f361c1002f0 0x7f361c101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f3622aa5640 1 -- 172.21.15.2:0/3683550998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f361c1002f0 msgr2=0x7f361c101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f3622aa5640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f361c1002f0 0x7f361c101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f3622aa5640 1 -- 172.21.15.2:0/3683550998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c100ca0 msgr2=0x7f361c1017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f3622aa5640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c100ca0 0x7f361c1017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f3622aa5640 1 -- 172.21.15.2:0/3683550998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361c1a6920 con 0x7f361c106f50 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f36222a4640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f361c1002f0 0x7f361c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.967+0000 7f3622aa5640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 0x7f361c101cf0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3614005cc0 tx=0x7f36140093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.968+0000 7f36137fe640 1 -- 172.21.15.2:0/3683550998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614003e00 con 0x7f361c106f50 2024-09-12T01:01:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.968+0000 7f36137fe640 1 -- 172.21.15.2:0/3683550998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3614004520 con 0x7f361c106f50 2024-09-12T01:01:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.968+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361c1a6bb0 con 0x7f361c106f50 2024-09-12T01:01:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.968+0000 7f36137fe640 1 -- 172.21.15.2:0/3683550998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614030db0 con 0x7f361c106f50 2024-09-12T01:01:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.968+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361c1a7140 con 0x7f361c106f50 2024-09-12T01:01:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.969+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f361c1006d0 con 0x7f361c106f50 2024-09-12T01:01:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.970+0000 7f36137fe640 1 -- 172.21.15.2:0/3683550998 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f36140046d0 con 0x7f361c106f50 2024-09-12T01:01:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.971+0000 7f36137fe640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36080a2d70 0x7f36080a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.971+0000 7f36137fe640 1 -- 172.21.15.2:0/3683550998 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7f361402e030 con 0x7f361c106f50 2024-09-12T01:01:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.971+0000 7f36222a4640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36080a2d70 0x7f36080a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.971+0000 7f36222a4640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36080a2d70 0x7f36080a5230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3618009b50 tx=0x7f3618005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:26.975+0000 7f36137fe640 1 -- 172.21.15.2:0/3683550998 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f361404b060 con 0x7f361c106f50 2024-09-12T01:01:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:26 smithi167 ceph-mon[35234]: pgmap v262: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:01:27.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.188+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f361c10a140 con 0x7f361c106f50 2024-09-12T01:01:27.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.189+0000 7f36137fe640 1 -- 172.21.15.2:0/3683550998 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11901 (secure 0 0 0) 0x7f36140bd320 con 0x7f361c106f50 2024-09-12T01:01:27.188 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:01:27.188 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"btime":"2024-09-12T01:01:05:651683+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T01:01:05.219177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T01:01:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 33 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.191+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36080a2d70 msgr2=0x7f36080a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.191+0000 7f3624508640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36080a2d70 0x7f36080a5230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3618009b50 tx=0x7f3618005f90 comp rx=0 tx=0).stop 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.191+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 msgr2=0x7f361c101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.191+0000 7f3624508640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 0x7f361c101cf0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3614005cc0 tx=0x7f36140093d0 comp rx=0 tx=0).stop 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.192+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 shutdown_connections 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.192+0000 7f3624508640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f36080a2d70 0x7f36080a5230 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.192+0000 7f3624508640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c106f50 0x7f361c101cf0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.192+0000 7f3624508640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c100ca0 0x7f361c1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.192+0000 7f3624508640 1 --2- 172.21.15.2:0/3683550998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f361c1002f0 0x7f361c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:27.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.192+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 >> 172.21.15.2:0/3683550998 conn(0x7f361c077210 msgr2=0x7f361c105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:27.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.192+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 shutdown_connections 2024-09-12T01:01:27.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:27.192+0000 7f3624508640 1 -- 172.21.15.2:0/3683550998 wait complete. 2024-09-12T01:01:27.778 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:27 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3683550998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:01:27.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:01:27.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:27 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3683550998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:01:28.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:27 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3683550998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:01:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 -- 172.21.15.2:0/2140337110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d701036c0 msgr2=0x7f7d7010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2140337110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d701036c0 0x7f7d7010bbb0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009ca0 tx=0x7f7d6402a950 comp rx=0 tx=0).stop 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 -- 172.21.15.2:0/2140337110 shutdown_connections 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2140337110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d7010c180 0x7f7d7010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2140337110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d701036c0 0x7f7d7010bbb0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2140337110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d70102da0 0x7f7d70103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 -- 172.21.15.2:0/2140337110 >> 172.21.15.2:0/2140337110 conn(0x7f7d700fc7a0 msgr2=0x7f7d700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 -- 172.21.15.2:0/2140337110 shutdown_connections 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.516+0000 7f7d74a58640 1 -- 172.21.15.2:0/2140337110 wait complete. 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d74a58640 1 Processor -- start 2024-09-12T01:01:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d74a58640 1 -- start start 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d74a58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d70102da0 0x7f7d701984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d74a58640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d701036c0 0x7f7d701989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d74a58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d7010c180 0x7f7d7019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d74a58640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d70111fb0 con 0x7f7d7010c180 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d74a58640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d70111e30 con 0x7f7d701036c0 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d74a58640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d70112130 con 0x7f7d70102da0 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d7010c180 0x7f7d7019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d7010c180 0x7f7d7019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38350/0 (socket says 172.21.15.2:38350) 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6ed9d640 1 -- 172.21.15.2:0/2734726893 learned_addr learned my addr 172.21.15.2:0/2734726893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d701036c0 0x7f7d701989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d70102da0 0x7f7d701984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6ed9d640 1 -- 172.21.15.2:0/2734726893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d70102da0 msgr2=0x7f7d701984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6ed9d640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d70102da0 0x7f7d701984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6ed9d640 1 -- 172.21.15.2:0/2734726893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d701036c0 msgr2=0x7f7d701989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6ed9d640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d701036c0 0x7f7d701989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6ed9d640 1 -- 172.21.15.2:0/2734726893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7019d460 con 0x7f7d7010c180 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.517+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d70102da0 0x7f7d701984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.518+0000 7f7d6ed9d640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d7010c180 0x7f7d7019cd80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800d750 tx=0x7f7d6800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.518+0000 7f7d5f7fe640 1 -- 172.21.15.2:0/2734726893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68017070 con 0x7f7d7010c180 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.518+0000 7f7d5f7fe640 1 -- 172.21.15.2:0/2734726893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d68005500 con 0x7f7d7010c180 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.518+0000 7f7d74a58640 1 -- 172.21.15.2:0/2734726893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7019d750 con 0x7f7d7010c180 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.518+0000 7f7d5f7fe640 1 -- 172.21.15.2:0/2734726893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68004d90 con 0x7f7d7010c180 2024-09-12T01:01:28.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.518+0000 7f7d74a58640 1 -- 172.21.15.2:0/2734726893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d701a5030 con 0x7f7d7010c180 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d5f7fe640 1 -- 172.21.15.2:0/2734726893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f7d68004f30 con 0x7f7d7010c180 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d76e31740 1 Processor -- start 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d76e31740 1 -- start start 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a127b40 0x55682a126090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a126a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a135780 0x55682a137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d76e31740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55682a08c2f0 con 0x55682a1265d0 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d76e31740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55682a033cf0 con 0x55682a127b40 2024-09-12T01:01:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d76e31740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55682a0882b0 con 0x55682a135780 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d6e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a126a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d6e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a126a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38364/0 (socket says 172.21.15.2:38364) 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d6e59c640 1 -- 172.21.15.2:0/4199076901 learned_addr learned my addr 172.21.15.2:0/4199076901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a127b40 0x55682a126090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.521+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a135780 0x55682a137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d5f7fe640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7d580a2d70 0x7f7d580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d6e59c640 1 -- 172.21.15.2:0/4199076901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a135780 msgr2=0x55682a137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a135780 0x55682a137b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d6e59c640 1 -- 172.21.15.2:0/4199076901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a127b40 msgr2=0x55682a126090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a127b40 0x55682a126090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d6e59c640 1 -- 172.21.15.2:0/4199076901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55682a0183a0 con 0x55682a1265d0 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d6ed9d640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7d580a2d70 0x7f7d580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a135780 0x55682a137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d5f7fe640 1 -- 172.21.15.2:0/2734726893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7f7d680cede0 con 0x7f7d7010c180 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a126a10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009c50 tx=0x7f7d6000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdf6762607ba837 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d5cff9640 1 -- 172.21.15.2:0/4199076901 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60016070 con 0x55682a1265d0 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d5cff9640 1 -- 172.21.15.2:0/4199076901 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d60005500 con 0x55682a1265d0 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.522+0000 7f7d5cff9640 1 -- 172.21.15.2:0/4199076901 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600116d0 con 0x55682a1265d0 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 -- 172.21.15.2:0/4199076901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 msgr2=0x55682a126a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d6ed9d640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7d580a2d70 0x7f7d580a5230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d68097c50 tx=0x7f7d680bb040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a126a10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009c50 tx=0x7f7d6000e6c0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 -- 172.21.15.2:0/4199076901 shutdown_connections 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a135780 0x55682a137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a126a10 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 --2- 172.21.15.2:0/4199076901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a127b40 0x55682a126090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 -- 172.21.15.2:0/4199076901 >> 172.21.15.2:0/4199076901 conn(0x55682a0ef310 msgr2=0x55682a122c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 -- 172.21.15.2:0/4199076901 shutdown_connections 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 -- 172.21.15.2:0/4199076901 wait complete. 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.523+0000 7f7d76e31740 1 -- start start 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d76e31740 1 Processor -- start 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a1350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a127b40 0x55682a1323a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a132900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d76e31740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55682a138480 con 0x55682a1265d0 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d76e31740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55682a047060 con 0x55682a135780 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d76e31740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55682a138600 con 0x55682a127b40 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d76e31740 10 client.0 _ll_register_callbacks cb 0x556829d9a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a1350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a1350f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38368/0 (socket says 172.21.15.2:38368) 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6dd9b640 1 -- 172.21.15.2:0/1362713189 learned_addr learned my addr 172.21.15.2:0/1362713189 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a127b40 0x55682a1323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6dd9b640 1 -- 172.21.15.2:0/1362713189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a127b40 msgr2=0x55682a1323a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a127b40 0x55682a1323a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6dd9b640 1 -- 172.21.15.2:0/1362713189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 msgr2=0x55682a132900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a132900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6dd9b640 1 -- 172.21.15.2:0/1362713189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556829dfd3c0 con 0x55682a1265d0 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.524+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a127b40 0x55682a1323a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a1350f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009ca0 tx=0x7f7d64003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab21ed0fd4497b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1362713189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6404c060 con 0x55682a1265d0 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1362713189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7f7d6402fc10 con 0x55682a1265d0 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d76e31740 1 -- 172.21.15.2:0/1362713189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d60005500 con 0x55682a1265d0 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1362713189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7d64034040 con 0x55682a1265d0 2024-09-12T01:01:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d76e31740 10 client.17403 fetch_fsmap learned FSMap version 33 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d76e31740 1 -- 172.21.15.2:0/1362713189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55682a143ee0 con 0x55682a1265d0 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1362713189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d60005500 con 0x55682a1265d0 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1362713189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7f7d64030600 con 0x55682a1265d0 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d76e31740 10 client.17403 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d76e31740 10 client.17403 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d76e31740 20 client.17403 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.525+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55682a1453a0 0x55682a147790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.526+0000 7f7d76e31740 4 client.17403 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.526+0000 7f7d76e31740 1 -- 172.21.15.2:0/1362713189 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55682a099860 con 0x55682a1453a0 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.526+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55682a1453a0 0x55682a147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.526+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55682a1453a0 0x55682a147790 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf26c7a81963c179 server_cookie=a0e1fbbfa5287612 in_seq=0 out_seq=0 2024-09-12T01:01:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.526+0000 7f7d55ffb640 10 client.17403 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:01:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1362713189 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55682a099860 con 0x55682a1453a0 2024-09-12T01:01:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d55ffb640 10 client.17403 handle_command_reply: tid=0 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 client.17403 shutdown 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 -- 172.21.15.2:0/1362713189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 msgr2=0x55682a1350f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a1350f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009ca0 tx=0x7f7d64003c10 comp rx=0 tx=0).stop 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 -- 172.21.15.2:0/1362713189 shutdown_connections 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55682a1453a0 0x55682a147790 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a132900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a127b40 0x55682a1323a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1362713189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a1265d0 0x55682a1350f0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 -- 172.21.15.2:0/1362713189 >> 172.21.15.2:0/1362713189 conn(0x55682a0ef310 msgr2=0x55682a128960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d55ffb640 0 client.17403 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 -- 172.21.15.2:0/1362713189 shutdown_connections 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 1 -- 172.21.15.2:0/1362713189 wait complete. 2024-09-12T01:01:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.527+0000 7f7d76e31740 20 client.17403 trim_cache size 0 max 16384 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.540+0000 7f7d76e31740 1 Processor -- start 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.540+0000 7f7d76e31740 1 -- start start 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.540+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 0x55682a141720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.540+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a122700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.540+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a136b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.540+0000 7f7d76e31740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d701ae140 con 0x55682a127b40 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.540+0000 7f7d76e31740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d701ab9b0 con 0x55682a135780 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.540+0000 7f7d76e31740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d701a9820 con 0x55682a1265d0 2024-09-12T01:01:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38374/0 (socket says 172.21.15.2:38374) 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 -- 172.21.15.2:0/2028360491 learned_addr learned my addr 172.21.15.2:0/2028360491 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 0x55682a141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 -- 172.21.15.2:0/2028360491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 msgr2=0x55682a141720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 0x55682a141720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a136b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 -- 172.21.15.2:0/2028360491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 msgr2=0x55682a136b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a136b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 -- 172.21.15.2:0/2028360491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55682a123730 con 0x55682a127b40 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a122700 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009c50 tx=0x7f7d60004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1791c61c68843391 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d57fff640 1 -- 172.21.15.2:0/2028360491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6002f070 con 0x55682a127b40 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d57fff640 1 -- 172.21.15.2:0/2028360491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d60004880 con 0x55682a127b40 2024-09-12T01:01:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.541+0000 7f7d57fff640 1 -- 172.21.15.2:0/2028360491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60016040 con 0x55682a127b40 2024-09-12T01:01:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 -- 172.21.15.2:0/2028360491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 msgr2=0x55682a122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a122700 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009c50 tx=0x7f7d60004d80 comp rx=0 tx=0).stop 2024-09-12T01:01:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 -- 172.21.15.2:0/2028360491 shutdown_connections 2024-09-12T01:01:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a136b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a122700 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 --2- 172.21.15.2:0/2028360491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 0x55682a141720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 -- 172.21.15.2:0/2028360491 >> 172.21.15.2:0/2028360491 conn(0x55682a0ef310 msgr2=0x55682a12d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 -- 172.21.15.2:0/2028360491 shutdown_connections 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 -- 172.21.15.2:0/2028360491 wait complete. 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 -- start start 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.542+0000 7f7d76e31740 1 Processor -- start 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 0x55682a13dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a12f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d76e31740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a12fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d76e31740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d701a9e70 con 0x55682a127b40 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d76e31740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d701ab2e0 con 0x55682a135780 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d76e31740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d701aa540 con 0x55682a1265d0 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d76e31740 10 client.0 _ll_register_callbacks cb 0x7f7d640098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a12f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a12f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38390/0 (socket says 172.21.15.2:38390) 2024-09-12T01:01:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 -- 172.21.15.2:0/1136626375 learned_addr learned my addr 172.21.15.2:0/1136626375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 0x55682a13dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a12fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 -- 172.21.15.2:0/1136626375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 msgr2=0x55682a13dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 0x55682a13dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 -- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 msgr2=0x55682a12fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a12fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 -- 172.21.15.2:0/1136626375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55682a1300a0 con 0x55682a127b40 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a12fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d6e59c640 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a12f620 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7d6002d040 tx=0x7f7d600058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626e9f198f65b715 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1136626375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60038060 con 0x55682a127b40 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1136626375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7f7d60004a30 con 0x55682a127b40 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.543+0000 7f7d76e31740 1 -- 172.21.15.2:0/1136626375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d60004880 con 0x55682a127b40 2024-09-12T01:01:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1136626375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7d60016050 con 0x55682a127b40 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d76e31740 10 client.17409 fetch_fsmap learned FSMap version 33 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d76e31740 1 -- 172.21.15.2:0/1136626375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55682a14d400 con 0x55682a127b40 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1136626375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d60004880 con 0x55682a127b40 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1136626375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7f7d6000f040 con 0x55682a127b40 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d76e31740 10 client.17409 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d76e31740 10 client.17409 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d76e31740 20 client.17409 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55682a1b0290 0x55682a1b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d76e31740 4 client.17409 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d76e31740 1 -- 172.21.15.2:0/1136626375 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55682a093d70 con 0x55682a1b0290 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.544+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55682a1b0290 0x55682a1b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d55ffb640 10 client.17409 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:01:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d6dd9b640 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55682a1b0290 0x55682a1b26b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d622b815aa59061 server_cookie=f7069bd9c9ad6a8a in_seq=0 out_seq=0 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d55ffb640 1 -- 172.21.15.2:0/1136626375 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55682a093d70 con 0x55682a1b0290 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d55ffb640 10 client.17409 handle_command_reply: tid=0 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 client.17409 shutdown 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 -- 172.21.15.2:0/1136626375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 msgr2=0x55682a12f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a12f620 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7d6002d040 tx=0x7f7d600058d0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 -- 172.21.15.2:0/1136626375 shutdown_connections 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x55682a1b0290 0x55682a1b26b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55682a135780 0x55682a12fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55682a127b40 0x55682a12f620 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 --2- 172.21.15.2:0/1136626375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55682a1265d0 0x55682a13dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 -- 172.21.15.2:0/1136626375 >> 172.21.15.2:0/1136626375 conn(0x55682a0ef310 msgr2=0x55682a128110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d55ffb640 0 client.17409 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:01:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 -- 172.21.15.2:0/1136626375 shutdown_connections 2024-09-12T01:01:28.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 1 -- 172.21.15.2:0/1136626375 wait complete. 2024-09-12T01:01:28.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.545+0000 7f7d76e31740 20 client.17409 trim_cache size 0 max 16384 2024-09-12T01:01:28.550 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:01:28.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 -- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7d580a2d70 msgr2=0x7f7d580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7d580a2d70 0x7f7d580a5230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d68097c50 tx=0x7f7d680bb040 comp rx=0 tx=0).stop 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 -- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d7010c180 msgr2=0x7f7d7019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d7010c180 0x7f7d7019cd80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800d750 tx=0x7f7d6800dc10 comp rx=0 tx=0).stop 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 -- 172.21.15.2:0/2734726893 shutdown_connections 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f7d580a2d70 0x7f7d580a5230 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d7010c180 0x7f7d7019cd80 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d701036c0 0x7f7d701989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 --2- 172.21.15.2:0/2734726893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d70102da0 0x7f7d701984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 -- 172.21.15.2:0/2734726893 >> 172.21.15.2:0/2734726893 conn(0x7f7d700fc7a0 msgr2=0x7f7d700fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 -- 172.21.15.2:0/2734726893 shutdown_connections 2024-09-12T01:01:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:28.546+0000 7f7d74a58640 1 -- 172.21.15.2:0/2734726893 wait complete. 2024-09-12T01:01:28.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:28 smithi002 ceph-mon[31210]: pgmap v263: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:01:28.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:28 smithi071 ceph-mon[35276]: pgmap v263: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:01:29.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:28 smithi167 ceph-mon[35234]: pgmap v263: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:01:29.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:01:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:01:29.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:29 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:29.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:29 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:29.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 -- 172.21.15.2:0/352262656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc106a80 msgr2=0x7feccc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:29.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 --2- 172.21.15.2:0/352262656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc106a80 0x7feccc106e60 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009930 tx=0x7fecc802a420 comp rx=0 tx=0).stop 2024-09-12T01:01:29.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 -- 172.21.15.2:0/352262656 shutdown_connections 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 --2- 172.21.15.2:0/352262656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feccc101420 0x7feccc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 --2- 172.21.15.2:0/352262656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feccc100a80 0x7feccc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 --2- 172.21.15.2:0/352262656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc106a80 0x7feccc106e60 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 -- 172.21.15.2:0/352262656 >> 172.21.15.2:0/352262656 conn(0x7feccc0fc7a0 msgr2=0x7feccc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 -- 172.21.15.2:0/352262656 shutdown_connections 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 -- 172.21.15.2:0/352262656 wait complete. 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.950+0000 7fecd36ea640 1 Processor -- start 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd36ea640 1 -- start start 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd36ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc100a80 0x7feccc199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd36ea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feccc101420 0x7feccc199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd36ea640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feccc106a80 0x7feccc1a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd36ea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feccc110e40 con 0x7feccc100a80 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd36ea640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feccc110cc0 con 0x7feccc106a80 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd36ea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feccc110fc0 con 0x7feccc101420 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1486640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc100a80 0x7feccc199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1486640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc100a80 0x7feccc199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38406/0 (socket says 172.21.15.2:38406) 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1486640 1 -- 172.21.15.2:0/799936824 learned_addr learned my addr 172.21.15.2:0/799936824 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1c87640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feccc106a80 0x7feccc1a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd0c85640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feccc101420 0x7feccc199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1486640 1 -- 172.21.15.2:0/799936824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feccc101420 msgr2=0x7feccc199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1486640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feccc101420 0x7feccc199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1486640 1 -- 172.21.15.2:0/799936824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feccc106a80 msgr2=0x7feccc1a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1486640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feccc106a80 0x7feccc1a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.951+0000 7fecd1486640 1 -- 172.21.15.2:0/799936824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc1a4810 con 0x7feccc100a80 2024-09-12T01:01:29.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.952+0000 7fecd1486640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc100a80 0x7feccc199250 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009230 tx=0x7fecc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.952+0000 7fecc27fc640 1 -- 172.21.15.2:0/799936824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc803f030 con 0x7feccc100a80 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.952+0000 7fecc27fc640 1 -- 172.21.15.2:0/799936824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc8003ad0 con 0x7feccc100a80 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.952+0000 7fecd36ea640 1 -- 172.21.15.2:0/799936824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc1a49e0 con 0x7feccc100a80 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.952+0000 7fecc27fc640 1 -- 172.21.15.2:0/799936824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8035070 con 0x7feccc100a80 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.952+0000 7fecd36ea640 1 -- 172.21.15.2:0/799936824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc1a4e90 con 0x7feccc100a80 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.954+0000 7fecc27fc640 1 -- 172.21.15.2:0/799936824 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fecc8042030 con 0x7feccc100a80 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.954+0000 7fecd5ac3740 1 Processor -- start 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd5ac3740 1 -- start start 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df69090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df69a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df76760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55942decf2f0 con 0x55942df695d0 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55942de76cf0 con 0x55942df74370 2024-09-12T01:01:29.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55942decb2b0 con 0x55942df6ab40 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecc27fc640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fecb80a2d70 0x7fecb80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1486640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df69a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1486640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df69a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38412/0 (socket says 172.21.15.2:38412) 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1486640 1 -- 172.21.15.2:0/2596783532 learned_addr learned my addr 172.21.15.2:0/2596783532 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1c87640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fecb80a2d70 0x7fecb80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd0c85640 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df76760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1c87640 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df69090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecc27fc640 1 -- 172.21.15.2:0/799936824 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fecc80ef6f0 con 0x7feccc100a80 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1486640 1 -- 172.21.15.2:0/2596783532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 msgr2=0x55942df69090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1486640 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df69090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1486640 1 -- 172.21.15.2:0/2596783532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 msgr2=0x55942df76760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:29.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1486640 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df76760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.955+0000 7fecd1486640 1 -- 172.21.15.2:0/2596783532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55942de5b3a0 con 0x55942df695d0 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.956+0000 7fecd1c87640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fecb80a2d70 0x7fecb80a5230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fecc4005c40 tx=0x7fecc40094f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.956+0000 7fecd1486640 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df69a10 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fecc80b7f40 tx=0x7fecc802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3da7abd4a24d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.956+0000 7fecb77fe640 1 -- 172.21.15.2:0/2596783532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8049040 con 0x55942df695d0 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.956+0000 7fecb77fe640 1 -- 172.21.15.2:0/2596783532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc80bfee0 con 0x55942df695d0 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.956+0000 7fecb77fe640 1 -- 172.21.15.2:0/2596783532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8031bd0 con 0x55942df695d0 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- 172.21.15.2:0/2596783532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 msgr2=0x55942df69a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df69a10 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fecc80b7f40 tx=0x7fecc802a420 comp rx=0 tx=0).stop 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- 172.21.15.2:0/2596783532 shutdown_connections 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df76760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df69a10 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/2596783532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df69090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- 172.21.15.2:0/2596783532 >> 172.21.15.2:0/2596783532 conn(0x55942df32310 msgr2=0x55942df65c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- 172.21.15.2:0/2596783532 shutdown_connections 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- 172.21.15.2:0/2596783532 wait complete. 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- start start 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 Processor -- start 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df73cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df70f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55942df76e30 con 0x55942df695d0 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55942de8a060 con 0x55942df74370 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.957+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55942df76fb0 con 0x55942df6ab40 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd5ac3740 10 client.0 _ll_register_callbacks cb 0x55942dbdd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df73cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df73cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38428/0 (socket says 172.21.15.2:38428) 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 -- 172.21.15.2:0/1694669254 learned_addr learned my addr 172.21.15.2:0/1694669254 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd0c85640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df70f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1c87640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 -- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 msgr2=0x55942df70f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df70f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 -- 172.21.15.2:0/1694669254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 msgr2=0x55942df714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 -- 172.21.15.2:0/1694669254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55942dc403c0 con 0x55942df695d0 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1c87640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd0c85640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df70f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd1486640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df73cb0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fecc8032c00 tx=0x7fecc80bbcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40f69b8af9162d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:29.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1694669254 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc80bce60 con 0x55942df695d0 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1694669254 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fecc80ecfe0 con 0x55942df695d0 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1694669254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc80bfee0 con 0x55942df695d0 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1694669254 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fecc8049050 con 0x55942df695d0 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd5ac3740 10 client.17421 fetch_fsmap learned FSMap version 34 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.958+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1694669254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55942df76e30 con 0x55942df695d0 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1694669254 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc80bfee0 con 0x55942df695d0 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1694669254 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fecc80da2a0 con 0x55942df695d0 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecd5ac3740 10 client.17421 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecd5ac3740 10 client.17421 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecd5ac3740 20 client.17421 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55942df83960 0x55942df85d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecd5ac3740 4 client.17421 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1694669254 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55942dedc860 con 0x55942df83960 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.959+0000 7fecd0c85640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55942df83960 0x55942df85d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.960+0000 7fecb4ff9640 10 client.17421 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.960+0000 7fecd0c85640 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55942df83960 0x55942df85d50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=450d85546123d3b5 server_cookie=643ac9cf8e453389 in_seq=0 out_seq=0 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.960+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1694669254 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55942dedc860 con 0x55942df83960 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.960+0000 7fecb4ff9640 10 client.17421 handle_command_reply: tid=0 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.960+0000 7fecd5ac3740 1 client.17421 shutdown 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1694669254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 msgr2=0x55942df73cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df73cb0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fecc8032c00 tx=0x7fecc80bbcb0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1694669254 shutdown_connections 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55942df83960 0x55942df85d50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df70f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecb4ff9640 0 client.17421 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1694669254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df695d0 0x55942df73cb0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1694669254 >> 172.21.15.2:0/1694669254 conn(0x55942df32310 msgr2=0x55942df6b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:29.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1694669254 shutdown_connections 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1694669254 wait complete. 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.961+0000 7fecd5ac3740 20 client.17421 trim_cache size 0 max 16384 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.974+0000 7fecd5ac3740 1 Processor -- start 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.974+0000 7fecd5ac3740 1 -- start start 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.974+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df695d0 0x55942df64a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.974+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df6ab40 0x55942df64f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.974+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df6c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.974+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1b0280 con 0x55942df6ab40 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.974+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1adb20 con 0x55942df74370 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.974+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1ab990 con 0x55942df695d0 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df6ab40 0x55942df64f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df6ab40 0x55942df64f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38438/0 (socket says 172.21.15.2:38438) 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 -- 172.21.15.2:0/368241828 learned_addr learned my addr 172.21.15.2:0/368241828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd1486640 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df695d0 0x55942df64a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 -- 172.21.15.2:0/368241828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df695d0 msgr2=0x55942df64a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df695d0 0x55942df64a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 -- 172.21.15.2:0/368241828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 msgr2=0x55942df6c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df6c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 -- 172.21.15.2:0/368241828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55942df737d0 con 0x55942df6ab40 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd1486640 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df695d0 0x55942df64a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecd0c85640 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df6ab40 0x55942df64f60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fecbc004700 tx=0x7fecbc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e8f67a0b7a1294 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecb6ffd640 1 -- 172.21.15.2:0/368241828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc003d60 con 0x55942df6ab40 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecb6ffd640 1 -- 172.21.15.2:0/368241828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecbc003f00 con 0x55942df6ab40 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.975+0000 7fecb6ffd640 1 -- 172.21.15.2:0/368241828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc01c470 con 0x55942df6ab40 2024-09-12T01:01:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 -- 172.21.15.2:0/368241828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df6ab40 msgr2=0x55942df64f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df6ab40 0x55942df64f60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fecbc004700 tx=0x7fecbc00ce30 comp rx=0 tx=0).stop 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 -- 172.21.15.2:0/368241828 shutdown_connections 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df74370 0x55942df6c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df6ab40 0x55942df64f60 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/368241828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df695d0 0x55942df64a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 -- 172.21.15.2:0/368241828 >> 172.21.15.2:0/368241828 conn(0x55942df32310 msgr2=0x55942df64310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 -- 172.21.15.2:0/368241828 shutdown_connections 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 -- 172.21.15.2:0/368241828 wait complete. 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 -- start start 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.976+0000 7fecd5ac3740 1 Processor -- start 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df695d0 0x55942df7c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df77a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd5ac3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df74370 0x55942df77fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1abfe0 con 0x55942df74370 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1ad450 con 0x55942df695d0 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd5ac3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1ac6b0 con 0x55942df6ab40 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd5ac3740 10 client.0 _ll_register_callbacks cb 0x7fecbc00c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df74370 0x55942df77fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df74370 0x55942df77fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38452/0 (socket says 172.21.15.2:38452) 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 -- 172.21.15.2:0/1101988750 learned_addr learned my addr 172.21.15.2:0/1101988750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd0c85640 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df77a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1486640 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df695d0 0x55942df7c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 -- 172.21.15.2:0/1101988750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 msgr2=0x55942df77a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df77a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 -- 172.21.15.2:0/1101988750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df695d0 msgr2=0x55942df7c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df695d0 0x55942df7c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 -- 172.21.15.2:0/1101988750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55942df785b0 con 0x55942df74370 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1486640 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df695d0 0x55942df7c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecd1c87640 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df74370 0x55942df77fc0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fecc4012520 tx=0x7fecc4009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e78a2fb2a80b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.977+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1101988750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4025070 con 0x55942df74370 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1101988750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fecc4004b20 con 0x55942df74370 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1101988750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecbc003f00 con 0x55942df74370 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1101988750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fecc4004d20 con 0x55942df74370 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 10 client.17427 fetch_fsmap learned FSMap version 34 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1101988750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55942dfee280 con 0x55942df74370 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1101988750 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecbc003f00 con 0x55942df74370 2024-09-12T01:01:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1101988750 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fecc4029cc0 con 0x55942df74370 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 10 client.17427 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 10 client.17427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 20 client.17427 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55942df83960 0x55942dff09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 4 client.17427 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1101988750 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55942ded6d70 con 0x55942df83960 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.978+0000 7fecd1486640 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55942df83960 0x55942dff09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd1486640 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55942df83960 0x55942dff09e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78aa36d0fb428f6e server_cookie=464815c333fa620e in_seq=0 out_seq=0 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecb4ff9640 10 client.17427 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecb4ff9640 1 -- 172.21.15.2:0/1101988750 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55942ded6d70 con 0x55942df83960 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecb4ff9640 10 client.17427 handle_command_reply: tid=0 2024-09-12T01:01:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 client.17427 shutdown 2024-09-12T01:01:29.998 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:01:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1101988750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df74370 msgr2=0x55942df77fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df74370 0x55942df77fc0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fecc4012520 tx=0x7fecc4009c90 comp rx=0 tx=0).stop 2024-09-12T01:01:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1101988750 shutdown_connections 2024-09-12T01:01:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55942df83960 0x55942dff09e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55942df74370 0x55942df77fc0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55942df6ab40 0x55942df77a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecb4ff9640 0 client.17427 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:01:29.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 --2- 172.21.15.2:0/1101988750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55942df695d0 0x55942df7c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:29.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1101988750 >> 172.21.15.2:0/1101988750 conn(0x55942df32310 msgr2=0x55942df72fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:29.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1101988750 shutdown_connections 2024-09-12T01:01:29.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 1 -- 172.21.15.2:0/1101988750 wait complete. 2024-09-12T01:01:29.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.979+0000 7fecd5ac3740 20 client.17427 trim_cache size 0 max 16384 2024-09-12T01:01:29.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 -- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fecb80a2d70 msgr2=0x7fecb80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fecb80a2d70 0x7fecb80a5230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fecc4005c40 tx=0x7fecc40094f0 comp rx=0 tx=0).stop 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 -- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc100a80 msgr2=0x7feccc199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc100a80 0x7feccc199250 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009230 tx=0x7fecc8004270 comp rx=0 tx=0).stop 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 -- 172.21.15.2:0/799936824 shutdown_connections 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fecb80a2d70 0x7fecb80a5230 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feccc106a80 0x7feccc1a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feccc101420 0x7feccc199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 --2- 172.21.15.2:0/799936824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc100a80 0x7feccc199250 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 -- 172.21.15.2:0/799936824 >> 172.21.15.2:0/799936824 conn(0x7feccc0fc7a0 msgr2=0x7feccc0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:30.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 -- 172.21.15.2:0/799936824 shutdown_connections 2024-09-12T01:01:30.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:29.980+0000 7fecd36ea640 1 -- 172.21.15.2:0/799936824 wait complete. 2024-09-12T01:01:30.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:29 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:30.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:01:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:01:30.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:30 smithi071 ceph-mon[35276]: pgmap v264: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:30.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:30 smithi002 ceph-mon[31210]: pgmap v264: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:30 smithi167 ceph-mon[35234]: pgmap v264: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 -- 172.21.15.2:0/4048280646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 msgr2=0x7f93cc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 --2- 172.21.15.2:0/4048280646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 0x7f93cc10bb50 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009900 tx=0x7f93bc02a480 comp rx=0 tx=0).stop 2024-09-12T01:01:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 -- 172.21.15.2:0/4048280646 shutdown_connections 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 --2- 172.21.15.2:0/4048280646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc10c170 0x7f93cc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 --2- 172.21.15.2:0/4048280646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 0x7f93cc10bb50 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 --2- 172.21.15.2:0/4048280646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93cc102d40 0x7f93cc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 -- 172.21.15.2:0/4048280646 >> 172.21.15.2:0/4048280646 conn(0x7f93cc0fc7a0 msgr2=0x7f93cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 -- 172.21.15.2:0/4048280646 shutdown_connections 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 -- 172.21.15.2:0/4048280646 wait complete. 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 Processor -- start 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.382+0000 7f93d35a8640 1 -- start start 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d35a8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc102d40 0x7f93cc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d35a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 0x7f93cc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d35a8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93cc10c170 0x7f93cc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d35a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc111f70 con 0x7f93cc103660 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d35a8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc111df0 con 0x7f93cc102d40 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d35a8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1120f0 con 0x7f93cc10c170 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 0x7f93cc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 0x7f93cc1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38476/0 (socket says 172.21.15.2:38476) 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 -- 172.21.15.2:0/3842886309 learned_addr learned my addr 172.21.15.2:0/3842886309 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d1b45640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93cc10c170 0x7f93cc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d1344640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc102d40 0x7f93cc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 -- 172.21.15.2:0/3842886309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93cc10c170 msgr2=0x7f93cc19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93cc10c170 0x7f93cc19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 -- 172.21.15.2:0/3842886309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc102d40 msgr2=0x7f93cc198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc102d40 0x7f93cc198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 -- 172.21.15.2:0/3842886309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc19d420 con 0x7f93cc103660 2024-09-12T01:01:31.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d1344640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc102d40 0x7f93cc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93d0b43640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 0x7f93cc1989b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f93bc006010 tx=0x7f93bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93c27fc640 1 -- 172.21.15.2:0/3842886309 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc03f030 con 0x7f93cc103660 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93c27fc640 1 -- 172.21.15.2:0/3842886309 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93bc003ce0 con 0x7f93cc103660 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.383+0000 7f93c27fc640 1 -- 172.21.15.2:0/3842886309 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc035070 con 0x7f93cc103660 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.384+0000 7f93d35a8640 1 -- 172.21.15.2:0/3842886309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc19d6b0 con 0x7f93cc103660 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.384+0000 7f93d35a8640 1 -- 172.21.15.2:0/3842886309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc19db40 con 0x7f93cc103660 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.386+0000 7f93c27fc640 1 -- 172.21.15.2:0/3842886309 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f93bc042030 con 0x7f93cc103660 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.386+0000 7f93d5981740 1 Processor -- start 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.386+0000 7f93d5981740 1 -- start start 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.386+0000 7f93d5981740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9cb40 0x55b008f9b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.386+0000 7f93d5981740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 0x55b008f9ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.386+0000 7f93c27fc640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f93b80a2d70 0x7f93b80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d5981740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008faa780 0x55b008facb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d5981740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b008f012f0 con 0x55b008faa780 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d5981740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b008ea8cf0 con 0x55b008f9b5d0 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d5981740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b008efd2b0 con 0x55b008f9cb40 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d0b43640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f93b80a2d70 0x7f93b80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008faa780 0x55b008facb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008faa780 0x55b008facb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38492/0 (socket says 172.21.15.2:38492) 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 -- 172.21.15.2:0/456529421 learned_addr learned my addr 172.21.15.2:0/456529421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9cb40 0x55b008f9b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93c27fc640 1 -- 172.21.15.2:0/3842886309 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7f93bc0efac0 con 0x7f93cc103660 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1344640 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 0x55b008f9ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 -- 172.21.15.2:0/456529421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9cb40 msgr2=0x55b008f9b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9cb40 0x55b008f9b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 -- 172.21.15.2:0/456529421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 msgr2=0x55b008f9ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 0x55b008f9ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 -- 172.21.15.2:0/456529421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b008e8d3a0 con 0x55b008faa780 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d0b43640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f93b80a2d70 0x7f93b80a5230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b8480 tx=0x7f93bc009560 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93d1b45640 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008faa780 0x55b008facb70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f93c4013a80 tx=0x7f93c400a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdebc41eab85b007 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93b77fe640 1 -- 172.21.15.2:0/456529421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4004b20 con 0x55b008faa780 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93b77fe640 1 -- 172.21.15.2:0/456529421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c400ee40 con 0x55b008faa780 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.387+0000 7f93b77fe640 1 -- 172.21.15.2:0/456529421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c40055e0 con 0x55b008faa780 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.388+0000 7f93d5981740 1 -- 172.21.15.2:0/456529421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008faa780 msgr2=0x55b008facb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.388+0000 7f93d5981740 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008faa780 0x55b008facb70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f93c4013a80 tx=0x7f93c400a590 comp rx=0 tx=0).stop 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.388+0000 7f93d5981740 1 -- 172.21.15.2:0/456529421 shutdown_connections 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.388+0000 7f93d5981740 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008faa780 0x55b008facb70 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.388+0000 7f93d5981740 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 0x55b008f9ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.388+0000 7f93d5981740 1 --2- 172.21.15.2:0/456529421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9cb40 0x55b008f9b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.389+0000 7f93d5981740 1 -- 172.21.15.2:0/456529421 >> 172.21.15.2:0/456529421 conn(0x55b008f64310 msgr2=0x55b008f97c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.389+0000 7f93d5981740 1 -- 172.21.15.2:0/456529421 shutdown_connections 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.389+0000 7f93d5981740 1 -- 172.21.15.2:0/456529421 wait complete. 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.389+0000 7f93d5981740 1 -- start start 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.389+0000 7f93d5981740 1 Processor -- start 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d5981740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9b5d0 0x55b008faa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d5981740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d5981740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008faa780 0x55b008fa7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d5981740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b008fad480 con 0x55b008f9cb40 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d5981740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b008ebc060 con 0x55b008faa780 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d5981740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b008fad600 con 0x55b008f9b5d0 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d5981740 10 client.0 _ll_register_callbacks cb 0x55b008c0f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38498/0 (socket says 172.21.15.2:38498) 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 -- 172.21.15.2:0/1772201101 learned_addr learned my addr 172.21.15.2:0/1772201101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1b45640 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008faa780 0x55b008fa7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1b45640 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9b5d0 0x55b008faa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 -- 172.21.15.2:0/1772201101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9b5d0 msgr2=0x55b008faa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9b5d0 0x55b008faa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 -- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008faa780 msgr2=0x55b008fa7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008faa780 0x55b008fa7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 -- 172.21.15.2:0/1772201101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b008c723c0 con 0x55b008f9cb40 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1b45640 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008faa780 0x55b008fa7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d1344640 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa7430 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f93c8010670 tx=0x7f93c8010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a0346ba522d47e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93b4ff9640 1 -- 172.21.15.2:0/1772201101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c800ead0 con 0x55b008f9cb40 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93d5981740 1 -- 172.21.15.2:0/1772201101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c400ee40 con 0x55b008f9cb40 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.390+0000 7f93b4ff9640 1 -- 172.21.15.2:0/1772201101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7f93c800ec70 con 0x55b008f9cb40 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93b4ff9640 1 -- 172.21.15.2:0/1772201101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f93c8010e70 con 0x55b008f9cb40 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d5981740 10 client.17439 fetch_fsmap learned FSMap version 34 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d5981740 1 -- 172.21.15.2:0/1772201101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b008fb8f80 con 0x55b008f9cb40 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93b4ff9640 1 -- 172.21.15.2:0/1772201101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c400ee40 con 0x55b008f9cb40 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93b4ff9640 1 -- 172.21.15.2:0/1772201101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f93c800f040 con 0x55b008f9cb40 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d5981740 10 client.17439 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d5981740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d5981740 20 client.17439 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d5981740 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b008fba490 0x55b008fbc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d5981740 4 client.17439 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d5981740 1 -- 172.21.15.2:0/1772201101 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b008f0e860 con 0x55b008fba490 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.391+0000 7f93d1b45640 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b008fba490 0x55b008fbc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.392+0000 7f93b4ff9640 10 client.17439 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.392+0000 7f93d1b45640 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b008fba490 0x55b008fbc8b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5599ec55026f2df9 server_cookie=b57eff6a736c1ba5 in_seq=0 out_seq=0 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.392+0000 7f93b4ff9640 1 -- 172.21.15.2:0/1772201101 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b008f0e860 con 0x55b008fba490 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.392+0000 7f93b4ff9640 10 client.17439 handle_command_reply: tid=0 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 client.17439 shutdown 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 -- 172.21.15.2:0/1772201101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 msgr2=0x55b008fa7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa7430 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f93c8010670 tx=0x7f93c8010b30 comp rx=0 tx=0).stop 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 -- 172.21.15.2:0/1772201101 shutdown_connections 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b008fba490 0x55b008fbc8b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008faa780 0x55b008fa7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa7430 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93b4ff9640 0 client.17439 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 --2- 172.21.15.2:0/1772201101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008f9b5d0 0x55b008faa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 -- 172.21.15.2:0/1772201101 >> 172.21.15.2:0/1772201101 conn(0x55b008f64310 msgr2=0x55b008f9d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 -- 172.21.15.2:0/1772201101 shutdown_connections 2024-09-12T01:01:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 1 -- 172.21.15.2:0/1772201101 wait complete. 2024-09-12T01:01:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.393+0000 7f93d5981740 20 client.17439 trim_cache size 0 max 16384 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d5981740 1 Processor -- start 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d5981740 1 -- start start 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d5981740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 0x55b008fb6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d5981740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d5981740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 0x55b008fc2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d5981740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1ae160 con 0x55b008f9cb40 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d5981740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1aba00 con 0x55b008f9b5d0 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d5981740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1a9870 con 0x55b008faa780 2024-09-12T01:01:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d1344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d1344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38512/0 (socket says 172.21.15.2:38512) 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d1344640 1 -- 172.21.15.2:0/198918060 learned_addr learned my addr 172.21.15.2:0/198918060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d1b45640 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 0x55b008fb6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d1b45640 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 0x55b008fc2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d1344640 1 -- 172.21.15.2:0/198918060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 msgr2=0x55b008fc2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d1344640 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 0x55b008fc2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.407+0000 7f93d1344640 1 -- 172.21.15.2:0/198918060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 msgr2=0x55b008fb6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.408+0000 7f93d1344640 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 0x55b008fb6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.408+0000 7f93d1344640 1 -- 172.21.15.2:0/198918060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b008f97de0 con 0x55b008f9cb40 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.408+0000 7f93d1b45640 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 0x55b008fc2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.408+0000 7f93d1344640 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa6430 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f93c80245c0 tx=0x7f93c80095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acd76bfa32a59b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.408+0000 7f93b6ffd640 1 -- 172.21.15.2:0/198918060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c800e8d0 con 0x55b008f9cb40 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.408+0000 7f93b6ffd640 1 -- 172.21.15.2:0/198918060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c8005040 con 0x55b008f9cb40 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.408+0000 7f93b6ffd640 1 -- 172.21.15.2:0/198918060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8024bb0 con 0x55b008f9cb40 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 -- 172.21.15.2:0/198918060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 msgr2=0x55b008fa6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa6430 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f93c80245c0 tx=0x7f93c80095f0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 -- 172.21.15.2:0/198918060 shutdown_connections 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 0x55b008fc2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9cb40 0x55b008fa6430 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 --2- 172.21.15.2:0/198918060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9b5d0 0x55b008fb6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 -- 172.21.15.2:0/198918060 >> 172.21.15.2:0/198918060 conn(0x55b008f64310 msgr2=0x55b008fa5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 -- 172.21.15.2:0/198918060 shutdown_connections 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 -- 172.21.15.2:0/198918060 wait complete. 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 -- start start 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.409+0000 7f93d5981740 1 Processor -- start 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d5981740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9b5d0 0x55b008fb2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d5981740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9cb40 0x55b008fa4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d5981740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 0x55b008fa4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d5981740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1a9ec0 con 0x55b008f9b5d0 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d5981740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1ab330 con 0x55b008f9cb40 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d5981740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1aa590 con 0x55b008faa780 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d5981740 10 client.0 _ll_register_callbacks cb 0x7f93c80094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9b5d0 0x55b008fb2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9b5d0 0x55b008fb2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38520/0 (socket says 172.21.15.2:38520) 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 -- 172.21.15.2:0/511608863 learned_addr learned my addr 172.21.15.2:0/511608863 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1344640 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9cb40 0x55b008fa4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 -- 172.21.15.2:0/511608863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 msgr2=0x55b008fa4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 0x55b008fa4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 -- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9cb40 msgr2=0x55b008fa4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9cb40 0x55b008fa4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 -- 172.21.15.2:0/511608863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b008fa4bf0 con 0x55b008f9b5d0 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1344640 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9cb40 0x55b008fa4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d1b45640 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9b5d0 0x55b008fb2e00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f93c400a340 tx=0x7f93c400ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f06049fec1c8de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93b4ff9640 1 -- 172.21.15.2:0/511608863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c402f070 con 0x55b008f9b5d0 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93b4ff9640 1 -- 172.21.15.2:0/511608863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7f93c40130b0 con 0x55b008f9b5d0 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.410+0000 7f93d5981740 1 -- 172.21.15.2:0/511608863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c8005040 con 0x55b008f9b5d0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93b4ff9640 1 -- 172.21.15.2:0/511608863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f93c4039050 con 0x55b008f9b5d0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d5981740 10 client.17445 fetch_fsmap learned FSMap version 34 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d5981740 1 -- 172.21.15.2:0/511608863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b009024f50 con 0x55b008f9b5d0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93b4ff9640 1 -- 172.21.15.2:0/511608863 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c8005040 con 0x55b008f9b5d0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93b4ff9640 1 -- 172.21.15.2:0/511608863 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f93c40052d0 con 0x55b008f9b5d0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d5981740 10 client.17445 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d5981740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d5981740 20 client.17445 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d5981740 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b0090254d0 0x55b0090278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d5981740 4 client.17445 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d5981740 1 -- 172.21.15.2:0/511608863 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b008f08d70 con 0x55b0090254d0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.411+0000 7f93d1344640 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b0090254d0 0x55b0090278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93b4ff9640 10 client.17445 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d1344640 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b0090254d0 0x55b0090278f0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5c8297e391b25d8 server_cookie=fd65f2de6ac3e5e0 in_seq=0 out_seq=0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93b4ff9640 1 -- 172.21.15.2:0/511608863 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b008f08d70 con 0x55b0090254d0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93b4ff9640 10 client.17445 handle_command_reply: tid=0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 client.17445 shutdown 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 -- 172.21.15.2:0/511608863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9b5d0 msgr2=0x55b008fb2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9b5d0 0x55b008fb2e00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f93c400a340 tx=0x7f93c400ad20 comp rx=0 tx=0).stop 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 -- 172.21.15.2:0/511608863 shutdown_connections 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b0090254d0 0x55b0090278f0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b008faa780 0x55b008fa4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b008f9cb40 0x55b008fa4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 --2- 172.21.15.2:0/511608863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b008f9b5d0 0x55b008fb2e00 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 -- 172.21.15.2:0/511608863 >> 172.21.15.2:0/511608863 conn(0x55b008f64310 msgr2=0x55b008fa8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93b4ff9640 0 client.17445 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 -- 172.21.15.2:0/511608863 shutdown_connections 2024-09-12T01:01:31.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 1 -- 172.21.15.2:0/511608863 wait complete. 2024-09-12T01:01:31.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.412+0000 7f93d5981740 20 client.17445 trim_cache size 0 max 16384 2024-09-12T01:01:31.420 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 -- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f93b80a2d70 msgr2=0x7f93b80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f93b80a2d70 0x7f93b80a5230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b8480 tx=0x7f93bc009560 comp rx=0 tx=0).stop 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 -- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 msgr2=0x7f93cc1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 0x7f93cc1989b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f93bc006010 tx=0x7f93bc0042f0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 -- 172.21.15.2:0/3842886309 shutdown_connections 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f93b80a2d70 0x7f93b80a5230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93cc10c170 0x7f93cc19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93cc103660 0x7f93cc1989b0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 --2- 172.21.15.2:0/3842886309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93cc102d40 0x7f93cc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 -- 172.21.15.2:0/3842886309 >> 172.21.15.2:0/3842886309 conn(0x7f93cc0fc7a0 msgr2=0x7f93cc0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 -- 172.21.15.2:0/3842886309 shutdown_connections 2024-09-12T01:01:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:31.413+0000 7f93d35a8640 1 -- 172.21.15.2:0/3842886309 wait complete. 2024-09-12T01:01:32.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:32 smithi071 ceph-mon[35276]: pgmap v265: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:01:32.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:32 smithi002 ceph-mon[31210]: pgmap v265: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:01:33.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:32 smithi167 ceph-mon[35234]: pgmap v265: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:01:33.210 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:01:33.211 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:01:33.483 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:01:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 -- 172.21.15.2:0/688257680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64410e810 msgr2=0x7fd644110c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 --2- 172.21.15.2:0/688257680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64410e810 0x7fd644110c00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009ca0 tx=0x7fd63c02a8b0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 -- 172.21.15.2:0/688257680 shutdown_connections 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 --2- 172.21.15.2:0/688257680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64410e810 0x7fd644110c00 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 --2- 172.21.15.2:0/688257680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd644102fc0 0x7fd6441005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 --2- 172.21.15.2:0/688257680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd644102b50 0x7fd644100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 -- 172.21.15.2:0/688257680 >> 172.21.15.2:0/688257680 conn(0x7fd644077210 msgr2=0x7fd6440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 -- 172.21.15.2:0/688257680 shutdown_connections 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.925+0000 7fd64b1de640 1 -- 172.21.15.2:0/688257680 wait complete. 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64b1de640 1 Processor -- start 2024-09-12T01:01:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64b1de640 1 -- start start 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64b1de640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd644102b50 0x7fd64419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64b1de640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd64410e810 0x7fd64419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64b1de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64419efc0 0x7fd64419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64b1de640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6441141b0 con 0x7fd64419efc0 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64b1de640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd644114030 con 0x7fd644102b50 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64b1de640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd644114330 con 0x7fd64410e810 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64977b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64419efc0 0x7fd64419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64977b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64419efc0 0x7fd64419f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38544/0 (socket says 172.21.15.2:38544) 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.926+0000 7fd64977b640 1 -- 172.21.15.2:0/486913768 learned_addr learned my addr 172.21.15.2:0/486913768 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd648f7a640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd644102b50 0x7fd64419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd643fff640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd64410e810 0x7fd64419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd64977b640 1 -- 172.21.15.2:0/486913768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd64410e810 msgr2=0x7fd64419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd64977b640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd64410e810 0x7fd64419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd64977b640 1 -- 172.21.15.2:0/486913768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd644102b50 msgr2=0x7fd64419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd64977b640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd644102b50 0x7fd64419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd64977b640 1 -- 172.21.15.2:0/486913768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64419fa80 con 0x7fd64419efc0 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd643fff640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd64410e810 0x7fd64419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd64977b640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64419efc0 0x7fd64419f470 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd63c006010 tx=0x7fd63c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd641ffb640 1 -- 172.21.15.2:0/486913768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c004040 con 0x7fd64419efc0 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd64b1de640 1 -- 172.21.15.2:0/486913768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64419fd10 con 0x7fd64419efc0 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd641ffb640 1 -- 172.21.15.2:0/486913768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd63c040070 con 0x7fd64419efc0 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd641ffb640 1 -- 172.21.15.2:0/486913768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c045bb0 con 0x7fd64419efc0 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.927+0000 7fd64b1de640 1 -- 172.21.15.2:0/486913768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6441a74f0 con 0x7fd64419efc0 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd641ffb640 1 -- 172.21.15.2:0/486913768 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fd63c0041e0 con 0x7fd64419efc0 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd64d5b7740 1 Processor -- start 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd64d5b7740 1 -- start start 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d5bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5c480 0x55d6e3d66800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d66d40 0x55d6e3d69130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3cc1280 con 0x55d6e3d5c480 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3c68b10 con 0x55d6e3d66d40 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.930+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3cbd240 con 0x55d6e3d5bb60 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd641ffb640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd6340a2cf0 0x7fd6340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5c480 0x55d6e3d66800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5c480 0x55d6e3d66800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38560/0 (socket says 172.21.15.2:38560) 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 -- 172.21.15.2:0/901156475 learned_addr learned my addr 172.21.15.2:0/901156475 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd64977b640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd6340a2cf0 0x7fd6340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd643fff640 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d5bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd643fff640 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d66d40 0x55d6e3d69130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd641ffb640 1 -- 172.21.15.2:0/486913768 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fd63c0f0990 con 0x7fd64419efc0 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 -- 172.21.15.2:0/901156475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5bb60 msgr2=0x55d6e3d5bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d5bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 -- 172.21.15.2:0/901156475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d66d40 msgr2=0x55d6e3d69130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d66d40 0x55d6e3d69130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 -- 172.21.15.2:0/901156475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e3c751f0 con 0x55d6e3d5c480 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd643fff640 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d66d40 0x55d6e3d69130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd64977b640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd6340a2cf0 0x7fd6340a51b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0bcc70 tx=0x7fd63c02a8b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd648f7a640 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5c480 0x55d6e3d66800 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd63800bd10 tx=0x7fd6380107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cf025124082540 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.931+0000 7fd62effd640 1 -- 172.21.15.2:0/901156475 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638004030 con 0x55d6e3d5c480 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd62effd640 1 -- 172.21.15.2:0/901156475 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6380041d0 con 0x55d6e3d5c480 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd62effd640 1 -- 172.21.15.2:0/901156475 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638011840 con 0x55d6e3d5c480 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 -- 172.21.15.2:0/901156475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5c480 msgr2=0x55d6e3d66800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5c480 0x55d6e3d66800 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd63800bd10 tx=0x7fd6380107a0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 -- 172.21.15.2:0/901156475 shutdown_connections 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d66d40 0x55d6e3d69130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5c480 0x55d6e3d66800 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/901156475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d5bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 -- 172.21.15.2:0/901156475 >> 172.21.15.2:0/901156475 conn(0x55d6e3d580f0 msgr2=0x55d6e3d584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 -- 172.21.15.2:0/901156475 shutdown_connections 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.932+0000 7fd64d5b7740 1 -- 172.21.15.2:0/901156475 wait complete. 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 1 -- start start 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 1 Processor -- start 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d63c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d64190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 0x55d6e3d646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3d69910 con 0x55d6e3d5bb60 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3c7bf10 con 0x55d6e3d5c480 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3d69a90 con 0x55d6e3d66d40 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd64d5b7740 10 client.0 _ll_register_callbacks cb 0x55d6e3c44a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd643fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d63c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd643fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d63c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38566/0 (socket says 172.21.15.2:38566) 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd643fff640 1 -- 172.21.15.2:0/2002459524 learned_addr learned my addr 172.21.15.2:0/2002459524 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.933+0000 7fd648f7a640 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d64190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd643fff640 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 0x55d6e3d646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd643fff640 1 -- 172.21.15.2:0/2002459524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 msgr2=0x55d6e3d646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd643fff640 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 0x55d6e3d646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd643fff640 1 -- 172.21.15.2:0/2002459524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 msgr2=0x55d6e3d64190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd643fff640 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d64190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd643fff640 1 -- 172.21.15.2:0/2002459524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e3a326a0 con 0x55d6e3d5bb60 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd643fff640 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d63c50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd630014dc0 tx=0x7fd6300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc9963870282a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd623fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd623fff640 1 -- 172.21.15.2:0/2002459524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd630014310 con 0x55d6e3d5bb60 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd623fff640 1 -- 172.21.15.2:0/2002459524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fd630012450 con 0x55d6e3d5bb60 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd64d5b7740 1 -- 172.21.15.2:0/2002459524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6380041d0 con 0x55d6e3d5bb60 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd623fff640 1 -- 172.21.15.2:0/2002459524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd630026050 con 0x55d6e3d5bb60 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd64d5b7740 10 client.17457 fetch_fsmap learned FSMap version 34 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd64d5b7740 1 -- 172.21.15.2:0/2002459524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d6e3d755f0 con 0x55d6e3d5bb60 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.934+0000 7fd623fff640 1 -- 172.21.15.2:0/2002459524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6380041d0 con 0x55d6e3d5bb60 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.935+0000 7fd623fff640 1 -- 172.21.15.2:0/2002459524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fd63000f830 con 0x55d6e3d5bb60 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.935+0000 7fd64d5b7740 10 client.17457 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.935+0000 7fd64d5b7740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.935+0000 7fd64d5b7740 20 client.17457 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.935+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d6e3d76ab0 0x55d6e3d78ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.935+0000 7fd64d5b7740 4 client.17457 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.935+0000 7fd64d5b7740 1 -- 172.21.15.2:0/2002459524 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6e3cce7f0 con 0x55d6e3d76ab0 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.935+0000 7fd648f7a640 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d6e3d76ab0 0x55d6e3d78ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.936+0000 7fd648f7a640 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d6e3d76ab0 0x55d6e3d78ea0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5928071d4279e2 server_cookie=6b10275d36d1adf2 in_seq=0 out_seq=0 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.936+0000 7fd623fff640 10 client.17457 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.936+0000 7fd623fff640 1 -- 172.21.15.2:0/2002459524 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6e3cce7f0 con 0x55d6e3d76ab0 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.936+0000 7fd623fff640 10 client.17457 handle_command_reply: tid=0 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 client.17457 shutdown 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 -- 172.21.15.2:0/2002459524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 msgr2=0x55d6e3d63c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d63c50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd630014dc0 tx=0x7fd6300046c0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 -- 172.21.15.2:0/2002459524 shutdown_connections 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d6e3d76ab0 0x55d6e3d78ea0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 0x55d6e3d646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd623fff640 0 client.17457 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d64190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/2002459524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d63c50 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 -- 172.21.15.2:0/2002459524 >> 172.21.15.2:0/2002459524 conn(0x55d6e3d580f0 msgr2=0x55d6e3d57270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 -- 172.21.15.2:0/2002459524 shutdown_connections 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 1 -- 172.21.15.2:0/2002459524 wait complete. 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.937+0000 7fd64d5b7740 20 client.17457 trim_cache size 0 max 16384 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.954+0000 7fd64d5b7740 1 Processor -- start 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd64d5b7740 1 -- start start 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d5e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5c480 0x55d6e3d7e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d66d40 0x55d6e3d7ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6441b2510 con 0x55d6e3d66d40 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6441afdb0 con 0x55d6e3d5bb60 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd6441adc20 con 0x55d6e3d5c480 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d66d40 0x55d6e3d7ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d66d40 0x55d6e3d7ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38582/0 (socket says 172.21.15.2:38582) 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 -- 172.21.15.2:0/3227398049 learned_addr learned my addr 172.21.15.2:0/3227398049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd648f7a640 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5c480 0x55d6e3d7e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d5e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 -- 172.21.15.2:0/3227398049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5c480 msgr2=0x55d6e3d7e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5c480 0x55d6e3d7e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 -- 172.21.15.2:0/3227398049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5bb60 msgr2=0x55d6e3d5e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d5e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 -- 172.21.15.2:0/3227398049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e3d66520 con 0x55d6e3d66d40 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.955+0000 7fd643fff640 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d66d40 0x55d6e3d7ec60 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd63000d010 tx=0x7fd630014ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaf3abed5ba1aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd62e7fc640 1 -- 172.21.15.2:0/3227398049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd630014310 con 0x55d6e3d66d40 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd62e7fc640 1 -- 172.21.15.2:0/3227398049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd630005070 con 0x55d6e3d66d40 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd62e7fc640 1 -- 172.21.15.2:0/3227398049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63000f680 con 0x55d6e3d66d40 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 -- 172.21.15.2:0/3227398049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d66d40 msgr2=0x55d6e3d7ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d66d40 0x55d6e3d7ec60 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd63000d010 tx=0x7fd630014ab0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 -- 172.21.15.2:0/3227398049 shutdown_connections 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d66d40 0x55d6e3d7ec60 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d5c480 0x55d6e3d7e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/3227398049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d5e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 -- 172.21.15.2:0/3227398049 >> 172.21.15.2:0/3227398049 conn(0x55d6e3d580f0 msgr2=0x55d6e3d65bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 -- 172.21.15.2:0/3227398049 shutdown_connections 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.956+0000 7fd64d5b7740 1 -- 172.21.15.2:0/3227398049 wait complete. 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 1 -- start start 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 1 Processor -- start 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d6aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d6afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 0x55d6e3d6b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6441ae270 con 0x55d6e3d5bb60 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6441af6e0 con 0x55d6e3d5c480 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd6441ae940 con 0x55d6e3d66d40 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd64d5b7740 10 client.0 _ll_register_callbacks cb 0x7fd630014a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd643fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d6aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd643fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d6aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38596/0 (socket says 172.21.15.2:38596) 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd643fff640 1 -- 172.21.15.2:0/1334498002 learned_addr learned my addr 172.21.15.2:0/1334498002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd648f7a640 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d6afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.957+0000 7fd643fff640 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 0x55d6e3d6b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd643fff640 1 -- 172.21.15.2:0/1334498002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 msgr2=0x55d6e3d6b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd643fff640 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 0x55d6e3d6b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd643fff640 1 -- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 msgr2=0x55d6e3d6afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd643fff640 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d6afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd643fff640 1 -- 172.21.15.2:0/1334498002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e3de0740 con 0x55d6e3d5bb60 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd648f7a640 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d6afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd643fff640 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d6aa90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd630014fd0 tx=0x7fd6300148b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5a1c0562665ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd623fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd623fff640 1 -- 172.21.15.2:0/1334498002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd630034040 con 0x55d6e3d5bb60 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd623fff640 1 -- 172.21.15.2:0/1334498002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fd63000f420 con 0x55d6e3d5bb60 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd64d5b7740 1 -- 172.21.15.2:0/1334498002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd630005070 con 0x55d6e3d5bb60 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd623fff640 1 -- 172.21.15.2:0/1334498002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd630005630 con 0x55d6e3d5bb60 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd64d5b7740 10 client.17463 fetch_fsmap learned FSMap version 34 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd64d5b7740 1 -- 172.21.15.2:0/1334498002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d6e3de1a60 con 0x55d6e3d5bb60 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.958+0000 7fd623fff640 1 -- 172.21.15.2:0/1334498002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd630005070 con 0x55d6e3d5bb60 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd623fff640 1 -- 172.21.15.2:0/1334498002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fd630037460 con 0x55d6e3d5bb60 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd64d5b7740 10 client.17463 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T01:01:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd64d5b7740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd64d5b7740 20 client.17463 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d6e3de20c0 0x55d6e3de44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd64d5b7740 4 client.17463 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd64d5b7740 1 -- 172.21.15.2:0/1334498002 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d6e3cc8d00 con 0x55d6e3de20c0 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd648f7a640 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d6e3de20c0 0x55d6e3de44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd623fff640 10 client.17463 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.959+0000 7fd648f7a640 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d6e3de20c0 0x55d6e3de44b0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbb48f084798983 server_cookie=a14fc92274ff3c7b in_seq=0 out_seq=0 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.960+0000 7fd623fff640 1 -- 172.21.15.2:0/1334498002 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d6e3cc8d00 con 0x55d6e3de20c0 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.960+0000 7fd623fff640 10 client.17463 handle_command_reply: tid=0 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.960+0000 7fd64d5b7740 1 client.17463 shutdown 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 -- 172.21.15.2:0/1334498002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 msgr2=0x55d6e3d6aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d6aa90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd630014fd0 tx=0x7fd6300148b0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 -- 172.21.15.2:0/1334498002 shutdown_connections 2024-09-12T01:01:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55d6e3de20c0 0x55d6e3de44b0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd623fff640 0 client.17463 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6e3d66d40 0x55d6e3d6b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6e3d5c480 0x55d6e3d6afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 --2- 172.21.15.2:0/1334498002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e3d5bb60 0x55d6e3d6aa90 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 -- 172.21.15.2:0/1334498002 >> 172.21.15.2:0/1334498002 conn(0x55d6e3d580f0 msgr2=0x55d6e3d65160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 -- 172.21.15.2:0/1334498002 shutdown_connections 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 1 -- 172.21.15.2:0/1334498002 wait complete. 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64d5b7740 20 client.17463 trim_cache size 0 max 16384 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "67f371f9-7189-4d90-ac49-b0d4a703adf5", 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64b1de640 1 -- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd6340a2cf0 msgr2=0x7fd6340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64b1de640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd6340a2cf0 0x7fd6340a51b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0bcc70 tx=0x7fd63c02a8b0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64b1de640 1 -- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64419efc0 msgr2=0x7fd64419f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.961+0000 7fd64b1de640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64419efc0 0x7fd64419f470 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd63c006010 tx=0x7fd63c009360 comp rx=0 tx=0).stop 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.962+0000 7fd64b1de640 1 -- 172.21.15.2:0/486913768 shutdown_connections 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.962+0000 7fd64b1de640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd6340a2cf0 0x7fd6340a51b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.962+0000 7fd64b1de640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd64419efc0 0x7fd64419f470 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.962+0000 7fd64b1de640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd64410e810 0x7fd64419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.962+0000 7fd64b1de640 1 --2- 172.21.15.2:0/486913768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd644102b50 0x7fd64419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.962+0000 7fd64b1de640 1 -- 172.21.15.2:0/486913768 >> 172.21.15.2:0/486913768 conn(0x7fd644077210 msgr2=0x7fd64410fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.962+0000 7fd64b1de640 1 -- 172.21.15.2:0/486913768 shutdown_connections 2024-09-12T01:01:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:33.962+0000 7fd64b1de640 1 -- 172.21.15.2:0/486913768 wait complete. 2024-09-12T01:01:34.710 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:34 smithi002 ceph-mon[31210]: pgmap v266: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:34.710 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:34 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T01:01:34.710 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:34 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:01:34.710 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:34 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T01:01:34.711 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:34 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:01:34.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:01:34.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:34 smithi071 ceph-mon[35276]: pgmap v266: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:34.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:34 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T01:01:34.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:34 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:01:34.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:34 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T01:01:34.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:34 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:01:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:01:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:34 smithi167 ceph-mon[35234]: pgmap v266: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:34 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T01:01:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:34 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:01:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:34 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T01:01:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:34 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.472+0000 7facacf98640 1 -- 172.21.15.2:0/3362882109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102570 msgr2=0x7faca81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.472+0000 7facacf98640 1 --2- 172.21.15.2:0/3362882109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102570 0x7faca81029b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fac90009900 tx=0x7fac9002a480 comp rx=0 tx=0).stop 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.473+0000 7facacf98640 1 -- 172.21.15.2:0/3362882109 shutdown_connections 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.473+0000 7facacf98640 1 --2- 172.21.15.2:0/3362882109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faca8102ef0 0x7faca810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.473+0000 7facacf98640 1 --2- 172.21.15.2:0/3362882109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102570 0x7faca81029b0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.473+0000 7facacf98640 1 --2- 172.21.15.2:0/3362882109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faca8100e20 0x7faca8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.473+0000 7facacf98640 1 -- 172.21.15.2:0/3362882109 >> 172.21.15.2:0/3362882109 conn(0x7faca80fc7d0 msgr2=0x7faca80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.473+0000 7facacf98640 1 -- 172.21.15.2:0/3362882109 shutdown_connections 2024-09-12T01:01:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.473+0000 7facacf98640 1 -- 172.21.15.2:0/3362882109 wait complete. 2024-09-12T01:01:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7facacf98640 1 Processor -- start 2024-09-12T01:01:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7facacf98640 1 -- start start 2024-09-12T01:01:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7facacf98640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faca8100e20 0x7faca81a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7facacf98640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faca8102570 0x7faca81a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7facacf98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102ef0 0x7faca819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7facacf98640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faca8111020 con 0x7faca8102ef0 2024-09-12T01:01:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7facacf98640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faca8110ea0 con 0x7faca8102570 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7facacf98640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faca81111a0 con 0x7faca8100e20 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7faca6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102ef0 0x7faca819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7faca6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102ef0 0x7faca819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38610/0 (socket says 172.21.15.2:38610) 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7faca6d9d640 1 -- 172.21.15.2:0/2594250188 learned_addr learned my addr 172.21.15.2:0/2594250188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7faca5d9b640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faca8102570 0x7faca81a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.474+0000 7faca659c640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faca8100e20 0x7faca81a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7faca6d9d640 1 -- 172.21.15.2:0/2594250188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faca8100e20 msgr2=0x7faca81a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7faca6d9d640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faca8100e20 0x7faca81a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7faca6d9d640 1 -- 172.21.15.2:0/2594250188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faca8102570 msgr2=0x7faca81a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7faca6d9d640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faca8102570 0x7faca81a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7faca6d9d640 1 -- 172.21.15.2:0/2594250188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca819aee0 con 0x7faca8102ef0 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7faca6d9d640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102ef0 0x7faca819a670 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fac9800b970 tx=0x7fac9800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7fac9f7fe640 1 -- 172.21.15.2:0/2594250188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98019070 con 0x7faca8102ef0 2024-09-12T01:01:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7fac9f7fe640 1 -- 172.21.15.2:0/2594250188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac98014440 con 0x7faca8102ef0 2024-09-12T01:01:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7facacf98640 1 -- 172.21.15.2:0/2594250188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca819b1d0 con 0x7faca8102ef0 2024-09-12T01:01:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7fac9f7fe640 1 -- 172.21.15.2:0/2594250188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac980075d0 con 0x7faca8102ef0 2024-09-12T01:01:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.475+0000 7facacf98640 1 -- 172.21.15.2:0/2594250188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca81a7520 con 0x7faca8102ef0 2024-09-12T01:01:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.477+0000 7fac9f7fe640 1 -- 172.21.15.2:0/2594250188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fac9801c070 con 0x7faca8102ef0 2024-09-12T01:01:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7facaf371740 1 Processor -- start 2024-09-12T01:01:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7facaf371740 1 -- start start 2024-09-12T01:01:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7facaf371740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7facaf371740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bddc0 0x55ca934c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7facaf371740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934c8680 0x55ca934caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7facaf371740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca934232e0 con 0x55ca934bddc0 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7facaf371740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca933cace0 con 0x55ca934bd4a0 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7facaf371740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca9341f2a0 con 0x55ca934c8680 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7faca659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bddc0 0x55ca934c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7faca659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bddc0 0x55ca934c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38612/0 (socket says 172.21.15.2:38612) 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7faca659c640 1 -- 172.21.15.2:0/3390626215 learned_addr learned my addr 172.21.15.2:0/3390626215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7faca5d9b640 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.478+0000 7faca5d9b640 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934c8680 0x55ca934caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7fac9f7fe640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fac940a2d70 0x7fac940a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7faca659c640 1 -- 172.21.15.2:0/3390626215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934c8680 msgr2=0x55ca934caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7faca659c640 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934c8680 0x55ca934caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7faca659c640 1 -- 172.21.15.2:0/3390626215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 msgr2=0x55ca934bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7faca659c640 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934bd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7faca659c640 1 -- 172.21.15.2:0/3390626215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca933af440 con 0x55ca934bddc0 2024-09-12T01:01:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7faca6d9d640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fac940a2d70 0x7fac940a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7faca5d9b640 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934c8680 0x55ca934caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7fac9f7fe640 1 -- 172.21.15.2:0/2594250188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fac980ce910 con 0x7faca8102ef0 2024-09-12T01:01:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7faca659c640 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bddc0 0x55ca934c8140 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7faca0009a70 tx=0x7faca0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2a1c2cfa98d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7fac9cff9640 1 -- 172.21.15.2:0/3390626215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0017070 con 0x55ca934bddc0 2024-09-12T01:01:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7fac9cff9640 1 -- 172.21.15.2:0/3390626215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca0013470 con 0x55ca934bddc0 2024-09-12T01:01:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.479+0000 7fac9cff9640 1 -- 172.21.15.2:0/3390626215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0012630 con 0x55ca934bddc0 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 -- 172.21.15.2:0/3390626215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bddc0 msgr2=0x55ca934c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7faca6d9d640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fac940a2d70 0x7fac940a5230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac980cc0f0 tx=0x7fac9806ced0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bddc0 0x55ca934c8140 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7faca0009a70 tx=0x7faca0009f30 comp rx=0 tx=0).stop 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 -- 172.21.15.2:0/3390626215 shutdown_connections 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934c8680 0x55ca934caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bddc0 0x55ca934c8140 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 --2- 172.21.15.2:0/3390626215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 -- 172.21.15.2:0/3390626215 >> 172.21.15.2:0/3390626215 conn(0x55ca934b9a30 msgr2=0x55ca934b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 -- 172.21.15.2:0/3390626215 shutdown_connections 2024-09-12T01:01:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 -- 172.21.15.2:0/3390626215 wait complete. 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 -- start start 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.480+0000 7facaf371740 1 Processor -- start 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7facaf371740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bd4a0 0x55ca934c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7facaf371740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bddc0 0x55ca934c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7facaf371740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934c8680 0x55ca934c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7facaf371740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca934cb250 con 0x55ca934c8680 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7facaf371740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca933de050 con 0x55ca934bddc0 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7facaf371740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca934cb3d0 con 0x55ca934bd4a0 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7facaf371740 10 client.0 _ll_register_callbacks cb 0x55ca9341e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934c8680 0x55ca934c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934c8680 0x55ca934c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38622/0 (socket says 172.21.15.2:38622) 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 -- 172.21.15.2:0/1441651218 learned_addr learned my addr 172.21.15.2:0/1441651218 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca659c640 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bddc0 0x55ca934c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bd4a0 0x55ca934c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 -- 172.21.15.2:0/1441651218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bd4a0 msgr2=0x55ca934c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bd4a0 0x55ca934c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 -- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bddc0 msgr2=0x55ca934c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bddc0 0x55ca934c51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 -- 172.21.15.2:0/1441651218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca931943c0 con 0x55ca934c8680 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca659c640 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bddc0 0x55ca934c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7faca5d9b640 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934c8680 0x55ca934c5710 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fac90009900 tx=0x7fac9002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4814fc7b93a319 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.481+0000 7fac8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7fac8dffb640 1 -- 172.21.15.2:0/1441651218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90035040 con 0x55ca934c8680 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 1 -- 172.21.15.2:0/1441651218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca0013470 con 0x55ca934c8680 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7fac8dffb640 1 -- 172.21.15.2:0/1441651218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fac90003d10 con 0x55ca934c8680 2024-09-12T01:01:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7fac8dffb640 1 -- 172.21.15.2:0/1441651218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fac90031540 con 0x55ca934c8680 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 10 client.17475 fetch_fsmap learned FSMap version 34 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 1 -- 172.21.15.2:0/1441651218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ca934d6bc0 con 0x55ca934c8680 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7fac8dffb640 1 -- 172.21.15.2:0/1441651218 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca0013470 con 0x55ca934c8680 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7fac8dffb640 1 -- 172.21.15.2:0/1441651218 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fac90052070 con 0x55ca934c8680 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 10 client.17475 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 10 client.17475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 20 client.17475 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca934d7fd0 0x55ca934da3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 4 client.17475 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.482+0000 7facaf371740 1 -- 172.21.15.2:0/1441651218 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca93430850 con 0x55ca934d7fd0 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.483+0000 7faca659c640 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca934d7fd0 0x55ca934da3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.483+0000 7faca659c640 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca934d7fd0 0x55ca934da3c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53ffb93423b281ca server_cookie=1bd459f8b56ccb2d in_seq=0 out_seq=0 2024-09-12T01:01:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.483+0000 7fac8dffb640 10 client.17475 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7fac8dffb640 1 -- 172.21.15.2:0/1441651218 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca93430850 con 0x55ca934d7fd0 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7fac8dffb640 10 client.17475 handle_command_reply: tid=0 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 client.17475 shutdown 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 -- 172.21.15.2:0/1441651218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934c8680 msgr2=0x55ca934c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934c8680 0x55ca934c5710 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fac90009900 tx=0x7fac9002a480 comp rx=0 tx=0).stop 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 -- 172.21.15.2:0/1441651218 shutdown_connections 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca934d7fd0 0x55ca934da3c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934c8680 0x55ca934c5710 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bddc0 0x55ca934c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 --2- 172.21.15.2:0/1441651218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bd4a0 0x55ca934c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7fac8dffb640 0 client.17475 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 -- 172.21.15.2:0/1441651218 >> 172.21.15.2:0/1441651218 conn(0x55ca934b9a30 msgr2=0x55ca934b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 -- 172.21.15.2:0/1441651218 shutdown_connections 2024-09-12T01:01:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 1 -- 172.21.15.2:0/1441651218 wait complete. 2024-09-12T01:01:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.484+0000 7facaf371740 20 client.17475 trim_cache size 0 max 16384 2024-09-12T01:01:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.501+0000 7facaf371740 1 Processor -- start 2024-09-12T01:01:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.501+0000 7facaf371740 1 -- start start 2024-09-12T01:01:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.501+0000 7facaf371740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934b9a30 0x55ca934d44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7facaf371740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bd4a0 0x55ca934dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7facaf371740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bddc0 0x55ca934e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7facaf371740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faca81b26a0 con 0x55ca934bd4a0 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7facaf371740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faca81aff40 con 0x55ca934b9a30 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7facaf371740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faca81addb0 con 0x55ca934bddc0 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bd4a0 0x55ca934dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bd4a0 0x55ca934dfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38630/0 (socket says 172.21.15.2:38630) 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 -- 172.21.15.2:0/2725809993 learned_addr learned my addr 172.21.15.2:0/2725809993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca5d9b640 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934b9a30 0x55ca934d44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 -- 172.21.15.2:0/2725809993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bddc0 msgr2=0x55ca934e01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bddc0 0x55ca934e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 -- 172.21.15.2:0/2725809993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934b9a30 msgr2=0x55ca934d44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934b9a30 0x55ca934d44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 -- 172.21.15.2:0/2725809993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca934c8290 con 0x55ca934bd4a0 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca5d9b640 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934b9a30 0x55ca934d44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7faca659c640 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bd4a0 0x55ca934dfc90 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7faca0009a70 tx=0x7faca0009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5291e3be85f3ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:35.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7fac8ffff640 1 -- 172.21.15.2:0/2725809993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca002b070 con 0x55ca934bd4a0 2024-09-12T01:01:35.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7fac8ffff640 1 -- 172.21.15.2:0/2725809993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca0025440 con 0x55ca934bd4a0 2024-09-12T01:01:35.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.502+0000 7fac8ffff640 1 -- 172.21.15.2:0/2725809993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0017040 con 0x55ca934bd4a0 2024-09-12T01:01:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 -- 172.21.15.2:0/2725809993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bd4a0 msgr2=0x55ca934dfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bd4a0 0x55ca934dfc90 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7faca0009a70 tx=0x7faca0009110 comp rx=0 tx=0).stop 2024-09-12T01:01:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 -- 172.21.15.2:0/2725809993 shutdown_connections 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bddc0 0x55ca934e01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934bd4a0 0x55ca934dfc90 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 --2- 172.21.15.2:0/2725809993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934b9a30 0x55ca934d44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 -- 172.21.15.2:0/2725809993 >> 172.21.15.2:0/2725809993 conn(0x55ca934c5870 msgr2=0x55ca934c3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 -- 172.21.15.2:0/2725809993 shutdown_connections 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 -- 172.21.15.2:0/2725809993 wait complete. 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 -- start start 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.503+0000 7facaf371740 1 Processor -- start 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7facaf371740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934b9a30 0x55ca934cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7facaf371740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7facaf371740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bddc0 0x55ca934cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7facaf371740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faca81ae400 con 0x55ca934b9a30 2024-09-12T01:01:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7facaf371740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faca81af870 con 0x55ca934bd4a0 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7facaf371740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faca81aead0 con 0x55ca934bddc0 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7facaf371740 10 client.0 _ll_register_callbacks cb 0x7fac90005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934b9a30 0x55ca934cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934b9a30 0x55ca934cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38636/0 (socket says 172.21.15.2:38636) 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 -- 172.21.15.2:0/3632571085 learned_addr learned my addr 172.21.15.2:0/3632571085 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca659c640 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 -- 172.21.15.2:0/3632571085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bddc0 msgr2=0x55ca934cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bddc0 0x55ca934cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 -- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 msgr2=0x55ca934ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 -- 172.21.15.2:0/3632571085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca93541eb0 con 0x55ca934b9a30 2024-09-12T01:01:35.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca659c640 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7faca5d9b640 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934b9a30 0x55ca934cc5c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fac90009850 tx=0x7fac9002ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99df048719cb0f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7fac8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7fac8dffb640 1 -- 172.21.15.2:0/3632571085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90058070 con 0x55ca934b9a30 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7fac8dffb640 1 -- 172.21.15.2:0/3632571085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8643+0+0 (secure 0 0 0) 0x7fac9003dbe0 con 0x55ca934b9a30 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.504+0000 7facaf371740 1 -- 172.21.15.2:0/3632571085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca0025440 con 0x55ca934b9a30 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7fac8dffb640 1 -- 172.21.15.2:0/3632571085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fac90035040 con 0x55ca934b9a30 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7facaf371740 10 client.17481 fetch_fsmap learned FSMap version 34 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7facaf371740 1 -- 172.21.15.2:0/3632571085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ca93543110 con 0x55ca934b9a30 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7fac8dffb640 1 -- 172.21.15.2:0/3632571085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca0025440 con 0x55ca934b9a30 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7fac8dffb640 1 -- 172.21.15.2:0/3632571085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fac9005b020 con 0x55ca934b9a30 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7facaf371740 10 client.17481 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7facaf371740 10 client.17481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7facaf371740 20 client.17481 populate_metadata read hostname 'smithi002' 2024-09-12T01:01:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7facaf371740 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca934c8680 0x55ca93545810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7facaf371740 4 client.17481 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7facaf371740 1 -- 172.21.15.2:0/3632571085 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ca9342ad60 con 0x55ca934c8680 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.505+0000 7faca659c640 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca934c8680 0x55ca93545810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7faca659c640 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca934c8680 0x55ca93545810 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a3fca0b3ad6b397 server_cookie=b9d59920851cb0b4 in_seq=0 out_seq=0 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7fac8dffb640 10 client.17481 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7fac8dffb640 1 -- 172.21.15.2:0/3632571085 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ca9342ad60 con 0x55ca934c8680 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7fac8dffb640 10 client.17481 handle_command_reply: tid=0 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 client.17481 shutdown 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 -- 172.21.15.2:0/3632571085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934b9a30 msgr2=0x55ca934cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934b9a30 0x55ca934cc5c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fac90009850 tx=0x7fac9002ab80 comp rx=0 tx=0).stop 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 -- 172.21.15.2:0/3632571085 shutdown_connections 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ca934c8680 0x55ca93545810 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7fac8dffb640 0 client.17481 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca934bddc0 0x55ca934cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca934bd4a0 0x55ca934ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 --2- 172.21.15.2:0/3632571085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca934b9a30 0x55ca934cc5c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 -- 172.21.15.2:0/3632571085 >> 172.21.15.2:0/3632571085 conn(0x55ca934c5870 msgr2=0x55ca934c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 -- 172.21.15.2:0/3632571085 shutdown_connections 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.506+0000 7facaf371740 1 -- 172.21.15.2:0/3632571085 wait complete. 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facaf371740 20 client.17481 trim_cache size 0 max 16384 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:01:35.512 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stdout: "67f371f9-7189-4d90-ac49-b0d4a703adf5": { 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "67f371f9-7189-4d90-ac49-b0d4a703adf5", 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:01:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 -- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fac940a2d70 msgr2=0x7fac940a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fac940a2d70 0x7fac940a5230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac980cc0f0 tx=0x7fac9806ced0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 -- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102ef0 msgr2=0x7faca819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102ef0 0x7faca819a670 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fac9800b970 tx=0x7fac9800bd70 comp rx=0 tx=0).stop 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 -- 172.21.15.2:0/2594250188 shutdown_connections 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fac940a2d70 0x7fac940a5230 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faca8102ef0 0x7faca819a670 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faca8102570 0x7faca81a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 --2- 172.21.15.2:0/2594250188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faca8100e20 0x7faca81a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 -- 172.21.15.2:0/2594250188 >> 172.21.15.2:0/2594250188 conn(0x7faca80fc7d0 msgr2=0x7faca806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 -- 172.21.15.2:0/2594250188 shutdown_connections 2024-09-12T01:01:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:01:35.507+0000 7facacf98640 1 -- 172.21.15.2:0/2594250188 wait complete. 2024-09-12T01:01:36.415 INFO:tasks.cephfs.filesystem:scrub status for tag:67f371f9-7189-4d90-ac49-b0d4a703adf5 - {'path': '/', 'tag': '67f371f9-7189-4d90-ac49-b0d4a703adf5', 'options': 'recursive,force'} 2024-09-12T01:01:36.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:36 smithi002 ceph-mon[31210]: pgmap v267: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:36.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:36 smithi002 ceph-mon[31210]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:36.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:36 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T01:01:36.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:36 smithi071 ceph-mon[35276]: pgmap v267: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:36.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:36 smithi071 ceph-mon[35276]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:36.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:36 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T01:01:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:36 smithi167 ceph-mon[35234]: pgmap v267: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:36 smithi167 ceph-mon[35234]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:01:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:36 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T01:01:38.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:38 smithi071 ceph-mon[35276]: pgmap v268: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:38.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:38 smithi002 ceph-mon[31210]: pgmap v268: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:39.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:38 smithi167 ceph-mon[35234]: pgmap v268: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:40.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:40 smithi071 ceph-mon[35276]: pgmap v269: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:40.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:40 smithi002 ceph-mon[31210]: pgmap v269: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:41.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:40 smithi167 ceph-mon[35234]: pgmap v269: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:42.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:42 smithi071 ceph-mon[35276]: pgmap v270: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:42 smithi002 ceph-mon[31210]: pgmap v270: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:43.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:42 smithi167 ceph-mon[35234]: pgmap v270: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:44.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:44 smithi071 ceph-mon[35276]: pgmap v271: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:44.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:44 smithi002 ceph-mon[31210]: pgmap v271: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:45.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:44 smithi167 ceph-mon[35234]: pgmap v271: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:46.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:46 smithi071 ceph-mon[35276]: pgmap v272: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:46.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:46 smithi002 ceph-mon[31210]: pgmap v272: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:47.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:46 smithi167 ceph-mon[35234]: pgmap v272: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:01:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:48 smithi071 ceph-mon[35276]: pgmap v273: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:48 smithi002 ceph-mon[31210]: pgmap v273: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:48 smithi167 ceph-mon[35234]: pgmap v273: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:01:50.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:50 smithi071 ceph-mon[35276]: pgmap v274: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:50.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:50 smithi002 ceph-mon[31210]: pgmap v274: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:51.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:50 smithi167 ceph-mon[35234]: pgmap v274: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:52.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:52 smithi071 ceph-mon[35276]: pgmap v275: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:01:52.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:52 smithi002 ceph-mon[31210]: pgmap v275: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:01:53.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:52 smithi167 ceph-mon[35234]: pgmap v275: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:01:54.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:54 smithi071 ceph-mon[35276]: pgmap v276: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:54.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:54 smithi002 ceph-mon[31210]: pgmap v276: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:55.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:54 smithi167 ceph-mon[35234]: pgmap v276: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:56.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:56 smithi071 ceph-mon[35276]: pgmap v277: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:56.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:56 smithi002 ceph-mon[31210]: pgmap v277: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:57.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:56 smithi167 ceph-mon[35234]: pgmap v277: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:01:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:01:58 smithi071 ceph-mon[35276]: pgmap v278: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:01:58.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:01:58 smithi002 ceph-mon[31210]: pgmap v278: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:01:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:01:58 smithi167 ceph-mon[35234]: pgmap v278: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:00.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:00 smithi071 ceph-mon[35276]: pgmap v279: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:00.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:00 smithi002 ceph-mon[31210]: pgmap v279: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:01.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:00 smithi167 ceph-mon[35234]: pgmap v279: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:02.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:02 smithi071 ceph-mon[35276]: pgmap v280: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:02:02.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:02 smithi002 ceph-mon[31210]: pgmap v280: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:02:03.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:02 smithi167 ceph-mon[35234]: pgmap v280: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-12T01:02:04.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:04 smithi071 ceph-mon[35276]: pgmap v281: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:02:04.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:04 smithi002 ceph-mon[31210]: pgmap v281: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:02:05.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:04 smithi167 ceph-mon[35234]: pgmap v281: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:02:06.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:02:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:06.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:06 smithi002 ceph-mon[31210]: pgmap v282: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:02:07.126 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:06 smithi167 ceph-mon[35234]: pgmap v282: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:02:07.126 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:06 smithi071 ceph-mon[35276]: pgmap v282: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-12T01:02:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.365+0000 7ff8b951e640 1 -- 172.21.15.2:0/2461075538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b4106f20 msgr2=0x7ff8b410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.365+0000 7ff8b951e640 1 --2- 172.21.15.2:0/2461075538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b4106f20 0x7ff8b410eaa0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009be0 tx=0x7ff8ac02a6d0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.369+0000 7ff8b951e640 1 -- 172.21.15.2:0/2461075538 shutdown_connections 2024-09-12T01:02:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.369+0000 7ff8b951e640 1 --2- 172.21.15.2:0/2461075538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b4106f20 0x7ff8b410eaa0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.369+0000 7ff8b951e640 1 --2- 172.21.15.2:0/2461075538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b41027a0 0x7ff8b41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.369+0000 7ff8b951e640 1 --2- 172.21.15.2:0/2461075538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b4101df0 0x7ff8b41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.369+0000 7ff8b951e640 1 -- 172.21.15.2:0/2461075538 >> 172.21.15.2:0/2461075538 conn(0x7ff8b40fd8b0 msgr2=0x7ff8b40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.370+0000 7ff8b951e640 1 -- 172.21.15.2:0/2461075538 shutdown_connections 2024-09-12T01:02:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.370+0000 7ff8b951e640 1 -- 172.21.15.2:0/2461075538 wait complete. 2024-09-12T01:02:07.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.371+0000 7ff8b951e640 1 Processor -- start 2024-09-12T01:02:07.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.373+0000 7ff8b951e640 1 -- start start 2024-09-12T01:02:07.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b951e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b4101df0 0x7ff8b4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b951e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b41027a0 0x7ff8b4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b951e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4106f20 0x7ff8b419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b951e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b4111f80 con 0x7ff8b41027a0 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b951e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b4111e00 con 0x7ff8b4101df0 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b951e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b4112100 con 0x7ff8b4106f20 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b41027a0 0x7ff8b4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b41027a0 0x7ff8b4198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44724/0 (socket says 172.21.15.2:44724) 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.374+0000 7ff8b27fc640 1 -- 172.21.15.2:0/699208012 learned_addr learned my addr 172.21.15.2:0/699208012 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.375+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4106f20 0x7ff8b419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.375+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b4101df0 0x7ff8b4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.375+0000 7ff8b27fc640 1 -- 172.21.15.2:0/699208012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4106f20 msgr2=0x7ff8b419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.375+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4106f20 0x7ff8b419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.375+0000 7ff8b27fc640 1 -- 172.21.15.2:0/699208012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b4101df0 msgr2=0x7ff8b4198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.375+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b4101df0 0x7ff8b4198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.375+0000 7ff8b27fc640 1 -- 172.21.15.2:0/699208012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b419d2d0 con 0x7ff8b41027a0 2024-09-12T01:02:07.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.376+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b41027a0 0x7ff8b4198860 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c920 tx=0x7ff8a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.379+0000 7ff89bfff640 1 -- 172.21.15.2:0/699208012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8007c70 con 0x7ff8b41027a0 2024-09-12T01:02:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.379+0000 7ff89bfff640 1 -- 172.21.15.2:0/699208012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8a8007e10 con 0x7ff8b41027a0 2024-09-12T01:02:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.379+0000 7ff89bfff640 1 -- 172.21.15.2:0/699208012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80189a0 con 0x7ff8b41027a0 2024-09-12T01:02:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.379+0000 7ff8b951e640 1 -- 172.21.15.2:0/699208012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b419d5c0 con 0x7ff8b41027a0 2024-09-12T01:02:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.379+0000 7ff8b951e640 1 -- 172.21.15.2:0/699208012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b41a4ea0 con 0x7ff8b41027a0 2024-09-12T01:02:07.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.383+0000 7ff8bb8f7740 1 Processor -- start 2024-09-12T01:02:07.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.384+0000 7ff8bb8f7740 1 -- start start 2024-09-12T01:02:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.384+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.384+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03ba570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.384+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.384+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fee03112e0 con 0x55fee03ab3c0 2024-09-12T01:02:07.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.384+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fee02b8ce0 con 0x55fee03baab0 2024-09-12T01:02:07.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.384+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fee030d2a0 con 0x55fee03abce0 2024-09-12T01:02:07.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.385+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03ba570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.385+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03ba570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:46804/0 (socket says 172.21.15.2:46804) 2024-09-12T01:02:07.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.385+0000 7ff8b2ffd640 1 -- 172.21.15.2:0/4140367439 learned_addr learned my addr 172.21.15.2:0/4140367439 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:07.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.385+0000 7ff89bfff640 1 -- 172.21.15.2:0/699208012 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7ff8a8018b40 con 0x7ff8b41027a0 2024-09-12T01:02:07.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.385+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.385+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.385+0000 7ff8b2ffd640 1 -- 172.21.15.2:0/4140367439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 msgr2=0x55fee03bcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:07.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.386+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03bcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.386+0000 7ff8b2ffd640 1 -- 172.21.15.2:0/4140367439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 msgr2=0x55fee03ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:07.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.386+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.386+0000 7ff8b2ffd640 1 -- 172.21.15.2:0/4140367439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee029d440 con 0x55fee03abce0 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.386+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.386+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03bcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.386+0000 7ff89bfff640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff89c0a2f00 0x7ff89c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.387+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03ba570 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4005fd0 tx=0x7ff8a400e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfa9ef665ca378eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.387+0000 7ff89bfff640 1 -- 172.21.15.2:0/699208012 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7ff8a80cf600 con 0x7ff8b41027a0 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.387+0000 7ff8997fa640 1 -- 172.21.15.2:0/4140367439 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4005220 con 0x55fee03abce0 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.387+0000 7ff8997fa640 1 -- 172.21.15.2:0/4140367439 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8a4004c80 con 0x55fee03abce0 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.387+0000 7ff8997fa640 1 -- 172.21.15.2:0/4140367439 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4010880 con 0x55fee03abce0 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.388+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4140367439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 msgr2=0x55fee03ba570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.388+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03ba570 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4005fd0 tx=0x7ff8a400e720 comp rx=0 tx=0).stop 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.388+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff89c0a2f00 0x7ff89c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.389+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4140367439 shutdown_connections 2024-09-12T01:02:07.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.389+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03bcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.389+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03ba570 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.389+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4140367439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.389+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4140367439 >> 172.21.15.2:0/4140367439 conn(0x55fee03a7a50 msgr2=0x55fee03a7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:07.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.389+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff89c0a2f00 0x7ff89c0a53c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006010 tx=0x7ff8ac030ce0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.391+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4140367439 shutdown_connections 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.391+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4140367439 wait complete. 2024-09-12T01:02:07.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.391+0000 7ff8bb8f7740 1 -- start start 2024-09-12T01:02:07.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.392+0000 7ff8bb8f7740 1 Processor -- start 2024-09-12T01:02:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.392+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.392+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.392+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.393+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fee03ae340 con 0x55fee03ab3c0 2024-09-12T01:02:07.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.393+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fee02cc050 con 0x55fee03baab0 2024-09-12T01:02:07.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.393+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fee03ae4c0 con 0x55fee03abce0 2024-09-12T01:02:07.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.393+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.393+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44734/0 (socket says 172.21.15.2:44734) 2024-09-12T01:02:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.393+0000 7ff8b2ffd640 1 -- 172.21.15.2:0/1565511922 learned_addr learned my addr 172.21.15.2:0/1565511922 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:07.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.393+0000 7ff8bb8f7740 10 client.0 _ll_register_callbacks cb 0x55fee030c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:07.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.394+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.394+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.394+0000 7ff8b2ffd640 1 -- 172.21.15.2:0/1565511922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 msgr2=0x55fee03b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:07.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.394+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.394+0000 7ff8b2ffd640 1 -- 172.21.15.2:0/1565511922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 msgr2=0x55fee03b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:07.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.394+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.394+0000 7ff8b2ffd640 1 -- 172.21.15.2:0/1565511922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee00823c0 con 0x55fee03ab3c0 2024-09-12T01:02:07.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.397+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03b3a10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4005e20 tx=0x7ff8a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1a2c20e2270cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:07.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.397+0000 7ff896ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:07.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.399+0000 7ff896ff5640 1 -- 172.21.15.2:0/1565511922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a402a060 con 0x55fee03ab3c0 2024-09-12T01:02:07.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.399+0000 7ff896ff5640 1 -- 172.21.15.2:0/1565511922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7ff8a4010500 con 0x55fee03ab3c0 2024-09-12T01:02:07.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.399+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1565511922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8a4004c80 con 0x55fee03ab3c0 2024-09-12T01:02:07.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.399+0000 7ff896ff5640 1 -- 172.21.15.2:0/1565511922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff8a4010700 con 0x55fee03ab3c0 2024-09-12T01:02:07.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.399+0000 7ff8bb8f7740 10 client.17493 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:07.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.400+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1565511922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fee03c4cf0 con 0x55fee03ab3c0 2024-09-12T01:02:07.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.401+0000 7ff896ff5640 1 -- 172.21.15.2:0/1565511922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8a4004c80 con 0x55fee03ab3c0 2024-09-12T01:02:07.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.401+0000 7ff896ff5640 1 -- 172.21.15.2:0/1565511922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff8a401a660 con 0x55fee03ab3c0 2024-09-12T01:02:07.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.403+0000 7ff8bb8f7740 10 client.17493 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:07.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.403+0000 7ff8bb8f7740 10 client.17493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:07.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.403+0000 7ff8bb8f7740 20 client.17493 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:07.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.403+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fee03c6040 0x55fee03c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.403+0000 7ff8bb8f7740 4 client.17493 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:07.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.403+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1565511922 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fee031e850 con 0x55fee03c6040 2024-09-12T01:02:07.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.404+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fee03c6040 0x55fee03c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.406+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fee03c6040 0x55fee03c8430 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7047be5bab27945d server_cookie=b3ef039051ecbf07 in_seq=0 out_seq=0 2024-09-12T01:02:07.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.406+0000 7ff896ff5640 10 client.17493 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:07.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.407+0000 7ff896ff5640 1 -- 172.21.15.2:0/1565511922 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fee031e850 con 0x55fee03c6040 2024-09-12T01:02:07.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.407+0000 7ff896ff5640 10 client.17493 handle_command_reply: tid=0 2024-09-12T01:02:07.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.408+0000 7ff8bb8f7740 1 client.17493 shutdown 2024-09-12T01:02:07.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.408+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1565511922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 msgr2=0x55fee03b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.408+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03b3a10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4005e20 tx=0x7ff8a40048f0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.409+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1565511922 shutdown_connections 2024-09-12T01:02:07.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.409+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fee03c6040 0x55fee03c8430 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.409+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03baab0 0x55fee03b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.409+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03abce0 0x55fee03b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.409+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1565511922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03b3a10 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.409+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1565511922 >> 172.21.15.2:0/1565511922 conn(0x55fee03a7a50 msgr2=0x55fee03ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:07.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.410+0000 7ff896ff5640 0 client.17493 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:07.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.410+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1565511922 shutdown_connections 2024-09-12T01:02:07.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.410+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1565511922 wait complete. 2024-09-12T01:02:07.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.411+0000 7ff8bb8f7740 20 client.17493 trim_cache size 0 max 16384 2024-09-12T01:02:07.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.446+0000 7ff8bb8f7740 1 Processor -- start 2024-09-12T01:02:07.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.447+0000 7ff8bb8f7740 1 -- start start 2024-09-12T01:02:07.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.447+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.447+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee03b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.447+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03baab0 0x55fee03b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.447+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41b6a90 con 0x55fee03ab3c0 2024-09-12T01:02:07.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.447+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41b4360 con 0x55fee03abce0 2024-09-12T01:02:07.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.447+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41b21d0 con 0x55fee03baab0 2024-09-12T01:02:07.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.448+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03baab0 0x55fee03b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.448+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03baab0 0x55fee03b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:46824/0 (socket says 172.21.15.2:46824) 2024-09-12T01:02:07.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.448+0000 7ff8b37fe640 1 -- 172.21.15.2:0/1432205174 learned_addr learned my addr 172.21.15.2:0/1432205174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:07.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.448+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/1432205174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.449+0000 7ff8b37fe640 1 -- 172.21.15.2:0/1432205174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 msgr2=0x55fee03b42e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:02:07.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.449+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/1432205174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee03b42e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.449+0000 7ff8b37fe640 1 -- 172.21.15.2:0/1432205174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 msgr2=0x55fee03a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:07.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.449+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/1432205174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03a6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.449+0000 7ff8b37fe640 1 -- 172.21.15.2:0/1432205174 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee03bcea0 con 0x55fee03baab0 2024-09-12T01:02:07.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.450+0000 7ff8b37fe640 1 --2- 172.21.15.2:0/1432205174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03baab0 0x55fee03b0c70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009330 tx=0x7ff8ac03f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=336418e613ad9c7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:07.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.450+0000 7ff898ff9640 1 -- 172.21.15.2:0/1432205174 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac04f070 con 0x55fee03baab0 2024-09-12T01:02:07.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.450+0000 7ff898ff9640 1 -- 172.21.15.2:0/1432205174 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac04bb30 con 0x55fee03baab0 2024-09-12T01:02:07.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.450+0000 7ff898ff9640 1 -- 172.21.15.2:0/1432205174 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac036040 con 0x55fee03baab0 2024-09-12T01:02:07.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.451+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1432205174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03baab0 msgr2=0x55fee03b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.451+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1432205174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03baab0 0x55fee03b0c70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009330 tx=0x7ff8ac03f000 comp rx=0 tx=0).stop 2024-09-12T01:02:07.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.452+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1432205174 shutdown_connections 2024-09-12T01:02:07.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.452+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1432205174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03baab0 0x55fee03b0c70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.452+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1432205174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee03b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.452+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/1432205174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03ab3c0 0x55fee03a6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.452+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1432205174 >> 172.21.15.2:0/1432205174 conn(0x55fee03a7a50 msgr2=0x55fee03ad760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:07.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.454+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1432205174 shutdown_connections 2024-09-12T01:02:07.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.454+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/1432205174 wait complete. 2024-09-12T01:02:07.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.455+0000 7ff8bb8f7740 1 -- start start 2024-09-12T01:02:07.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.455+0000 7ff8bb8f7740 1 Processor -- start 2024-09-12T01:02:07.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03ab3c0 0x55fee03c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee04293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8bb8f7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03baab0 0x55fee04298e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41b2820 con 0x55fee03baab0 2024-09-12T01:02:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41b3c90 con 0x55fee03abce0 2024-09-12T01:02:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8bb8f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41b2ef0 con 0x55fee03ab3c0 2024-09-12T01:02:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8bb8f7740 10 client.0 _ll_register_callbacks cb 0x7ff8a4014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8b27fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee04293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03ab3c0 0x55fee03c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8b27fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee04293a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:41062/0 (socket says 172.21.15.2:41062) 2024-09-12T01:02:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.456+0000 7ff8b27fc640 1 -- 172.21.15.2:0/4067034786 learned_addr learned my addr 172.21.15.2:0/4067034786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.458+0000 7ff8b27fc640 1 -- 172.21.15.2:0/4067034786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03ab3c0 msgr2=0x55fee03c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.458+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03ab3c0 0x55fee03c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.458+0000 7ff8b27fc640 1 -- 172.21.15.2:0/4067034786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03baab0 msgr2=0x55fee04298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.458+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03baab0 0x55fee04298e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.458+0000 7ff8b27fc640 1 -- 172.21.15.2:0/4067034786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee0429e70 con 0x55fee03abce0 2024-09-12T01:02:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.459+0000 7ff8b27fc640 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee04293a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8005ed0 tx=0x7ff8a8005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f27a5456b4174f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.459+0000 7ff896ff5640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T01:02:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.459+0000 7ff896ff5640 1 -- 172.21.15.2:0/4067034786 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a809fdd0 con 0x55fee03abce0 2024-09-12T01:02:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.459+0000 7ff896ff5640 1 -- 172.21.15.2:0/4067034786 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7ff8a801fda0 con 0x55fee03abce0 2024-09-12T01:02:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.459+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4067034786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ac04bb30 con 0x55fee03abce0 2024-09-12T01:02:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.460+0000 7ff896ff5640 1 -- 172.21.15.2:0/4067034786 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff8a80a4690 con 0x55fee03abce0 2024-09-12T01:02:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.460+0000 7ff8bb8f7740 10 client.26792 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.460+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4067034786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fee03c1380 con 0x55fee03abce0 2024-09-12T01:02:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.461+0000 7ff896ff5640 1 -- 172.21.15.2:0/4067034786 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac04bb30 con 0x55fee03abce0 2024-09-12T01:02:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.461+0000 7ff896ff5640 1 -- 172.21.15.2:0/4067034786 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff8a809bc80 con 0x55fee03abce0 2024-09-12T01:02:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.461+0000 7ff8bb8f7740 10 client.26792 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.461+0000 7ff8bb8f7740 10 client.26792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.461+0000 7ff8bb8f7740 20 client.26792 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.461+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fee0452e50 0x55fee0455270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.461+0000 7ff8bb8f7740 4 client.26792 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:02:07.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.461+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4067034786 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fee0318d60 con 0x55fee0452e50 2024-09-12T01:02:07.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.462+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fee0452e50 0x55fee0455270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:07.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.464+0000 7ff8b2ffd640 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fee0452e50 0x55fee0455270 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c73e9d68a30e1f server_cookie=e31ec43b6552a528 in_seq=0 out_seq=0 2024-09-12T01:02:07.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.464+0000 7ff896ff5640 10 client.26792 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:07.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.464+0000 7ff896ff5640 1 -- 172.21.15.2:0/4067034786 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fee0318d60 con 0x55fee0452e50 2024-09-12T01:02:07.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.464+0000 7ff896ff5640 10 client.26792 handle_command_reply: tid=0 2024-09-12T01:02:07.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.464+0000 7ff8bb8f7740 1 client.26792 shutdown 2024-09-12T01:02:07.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.465+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4067034786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 msgr2=0x55fee04293a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.465+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee04293a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8005ed0 tx=0x7ff8a8005e40 comp rx=0 tx=0).stop 2024-09-12T01:02:07.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.466+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4067034786 shutdown_connections 2024-09-12T01:02:07.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.466+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55fee0452e50 0x55fee0455270 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.466+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee03baab0 0x55fee04298e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.466+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fee03abce0 0x55fee04293a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.466+0000 7ff8bb8f7740 1 --2- 172.21.15.2:0/4067034786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fee03ab3c0 0x55fee03c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.466+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4067034786 >> 172.21.15.2:0/4067034786 conn(0x55fee03a7a50 msgr2=0x55fee03ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:07.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.466+0000 7ff896ff5640 0 client.26792 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:07.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.467+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4067034786 shutdown_connections 2024-09-12T01:02:07.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.467+0000 7ff8bb8f7740 1 -- 172.21.15.2:0/4067034786 wait complete. 2024-09-12T01:02:07.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.467+0000 7ff8bb8f7740 20 client.26792 trim_cache size 0 max 16384 2024-09-12T01:02:07.466 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:02:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T01:02:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T01:02:07.466 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:02:07.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 -- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff89c0a2f00 msgr2=0x7ff89c0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff89c0a2f00 0x7ff89c0a53c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006010 tx=0x7ff8ac030ce0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 -- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b41027a0 msgr2=0x7ff8b4198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:07.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b41027a0 0x7ff8b4198860 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c920 tx=0x7ff8a800cde0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 -- 172.21.15.2:0/699208012 shutdown_connections 2024-09-12T01:02:07.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff89c0a2f00 0x7ff89c0a53c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4106f20 0x7ff8b419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b41027a0 0x7ff8b4198860 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.468+0000 7ff8b951e640 1 --2- 172.21.15.2:0/699208012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b4101df0 0x7ff8b4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:07.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.469+0000 7ff8b951e640 1 -- 172.21.15.2:0/699208012 >> 172.21.15.2:0/699208012 conn(0x7ff8b40fd8b0 msgr2=0x7ff8b40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:07.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.470+0000 7ff8b951e640 1 -- 172.21.15.2:0/699208012 shutdown_connections 2024-09-12T01:02:07.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:07.470+0000 7ff8b951e640 1 -- 172.21.15.2:0/699208012 wait complete. 2024-09-12T01:02:07.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:07 smithi002 ceph-mon[31210]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:02:07.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:07 smithi071 ceph-mon[35276]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:02:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:07 smithi167 ceph-mon[35234]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:02:08.323 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:02:08.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:02:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:08.962 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:08 smithi002 ceph-mon[31210]: pgmap v284: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:02:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:08 smithi167 ceph-mon[35234]: pgmap v284: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 -- 172.21.15.2:0/2985189579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c100e20 msgr2=0x7ff95c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 --2- 172.21.15.2:0/2985189579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c100e20 0x7ff95c101200 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff958009900 tx=0x7ff95802a480 comp rx=0 tx=0).stop 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 -- 172.21.15.2:0/2985189579 shutdown_connections 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 --2- 172.21.15.2:0/2985189579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c102ef0 0x7ff95c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 --2- 172.21.15.2:0/2985189579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff95c102570 0x7ff95c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 --2- 172.21.15.2:0/2985189579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c100e20 0x7ff95c101200 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 -- 172.21.15.2:0/2985189579 >> 172.21.15.2:0/2985189579 conn(0x7ff95c0fc7d0 msgr2=0x7ff95c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 -- 172.21.15.2:0/2985189579 shutdown_connections 2024-09-12T01:02:09.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 -- 172.21.15.2:0/2985189579 wait complete. 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.046+0000 7ff96360b640 1 Processor -- start 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff96360b640 1 -- start start 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff96360b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c100e20 0x7ff95c103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff96360b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff95c102570 0x7ff95c103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff96360b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c102ef0 0x7ff95c1041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff96360b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c110f80 con 0x7ff95c102ef0 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff96360b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c110e00 con 0x7ff95c102570 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff96360b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c111100 con 0x7ff95c100e20 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c102ef0 0x7ff95c1041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:09.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c102ef0 0x7ff95c1041d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44778/0 (socket says 172.21.15.2:44778) 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 -- 172.21.15.2:0/2977989940 learned_addr learned my addr 172.21.15.2:0/2977989940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff960ba6640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff95c102570 0x7ff95c103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff9613a7640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c100e20 0x7ff95c103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 -- 172.21.15.2:0/2977989940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c100e20 msgr2=0x7ff95c103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c100e20 0x7ff95c103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 -- 172.21.15.2:0/2977989940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff95c102570 msgr2=0x7ff95c103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff95c102570 0x7ff95c103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 -- 172.21.15.2:0/2977989940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95c1a69a0 con 0x7ff95c102ef0 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff9613a7640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c100e20 0x7ff95c103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.047+0000 7ff961ba8640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c102ef0 0x7ff95c1041d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff954009fd0 tx=0x7ff95400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.048+0000 7ff9527fc640 1 -- 172.21.15.2:0/2977989940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954017070 con 0x7ff95c102ef0 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.048+0000 7ff9527fc640 1 -- 172.21.15.2:0/2977989940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff954003e50 con 0x7ff95c102ef0 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.048+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95c1a6c90 con 0x7ff95c102ef0 2024-09-12T01:02:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.048+0000 7ff9527fc640 1 -- 172.21.15.2:0/2977989940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540106c0 con 0x7ff95c102ef0 2024-09-12T01:02:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.048+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95c1a7180 con 0x7ff95c102ef0 2024-09-12T01:02:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.049+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff95c101200 con 0x7ff95c102ef0 2024-09-12T01:02:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.050+0000 7ff9527fc640 1 -- 172.21.15.2:0/2977989940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7ff954003970 con 0x7ff95c102ef0 2024-09-12T01:02:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.051+0000 7ff9527fc640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff9480a2cf0 0x7ff9480a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.051+0000 7ff9613a7640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff9480a2cf0 0x7ff9480a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.051+0000 7ff9527fc640 1 -- 172.21.15.2:0/2977989940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7ff9540cf330 con 0x7ff95c102ef0 2024-09-12T01:02:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.051+0000 7ff9613a7640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff9480a2cf0 0x7ff9480a51b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff958000c00 tx=0x7ff958004100 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.056+0000 7ff9527fc640 1 -- 172.21.15.2:0/2977989940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff95409be50 con 0x7ff95c102ef0 2024-09-12T01:02:09.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:08 smithi071 ceph-mon[35276]: pgmap v284: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:02:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.270+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff95c1a73b0 con 0x7ff95c102ef0 2024-09-12T01:02:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.270+0000 7ff9527fc640 1 -- 172.21.15.2:0/2977989940 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11899 (secure 0 0 0) 0x7ff95409b750 con 0x7ff95c102ef0 2024-09-12T01:02:09.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:02:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":35,"btime":"2024-09-12T01:01:35:630451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T01:01:35.219926+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T01:02:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 35 2024-09-12T01:02:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff9480a2cf0 msgr2=0x7ff9480a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff9480a2cf0 0x7ff9480a51b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff958000c00 tx=0x7ff958004100 comp rx=0 tx=0).stop 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c102ef0 msgr2=0x7ff95c1041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c102ef0 0x7ff95c1041d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff954009fd0 tx=0x7ff95400b260 comp rx=0 tx=0).stop 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 shutdown_connections 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ff9480a2cf0 0x7ff9480a51b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff95c102ef0 0x7ff95c1041d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff95c102570 0x7ff95c103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 --2- 172.21.15.2:0/2977989940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c100e20 0x7ff95c103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 >> 172.21.15.2:0/2977989940 conn(0x7ff95c0fc7d0 msgr2=0x7ff95c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 shutdown_connections 2024-09-12T01:02:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:09.273+0000 7ff96360b640 1 -- 172.21.15.2:0/2977989940 wait complete. 2024-09-12T01:02:09.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:09 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2977989940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:02:09.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:02:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:09 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2977989940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:02:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:10.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:09 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2977989940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.587+0000 7fd770e0a640 1 -- 172.21.15.2:0/1404949767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 msgr2=0x7fd76c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1404949767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 0x7fd76c101200 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009900 tx=0x7fd75c02a480 comp rx=0 tx=0).stop 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 -- 172.21.15.2:0/1404949767 shutdown_connections 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1404949767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd76c102ef0 0x7fd76c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1404949767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd76c102570 0x7fd76c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1404949767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 0x7fd76c101200 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 -- 172.21.15.2:0/1404949767 >> 172.21.15.2:0/1404949767 conn(0x7fd76c0fc7d0 msgr2=0x7fd76c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 -- 172.21.15.2:0/1404949767 shutdown_connections 2024-09-12T01:02:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 -- 172.21.15.2:0/1404949767 wait complete. 2024-09-12T01:02:10.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.588+0000 7fd770e0a640 1 Processor -- start 2024-09-12T01:02:10.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd770e0a640 1 -- start start 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd770e0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 0x7fd76c1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd770e0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd76c102570 0x7fd76c199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd770e0a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd76c102ef0 0x7fd76c1a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd770e0a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c111020 con 0x7fd76c100e20 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd770e0a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c110ea0 con 0x7fd76c102ef0 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd770e0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1111a0 con 0x7fd76c102570 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 0x7fd76c1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 0x7fd76c1994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44802/0 (socket says 172.21.15.2:44802) 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76a59c640 1 -- 172.21.15.2:0/1007511547 learned_addr learned my addr 172.21.15.2:0/1007511547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd76c102ef0 0x7fd76c1a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd763fff640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd76c102570 0x7fd76c199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76a59c640 1 -- 172.21.15.2:0/1007511547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd76c102570 msgr2=0x7fd76c199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76a59c640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd76c102570 0x7fd76c199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76a59c640 1 -- 172.21.15.2:0/1007511547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd76c102ef0 msgr2=0x7fd76c1a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76a59c640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd76c102ef0 0x7fd76c1a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76a59c640 1 -- 172.21.15.2:0/1007511547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c1a4ab0 con 0x7fd76c100e20 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.589+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd76c102ef0 0x7fd76c1a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.590+0000 7fd76a59c640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 0x7fd76c1994f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd75c006010 tx=0x7fd75c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.590+0000 7fd7637fe640 1 -- 172.21.15.2:0/1007511547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c03f070 con 0x7fd76c100e20 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.590+0000 7fd7637fe640 1 -- 172.21.15.2:0/1007511547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd75c031e30 con 0x7fd76c100e20 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.590+0000 7fd770e0a640 1 -- 172.21.15.2:0/1007511547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c1a4c80 con 0x7fd76c100e20 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.590+0000 7fd7637fe640 1 -- 172.21.15.2:0/1007511547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c035030 con 0x7fd76c100e20 2024-09-12T01:02:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.590+0000 7fd770e0a640 1 -- 172.21.15.2:0/1007511547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c1a5130 con 0x7fd76c100e20 2024-09-12T01:02:10.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.592+0000 7fd7637fe640 1 -- 172.21.15.2:0/1007511547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fd75c042070 con 0x7fd76c100e20 2024-09-12T01:02:10.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.592+0000 7fd7731e3740 1 Processor -- start 2024-09-12T01:02:10.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7731e3740 1 -- start start 2024-09-12T01:02:10.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b444090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b4445d0 0x559e5b444a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b453780 0x559e5b455b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7731e3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559e5b3aa2f0 con 0x559e5b453780 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7731e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559e5b351cf0 con 0x559e5b4445d0 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7731e3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559e5b3a62b0 con 0x559e5b445b40 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7637fe640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7580a2d70 0x7fd7580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd763fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b453780 0x559e5b455b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd763fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b453780 0x559e5b455b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44804/0 (socket says 172.21.15.2:44804) 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd763fff640 1 -- 172.21.15.2:0/3588422365 learned_addr learned my addr 172.21.15.2:0/3588422365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7580a2d70 0x7fd7580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd7637fe640 1 -- 172.21.15.2:0/1007511547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7fd75c0efe20 con 0x7fd76c100e20 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd76a59c640 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b4445d0 0x559e5b444a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.593+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b444090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd763fff640 1 -- 172.21.15.2:0/3588422365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 msgr2=0x559e5b444090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd763fff640 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b444090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd763fff640 1 -- 172.21.15.2:0/3588422365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b4445d0 msgr2=0x559e5b444a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd763fff640 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b4445d0 0x559e5b444a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd763fff640 1 -- 172.21.15.2:0/3588422365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e5b3363a0 con 0x559e5b453780 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd76a59c640 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b4445d0 0x559e5b444a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7580a2d70 0x7fd7580a5230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd764009440 tx=0x7fd7640093b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd763fff640 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b453780 0x559e5b455b70 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd75400b7f0 tx=0x7fd75400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c58a38c8d529807 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd760ff9640 1 -- 172.21.15.2:0/3588422365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75400d950 con 0x559e5b453780 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd760ff9640 1 -- 172.21.15.2:0/3588422365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754018070 con 0x559e5b453780 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.594+0000 7fd760ff9640 1 -- 172.21.15.2:0/3588422365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7540123e0 con 0x559e5b453780 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 -- 172.21.15.2:0/3588422365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b453780 msgr2=0x559e5b455b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b453780 0x559e5b455b70 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd75400b7f0 tx=0x7fd75400bcb0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 -- 172.21.15.2:0/3588422365 shutdown_connections 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b453780 0x559e5b455b70 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b4445d0 0x559e5b444a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3588422365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b444090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 -- 172.21.15.2:0/3588422365 >> 172.21.15.2:0/3588422365 conn(0x559e5b40d310 msgr2=0x559e5b440c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 -- 172.21.15.2:0/3588422365 shutdown_connections 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 -- 172.21.15.2:0/3588422365 wait complete. 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 -- start start 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.595+0000 7fd7731e3740 1 Processor -- start 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b453080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b450380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b4508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd7731e3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559e5b456480 con 0x559e5b4445d0 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd7731e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559e5b365060 con 0x559e5b453780 2024-09-12T01:02:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd7731e3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559e5b456600 con 0x559e5b445b40 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd7731e3740 10 client.0 _ll_register_callbacks cb 0x559e5b0b88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b453080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b453080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44806/0 (socket says 172.21.15.2:44806) 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 -- 172.21.15.2:0/1732922362 learned_addr learned my addr 172.21.15.2:0/1732922362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd763fff640 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b450380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b4508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 -- 172.21.15.2:0/1732922362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 msgr2=0x559e5b450380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b450380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 -- 172.21.15.2:0/1732922362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 msgr2=0x559e5b4508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b4508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 -- 172.21.15.2:0/1732922362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e5b11b3c0 con 0x559e5b4445d0 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd76a59c640 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b453080 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0bbf40 tx=0x7fd75c034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91f95652c96eaec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd751ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd751ffb640 1 -- 172.21.15.2:0/1732922362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c049040 con 0x559e5b4445d0 2024-09-12T01:02:10.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd751ffb640 1 -- 172.21.15.2:0/1732922362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7fd75c03b5f0 con 0x559e5b4445d0 2024-09-12T01:02:10.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.596+0000 7fd7731e3740 1 -- 172.21.15.2:0/1732922362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd754018070 con 0x559e5b4445d0 2024-09-12T01:02:10.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd751ffb640 1 -- 172.21.15.2:0/1732922362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd75c0bc940 con 0x559e5b4445d0 2024-09-12T01:02:10.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd7731e3740 10 client.17514 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:10.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd7731e3740 1 -- 172.21.15.2:0/1732922362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559e5b456480 con 0x559e5b4445d0 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd751ffb640 1 -- 172.21.15.2:0/1732922362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754018070 con 0x559e5b4445d0 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd751ffb640 1 -- 172.21.15.2:0/1732922362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd75c0ed6f0 con 0x559e5b4445d0 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd7731e3740 10 client.17514 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd7731e3740 10 client.17514 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd7731e3740 20 client.17514 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd7731e3740 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x559e5b463260 0x559e5b4656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd7731e3740 4 client.17514 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd7731e3740 1 -- 172.21.15.2:0/1732922362 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e5b3b7860 con 0x559e5b463260 2024-09-12T01:02:10.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.597+0000 7fd763fff640 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x559e5b463260 0x559e5b4656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.598+0000 7fd763fff640 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x559e5b463260 0x559e5b4656f0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=771a3993590ce18d server_cookie=ccc0385c8c6b02c0 in_seq=0 out_seq=0 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.598+0000 7fd751ffb640 10 client.17514 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.598+0000 7fd751ffb640 1 -- 172.21.15.2:0/1732922362 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e5b3b7860 con 0x559e5b463260 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.598+0000 7fd751ffb640 10 client.17514 handle_command_reply: tid=0 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 client.17514 shutdown 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 -- 172.21.15.2:0/1732922362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 msgr2=0x559e5b453080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b453080 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0bbf40 tx=0x7fd75c034000 comp rx=0 tx=0).stop 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 -- 172.21.15.2:0/1732922362 shutdown_connections 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x559e5b463260 0x559e5b4656f0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b4508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b450380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd751ffb640 0 client.17514 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:02:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 --2- 172.21.15.2:0/1732922362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b453080 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 -- 172.21.15.2:0/1732922362 >> 172.21.15.2:0/1732922362 conn(0x559e5b40d310 msgr2=0x559e5b446960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 -- 172.21.15.2:0/1732922362 shutdown_connections 2024-09-12T01:02:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 1 -- 172.21.15.2:0/1732922362 wait complete. 2024-09-12T01:02:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.599+0000 7fd7731e3740 20 client.17514 trim_cache size 0 max 16384 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd7731e3740 1 Processor -- start 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd7731e3740 1 -- start start 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b4445d0 0x559e5b45f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b445b40 0x559e5b46afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b46b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd7731e3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1ae290 con 0x559e5b445b40 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd7731e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1abb60 con 0x559e5b453780 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd7731e3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1a99d0 con 0x559e5b4445d0 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd763fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b445b40 0x559e5b46afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd763fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b445b40 0x559e5b46afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44814/0 (socket says 172.21.15.2:44814) 2024-09-12T01:02:10.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd763fff640 1 -- 172.21.15.2:0/834835892 learned_addr learned my addr 172.21.15.2:0/834835892 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b46b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd76a59c640 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b4445d0 0x559e5b45f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd763fff640 1 -- 172.21.15.2:0/834835892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b4445d0 msgr2=0x559e5b45f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd763fff640 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b4445d0 0x559e5b45f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd763fff640 1 -- 172.21.15.2:0/834835892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 msgr2=0x559e5b46b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd763fff640 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b46b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd763fff640 1 -- 172.21.15.2:0/834835892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e5b450c50 con 0x559e5b445b40 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.612+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b46b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd763fff640 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b445b40 0x559e5b46afd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd754004810 tx=0x7fd754013ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1ed692f2b90814 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd753fff640 1 -- 172.21.15.2:0/834835892 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754029070 con 0x559e5b445b40 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd753fff640 1 -- 172.21.15.2:0/834835892 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754018040 con 0x559e5b445b40 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd753fff640 1 -- 172.21.15.2:0/834835892 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754024ae0 con 0x559e5b445b40 2024-09-12T01:02:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd7731e3740 1 -- 172.21.15.2:0/834835892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b445b40 msgr2=0x559e5b46afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd7731e3740 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b445b40 0x559e5b46afd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd754004810 tx=0x7fd754013ab0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd7731e3740 1 -- 172.21.15.2:0/834835892 shutdown_connections 2024-09-12T01:02:10.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd7731e3740 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b46b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd7731e3740 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b445b40 0x559e5b46afd0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd7731e3740 1 --2- 172.21.15.2:0/834835892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b4445d0 0x559e5b45f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd7731e3740 1 -- 172.21.15.2:0/834835892 >> 172.21.15.2:0/834835892 conn(0x559e5b40d310 msgr2=0x559e5b44b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:10.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.613+0000 7fd7731e3740 1 -- 172.21.15.2:0/834835892 shutdown_connections 2024-09-12T01:02:10.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 -- 172.21.15.2:0/834835892 wait complete. 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 -- start start 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 Processor -- start 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b45b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b45bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b458860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1aa020 con 0x559e5b4445d0 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1ab490 con 0x559e5b453780 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1aa6f0 con 0x559e5b445b40 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd7731e3740 10 client.0 _ll_register_callbacks cb 0x7fd75c03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd76a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b45b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd76a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b45b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44826/0 (socket says 172.21.15.2:44826) 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd76a59c640 1 -- 172.21.15.2:0/3909618813 learned_addr learned my addr 172.21.15.2:0/3909618813 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:10.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.614+0000 7fd76ad9d640 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b458860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd763fff640 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b45bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd76a59c640 1 -- 172.21.15.2:0/3909618813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 msgr2=0x559e5b45bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd76a59c640 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b45bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd76a59c640 1 -- 172.21.15.2:0/3909618813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 msgr2=0x559e5b458860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd76a59c640 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b458860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd76a59c640 1 -- 172.21.15.2:0/3909618813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e5b458dd0 con 0x559e5b4445d0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd76a59c640 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b45b890 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd75c03b9d0 tx=0x7fd75c03b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ea63fde4eda5b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd751ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd751ffb640 1 -- 172.21.15.2:0/3909618813 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c049070 con 0x559e5b4445d0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd751ffb640 1 -- 172.21.15.2:0/3909618813 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7fd75c09f020 con 0x559e5b4445d0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd7731e3740 1 -- 172.21.15.2:0/3909618813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd754018040 con 0x559e5b4445d0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd751ffb640 1 -- 172.21.15.2:0/3909618813 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd75c0bbd80 con 0x559e5b4445d0 2024-09-12T01:02:10.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd7731e3740 10 client.17520 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd7731e3740 1 -- 172.21.15.2:0/3909618813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559e5b4ce780 con 0x559e5b4445d0 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd751ffb640 1 -- 172.21.15.2:0/3909618813 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754018040 con 0x559e5b4445d0 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.615+0000 7fd751ffb640 1 -- 172.21.15.2:0/3909618813 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd75c0edbc0 con 0x559e5b4445d0 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 10 client.17520 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 10 client.17520 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 20 client.17520 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x559e5b4cecd0 0x559e5b4d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 4 client.17520 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 1 -- 172.21.15.2:0/3909618813 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e5b3b1d70 con 0x559e5b4cecd0 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd763fff640 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x559e5b4cecd0 0x559e5b4d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd763fff640 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x559e5b4cecd0 0x559e5b4d10f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ab982b3a78347b1 server_cookie=ad39c638a324f4b5 in_seq=0 out_seq=0 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd751ffb640 10 client.17520 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:02:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd751ffb640 1 -- 172.21.15.2:0/3909618813 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e5b3b1d70 con 0x559e5b4cecd0 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd751ffb640 10 client.17520 handle_command_reply: tid=0 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 1 client.17520 shutdown 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 1 -- 172.21.15.2:0/3909618813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 msgr2=0x559e5b45b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b45b890 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd75c03b9d0 tx=0x7fd75c03b820 comp rx=0 tx=0).stop 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 1 -- 172.21.15.2:0/3909618813 shutdown_connections 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.616+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x559e5b4cecd0 0x559e5b4d10f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e5b453780 0x559e5b458860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e5b445b40 0x559e5b45bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd751ffb640 0 client.17520 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd7731e3740 1 --2- 172.21.15.2:0/3909618813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e5b4445d0 0x559e5b45b890 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd7731e3740 1 -- 172.21.15.2:0/3909618813 >> 172.21.15.2:0/3909618813 conn(0x559e5b40d310 msgr2=0x559e5b446110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd7731e3740 1 -- 172.21.15.2:0/3909618813 shutdown_connections 2024-09-12T01:02:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd7731e3740 1 -- 172.21.15.2:0/3909618813 wait complete. 2024-09-12T01:02:10.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd7731e3740 20 client.17520 trim_cache size 0 max 16384 2024-09-12T01:02:10.622 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:02:10.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 -- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7580a2d70 msgr2=0x7fd7580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7580a2d70 0x7fd7580a5230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd764009440 tx=0x7fd7640093b0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 -- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 msgr2=0x7fd76c1994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 0x7fd76c1994f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd75c006010 tx=0x7fd75c003c80 comp rx=0 tx=0).stop 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 -- 172.21.15.2:0/1007511547 shutdown_connections 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd7580a2d70 0x7fd7580a5230 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd76c102ef0 0x7fd76c1a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd76c102570 0x7fd76c199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 --2- 172.21.15.2:0/1007511547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c100e20 0x7fd76c1994f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 -- 172.21.15.2:0/1007511547 >> 172.21.15.2:0/1007511547 conn(0x7fd76c0fc7d0 msgr2=0x7fd76c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 -- 172.21.15.2:0/1007511547 shutdown_connections 2024-09-12T01:02:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:10.617+0000 7fd770e0a640 1 -- 172.21.15.2:0/1007511547 wait complete. 2024-09-12T01:02:10.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:10 smithi002 ceph-mon[31210]: pgmap v285: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:02:11.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:10 smithi167 ceph-mon[35234]: pgmap v285: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:02:11.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:10 smithi071 ceph-mon[35276]: pgmap v285: 97 pgs: 97 active+clean; 245 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-12T01:02:11.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:02:11.619 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:11.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:11 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:02:11.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:11 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:02:11.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:11 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:02:11.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:11 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:02:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:11 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:02:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:11 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:02:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:11 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:02:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:11 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:02:12.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:11 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:02:12.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:11 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:02:12.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:11 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:02:12.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:11 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.207+0000 7f255cea7640 1 -- 172.21.15.2:0/1049872115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558100a80 msgr2=0x7f2558100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.207+0000 7f255cea7640 1 --2- 172.21.15.2:0/1049872115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558100a80 0x7f2558100ee0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f254c009930 tx=0x7f254c02a420 comp rx=0 tx=0).stop 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 -- 172.21.15.2:0/1049872115 shutdown_connections 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 --2- 172.21.15.2:0/1049872115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558101420 0x7f255810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 --2- 172.21.15.2:0/1049872115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558100a80 0x7f2558100ee0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 --2- 172.21.15.2:0/1049872115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558106a80 0x7f2558106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 -- 172.21.15.2:0/1049872115 >> 172.21.15.2:0/1049872115 conn(0x7f25580fc7a0 msgr2=0x7f25580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 -- 172.21.15.2:0/1049872115 shutdown_connections 2024-09-12T01:02:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 -- 172.21.15.2:0/1049872115 wait complete. 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 Processor -- start 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.208+0000 7f255cea7640 1 -- start start 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f255cea7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100a80 0x7f25581973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f255cea7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558101420 0x7f2558197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f255cea7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558106a80 0x7f255819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f255cea7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2558110ec0 con 0x7f2558101420 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f255cea7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2558110d40 con 0x7f2558106a80 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f255cea7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2558111040 con 0x7f2558100a80 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558101420 0x7f2558197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558101420 0x7f2558197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44858/0 (socket says 172.21.15.2:44858) 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 -- 172.21.15.2:0/3198124480 learned_addr learned my addr 172.21.15.2:0/3198124480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2556d9d640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558106a80 0x7f255819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f255659c640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100a80 0x7f25581973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 -- 172.21.15.2:0/3198124480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100a80 msgr2=0x7f25581973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100a80 0x7f25581973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 -- 172.21.15.2:0/3198124480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558106a80 msgr2=0x7f255819bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558106a80 0x7f255819bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 -- 172.21.15.2:0/3198124480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255819c390 con 0x7f2558101420 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.209+0000 7f2555d9b640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558101420 0x7f2558197920 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f254c009230 tx=0x7f254c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.210+0000 7f25477fe640 1 -- 172.21.15.2:0/3198124480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c03f030 con 0x7f2558101420 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.210+0000 7f25477fe640 1 -- 172.21.15.2:0/3198124480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f254c003ad0 con 0x7f2558101420 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.210+0000 7f255cea7640 1 -- 172.21.15.2:0/3198124480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255819c620 con 0x7f2558101420 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.210+0000 7f25477fe640 1 -- 172.21.15.2:0/3198124480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c035070 con 0x7f2558101420 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.210+0000 7f255cea7640 1 -- 172.21.15.2:0/3198124480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25581a3f60 con 0x7f2558101420 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.212+0000 7f25477fe640 1 -- 172.21.15.2:0/3198124480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f254c042030 con 0x7f2558101420 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.212+0000 7f255f280740 1 Processor -- start 2024-09-12T01:02:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.212+0000 7f255f280740 1 -- start start 2024-09-12T01:02:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f255f280740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a94997090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f255f280740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 0x557a94997a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f255f280740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949a4580 0x557a949a6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f255f280740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a948fd2f0 con 0x557a94998b40 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f255f280740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a948a4cf0 con 0x557a949a4580 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f255f280740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557a948f92b0 con 0x557a949975d0 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a94997090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a94997090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44860/0 (socket says 172.21.15.2:44860) 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 -- 172.21.15.2:0/560626848 learned_addr learned my addr 172.21.15.2:0/560626848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f255659c640 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 0x557a94997a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f25477fe640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25400a2cf0 0x7f25400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2555d9b640 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949a4580 0x557a949a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 -- 172.21.15.2:0/560626848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 msgr2=0x557a94997a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 0x557a94997a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 -- 172.21.15.2:0/560626848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949a4580 msgr2=0x557a949a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949a4580 0x557a949a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 -- 172.21.15.2:0/560626848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a948893a0 con 0x557a94998b40 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2555d9b640 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949a4580 0x557a949a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f2556d9d640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25400a2cf0 0x7f25400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.213+0000 7f25477fe640 1 -- 172.21.15.2:0/3198124480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7f254c0ef930 con 0x7f2558101420 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.214+0000 7f2556d9d640 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a94997090 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f255000a5d0 tx=0x7f255000aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92b59b315714175 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.214+0000 7f2544ff9640 1 -- 172.21.15.2:0/560626848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255001a040 con 0x557a94998b40 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.214+0000 7f2544ff9640 1 -- 172.21.15.2:0/560626848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2550021ba0 con 0x557a94998b40 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.214+0000 7f2544ff9640 1 -- 172.21.15.2:0/560626848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255001f350 con 0x557a94998b40 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.214+0000 7f255f280740 1 -- 172.21.15.2:0/560626848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 msgr2=0x557a94997090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.214+0000 7f255f280740 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a94997090 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f255000a5d0 tx=0x7f255000aa90 comp rx=0 tx=0).stop 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.214+0000 7f2556d9d640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25400a2cf0 0x7f25400a51b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2550020000 tx=0x7f2550021000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.214+0000 7f255f280740 1 -- 172.21.15.2:0/560626848 shutdown_connections 2024-09-12T01:02:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949a4580 0x557a949a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 0x557a94997a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 --2- 172.21.15.2:0/560626848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a94997090 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 -- 172.21.15.2:0/560626848 >> 172.21.15.2:0/560626848 conn(0x557a94960310 msgr2=0x557a94993c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 -- 172.21.15.2:0/560626848 shutdown_connections 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 -- 172.21.15.2:0/560626848 wait complete. 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 -- start start 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 Processor -- start 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 0x557a949a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949a4580 0x557a949a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a949a7280 con 0x557a949a4580 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a948b8060 con 0x557a94998b40 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557a949a7400 con 0x557a949975d0 2024-09-12T01:02:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f255f280740 10 client.0 _ll_register_callbacks cb 0x557a9460b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f2556d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949a4580 0x557a949a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f2556d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949a4580 0x557a949a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44862/0 (socket says 172.21.15.2:44862) 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.215+0000 7f2556d9d640 1 -- 172.21.15.2:0/3298001051 learned_addr learned my addr 172.21.15.2:0/3298001051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f255659c640 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 0x557a949a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f2555d9b640 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f2556d9d640 1 -- 172.21.15.2:0/3298001051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 msgr2=0x557a949a3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f2556d9d640 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 0x557a949a3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f2556d9d640 1 -- 172.21.15.2:0/3298001051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 msgr2=0x557a949a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f2556d9d640 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f2556d9d640 1 -- 172.21.15.2:0/3298001051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9466e3c0 con 0x557a949a4580 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f2555d9b640 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f2556d9d640 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949a4580 0x557a949a1850 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2550009c00 tx=0x7f2550009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179877c5d75d4b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f253dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f253dffb640 1 -- 172.21.15.2:0/3298001051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255002d070 con 0x557a949a4580 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f253dffb640 1 -- 172.21.15.2:0/3298001051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7f2550021920 con 0x557a949a4580 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f255f280740 1 -- 172.21.15.2:0/3298001051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2550021ba0 con 0x557a949a4580 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f253dffb640 1 -- 172.21.15.2:0/3298001051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2550039050 con 0x557a949a4580 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f255f280740 10 client.17532 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.216+0000 7f255f280740 1 -- 172.21.15.2:0/3298001051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557a949b2d50 con 0x557a949a4580 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f253dffb640 1 -- 172.21.15.2:0/3298001051 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2550021ba0 con 0x557a949a4580 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f253dffb640 1 -- 172.21.15.2:0/3298001051 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2550028040 con 0x557a949a4580 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f255f280740 10 client.17532 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f255f280740 10 client.17532 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f255f280740 20 client.17532 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f255f280740 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x557a949b4210 0x557a949b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f255f280740 4 client.17532 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f255f280740 1 -- 172.21.15.2:0/3298001051 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a9490a860 con 0x557a949b4210 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.217+0000 7f255659c640 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x557a949b4210 0x557a949b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255659c640 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x557a949b4210 0x557a949b6600 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f9286643b20b900 server_cookie=26a8ba470418d87a in_seq=0 out_seq=0 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f253dffb640 10 client.17532 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f253dffb640 1 -- 172.21.15.2:0/3298001051 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a9490a860 con 0x557a949b4210 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f253dffb640 10 client.17532 handle_command_reply: tid=0 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 client.17532 shutdown 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 -- 172.21.15.2:0/3298001051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949a4580 msgr2=0x557a949a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949a4580 0x557a949a1850 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2550009c00 tx=0x7f2550009970 comp rx=0 tx=0).stop 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 -- 172.21.15.2:0/3298001051 shutdown_connections 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x557a949b4210 0x557a949b6600 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949a4580 0x557a949a1850 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 --2- 172.21.15.2:0/3298001051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949975d0 0x557a949a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 -- 172.21.15.2:0/3298001051 >> 172.21.15.2:0/3298001051 conn(0x557a94960310 msgr2=0x557a94999960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f253dffb640 0 client.17532 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:02:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 -- 172.21.15.2:0/3298001051 shutdown_connections 2024-09-12T01:02:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.218+0000 7f255f280740 1 -- 172.21.15.2:0/3298001051 wait complete. 2024-09-12T01:02:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.219+0000 7f255f280740 20 client.17532 trim_cache size 0 max 16384 2024-09-12T01:02:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255f280740 1 Processor -- start 2024-09-12T01:02:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255f280740 1 -- start start 2024-09-12T01:02:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255f280740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949975d0 0x557a949b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255f280740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a949a0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255f280740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 0x557a949bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255f280740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25581ae180 con 0x557a94998b40 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255f280740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25581aba50 con 0x557a949975d0 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255f280740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25581a98c0 con 0x557a949a4580 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a949a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a949a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44866/0 (socket says 172.21.15.2:44866) 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 -- 172.21.15.2:0/872594289 learned_addr learned my addr 172.21.15.2:0/872594289 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f255659c640 1 --2- 172.21.15.2:0/872594289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949975d0 0x557a949b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 -- 172.21.15.2:0/872594289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 msgr2=0x557a949bbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 --2- 172.21.15.2:0/872594289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 0x557a949bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 -- 172.21.15.2:0/872594289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949975d0 msgr2=0x557a949b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 --2- 172.21.15.2:0/872594289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949975d0 0x557a949b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 -- 172.21.15.2:0/872594289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a949972d0 con 0x557a94998b40 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.232+0000 7f2555d9b640 1 --2- 172.21.15.2:0/872594289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a949a0220 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f254c009a50 tx=0x7f254c0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6363994f323f6c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f253ffff640 1 -- 172.21.15.2:0/872594289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c049040 con 0x557a94998b40 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f253ffff640 1 -- 172.21.15.2:0/872594289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f254c0c4a20 con 0x557a94998b40 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f253ffff640 1 -- 172.21.15.2:0/872594289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c0bc0c0 con 0x557a94998b40 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 -- 172.21.15.2:0/872594289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 msgr2=0x557a949a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 --2- 172.21.15.2:0/872594289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a949a0220 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f254c009a50 tx=0x7f254c0045f0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 -- 172.21.15.2:0/872594289 shutdown_connections 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 --2- 172.21.15.2:0/872594289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 0x557a949bbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 --2- 172.21.15.2:0/872594289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a94998b40 0x557a949a0220 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 --2- 172.21.15.2:0/872594289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a949975d0 0x557a949b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 -- 172.21.15.2:0/872594289 >> 172.21.15.2:0/872594289 conn(0x557a94960310 msgr2=0x557a9499fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 -- 172.21.15.2:0/872594289 shutdown_connections 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.233+0000 7f255f280740 1 -- 172.21.15.2:0/872594289 wait complete. 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 1 -- start start 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 1 Processor -- start 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949975d0 0x557a949acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 0x557a949a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25581a9f10 con 0x557a949975d0 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25581ab380 con 0x557a94998b40 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25581aa5e0 con 0x557a949a4580 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255f280740 10 client.0 _ll_register_callbacks cb 0x7f2548004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949975d0 0x557a949acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949975d0 0x557a949acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44876/0 (socket says 172.21.15.2:44876) 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255659c640 1 -- 172.21.15.2:0/2902880365 learned_addr learned my addr 172.21.15.2:0/2902880365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f2555d9b640 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f2556d9d640 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 0x557a949a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255659c640 1 -- 172.21.15.2:0/2902880365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 msgr2=0x557a949a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255659c640 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 0x557a949a85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255659c640 1 -- 172.21.15.2:0/2902880365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 msgr2=0x557a949a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255659c640 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f255659c640 1 -- 172.21.15.2:0/2902880365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a94994960 con 0x557a949975d0 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.234+0000 7f2555d9b640 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255659c640 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949975d0 0x557a949acd30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x557a949b6ce0 tx=0x7f254800bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba358b7139d82f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f253dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f253dffb640 1 -- 172.21.15.2:0/2902880365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2548005220 con 0x557a949975d0 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 1 -- 172.21.15.2:0/2902880365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f254c0c4a20 con 0x557a949975d0 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f253dffb640 1 -- 172.21.15.2:0/2902880365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8687+0+0 (secure 0 0 0) 0x7f25480053c0 con 0x557a949975d0 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f253dffb640 1 -- 172.21.15.2:0/2902880365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f25480055c0 con 0x557a949975d0 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 10 client.17538 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 1 -- 172.21.15.2:0/2902880365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557a94a1eb30 con 0x557a949975d0 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f253dffb640 1 -- 172.21.15.2:0/2902880365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f254c0c4a20 con 0x557a949975d0 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f253dffb640 1 -- 172.21.15.2:0/2902880365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f25480118d0 con 0x557a949975d0 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 10 client.17538 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 10 client.17538 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 20 client.17538 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x557a94a1f2a0 0x557a94a21690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 4 client.17538 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.235+0000 7f255f280740 1 -- 172.21.15.2:0/2902880365 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a94904d70 con 0x557a94a1f2a0 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f2555d9b640 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x557a94a1f2a0 0x557a94a21690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f2555d9b640 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x557a94a1f2a0 0x557a94a21690 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=decb89a78e4a3796 server_cookie=a8dc4c278aa8f451 in_seq=0 out_seq=0 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f253dffb640 10 client.17538 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f253dffb640 1 -- 172.21.15.2:0/2902880365 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a94904d70 con 0x557a94a1f2a0 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f253dffb640 10 client.17538 handle_command_reply: tid=0 2024-09-12T01:02:12.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 client.17538 shutdown 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 -- 172.21.15.2:0/2902880365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949975d0 msgr2=0x557a949acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949975d0 0x557a949acd30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x557a949b6ce0 tx=0x7f254800bf70 comp rx=0 tx=0).stop 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 -- 172.21.15.2:0/2902880365 shutdown_connections 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x557a94a1f2a0 0x557a94a21690 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a949a4580 0x557a949a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a94998b40 0x557a949a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f253dffb640 0 client.17538 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 --2- 172.21.15.2:0/2902880365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a949975d0 0x557a949acd30 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.236+0000 7f255f280740 1 -- 172.21.15.2:0/2902880365 >> 172.21.15.2:0/2902880365 conn(0x557a94960310 msgr2=0x557a949a0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255f280740 1 -- 172.21.15.2:0/2902880365 shutdown_connections 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255f280740 1 -- 172.21.15.2:0/2902880365 wait complete. 2024-09-12T01:02:12.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255f280740 20 client.17538 trim_cache size 0 max 16384 2024-09-12T01:02:12.243 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 -- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25400a2cf0 msgr2=0x7f25400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25400a2cf0 0x7f25400a51b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2550020000 tx=0x7f2550021000 comp rx=0 tx=0).stop 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 -- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558101420 msgr2=0x7f2558197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558101420 0x7f2558197920 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f254c009230 tx=0x7f254c004270 comp rx=0 tx=0).stop 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 -- 172.21.15.2:0/3198124480 shutdown_connections 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f25400a2cf0 0x7f25400a51b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558106a80 0x7f255819bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558101420 0x7f2558197920 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 --2- 172.21.15.2:0/3198124480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100a80 0x7f25581973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 -- 172.21.15.2:0/3198124480 >> 172.21.15.2:0/3198124480 conn(0x7f25580fc7a0 msgr2=0x7f25580fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:12.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.237+0000 7f255cea7640 1 -- 172.21.15.2:0/3198124480 shutdown_connections 2024-09-12T01:02:12.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:12.238+0000 7f255cea7640 1 -- 172.21.15.2:0/3198124480 wait complete. 2024-09-12T01:02:12.959 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:12 smithi002 ceph-mon[31210]: pgmap v286: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:12.989 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:02:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:12 smithi167 ceph-mon[35234]: pgmap v286: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:13.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:12 smithi071 ceph-mon[35276]: pgmap v286: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 -- 172.21.15.2:0/591679956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910102790 msgr2=0x7f29101067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 --2- 172.21.15.2:0/591679956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910102790 0x7f29101067e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2904009900 tx=0x7f290402a410 comp rx=0 tx=0).stop 2024-09-12T01:02:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 -- 172.21.15.2:0/591679956 shutdown_connections 2024-09-12T01:02:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 --2- 172.21.15.2:0/591679956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2910106f10 0x7f291010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 --2- 172.21.15.2:0/591679956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910102790 0x7f29101067e0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 --2- 172.21.15.2:0/591679956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2910101de0 0x7f29101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 -- 172.21.15.2:0/591679956 >> 172.21.15.2:0/591679956 conn(0x7f29100fd8c0 msgr2=0x7f29100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 -- 172.21.15.2:0/591679956 shutdown_connections 2024-09-12T01:02:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.765+0000 7f29158f7640 1 -- 172.21.15.2:0/591679956 wait complete. 2024-09-12T01:02:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f29158f7640 1 Processor -- start 2024-09-12T01:02:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f29158f7640 1 -- start start 2024-09-12T01:02:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f29158f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910101de0 0x7f291019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f29158f7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2910102790 0x7f291019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f29158f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2910106f10 0x7f291019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f29158f7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2910111f70 con 0x7f2910101de0 2024-09-12T01:02:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f29158f7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2910111df0 con 0x7f2910102790 2024-09-12T01:02:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f29158f7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29101120f0 con 0x7f2910106f10 2024-09-12T01:02:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f290effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910101de0 0x7f291019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f290effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910101de0 0x7f291019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44906/0 (socket says 172.21.15.2:44906) 2024-09-12T01:02:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f290effd640 1 -- 172.21.15.2:0/2649285859 learned_addr learned my addr 172.21.15.2:0/2649285859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f290e7fc640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2910102790 0x7f291019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.766+0000 7f290f7fe640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2910106f10 0x7f291019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f290effd640 1 -- 172.21.15.2:0/2649285859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2910106f10 msgr2=0x7f291019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f290effd640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2910106f10 0x7f291019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f290effd640 1 -- 172.21.15.2:0/2649285859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2910102790 msgr2=0x7f291019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f290effd640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2910102790 0x7f291019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f290effd640 1 -- 172.21.15.2:0/2649285859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291019f660 con 0x7f2910101de0 2024-09-12T01:02:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f290f7fe640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2910106f10 0x7f291019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f290effd640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910101de0 0x7f291019a6b0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f290000d950 tx=0x7f290000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f29148f5640 1 -- 172.21.15.2:0/2649285859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900017070 con 0x7f2910101de0 2024-09-12T01:02:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f29158f7640 1 -- 172.21.15.2:0/2649285859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291019f950 con 0x7f2910101de0 2024-09-12T01:02:13.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f29148f5640 1 -- 172.21.15.2:0/2649285859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2900009c30 con 0x7f2910101de0 2024-09-12T01:02:13.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f29148f5640 1 -- 172.21.15.2:0/2649285859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290000f6b0 con 0x7f2910101de0 2024-09-12T01:02:13.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.767+0000 7f29158f7640 1 -- 172.21.15.2:0/2649285859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29101a7230 con 0x7f2910101de0 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f29148f5640 1 -- 172.21.15.2:0/2649285859 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f29000109d0 con 0x7f2910101de0 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f2917cd0740 1 Processor -- start 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f2917cd0740 1 -- start start 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb1b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb1ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb28760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f2917cd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56456ea812f0 con 0x56456eb1cb40 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f2917cd0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56456ea28cf0 con 0x56456eb26370 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f2917cd0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56456ea7d2b0 con 0x56456eb1b5d0 2024-09-12T01:02:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f290f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb1b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f290f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb1b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44910/0 (socket says 172.21.15.2:44910) 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f290f7fe640 1 -- 172.21.15.2:0/3299201706 learned_addr learned my addr 172.21.15.2:0/3299201706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f290e7fc640 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb28760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f290effd640 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb1ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.770+0000 7f290f7fe640 1 -- 172.21.15.2:0/3299201706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 msgr2=0x56456eb1ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f290f7fe640 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb1ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f290f7fe640 1 -- 172.21.15.2:0/3299201706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 msgr2=0x56456eb28760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f290f7fe640 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb28760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f290f7fe640 1 -- 172.21.15.2:0/3299201706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456ea0d3a0 con 0x56456eb1cb40 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f290e7fc640 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb28760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f290effd640 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb1ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f29148f5640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28f80a2cf0 0x7f28f80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f290f7fe640 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb1b090 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2908009fd0 tx=0x7f2908010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf517f954206aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f290effd640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28f80a2cf0 0x7f28f80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f28f5ffb640 1 -- 172.21.15.2:0/3299201706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908011700 con 0x56456eb1cb40 2024-09-12T01:02:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f28f5ffb640 1 -- 172.21.15.2:0/3299201706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2908011d80 con 0x56456eb1cb40 2024-09-12T01:02:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f28f5ffb640 1 -- 172.21.15.2:0/3299201706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290800e3c0 con 0x56456eb1cb40 2024-09-12T01:02:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.771+0000 7f29148f5640 1 -- 172.21.15.2:0/2649285859 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f29000cf140 con 0x7f2910101de0 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 -- 172.21.15.2:0/3299201706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 msgr2=0x56456eb1b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb1b090 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2908009fd0 tx=0x7f2908010860 comp rx=0 tx=0).stop 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f290effd640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28f80a2cf0 0x7f28f80a51b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29000cc8c0 tx=0x7f290000bf60 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 -- 172.21.15.2:0/3299201706 shutdown_connections 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb28760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb1ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 --2- 172.21.15.2:0/3299201706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb1b090 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 -- 172.21.15.2:0/3299201706 >> 172.21.15.2:0/3299201706 conn(0x56456eae4310 msgr2=0x56456eb17c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 -- 172.21.15.2:0/3299201706 shutdown_connections 2024-09-12T01:02:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 -- 172.21.15.2:0/3299201706 wait complete. 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.772+0000 7f2917cd0740 1 -- start start 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f2917cd0740 1 Processor -- start 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb25d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1cb40 0x56456eb23040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb23650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f2917cd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56456eb29070 con 0x56456eb1b5d0 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f2917cd0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56456ea3c060 con 0x56456eb26370 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f2917cd0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56456eb291f0 con 0x56456eb1cb40 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f2917cd0740 10 client.0 _ll_register_callbacks cb 0x56456e78f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb25d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb25d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44916/0 (socket says 172.21.15.2:44916) 2024-09-12T01:02:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290f7fe640 1 -- 172.21.15.2:0/241365137 learned_addr learned my addr 172.21.15.2:0/241365137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290e7fc640 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1cb40 0x56456eb23040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290f7fe640 1 -- 172.21.15.2:0/241365137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1cb40 msgr2=0x56456eb23040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290f7fe640 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1cb40 0x56456eb23040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290f7fe640 1 -- 172.21.15.2:0/241365137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 msgr2=0x56456eb23650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290f7fe640 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb23650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.773+0000 7f290f7fe640 1 -- 172.21.15.2:0/241365137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456e7f23c0 con 0x56456eb1b5d0 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f290f7fe640 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb25d90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2908005cc0 tx=0x7f290801bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bdca6df1769d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f28eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f28eeffd640 1 -- 172.21.15.2:0/241365137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290801b900 con 0x56456eb1b5d0 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f28eeffd640 1 -- 172.21.15.2:0/241365137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f2908011500 con 0x56456eb1b5d0 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f2917cd0740 1 -- 172.21.15.2:0/241365137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2908011d80 con 0x56456eb1b5d0 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f28eeffd640 1 -- 172.21.15.2:0/241365137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2908011700 con 0x56456eb1b5d0 2024-09-12T01:02:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f2917cd0740 10 client.17550 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f2917cd0740 1 -- 172.21.15.2:0/241365137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56456eb34ab0 con 0x56456eb1b5d0 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f28eeffd640 1 -- 172.21.15.2:0/241365137 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2908011d80 con 0x56456eb1b5d0 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f28eeffd640 1 -- 172.21.15.2:0/241365137 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2908030430 con 0x56456eb1b5d0 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f2917cd0740 10 client.17550 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f2917cd0740 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f2917cd0740 20 client.17550 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.774+0000 7f2917cd0740 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56456eb35e00 0x56456eb381f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.775+0000 7f2917cd0740 4 client.17550 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.775+0000 7f2917cd0740 1 -- 172.21.15.2:0/241365137 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56456ea8e860 con 0x56456eb35e00 2024-09-12T01:02:13.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.775+0000 7f290e7fc640 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56456eb35e00 0x56456eb381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.775+0000 7f290e7fc640 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56456eb35e00 0x56456eb381f0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e33f365d091b091e server_cookie=2596e081927fd3ca in_seq=0 out_seq=0 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.775+0000 7f28eeffd640 10 client.17550 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f28eeffd640 1 -- 172.21.15.2:0/241365137 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56456ea8e860 con 0x56456eb35e00 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f28eeffd640 10 client.17550 handle_command_reply: tid=0 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 client.17550 shutdown 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 -- 172.21.15.2:0/241365137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 msgr2=0x56456eb25d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb25d90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2908005cc0 tx=0x7f290801bd30 comp rx=0 tx=0).stop 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 -- 172.21.15.2:0/241365137 shutdown_connections 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56456eb35e00 0x56456eb381f0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f28eeffd640 0 client.17550 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb23650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1cb40 0x56456eb23040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 --2- 172.21.15.2:0/241365137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb25d90 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 -- 172.21.15.2:0/241365137 >> 172.21.15.2:0/241365137 conn(0x56456eae4310 msgr2=0x56456eb1d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:13.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 -- 172.21.15.2:0/241365137 shutdown_connections 2024-09-12T01:02:13.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 1 -- 172.21.15.2:0/241365137 wait complete. 2024-09-12T01:02:13.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.776+0000 7f2917cd0740 20 client.17550 trim_cache size 0 max 16384 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.789+0000 7f2917cd0740 1 Processor -- start 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.789+0000 7f2917cd0740 1 -- start start 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb32490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb1cb40 0x56456eb17510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb26370 0x56456eb17a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f2917cd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29101b2620 con 0x56456eb1b5d0 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f2917cd0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29101afef0 con 0x56456eb1cb40 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f2917cd0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29101add60 con 0x56456eb26370 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb32490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb32490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44930/0 (socket says 172.21.15.2:44930) 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 -- 172.21.15.2:0/1140440152 learned_addr learned my addr 172.21.15.2:0/1140440152 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 -- 172.21.15.2:0/1140440152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb26370 msgr2=0x56456eb17a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 --2- 172.21.15.2:0/1140440152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb26370 0x56456eb17a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 -- 172.21.15.2:0/1140440152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb1cb40 msgr2=0x56456eb17510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 --2- 172.21.15.2:0/1140440152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb1cb40 0x56456eb17510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 -- 172.21.15.2:0/1140440152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456eb18960 con 0x56456eb1b5d0 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f290f7fe640 1 --2- 172.21.15.2:0/1140440152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb32490 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f29080108a0 tx=0x7f29080099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f968402070f6fcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f28f57fa640 1 -- 172.21.15.2:0/1140440152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290803d070 con 0x56456eb1b5d0 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f28f57fa640 1 -- 172.21.15.2:0/1140440152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2908011d80 con 0x56456eb1b5d0 2024-09-12T01:02:13.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.790+0000 7f28f57fa640 1 -- 172.21.15.2:0/1140440152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908029450 con 0x56456eb1b5d0 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 -- 172.21.15.2:0/1140440152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 msgr2=0x56456eb32490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 --2- 172.21.15.2:0/1140440152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb32490 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f29080108a0 tx=0x7f29080099c0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 -- 172.21.15.2:0/1140440152 shutdown_connections 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 --2- 172.21.15.2:0/1140440152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb26370 0x56456eb17a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 --2- 172.21.15.2:0/1140440152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb1cb40 0x56456eb17510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 --2- 172.21.15.2:0/1140440152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1b5d0 0x56456eb32490 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 -- 172.21.15.2:0/1140440152 >> 172.21.15.2:0/1140440152 conn(0x56456eae4310 msgr2=0x56456eb22130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 -- 172.21.15.2:0/1140440152 shutdown_connections 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 -- 172.21.15.2:0/1140440152 wait complete. 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.791+0000 7f2917cd0740 1 -- start start 2024-09-12T01:02:13.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f2917cd0740 1 Processor -- start 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb3ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb38df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f2917cd0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f2917cd0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29101ae3b0 con 0x56456eb1cb40 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f2917cd0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29101af820 con 0x56456eb26370 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f2917cd0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29101aea80 con 0x56456eb1b5d0 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f2917cd0740 10 client.0 _ll_register_callbacks cb 0x7f2908009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb38df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb38df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44938/0 (socket says 172.21.15.2:44938) 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290e7fc640 1 -- 172.21.15.2:0/4166245945 learned_addr learned my addr 172.21.15.2:0/4166245945 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290f7fe640 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290f7fe640 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb3ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290e7fc640 1 -- 172.21.15.2:0/4166245945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 msgr2=0x56456eb3ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290e7fc640 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb3ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290e7fc640 1 -- 172.21.15.2:0/4166245945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 msgr2=0x56456eb393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290e7fc640 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290e7fc640 1 -- 172.21.15.2:0/4166245945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456eb39c10 con 0x56456eb1cb40 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.792+0000 7f290f7fe640 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb3ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f290e7fc640 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb38df0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2904009900 tx=0x7f2904005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdedacd7864c2eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f28eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f28eeffd640 1 -- 172.21.15.2:0/4166245945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2904035020 con 0x56456eb1cb40 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f28eeffd640 1 -- 172.21.15.2:0/4166245945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f2904004030 con 0x56456eb1cb40 2024-09-12T01:02:13.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 1 -- 172.21.15.2:0/4166245945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2908011d80 con 0x56456eb1cb40 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f28eeffd640 1 -- 172.21.15.2:0/4166245945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2904055050 con 0x56456eb1cb40 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 10 client.17556 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 1 -- 172.21.15.2:0/4166245945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56456eba08b0 con 0x56456eb1cb40 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f28eeffd640 1 -- 172.21.15.2:0/4166245945 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2908011d80 con 0x56456eb1cb40 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f28eeffd640 1 -- 172.21.15.2:0/4166245945 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f290403a040 con 0x56456eb1cb40 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 10 client.17556 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 10 client.17556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 20 client.17556 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56456eba10e0 0x56456eba3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 4 client.17556 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.793+0000 7f2917cd0740 1 -- 172.21.15.2:0/4166245945 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56456ea88d70 con 0x56456eba10e0 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.794+0000 7f290f7fe640 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56456eba10e0 0x56456eba3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.794+0000 7f290f7fe640 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56456eba10e0 0x56456eba3500 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f92a2e369bf4b5d server_cookie=c56c9571a1dfa24e in_seq=0 out_seq=0 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.794+0000 7f28eeffd640 10 client.17556 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.794+0000 7f28eeffd640 1 -- 172.21.15.2:0/4166245945 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56456ea88d70 con 0x56456eba10e0 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.794+0000 7f28eeffd640 10 client.17556 handle_command_reply: tid=0 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.794+0000 7f2917cd0740 1 client.17556 shutdown 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 -- 172.21.15.2:0/4166245945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 msgr2=0x56456eb38df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb38df0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2904009900 tx=0x7f2904005240 comp rx=0 tx=0).stop 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 -- 172.21.15.2:0/4166245945 shutdown_connections 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56456eba10e0 0x56456eba3500 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56456eb26370 0x56456eb393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456eb1cb40 0x56456eb38df0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f28eeffd640 0 client.17556 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 --2- 172.21.15.2:0/4166245945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56456eb1b5d0 0x56456eb3ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 -- 172.21.15.2:0/4166245945 >> 172.21.15.2:0/4166245945 conn(0x56456eae4310 msgr2=0x56456eb1d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 -- 172.21.15.2:0/4166245945 shutdown_connections 2024-09-12T01:02:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 1 -- 172.21.15.2:0/4166245945 wait complete. 2024-09-12T01:02:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f2917cd0740 20 client.17556 trim_cache size 0 max 16384 2024-09-12T01:02:13.799 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:02:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 -- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28f80a2cf0 msgr2=0x7f28f80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28f80a2cf0 0x7f28f80a51b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29000cc8c0 tx=0x7f290000bf60 comp rx=0 tx=0).stop 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 -- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910101de0 msgr2=0x7f291019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910101de0 0x7f291019a6b0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f290000d950 tx=0x7f290000de10 comp rx=0 tx=0).stop 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 -- 172.21.15.2:0/2649285859 shutdown_connections 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28f80a2cf0 0x7f28f80a51b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2910106f10 0x7f291019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2910102790 0x7f291019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 --2- 172.21.15.2:0/2649285859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2910101de0 0x7f291019a6b0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.795+0000 7f29158f7640 1 -- 172.21.15.2:0/2649285859 >> 172.21.15.2:0/2649285859 conn(0x7f29100fd8c0 msgr2=0x7f29100fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.796+0000 7f29158f7640 1 -- 172.21.15.2:0/2649285859 shutdown_connections 2024-09-12T01:02:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:13.796+0000 7f29158f7640 1 -- 172.21.15.2:0/2649285859 wait complete. 2024-09-12T01:02:14.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:14 smithi002 ceph-mon[31210]: pgmap v287: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:14.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:14 smithi002 ceph-mon[31210]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:02:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:14 smithi071 ceph-mon[35276]: pgmap v287: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:14 smithi071 ceph-mon[35276]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:02:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:14 smithi167 ceph-mon[35234]: pgmap v287: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:14 smithi167 ceph-mon[35234]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:02:15.392 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:02:15.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:02:15.665 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:16.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 -- 172.21.15.2:0/2137540396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 msgr2=0x7f4aec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/2137540396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 0x7f4aec101200 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009900 tx=0x7f4ae802a480 comp rx=0 tx=0).stop 2024-09-12T01:02:16.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 -- 172.21.15.2:0/2137540396 shutdown_connections 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/2137540396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4aec102ef0 0x7f4aec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/2137540396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4aec102570 0x7f4aec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/2137540396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 0x7f4aec101200 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 -- 172.21.15.2:0/2137540396 >> 172.21.15.2:0/2137540396 conn(0x7f4aec0fc7d0 msgr2=0x7f4aec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 -- 172.21.15.2:0/2137540396 shutdown_connections 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 -- 172.21.15.2:0/2137540396 wait complete. 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.123+0000 7f4af3ea0640 1 Processor -- start 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af3ea0640 1 -- start start 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af3ea0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 0x7f4aec1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af3ea0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4aec102570 0x7f4aec1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af3ea0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4aec102ef0 0x7f4aec19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af3ea0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec110fc0 con 0x7f4aec100e20 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af3ea0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec110e40 con 0x7f4aec102ef0 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af3ea0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec111140 con 0x7f4aec102570 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 0x7f4aec1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 0x7f4aec1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40194/0 (socket says 172.21.15.2:40194) 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 -- 172.21.15.2:0/98793709 learned_addr learned my addr 172.21.15.2:0/98793709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af143b640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4aec102570 0x7f4aec1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af243d640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4aec102ef0 0x7f4aec19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 -- 172.21.15.2:0/98793709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4aec102570 msgr2=0x7f4aec1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4aec102570 0x7f4aec1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 -- 172.21.15.2:0/98793709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4aec102ef0 msgr2=0x7f4aec19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4aec102ef0 0x7f4aec19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 -- 172.21.15.2:0/98793709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec19c450 con 0x7f4aec100e20 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af143b640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4aec102570 0x7f4aec1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af243d640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4aec102ef0 0x7f4aec19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.124+0000 7f4af1c3c640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 0x7f4aec1974a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8006010 tx=0x7f4ae8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.125+0000 7f4ae2ffd640 1 -- 172.21.15.2:0/98793709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae803f070 con 0x7f4aec100e20 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.125+0000 7f4ae2ffd640 1 -- 172.21.15.2:0/98793709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae8031c30 con 0x7f4aec100e20 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.125+0000 7f4af3ea0640 1 -- 172.21.15.2:0/98793709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec19c6e0 con 0x7f4aec100e20 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.125+0000 7f4ae2ffd640 1 -- 172.21.15.2:0/98793709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8035030 con 0x7f4aec100e20 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.125+0000 7f4af3ea0640 1 -- 172.21.15.2:0/98793709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec1a4020 con 0x7f4aec100e20 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.127+0000 7f4ae2ffd640 1 -- 172.21.15.2:0/98793709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f4ae8042070 con 0x7f4aec100e20 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.127+0000 7f4af6279740 1 Processor -- start 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af6279740 1 -- start start 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af6279740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771ae0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af6279740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771ae1340 0x55a771aefe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af6279740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771af0340 0x55a771af2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af6279740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a771a46280 con 0x55a771ae0a20 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af6279740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a7719edb10 con 0x55a771af0340 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af6279740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a771a42240 con 0x55a771ae1340 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771ae0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771ae0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40210/0 (socket says 172.21.15.2:40210) 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 -- 172.21.15.2:0/2793680705 learned_addr learned my addr 172.21.15.2:0/2793680705 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af1c3c640 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771ae1340 0x55a771aefe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 -- 172.21.15.2:0/2793680705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771ae1340 msgr2=0x55a771aefe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af143b640 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771af0340 0x55a771af2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771ae1340 0x55a771aefe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 -- 172.21.15.2:0/2793680705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771af0340 msgr2=0x55a771af2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771af0340 0x55a771af2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 -- 172.21.15.2:0/2793680705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7719fa1f0 con 0x55a771ae0a20 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af1c3c640 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771ae1340 0x55a771aefe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af143b640 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771af0340 0x55a771af2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4ae2ffd640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ad80a2cf0 0x7f4ad80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.128+0000 7f4af243d640 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771ae0e00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4007f30 tx=0x7f4ae400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb1f28b2e915637 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.129+0000 7f4af1c3c640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ad80a2cf0 0x7f4ad80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.129+0000 7f4ad7fff640 1 -- 172.21.15.2:0/2793680705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4014070 con 0x55a771ae0a20 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.129+0000 7f4ae2ffd640 1 -- 172.21.15.2:0/98793709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f4ae80efa90 con 0x7f4aec100e20 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.129+0000 7f4ad7fff640 1 -- 172.21.15.2:0/2793680705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae400fd30 con 0x55a771ae0a20 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.129+0000 7f4ad7fff640 1 -- 172.21.15.2:0/2793680705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400ed50 con 0x55a771ae0a20 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 -- 172.21.15.2:0/2793680705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 msgr2=0x55a771ae0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af1c3c640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ad80a2cf0 0x7f4ad80a51b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80ed210 tx=0x7f4ae803b870 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771ae0e00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4007f30 tx=0x7f4ae400c750 comp rx=0 tx=0).stop 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 -- 172.21.15.2:0/2793680705 shutdown_connections 2024-09-12T01:02:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771af0340 0x55a771af2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771ae1340 0x55a771aefe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 --2- 172.21.15.2:0/2793680705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771ae0e00 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 -- 172.21.15.2:0/2793680705 >> 172.21.15.2:0/2793680705 conn(0x55a771add0f0 msgr2=0x55a771add4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 -- 172.21.15.2:0/2793680705 shutdown_connections 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 -- 172.21.15.2:0/2793680705 wait complete. 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 -- start start 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.130+0000 7f4af6279740 1 Processor -- start 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af6279740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af6279740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aed730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af6279740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771aedc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af6279740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a771af2d30 con 0x55a771ae0a20 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af6279740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a771a00f10 con 0x55a771ae1340 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af6279740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a771af2eb0 con 0x55a771af0340 2024-09-12T01:02:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af6279740 10 client.0 _ll_register_callbacks cb 0x55a7719c9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aed1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40222/0 (socket says 172.21.15.2:40222) 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 -- 172.21.15.2:0/3618854885 learned_addr learned my addr 172.21.15.2:0/3618854885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af143b640 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771aedc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 -- 172.21.15.2:0/3618854885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 msgr2=0x55a771aedc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771aedc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 -- 172.21.15.2:0/3618854885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 msgr2=0x55a771aed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aed730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 -- 172.21.15.2:0/3618854885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7717b76a0 con 0x55a771ae0a20 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af243d640 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aed1f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400e910 tx=0x7f4ae400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf8c03f804cdbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4ad57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4ad57fa640 1 -- 172.21.15.2:0/3618854885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4022040 con 0x55a771ae0a20 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4ad57fa640 1 -- 172.21.15.2:0/3618854885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f4ae400fa60 con 0x55a771ae0a20 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.131+0000 7f4af6279740 1 -- 172.21.15.2:0/3618854885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae400fd30 con 0x55a771ae0a20 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4ad57fa640 1 -- 172.21.15.2:0/3618854885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4ae4014040 con 0x55a771ae0a20 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af6279740 10 client.17568 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af6279740 1 -- 172.21.15.2:0/3618854885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a771afe8b0 con 0x55a771ae0a20 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4ad57fa640 1 -- 172.21.15.2:0/3618854885 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae400fd30 con 0x55a771ae0a20 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4ad57fa640 1 -- 172.21.15.2:0/3618854885 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f4ae402e550 con 0x55a771ae0a20 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af6279740 10 client.17568 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af6279740 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af6279740 20 client.17568 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af6279740 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a771affc00 0x55a771b01ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af6279740 4 client.17568 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af6279740 1 -- 172.21.15.2:0/3618854885 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a771a537f0 con 0x55a771affc00 2024-09-12T01:02:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.132+0000 7f4af143b640 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a771affc00 0x55a771b01ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.133+0000 7f4af143b640 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a771affc00 0x55a771b01ff0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15ca3012430bb4da server_cookie=ea588b5b8cebdd77 in_seq=0 out_seq=0 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.133+0000 7f4ad57fa640 10 client.17568 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.133+0000 7f4ad57fa640 1 -- 172.21.15.2:0/3618854885 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a771a537f0 con 0x55a771affc00 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.133+0000 7f4ad57fa640 10 client.17568 handle_command_reply: tid=0 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.133+0000 7f4af6279740 1 client.17568 shutdown 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.133+0000 7f4af6279740 1 -- 172.21.15.2:0/3618854885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 msgr2=0x55a771aed1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.133+0000 7f4af6279740 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aed1f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400e910 tx=0x7f4ae400ea10 comp rx=0 tx=0).stop 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 1 -- 172.21.15.2:0/3618854885 shutdown_connections 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a771affc00 0x55a771b01ff0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771aedc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 1 --2- 172.21.15.2:0/3618854885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aed1f0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4ad57fa640 0 client.17568 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:16.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 1 -- 172.21.15.2:0/3618854885 >> 172.21.15.2:0/3618854885 conn(0x55a771add0f0 msgr2=0x55a771adc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:16.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 1 -- 172.21.15.2:0/3618854885 shutdown_connections 2024-09-12T01:02:16.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 1 -- 172.21.15.2:0/3618854885 wait complete. 2024-09-12T01:02:16.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.134+0000 7f4af6279740 20 client.17568 trim_cache size 0 max 16384 2024-09-12T01:02:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af6279740 1 Processor -- start 2024-09-12T01:02:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af6279740 1 -- start start 2024-09-12T01:02:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af6279740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aeadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af6279740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af6279740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771b07680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af6279740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ae210 con 0x55a771ae0a20 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af6279740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1abae0 con 0x55a771ae1340 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af6279740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1a9950 con 0x55a771af0340 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af243d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aeadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af243d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aeadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40228/0 (socket says 172.21.15.2:40228) 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af243d640 1 -- 172.21.15.2:0/2294065874 learned_addr learned my addr 172.21.15.2:0/2294065874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af243d640 1 -- 172.21.15.2:0/2294065874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 msgr2=0x55a771b07680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af243d640 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771b07680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af243d640 1 -- 172.21.15.2:0/2294065874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 msgr2=0x55a771aef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af143b640 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af243d640 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af243d640 1 -- 172.21.15.2:0/2294065874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a771ad7680 con 0x55a771ae0a20 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.152+0000 7f4af143b640 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.153+0000 7f4af243d640 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aeadd0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4004b90 tx=0x7f4ae4007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa767ba2e786e229 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.153+0000 7f4ad77fe640 1 -- 172.21.15.2:0/2294065874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae402eb40 con 0x55a771ae0a20 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.153+0000 7f4ad77fe640 1 -- 172.21.15.2:0/2294065874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae402ece0 con 0x55a771ae0a20 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.153+0000 7f4ad77fe640 1 -- 172.21.15.2:0/2294065874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40196b0 con 0x55a771ae0a20 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.153+0000 7f4af6279740 1 -- 172.21.15.2:0/2294065874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 msgr2=0x55a771aeadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.153+0000 7f4af6279740 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aeadd0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4004b90 tx=0x7f4ae4007800 comp rx=0 tx=0).stop 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.153+0000 7f4af6279740 1 -- 172.21.15.2:0/2294065874 shutdown_connections 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.153+0000 7f4af6279740 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771b07680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.154+0000 7f4af6279740 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771aef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.154+0000 7f4af6279740 1 --2- 172.21.15.2:0/2294065874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771aeadd0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.154+0000 7f4af6279740 1 -- 172.21.15.2:0/2294065874 >> 172.21.15.2:0/2294065874 conn(0x55a771add0f0 msgr2=0x55a771aee940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.154+0000 7f4af6279740 1 -- 172.21.15.2:0/2294065874 shutdown_connections 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.154+0000 7f4af6279740 1 -- 172.21.15.2:0/2294065874 wait complete. 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.154+0000 7f4af6279740 1 -- start start 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.154+0000 7f4af6279740 1 Processor -- start 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af6279740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771af8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af6279740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771af8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af6279740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771af5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af6279740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1a9fa0 con 0x55a771ae0a20 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af6279740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ab410 con 0x55a771ae1340 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af6279740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1aa670 con 0x55a771af0340 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af6279740 10 client.0 _ll_register_callbacks cb 0x7f4ae4007d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771af8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771af8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40242/0 (socket says 172.21.15.2:40242) 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 -- 172.21.15.2:0/1130265032 learned_addr learned my addr 172.21.15.2:0/1130265032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af143b640 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771af8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771af5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 -- 172.21.15.2:0/1130265032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 msgr2=0x55a771af5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771af5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 -- 172.21.15.2:0/1130265032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 msgr2=0x55a771af8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771af8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 -- 172.21.15.2:0/1130265032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a771af8cc0 con 0x55a771ae0a20 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af243d640 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771af8140 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400cd90 tx=0x7f4ae400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6032f073e003d27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4ad57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4ad57fa640 1 -- 172.21.15.2:0/1130265032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400e970 con 0x55a771ae0a20 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4ad57fa640 1 -- 172.21.15.2:0/1130265032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f4ae400e3a0 con 0x55a771ae0a20 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.155+0000 7f4af6279740 1 -- 172.21.15.2:0/1130265032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae402ece0 con 0x55a771ae0a20 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4ad57fa640 1 -- 172.21.15.2:0/1130265032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4ae400f860 con 0x55a771ae0a20 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af6279740 10 client.17574 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af6279740 1 -- 172.21.15.2:0/1130265032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a771b6ab40 con 0x55a771ae0a20 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4ad57fa640 1 -- 172.21.15.2:0/1130265032 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae402ece0 con 0x55a771ae0a20 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4ad57fa640 1 -- 172.21.15.2:0/1130265032 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f4ae4036070 con 0x55a771ae0a20 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af6279740 10 client.17574 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af6279740 10 client.17574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af6279740 20 client.17574 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af6279740 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a771b6b120 0x55a771b6d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af6279740 4 client.17574 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af6279740 1 -- 172.21.15.2:0/1130265032 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a771a4dd00 con 0x55a771b6b120 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.156+0000 7f4af143b640 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a771b6b120 0x55a771b6d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.157+0000 7f4ad57fa640 10 client.17574 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.157+0000 7f4af143b640 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a771b6b120 0x55a771b6d540 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec16338d1acfd20f server_cookie=961d00c9bbcbfdea in_seq=0 out_seq=0 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4ad57fa640 1 -- 172.21.15.2:0/1130265032 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a771a4dd00 con 0x55a771b6b120 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4ad57fa640 10 client.17574 handle_command_reply: tid=0 2024-09-12T01:02:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 client.17574 shutdown 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 -- 172.21.15.2:0/1130265032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 msgr2=0x55a771af8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771af8140 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400cd90 tx=0x7f4ae400ee20 comp rx=0 tx=0).stop 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 -- 172.21.15.2:0/1130265032 shutdown_connections 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55a771b6b120 0x55a771b6d540 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a771af0340 0x55a771af5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a771ae1340 0x55a771af8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 --2- 172.21.15.2:0/1130265032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a771ae0a20 0x55a771af8140 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 -- 172.21.15.2:0/1130265032 >> 172.21.15.2:0/1130265032 conn(0x55a771add0f0 msgr2=0x55a771ae2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4ad57fa640 0 client.17574 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 -- 172.21.15.2:0/1130265032 shutdown_connections 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 1 -- 172.21.15.2:0/1130265032 wait complete. 2024-09-12T01:02:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.158+0000 7f4af6279740 20 client.17574 trim_cache size 0 max 16384 2024-09-12T01:02:16.166 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:02:16.166 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T01:02:16.166 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "e25ce140-8c41-4a39-a5bc-1eb6a2ad2966", 2024-09-12T01:02:16.166 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T01:02:16.166 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:02:16.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 -- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ad80a2cf0 msgr2=0x7f4ad80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ad80a2cf0 0x7f4ad80a51b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80ed210 tx=0x7f4ae803b870 comp rx=0 tx=0).stop 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 -- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 msgr2=0x7f4aec1974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 0x7f4aec1974a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8006010 tx=0x7f4ae8003c10 comp rx=0 tx=0).stop 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 -- 172.21.15.2:0/98793709 shutdown_connections 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ad80a2cf0 0x7f4ad80a51b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4aec102ef0 0x7f4aec19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4aec102570 0x7f4aec1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 --2- 172.21.15.2:0/98793709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aec100e20 0x7f4aec1974a0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 -- 172.21.15.2:0/98793709 >> 172.21.15.2:0/98793709 conn(0x7f4aec0fc7d0 msgr2=0x7f4aec0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 -- 172.21.15.2:0/98793709 shutdown_connections 2024-09-12T01:02:16.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:16.159+0000 7f4af3ea0640 1 -- 172.21.15.2:0/98793709 wait complete. 2024-09-12T01:02:16.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:16 smithi002 ceph-mon[31210]: pgmap v289: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 123 B/s wr, 3 op/s 2024-09-12T01:02:16.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:16 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T01:02:16.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:16 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:16.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:16 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T01:02:16.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:16 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:16.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:02:16.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:16 smithi071 ceph-mon[35276]: pgmap v289: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 123 B/s wr, 3 op/s 2024-09-12T01:02:16.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:16 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T01:02:16.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:16 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:16.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:16 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T01:02:16.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:16 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:16 smithi167 ceph-mon[35234]: pgmap v289: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 123 B/s wr, 3 op/s 2024-09-12T01:02:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:16 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T01:02:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:16 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:16 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T01:02:17.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:16 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 -- 172.21.15.2:0/536540874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 msgr2=0x7f9c38110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 --2- 172.21.15.2:0/536540874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 0x7f9c38110870 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009ca0 tx=0x7f9c3002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 -- 172.21.15.2:0/536540874 shutdown_connections 2024-09-12T01:02:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 --2- 172.21.15.2:0/536540874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 0x7f9c38110870 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 --2- 172.21.15.2:0/536540874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38101280 0x7f9c3810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 --2- 172.21.15.2:0/536540874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c381008d0 0x7f9c38100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 -- 172.21.15.2:0/536540874 >> 172.21.15.2:0/536540874 conn(0x7f9c380fc7a0 msgr2=0x7f9c380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 -- 172.21.15.2:0/536540874 shutdown_connections 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.605+0000 7f9c400e5640 1 -- 172.21.15.2:0/536540874 wait complete. 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c400e5640 1 Processor -- start 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c400e5640 1 -- start start 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c400e5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c381008d0 0x7f9c3819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c400e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38101280 0x7f9c3819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c400e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 0x7f9c3819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c400e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381141c0 con 0x7f9c3810e480 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c400e5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38114040 con 0x7f9c381008d0 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c400e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38114340 con 0x7f9c38101280 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.606+0000 7f9c3e682640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 0x7f9c3819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3e682640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 0x7f9c3819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40272/0 (socket says 172.21.15.2:40272) 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3e682640 1 -- 172.21.15.2:0/888030670 learned_addr learned my addr 172.21.15.2:0/888030670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3de81640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c381008d0 0x7f9c3819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3d680640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38101280 0x7f9c3819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3e682640 1 -- 172.21.15.2:0/888030670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38101280 msgr2=0x7f9c3819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3e682640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38101280 0x7f9c3819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3e682640 1 -- 172.21.15.2:0/888030670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c381008d0 msgr2=0x7f9c3819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3e682640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c381008d0 0x7f9c3819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3e682640 1 -- 172.21.15.2:0/888030670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3819f610 con 0x7f9c3810e480 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.607+0000 7f9c3e682640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 0x7f9c3819ef30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9c3002ade0 tx=0x7f9c30031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.609+0000 7f9c2effd640 1 -- 172.21.15.2:0/888030670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30003b70 con 0x7f9c3810e480 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.609+0000 7f9c2effd640 1 -- 172.21.15.2:0/888030670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c30003d10 con 0x7f9c3810e480 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.609+0000 7f9c400e5640 1 -- 172.21.15.2:0/888030670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3819f8a0 con 0x7f9c3810e480 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.609+0000 7f9c2effd640 1 -- 172.21.15.2:0/888030670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30004730 con 0x7f9c3810e480 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.610+0000 7f9c400e5640 1 -- 172.21.15.2:0/888030670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c381a71e0 con 0x7f9c3810e480 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.612+0000 7f9c2effd640 1 -- 172.21.15.2:0/888030670 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f9c3002f710 con 0x7f9c3810e480 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.612+0000 7f9c424be740 1 Processor -- start 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.612+0000 7f9c424be740 1 -- start start 2024-09-12T01:02:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.612+0000 7f9c424be740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f47d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c2effd640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c424be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f488140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c424be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 0x55be9f48aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c424be740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55be9f3e32e0 con 0x55be9f47d4a0 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c424be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55be9f38ace0 con 0x55be9f488680 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c424be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55be9f3df2a0 con 0x55be9f47ddc0 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3de81640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f47d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c2effd640 1 -- 172.21.15.2:0/888030670 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f9c300f0620 con 0x7f9c3810e480 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f47d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40280/0 (socket says 172.21.15.2:40280) 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 -- 172.21.15.2:0/1446679091 learned_addr learned my addr 172.21.15.2:0/1446679091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f488140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3e682640 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 0x55be9f48aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 -- 172.21.15.2:0/1446679091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 msgr2=0x55be9f488140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f488140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 -- 172.21.15.2:0/1446679091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 msgr2=0x55be9f48aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 0x55be9f48aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 -- 172.21.15.2:0/1446679091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be9f36f440 con 0x55be9f47d4a0 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3de81640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400abe0 tx=0x7f9c3400a2d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.613+0000 7f9c3d680640 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f47d880 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9c28006aa0 tx=0x7f9c280094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748b8cbb995c607d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c23fff640 1 -- 172.21.15.2:0/1446679091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28012870 con 0x55be9f47d4a0 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c23fff640 1 -- 172.21.15.2:0/1446679091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c2801d070 con 0x55be9f47d4a0 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c23fff640 1 -- 172.21.15.2:0/1446679091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280189a0 con 0x55be9f47d4a0 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 -- 172.21.15.2:0/1446679091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 msgr2=0x55be9f47d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f47d880 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9c28006aa0 tx=0x7f9c280094c0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 -- 172.21.15.2:0/1446679091 shutdown_connections 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 0x55be9f48aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f488140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 --2- 172.21.15.2:0/1446679091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f47d880 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 -- 172.21.15.2:0/1446679091 >> 172.21.15.2:0/1446679091 conn(0x55be9f479a30 msgr2=0x55be9f479e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 -- 172.21.15.2:0/1446679091 shutdown_connections 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.614+0000 7f9c424be740 1 -- 172.21.15.2:0/1446679091 wait complete. 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 1 -- start start 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 1 Processor -- start 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f487f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4851d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 0x55be9f485710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55be9f48b250 con 0x55be9f47d4a0 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55be9f39e050 con 0x55be9f488680 2024-09-12T01:02:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55be9f48b3d0 con 0x55be9f47ddc0 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c424be740 10 client.0 _ll_register_callbacks cb 0x55be9f3de160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c3de81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f487f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c3de81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f487f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40286/0 (socket says 172.21.15.2:40286) 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.615+0000 7f9c3de81640 1 -- 172.21.15.2:0/240130716 learned_addr learned my addr 172.21.15.2:0/240130716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c3d680640 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4851d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c3e682640 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 0x55be9f485710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c3de81640 1 -- 172.21.15.2:0/240130716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 msgr2=0x55be9f4851d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c3de81640 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4851d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c3de81640 1 -- 172.21.15.2:0/240130716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 msgr2=0x55be9f485710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c3de81640 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 0x55be9f485710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c3de81640 1 -- 172.21.15.2:0/240130716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9f1543c0 con 0x55be9f47d4a0 2024-09-12T01:02:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c3de81640 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f487f20 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9c34005e10 tx=0x7f9c34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e421fd4f5688971 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c217fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c217fa640 1 -- 172.21.15.2:0/240130716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34016070 con 0x55be9f47d4a0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c217fa640 1 -- 172.21.15.2:0/240130716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f9c3400fe40 con 0x55be9f47d4a0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c424be740 1 -- 172.21.15.2:0/240130716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c2801d070 con 0x55be9f47d4a0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c217fa640 1 -- 172.21.15.2:0/240130716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9c34027480 con 0x55be9f47d4a0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c424be740 10 client.17586 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.616+0000 7f9c424be740 1 -- 172.21.15.2:0/240130716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55be9f496bd0 con 0x55be9f47d4a0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c217fa640 1 -- 172.21.15.2:0/240130716 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c2801d070 con 0x55be9f47d4a0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c217fa640 1 -- 172.21.15.2:0/240130716 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9c3401c630 con 0x55be9f47d4a0 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c424be740 10 client.17586 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c424be740 10 client.17586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c424be740 20 client.17586 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c424be740 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55be9f498090 0x55be9f49a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c424be740 4 client.17586 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c424be740 1 -- 172.21.15.2:0/240130716 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be9f3f0850 con 0x55be9f498090 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c3d680640 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55be9f498090 0x55be9f49a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c3d680640 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55be9f498090 0x55be9f49a4e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50d884f5aaa168fd server_cookie=839c8594a39becf8 in_seq=0 out_seq=0 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.617+0000 7f9c217fa640 10 client.17586 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c217fa640 1 -- 172.21.15.2:0/240130716 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be9f3f0850 con 0x55be9f498090 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c217fa640 10 client.17586 handle_command_reply: tid=0 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 client.17586 shutdown 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 -- 172.21.15.2:0/240130716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 msgr2=0x55be9f487f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f487f20 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9c34005e10 tx=0x7f9c34004730 comp rx=0 tx=0).stop 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 -- 172.21.15.2:0/240130716 shutdown_connections 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55be9f498090 0x55be9f49a4e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f488680 0x55be9f485710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c217fa640 0 client.17586 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4851d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 --2- 172.21.15.2:0/240130716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f487f20 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.618+0000 7f9c424be740 1 -- 172.21.15.2:0/240130716 >> 172.21.15.2:0/240130716 conn(0x55be9f479a30 msgr2=0x55be9f47f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.619+0000 7f9c424be740 1 -- 172.21.15.2:0/240130716 shutdown_connections 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.619+0000 7f9c424be740 1 -- 172.21.15.2:0/240130716 wait complete. 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.619+0000 7f9c424be740 20 client.17586 trim_cache size 0 max 16384 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c424be740 1 Processor -- start 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c424be740 1 -- start start 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c424be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 0x55be9f478a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c424be740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f49fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c424be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c424be740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381b24f0 con 0x55be9f47d4a0 2024-09-12T01:02:17.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c424be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381afdc0 con 0x55be9f479a30 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c424be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381adc30 con 0x55be9f47ddc0 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f49fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f49fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40292/0 (socket says 172.21.15.2:40292) 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 -- 172.21.15.2:0/3687025713 learned_addr learned my addr 172.21.15.2:0/3687025713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3de81640 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 0x55be9f478a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3e682640 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 -- 172.21.15.2:0/3687025713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 msgr2=0x55be9f4a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 -- 172.21.15.2:0/3687025713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 msgr2=0x55be9f478a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 0x55be9f478a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 -- 172.21.15.2:0/3687025713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be9f488290 con 0x55be9f47d4a0 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3e682640 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:17.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.636+0000 7f9c3d680640 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f49fdb0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9c28006aa0 tx=0x7f9c28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe355c1449bee6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c237fe640 1 -- 172.21.15.2:0/3687025713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280186b0 con 0x55be9f47d4a0 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c237fe640 1 -- 172.21.15.2:0/3687025713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c2802f070 con 0x55be9f47d4a0 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c237fe640 1 -- 172.21.15.2:0/3687025713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28012b10 con 0x55be9f47d4a0 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 -- 172.21.15.2:0/3687025713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 msgr2=0x55be9f49fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f49fdb0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9c28006aa0 tx=0x7f9c28008040 comp rx=0 tx=0).stop 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 -- 172.21.15.2:0/3687025713 shutdown_connections 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f4a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f49fdb0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 --2- 172.21.15.2:0/3687025713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 0x55be9f478a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 -- 172.21.15.2:0/3687025713 >> 172.21.15.2:0/3687025713 conn(0x55be9f485870 msgr2=0x55be9f478350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 -- 172.21.15.2:0/3687025713 shutdown_connections 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.637+0000 7f9c424be740 1 -- 172.21.15.2:0/3687025713 wait complete. 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 1 -- start start 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 1 Processor -- start 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 0x55be9f490ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f48de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f48e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381ae280 con 0x55be9f47d4a0 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381af6f0 con 0x55be9f479a30 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381ae950 con 0x55be9f47ddc0 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c424be740 10 client.0 _ll_register_callbacks cb 0x7f9c3400a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c3d680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f48de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c3d680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f48de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40300/0 (socket says 172.21.15.2:40300) 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c3d680640 1 -- 172.21.15.2:0/2698708112 learned_addr learned my addr 172.21.15.2:0/2698708112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c3de81640 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 0x55be9f490ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.638+0000 7f9c3e682640 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f48e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c3d680640 1 -- 172.21.15.2:0/2698708112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 msgr2=0x55be9f48e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c3d680640 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f48e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c3d680640 1 -- 172.21.15.2:0/2698708112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 msgr2=0x55be9f490ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c3d680640 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 0x55be9f490ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c3d680640 1 -- 172.21.15.2:0/2698708112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9f48e890 con 0x55be9f47d4a0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c3d680640 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f48de10 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9c28004700 tx=0x7f9c280183f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c22806a49b10364 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c217fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c217fa640 1 -- 172.21.15.2:0/2698708112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28012950 con 0x55be9f47d4a0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c424be740 1 -- 172.21.15.2:0/2698708112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c2802f070 con 0x55be9f47d4a0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c217fa640 1 -- 172.21.15.2:0/2698708112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f9c28012af0 con 0x55be9f47d4a0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c217fa640 1 -- 172.21.15.2:0/2698708112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9c28012cf0 con 0x55be9f47d4a0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c424be740 10 client.17592 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.639+0000 7f9c424be740 1 -- 172.21.15.2:0/2698708112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55be9f502a60 con 0x55be9f47d4a0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c217fa640 1 -- 172.21.15.2:0/2698708112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c2802f070 con 0x55be9f47d4a0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c217fa640 1 -- 172.21.15.2:0/2698708112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9c28044070 con 0x55be9f47d4a0 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c424be740 10 client.17592 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c424be740 10 client.17592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c424be740 20 client.17592 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c424be740 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55be9f488680 0x55be9f504e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c424be740 4 client.17592 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:02:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c424be740 1 -- 172.21.15.2:0/2698708112 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be9f3ead60 con 0x55be9f488680 2024-09-12T01:02:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c3de81640 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55be9f488680 0x55be9f504e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c3de81640 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55be9f488680 0x55be9f504e30 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a32d9c1a821363bb server_cookie=9c899d862b65c87e in_seq=0 out_seq=0 2024-09-12T01:02:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.640+0000 7f9c217fa640 10 client.17592 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c217fa640 1 -- 172.21.15.2:0/2698708112 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55be9f3ead60 con 0x55be9f488680 2024-09-12T01:02:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c217fa640 10 client.17592 handle_command_reply: tid=0 2024-09-12T01:02:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 client.17592 shutdown 2024-09-12T01:02:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 -- 172.21.15.2:0/2698708112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 msgr2=0x55be9f48de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f48de10 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9c28004700 tx=0x7f9c280183f0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 -- 172.21.15.2:0/2698708112 shutdown_connections 2024-09-12T01:02:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55be9f488680 0x55be9f504e30 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be9f47ddc0 0x55be9f48e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c217fa640 0 client.17592 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be9f47d4a0 0x55be9f48de10 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 --2- 172.21.15.2:0/2698708112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be9f479a30 0x55be9f490ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 -- 172.21.15.2:0/2698708112 >> 172.21.15.2:0/2698708112 conn(0x55be9f485870 msgr2=0x55be9f483660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 -- 172.21.15.2:0/2698708112 shutdown_connections 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 1 -- 172.21.15.2:0/2698708112 wait complete. 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.641+0000 7f9c424be740 20 client.17592 trim_cache size 0 max 16384 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:02:17.655 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stdout: "e25ce140-8c41-4a39-a5bc-1eb6a2ad2966": { 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "e25ce140-8c41-4a39-a5bc-1eb6a2ad2966", 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:02:17.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 -- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 msgr2=0x7f9c240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400abe0 tx=0x7f9c3400a2d0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 -- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 msgr2=0x7f9c3819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 0x7f9c3819ef30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9c3002ade0 tx=0x7f9c30031a60 comp rx=0 tx=0).stop 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 -- 172.21.15.2:0/888030670 shutdown_connections 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9c240a2cf0 0x7f9c240a51b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3810e480 0x7f9c3819ef30 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c38101280 0x7f9c3819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 --2- 172.21.15.2:0/888030670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c381008d0 0x7f9c3819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 -- 172.21.15.2:0/888030670 >> 172.21.15.2:0/888030670 conn(0x7f9c380fc7a0 msgr2=0x7f9c380feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 -- 172.21.15.2:0/888030670 shutdown_connections 2024-09-12T01:02:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:17.642+0000 7f9c400e5640 1 -- 172.21.15.2:0/888030670 wait complete. 2024-09-12T01:02:18.253 INFO:tasks.cephfs.filesystem:scrub status for tag:e25ce140-8c41-4a39-a5bc-1eb6a2ad2966 - {'path': '/', 'tag': 'e25ce140-8c41-4a39-a5bc-1eb6a2ad2966', 'options': 'recursive,force'} 2024-09-12T01:02:18.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:18 smithi071 ceph-mon[35276]: pgmap v290: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:18.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:18 smithi002 ceph-mon[31210]: pgmap v290: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:19.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:18 smithi167 ceph-mon[35234]: pgmap v290: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:20.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:20 smithi071 ceph-mon[35276]: pgmap v291: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:20.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:20 smithi002 ceph-mon[31210]: pgmap v291: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:21.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:20 smithi167 ceph-mon[35234]: pgmap v291: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-12T01:02:21.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:21 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T01:02:21.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:21 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T01:02:22.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:21 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T01:02:22.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:22 smithi071 ceph-mon[35276]: pgmap v292: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:02:22.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:22 smithi002 ceph-mon[31210]: pgmap v292: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:02:23.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:22 smithi167 ceph-mon[35234]: pgmap v292: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:02:24.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:24 smithi071 ceph-mon[35276]: pgmap v293: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:02:24.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:24 smithi002 ceph-mon[31210]: pgmap v293: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:02:25.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:24 smithi167 ceph-mon[35234]: pgmap v293: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:02:26.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:26 smithi071 ceph-mon[35276]: pgmap v294: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:02:26.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:26 smithi002 ceph-mon[31210]: pgmap v294: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:02:27.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:26 smithi167 ceph-mon[35234]: pgmap v294: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:02:28.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:28 smithi071 ceph-mon[35276]: pgmap v295: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:02:28.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:28 smithi002 ceph-mon[31210]: pgmap v295: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:02:29.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:28 smithi167 ceph-mon[35234]: pgmap v295: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:02:30.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:30 smithi071 ceph-mon[35276]: pgmap v296: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:02:30.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:30 smithi002 ceph-mon[31210]: pgmap v296: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:02:31.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:30 smithi167 ceph-mon[35234]: pgmap v296: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:02:32.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:32 smithi071 ceph-mon[35276]: pgmap v297: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:02:32.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:32 smithi002 ceph-mon[31210]: pgmap v297: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:02:33.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:32 smithi167 ceph-mon[35234]: pgmap v297: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T01:02:34.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:34 smithi071 ceph-mon[35276]: pgmap v298: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:34.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:34 smithi002 ceph-mon[31210]: pgmap v298: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:34 smithi167 ceph-mon[35234]: pgmap v298: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:36.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:36 smithi071 ceph-mon[35276]: pgmap v299: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:36.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:36 smithi002 ceph-mon[31210]: pgmap v299: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:37.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:36 smithi167 ceph-mon[35234]: pgmap v299: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:38.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:38 smithi071 ceph-mon[35276]: pgmap v300: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:38.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:38 smithi002 ceph-mon[31210]: pgmap v300: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:39.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:38 smithi167 ceph-mon[35234]: pgmap v300: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:40.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:40 smithi071 ceph-mon[35276]: pgmap v301: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:40.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:40 smithi002 ceph-mon[31210]: pgmap v301: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:41.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:40 smithi167 ceph-mon[35234]: pgmap v301: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:42.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:42 smithi071 ceph-mon[35276]: pgmap v302: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:42.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:42 smithi002 ceph-mon[31210]: pgmap v302: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:43.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:42 smithi167 ceph-mon[35234]: pgmap v302: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:44.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:44 smithi071 ceph-mon[35276]: pgmap v303: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:44.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:44 smithi002 ceph-mon[31210]: pgmap v303: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:45.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:44 smithi167 ceph-mon[35234]: pgmap v303: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:46.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:46 smithi071 ceph-mon[35276]: pgmap v304: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:46.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:46 smithi002 ceph-mon[31210]: pgmap v304: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:47.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:46 smithi167 ceph-mon[35234]: pgmap v304: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:48.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:02:48.525 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:48.892 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:48 smithi002 ceph-mon[31210]: pgmap v305: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:48.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:48 smithi071 ceph-mon[35276]: pgmap v305: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 -- 172.21.15.2:0/577384301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e810e500 msgr2=0x7fa7e8110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/577384301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e810e500 0x7fa7e8110910 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009ca0 tx=0x7fa7e002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 -- 172.21.15.2:0/577384301 shutdown_connections 2024-09-12T01:02:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/577384301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e810e500 0x7fa7e8110910 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/577384301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7e8101440 0x7fa7e810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/577384301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7e8100b20 0x7fa7e8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 -- 172.21.15.2:0/577384301 >> 172.21.15.2:0/577384301 conn(0x7fa7e80fc7d0 msgr2=0x7fa7e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 -- 172.21.15.2:0/577384301 shutdown_connections 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 -- 172.21.15.2:0/577384301 wait complete. 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 Processor -- start 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.977+0000 7fa7f03f9640 1 -- start start 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7f03f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e8100b20 0x7fa7e819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7f03f9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7e8101440 0x7fa7e819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7f03f9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7e810e500 0x7fa7e819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7f03f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e8114250 con 0x7fa7e8100b20 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7f03f9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81140d0 con 0x7fa7e8101440 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7f03f9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81143d0 con 0x7fa7e810e500 2024-09-12T01:02:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e8100b20 0x7fa7e819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e8100b20 0x7fa7e819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59496/0 (socket says 172.21.15.2:59496) 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 -- 172.21.15.2:0/2596274525 learned_addr learned my addr 172.21.15.2:0/2596274525 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ed994640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7e8101440 0x7fa7e819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee996640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7e810e500 0x7fa7e819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 -- 172.21.15.2:0/2596274525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7e810e500 msgr2=0x7fa7e819efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7e810e500 0x7fa7e819efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 -- 172.21.15.2:0/2596274525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7e8101440 msgr2=0x7fa7e819ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7e8101440 0x7fa7e819ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 -- 172.21.15.2:0/2596274525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e819f6c0 con 0x7fa7e8100b20 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7ee195640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e8100b20 0x7fa7e819a710 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400c890 tx=0x7fa7e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7df7fe640 1 -- 172.21.15.2:0/2596274525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4004220 con 0x7fa7e8100b20 2024-09-12T01:02:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7df7fe640 1 -- 172.21.15.2:0/2596274525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e40043c0 con 0x7fa7e8100b20 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.978+0000 7fa7f03f9640 1 -- 172.21.15.2:0/2596274525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e819f9b0 con 0x7fa7e8100b20 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.979+0000 7fa7df7fe640 1 -- 172.21.15.2:0/2596274525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e40049e0 con 0x7fa7e8100b20 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.979+0000 7fa7f03f9640 1 -- 172.21.15.2:0/2596274525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e81a7290 con 0x7fa7e8100b20 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.981+0000 7fa7df7fe640 1 -- 172.21.15.2:0/2596274525 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fa7e40079b0 con 0x7fa7e8100b20 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.981+0000 7fa7f27d2740 1 Processor -- start 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.981+0000 7fa7f27d2740 1 -- start start 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4be680 0x55ea3e4c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e4192e0 con 0x55ea3e4b34a0 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e3c0ce0 con 0x55ea3e4be680 2024-09-12T01:02:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e4152a0 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59512/0 (socket says 172.21.15.2:59512) 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 -- 172.21.15.2:0/374737317 learned_addr learned my addr 172.21.15.2:0/374737317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee195640 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ed994640 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4be680 0x55ea3e4c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7df7fe640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa7d40a2d70 0x7fa7d40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 -- 172.21.15.2:0/374737317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 msgr2=0x55ea3e4be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4be140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 -- 172.21.15.2:0/374737317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4be680 msgr2=0x55ea3e4c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4be680 0x55ea3e4c0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 -- 172.21.15.2:0/374737317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea3e3a5440 con 0x55ea3e4b34a0 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee195640 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7df7fe640 1 -- 172.21.15.2:0/2596274525 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fa7e40cf550 con 0x7fa7e8100b20 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.982+0000 7fa7ee996640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa7d40a2d70 0x7fa7d40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.983+0000 7fa7ee996640 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4b3880 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0005cc0 tx=0x7fa7e0031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3407d2ca0b21050f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.983+0000 7fa7dcdea640 1 -- 172.21.15.2:0/374737317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0041040 con 0x55ea3e4b34a0 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.983+0000 7fa7dcdea640 1 -- 172.21.15.2:0/374737317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e0036070 con 0x55ea3e4b34a0 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.983+0000 7fa7dcdea640 1 -- 172.21.15.2:0/374737317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e002fa30 con 0x55ea3e4b34a0 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 -- 172.21.15.2:0/374737317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 msgr2=0x55ea3e4b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4b3880 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0005cc0 tx=0x7fa7e0031bb0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7ee996640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa7d40a2d70 0x7fa7d40a5230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa7e004c000 tx=0x7fa7e004d000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 -- 172.21.15.2:0/374737317 shutdown_connections 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4be680 0x55ea3e4c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/374737317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4b3880 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 -- 172.21.15.2:0/374737317 >> 172.21.15.2:0/374737317 conn(0x55ea3e4afa30 msgr2=0x55ea3e4afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 -- 172.21.15.2:0/374737317 shutdown_connections 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 -- 172.21.15.2:0/374737317 wait complete. 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 -- start start 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 Processor -- start 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4bdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.984+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4bb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4be680 0x55ea3e4bb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e4c1250 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e3d4050 con 0x55ea3e4b34a0 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e4c13d0 con 0x55ea3e4be680 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7f27d2740 10 client.0 _ll_register_callbacks cb 0x55ea3e414160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4bb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59518/0 (socket says 172.21.15.2:59518) 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 -- 172.21.15.2:0/847573104 learned_addr learned my addr 172.21.15.2:0/847573104 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ee996640 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4be680 0x55ea3e4bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ee195640 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4bdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 -- 172.21.15.2:0/847573104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4be680 msgr2=0x55ea3e4bb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4be680 0x55ea3e4bb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 -- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 msgr2=0x55ea3e4bdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4bdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 -- 172.21.15.2:0/847573104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea3e18a3c0 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ee195640 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4bdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7ed994640 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4bb200 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8010720 tx=0x7fa7d8010be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8308bcd3595ae17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/847573104 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8004300 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.985+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/847573104 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fa7d800f980 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 1 -- 172.21.15.2:0/847573104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e0036070 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/847573104 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa7d80044a0 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 10 client.17604 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 1 -- 172.21.15.2:0/847573104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ea3e4ccc00 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/847573104 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e0036070 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/847573104 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa7d801a420 con 0x55ea3e4b3dc0 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 10 client.17604 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 10 client.17604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 20 client.17604 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ea3e4ce110 0x55ea3e4d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 4 client.17604 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.986+0000 7fa7f27d2740 1 -- 172.21.15.2:0/847573104 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea3e426850 con 0x55ea3e4ce110 2024-09-12T01:02:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.987+0000 7fa7ee195640 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ea3e4ce110 0x55ea3e4d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.987+0000 7fa7ee195640 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ea3e4ce110 0x55ea3e4d0590 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ec3928ff889756d server_cookie=fa6d183c36f3ca00 in_seq=0 out_seq=0 2024-09-12T01:02:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.987+0000 7fa7d1ffb640 10 client.17604 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/847573104 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea3e426850 con 0x55ea3e4ce110 2024-09-12T01:02:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7d1ffb640 10 client.17604 handle_command_reply: tid=0 2024-09-12T01:02:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 client.17604 shutdown 2024-09-12T01:02:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 -- 172.21.15.2:0/847573104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b3dc0 msgr2=0x55ea3e4bb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4bb200 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8010720 tx=0x7fa7d8010be0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 -- 172.21.15.2:0/847573104 shutdown_connections 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ea3e4ce110 0x55ea3e4d0590 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4be680 0x55ea3e4bb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4bb200 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/847573104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4bdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 -- 172.21.15.2:0/847573104 >> 172.21.15.2:0/847573104 conn(0x55ea3e4afa30 msgr2=0x55ea3e4aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7d1ffb640 0 client.17604 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 -- 172.21.15.2:0/847573104 shutdown_connections 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 1 -- 172.21.15.2:0/847573104 wait complete. 2024-09-12T01:02:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:48.988+0000 7fa7f27d2740 20 client.17604 trim_cache size 0 max 16384 2024-09-12T01:02:49.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.005+0000 7fa7f27d2740 1 Processor -- start 2024-09-12T01:02:49.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.005+0000 7fa7f27d2740 1 -- start start 2024-09-12T01:02:49.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.005+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4afa30 0x55ea3e4ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:49.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.005+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.005+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4ba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.005+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81b25d0 con 0x55ea3e4afa30 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.005+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81afea0 con 0x55ea3e4b34a0 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.005+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81add10 con 0x55ea3e4b3dc0 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4afa30 0x55ea3e4ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4afa30 0x55ea3e4ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59532/0 (socket says 172.21.15.2:59532) 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 -- 172.21.15.2:0/1713976444 learned_addr learned my addr 172.21.15.2:0/1713976444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 -- 172.21.15.2:0/1713976444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 msgr2=0x55ea3e4ba1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 --2- 172.21.15.2:0/1713976444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4ba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 -- 172.21.15.2:0/1713976444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 msgr2=0x55ea3e4d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ed994640 1 --2- 172.21.15.2:0/1713976444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 --2- 172.21.15.2:0/1713976444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 -- 172.21.15.2:0/1713976444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea3e4b3bb0 con 0x55ea3e4afa30 2024-09-12T01:02:49.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7ee195640 1 --2- 172.21.15.2:0/1713976444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4afa30 0x55ea3e4ca4b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa7e409b920 tx=0x7fa7e4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab389debf730270a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:49.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7d3fff640 1 -- 172.21.15.2:0/1713976444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e401d040 con 0x55ea3e4afa30 2024-09-12T01:02:49.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7d3fff640 1 -- 172.21.15.2:0/1713976444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e409c090 con 0x55ea3e4afa30 2024-09-12T01:02:49.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.006+0000 7fa7d3fff640 1 -- 172.21.15.2:0/1713976444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e40cce40 con 0x55ea3e4afa30 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 -- 172.21.15.2:0/1713976444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4afa30 msgr2=0x55ea3e4ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/1713976444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4afa30 0x55ea3e4ca4b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa7e409b920 tx=0x7fa7e4086040 comp rx=0 tx=0).stop 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 -- 172.21.15.2:0/1713976444 shutdown_connections 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/1713976444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4ba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/1713976444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/1713976444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4afa30 0x55ea3e4ca4b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 -- 172.21.15.2:0/1713976444 >> 172.21.15.2:0/1713976444 conn(0x55ea3e4bb8a0 msgr2=0x55ea3e4b9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 -- 172.21.15.2:0/1713976444 shutdown_connections 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 -- 172.21.15.2:0/1713976444 wait complete. 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 -- start start 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.007+0000 7fa7f27d2740 1 Processor -- start 2024-09-12T01:02:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4afa30 0x55ea3e4c2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7f27d2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81ae360 con 0x55ea3e4b34a0 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81af7d0 con 0x55ea3e4afa30 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7f27d2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81aea30 con 0x55ea3e4b3dc0 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7f27d2740 10 client.0 _ll_register_callbacks cb 0x7fa7d800a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59542/0 (socket says 172.21.15.2:59542) 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 -- 172.21.15.2:0/4062306313 learned_addr learned my addr 172.21.15.2:0/4062306313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ee195640 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4afa30 0x55ea3e4c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ee996640 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 -- 172.21.15.2:0/4062306313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 msgr2=0x55ea3e4c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4c2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 -- 172.21.15.2:0/4062306313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4afa30 msgr2=0x55ea3e4c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4afa30 0x55ea3e4c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 -- 172.21.15.2:0/4062306313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea3e537e30 con 0x55ea3e4b34a0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7ed994640 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4c27d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8006010 tx=0x7fa7d801a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bf6714ef153dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/4062306313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8004300 con 0x55ea3e4b34a0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/4062306313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fa7d800fb90 con 0x55ea3e4b34a0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.008+0000 7fa7f27d2740 1 -- 172.21.15.2:0/4062306313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e409c090 con 0x55ea3e4b34a0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/4062306313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa7d800fdb0 con 0x55ea3e4b34a0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7f27d2740 10 client.17610 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7f27d2740 1 -- 172.21.15.2:0/4062306313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ea3e539040 con 0x55ea3e4b34a0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/4062306313 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e409c090 con 0x55ea3e4b34a0 2024-09-12T01:02:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/4062306313 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa7d802a550 con 0x55ea3e4b34a0 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7f27d2740 10 client.17610 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7f27d2740 10 client.17610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7f27d2740 20 client.17610 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ea3e4be680 0x55ea3e53b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7f27d2740 4 client.17610 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7f27d2740 1 -- 172.21.15.2:0/4062306313 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ea3e420d60 con 0x55ea3e4be680 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.009+0000 7fa7ee195640 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ea3e4be680 0x55ea3e53b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7ee195640 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ea3e4be680 0x55ea3e53b750 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13d7515b6adfacf4 server_cookie=272d144764691ea7 in_seq=0 out_seq=0 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7d1ffb640 10 client.17610 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7d1ffb640 1 -- 172.21.15.2:0/4062306313 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ea3e420d60 con 0x55ea3e4be680 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7d1ffb640 10 client.17610 handle_command_reply: tid=0 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 client.17610 shutdown 2024-09-12T01:02:49.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 -- 172.21.15.2:0/4062306313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 msgr2=0x55ea3e4c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4c27d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8006010 tx=0x7fa7d801a6d0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 -- 172.21.15.2:0/4062306313 shutdown_connections 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55ea3e4be680 0x55ea3e53b750 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea3e4b3dc0 0x55ea3e4c2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e4b34a0 0x55ea3e4c27d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 --2- 172.21.15.2:0/4062306313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea3e4afa30 0x55ea3e4c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 -- 172.21.15.2:0/4062306313 >> 172.21.15.2:0/4062306313 conn(0x55ea3e4bb8a0 msgr2=0x55ea3e4ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7d1ffb640 0 client.17610 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 -- 172.21.15.2:0/4062306313 shutdown_connections 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 1 -- 172.21.15.2:0/4062306313 wait complete. 2024-09-12T01:02:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.010+0000 7fa7f27d2740 20 client.17610 trim_cache size 0 max 16384 2024-09-12T01:02:49.016 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:02:49.016 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T01:02:49.016 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T01:02:49.016 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 -- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa7d40a2d70 msgr2=0x7fa7d40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa7d40a2d70 0x7fa7d40a5230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa7e004c000 tx=0x7fa7e004d000 comp rx=0 tx=0).stop 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 -- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e8100b20 msgr2=0x7fa7e819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e8100b20 0x7fa7e819a710 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400c890 tx=0x7fa7e400cd50 comp rx=0 tx=0).stop 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 -- 172.21.15.2:0/2596274525 shutdown_connections 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa7d40a2d70 0x7fa7d40a5230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7e810e500 0x7fa7e819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7e8101440 0x7fa7e819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 --2- 172.21.15.2:0/2596274525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7e8100b20 0x7fa7e819a710 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 -- 172.21.15.2:0/2596274525 >> 172.21.15.2:0/2596274525 conn(0x7fa7e80fc7d0 msgr2=0x7fa7e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 -- 172.21.15.2:0/2596274525 shutdown_connections 2024-09-12T01:02:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:49.011+0000 7fa7f03f9640 1 -- 172.21.15.2:0/2596274525 wait complete. 2024-09-12T01:02:49.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:48 smithi167 ceph-mon[35234]: pgmap v305: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:49.778 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:02:49.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:02:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 -- 172.21.15.2:0/4217555440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c101420 msgr2=0x7f5b8c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 --2- 172.21.15.2:0/4217555440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c101420 0x7f5b8c10d950 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009cd0 tx=0x7f5b8402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 -- 172.21.15.2:0/4217555440 shutdown_connections 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 --2- 172.21.15.2:0/4217555440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c101420 0x7f5b8c10d950 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 --2- 172.21.15.2:0/4217555440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8c100a80 0x7f5b8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 --2- 172.21.15.2:0/4217555440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b8c106a80 0x7f5b8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 -- 172.21.15.2:0/4217555440 >> 172.21.15.2:0/4217555440 conn(0x7f5b8c0fc7a0 msgr2=0x7f5b8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 -- 172.21.15.2:0/4217555440 shutdown_connections 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.491+0000 7f5b929e7640 1 -- 172.21.15.2:0/4217555440 wait complete. 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b929e7640 1 Processor -- start 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b929e7640 1 -- start start 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b929e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b8c100a80 0x7f5b8c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b929e7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8c101420 0x7f5b8c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b929e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c106a80 0x7f5b8c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b929e7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c110ef0 con 0x7f5b8c106a80 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b929e7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c110d70 con 0x7f5b8c101420 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b929e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c111070 con 0x7f5b8c100a80 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b90f84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c106a80 0x7f5b8c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b90f84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c106a80 0x7f5b8c199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59558/0 (socket says 172.21.15.2:59558) 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.492+0000 7f5b90f84640 1 -- 172.21.15.2:0/1824929818 learned_addr learned my addr 172.21.15.2:0/1824929818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b8bfff640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b8c100a80 0x7f5b8c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b8b7fe640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8c101420 0x7f5b8c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b90f84640 1 -- 172.21.15.2:0/1824929818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b8c100a80 msgr2=0x7f5b8c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b90f84640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b8c100a80 0x7f5b8c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b90f84640 1 -- 172.21.15.2:0/1824929818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8c101420 msgr2=0x7f5b8c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b90f84640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8c101420 0x7f5b8c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b90f84640 1 -- 172.21.15.2:0/1824929818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c1a46e0 con 0x7f5b8c106a80 2024-09-12T01:02:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b8bfff640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b8c100a80 0x7f5b8c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b90f84640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c106a80 0x7f5b8c199da0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009ca0 tx=0x7f5b84003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b897fa640 1 -- 172.21.15.2:0/1824929818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84004240 con 0x7f5b8c106a80 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b897fa640 1 -- 172.21.15.2:0/1824929818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b840305a0 con 0x7f5b8c106a80 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c1a4970 con 0x7f5b8c106a80 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b897fa640 1 -- 172.21.15.2:0/1824929818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8403a660 con 0x7f5b8c106a80 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.493+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c1a4f00 con 0x7f5b8c106a80 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.494+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8c100ee0 con 0x7f5b8c106a80 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.495+0000 7f5b897fa640 1 -- 172.21.15.2:0/1824929818 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f5b84030750 con 0x7f5b8c106a80 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.496+0000 7f5b897fa640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5b740a2d70 0x7f5b740a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.496+0000 7f5b8bfff640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5b740a2d70 0x7f5b740a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.496+0000 7f5b897fa640 1 -- 172.21.15.2:0/1824929818 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f5b8402e030 con 0x7f5b8c106a80 2024-09-12T01:02:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.497+0000 7f5b8bfff640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5b740a2d70 0x7f5b740a5230 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009930 tx=0x7f5b7c008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.500+0000 7f5b897fa640 1 -- 172.21.15.2:0/1824929818 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b840bd2d0 con 0x7f5b8c106a80 2024-09-12T01:02:50.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.711+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b8c1a51c0 con 0x7f5b8c106a80 2024-09-12T01:02:50.711 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:50 smithi002 ceph-mon[31210]: pgmap v306: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:50.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.712+0000 7f5b897fa640 1 -- 172.21.15.2:0/1824929818 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11899 (secure 0 0 0) 0x7f5b840bcbd0 con 0x7f5b8c106a80 2024-09-12T01:02:50.712 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:02:50.712 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":35,"btime":"2024-09-12T01:01:35:630451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T01:01:35.219926+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T01:02:50.712 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 35 2024-09-12T01:02:50.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5b740a2d70 msgr2=0x7f5b740a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:50.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5b740a2d70 0x7f5b740a5230 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009930 tx=0x7f5b7c008040 comp rx=0 tx=0).stop 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c106a80 msgr2=0x7f5b8c199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c106a80 0x7f5b8c199da0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009ca0 tx=0x7f5b84003ba0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 shutdown_connections 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5b740a2d70 0x7f5b740a5230 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b8c106a80 0x7f5b8c199da0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8c101420 0x7f5b8c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 --2- 172.21.15.2:0/1824929818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b8c100a80 0x7f5b8c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 >> 172.21.15.2:0/1824929818 conn(0x7f5b8c0fc7a0 msgr2=0x7f5b8c0fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 shutdown_connections 2024-09-12T01:02:50.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:50.715+0000 7f5b929e7640 1 -- 172.21.15.2:0/1824929818 wait complete. 2024-09-12T01:02:50.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:50 smithi071 ceph-mon[35276]: pgmap v306: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:51.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:50 smithi167 ceph-mon[35234]: pgmap v306: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:51.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:02:51.561 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:51.932 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:51 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1824929818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:02:51.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:51 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1824929818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:02:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 -- 172.21.15.2:0/1769374449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0101420 msgr2=0x7fe3f010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/1769374449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0101420 0x7fe3f010d950 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009cd0 tx=0x7fe3e802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 -- 172.21.15.2:0/1769374449 shutdown_connections 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/1769374449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0101420 0x7fe3f010d950 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/1769374449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3f0100a80 0x7fe3f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/1769374449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3f0106a80 0x7fe3f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 -- 172.21.15.2:0/1769374449 >> 172.21.15.2:0/1769374449 conn(0x7fe3f00fc7a0 msgr2=0x7fe3f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 -- 172.21.15.2:0/1769374449 shutdown_connections 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.017+0000 7fe3f6a86640 1 -- 172.21.15.2:0/1769374449 wait complete. 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f6a86640 1 Processor -- start 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f6a86640 1 -- start start 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f6a86640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3f0100a80 0x7fe3f0197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f6a86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3f0101420 0x7fe3f01978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f6a86640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0106a80 0x7fe3f019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f6a86640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f0110ea0 con 0x7fe3f0106a80 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f6a86640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f0110d20 con 0x7fe3f0100a80 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f6a86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f0111020 con 0x7fe3f0101420 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f5023640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0106a80 0x7fe3f019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f5023640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0106a80 0x7fe3f019bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59582/0 (socket says 172.21.15.2:59582) 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f5023640 1 -- 172.21.15.2:0/3859962707 learned_addr learned my addr 172.21.15.2:0/3859962707 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3f0101420 0x7fe3f01978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.018+0000 7fe3f4822640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3f0100a80 0x7fe3f0197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3f5023640 1 -- 172.21.15.2:0/3859962707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3f0101420 msgr2=0x7fe3f01978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3f5023640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3f0101420 0x7fe3f01978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3f5023640 1 -- 172.21.15.2:0/3859962707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3f0100a80 msgr2=0x7fe3f0197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3f5023640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3f0100a80 0x7fe3f0197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3f5023640 1 -- 172.21.15.2:0/3859962707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f019c310 con 0x7fe3f0106a80 2024-09-12T01:02:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3f5023640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0106a80 0x7fe3f019bc30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006010 tx=0x7fe3e8031d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3e5ffb640 1 -- 172.21.15.2:0/3859962707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8004240 con 0x7fe3f0106a80 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3e5ffb640 1 -- 172.21.15.2:0/3859962707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e803d610 con 0x7fe3f0106a80 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3f6a86640 1 -- 172.21.15.2:0/3859962707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f019c5a0 con 0x7fe3f0106a80 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3e5ffb640 1 -- 172.21.15.2:0/3859962707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8030800 con 0x7fe3f0106a80 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.019+0000 7fe3f6a86640 1 -- 172.21.15.2:0/3859962707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f006a790 con 0x7fe3f0106a80 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3e5ffb640 1 -- 172.21.15.2:0/3859962707 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe3e803d7c0 con 0x7fe3f0106a80 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f8e5f740 1 Processor -- start 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f8e5f740 1 -- start start 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa91090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa915d0 0x5628bfa91a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa9c370 0x5628bfa9e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5628bf9f72f0 con 0x5628bfa9c370 2024-09-12T01:02:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5628bf99ecf0 con 0x5628bfa92b40 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628bf9f32b0 con 0x5628bfa915d0 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa9c370 0x5628bfa9e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa9c370 0x5628bfa9e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59590/0 (socket says 172.21.15.2:59590) 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3e7fff640 1 -- 172.21.15.2:0/2010011299 learned_addr learned my addr 172.21.15.2:0/2010011299 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa91090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3f4822640 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa915d0 0x5628bfa91a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.022+0000 7fe3e5ffb640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3d80a2d70 0x7fe3d80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3e7fff640 1 -- 172.21.15.2:0/2010011299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa915d0 msgr2=0x5628bfa91a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa915d0 0x5628bfa91a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3e7fff640 1 -- 172.21.15.2:0/2010011299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa9c370 msgr2=0x5628bfa9e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa9c370 0x5628bfa9e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3f5023640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3d80a2d70 0x7fe3d80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3e7fff640 1 -- 172.21.15.2:0/2010011299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628bf9833a0 con 0x5628bfa92b40 2024-09-12T01:02:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3e5ffb640 1 -- 172.21.15.2:0/3859962707 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fe3e802e030 con 0x7fe3f0106a80 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa91090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0005b00 tx=0x7fe3e000a2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de6e15f9a114bcea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3d6ffd640 1 -- 172.21.15.2:0/2010011299 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0004020 con 0x5628bfa92b40 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3f5023640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3d80a2d70 0x7fe3d80a5230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80bf360 tx=0x7fe3e802a8e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3d6ffd640 1 -- 172.21.15.2:0/2010011299 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e000dc20 con 0x5628bfa92b40 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.023+0000 7fe3d6ffd640 1 -- 172.21.15.2:0/2010011299 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0003850 con 0x5628bfa92b40 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2010011299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 msgr2=0x5628bfa91090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa91090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0005b00 tx=0x7fe3e000a2d0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2010011299 shutdown_connections 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa9c370 0x5628bfa9e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa915d0 0x5628bfa91a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/2010011299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa91090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2010011299 >> 172.21.15.2:0/2010011299 conn(0x5628bfa5a310 msgr2=0x5628bfa8dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2010011299 shutdown_connections 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2010011299 wait complete. 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 -- start start 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.024+0000 7fe3f8e5f740 1 Processor -- start 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa9bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa99050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa9c370 0x5628bfa997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5628bfa9f010 con 0x5628bfa915d0 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5628bf9b2060 con 0x5628bfa92b40 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628bfa9f190 con 0x5628bfa9c370 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3f8e5f740 10 client.0 _ll_register_callbacks cb 0x5628bf7058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa9bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa9bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59604/0 (socket says 172.21.15.2:59604) 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 -- 172.21.15.2:0/1900294803 learned_addr learned my addr 172.21.15.2:0/1900294803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3f4822640 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa99050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 -- 172.21.15.2:0/1900294803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa9c370 msgr2=0x5628bfa997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa9c370 0x5628bfa997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 -- 172.21.15.2:0/1900294803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 msgr2=0x5628bfa99050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa99050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 -- 172.21.15.2:0/1900294803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628bf7683c0 con 0x5628bfa915d0 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa9bda0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000ac00 tx=0x7fe3e000a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6a535d696657f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.025+0000 7fe3cffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3cffff640 1 -- 172.21.15.2:0/1900294803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0015070 con 0x5628bfa915d0 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3cffff640 1 -- 172.21.15.2:0/1900294803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fe3e0005100 con 0x5628bfa915d0 2024-09-12T01:02:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1900294803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e000dc20 con 0x5628bfa915d0 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3cffff640 1 -- 172.21.15.2:0/1900294803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe3e0037050 con 0x5628bfa915d0 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 10 client.17628 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1900294803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5628bfaaaaf0 con 0x5628bfa915d0 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3cffff640 1 -- 172.21.15.2:0/1900294803 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e000dc20 con 0x5628bfa915d0 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3cffff640 1 -- 172.21.15.2:0/1900294803 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe3e001d5e0 con 0x5628bfa915d0 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 10 client.17628 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 10 client.17628 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 20 client.17628 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5628bfaabef0 0x5628bfaae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 4 client.17628 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.026+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1900294803 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628bfa04860 con 0x5628bfaabef0 2024-09-12T01:02:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.027+0000 7fe3f4822640 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5628bfaabef0 0x5628bfaae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.027+0000 7fe3cffff640 10 client.17628 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.027+0000 7fe3f4822640 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5628bfaabef0 0x5628bfaae2e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d92b7514837cc4ad server_cookie=63ea63fd52ed0cdd in_seq=0 out_seq=0 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3cffff640 1 -- 172.21.15.2:0/1900294803 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628bfa04860 con 0x5628bfaabef0 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3cffff640 10 client.17628 handle_command_reply: tid=0 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 client.17628 shutdown 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1900294803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 msgr2=0x5628bfa9bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa9bda0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000ac00 tx=0x7fe3e000a5f0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1900294803 shutdown_connections 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5628bfaabef0 0x5628bfaae2e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa9c370 0x5628bfa997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa99050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1900294803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa9bda0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3cffff640 0 client.17628 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:02:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1900294803 >> 172.21.15.2:0/1900294803 conn(0x5628bfa5a310 msgr2=0x5628bfa93960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1900294803 shutdown_connections 2024-09-12T01:02:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1900294803 wait complete. 2024-09-12T01:02:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.028+0000 7fe3f8e5f740 20 client.17628 trim_cache size 0 max 16384 2024-09-12T01:02:52.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:51 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1824929818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.041+0000 7fe3f8e5f740 1 Processor -- start 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.041+0000 7fe3f8e5f740 1 -- start start 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.041+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa93820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.041+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa92b40 0x5628bfa93d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.041+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa9c370 0x5628bfa8d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.041+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f01ae140 con 0x5628bfa915d0 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.041+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f01aba10 con 0x5628bfa9c370 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.041+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f01a9880 con 0x5628bfa92b40 2024-09-12T01:02:52.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa93820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa93820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59608/0 (socket says 172.21.15.2:59608) 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 -- 172.21.15.2:0/2428281898 learned_addr learned my addr 172.21.15.2:0/2428281898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3f4822640 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa92b40 0x5628bfa93d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 -- 172.21.15.2:0/2428281898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa92b40 msgr2=0x5628bfa93d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa92b40 0x5628bfa93d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 -- 172.21.15.2:0/2428281898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa9c370 msgr2=0x5628bfa8d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa9c370 0x5628bfa8d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 -- 172.21.15.2:0/2428281898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628bfaa8780 con 0x5628bfa915d0 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3f4822640 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa92b40 0x5628bfa93d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa93820 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0014040 tx=0x7fe3e000a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5452bc30b66da9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3d67fc640 1 -- 172.21.15.2:0/2428281898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0015070 con 0x5628bfa915d0 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3d67fc640 1 -- 172.21.15.2:0/2428281898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e002e070 con 0x5628bfa915d0 2024-09-12T01:02:52.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.042+0000 7fe3d67fc640 1 -- 172.21.15.2:0/2428281898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0004660 con 0x5628bfa915d0 2024-09-12T01:02:52.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2428281898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 msgr2=0x5628bfa93820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa93820 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0014040 tx=0x7fe3e000a350 comp rx=0 tx=0).stop 2024-09-12T01:02:52.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2428281898 shutdown_connections 2024-09-12T01:02:52.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa9c370 0x5628bfa8d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa92b40 0x5628bfa93d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/2428281898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfa93820 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2428281898 >> 172.21.15.2:0/2428281898 conn(0x5628bfa5a310 msgr2=0x5628bfa93110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2428281898 shutdown_connections 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/2428281898 wait complete. 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 -- start start 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.043+0000 7fe3f8e5f740 1 Processor -- start 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfaa4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa95ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3f8e5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa9c370 0x5628bfa964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f01a9ed0 con 0x5628bfa915d0 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f01ab340 con 0x5628bfa92b40 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3f8e5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f01aa5a0 con 0x5628bfa9c370 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3f8e5f740 10 client.0 _ll_register_callbacks cb 0x7fe3e000a9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:52.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfaa4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfaa4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59624/0 (socket says 172.21.15.2:59624) 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 -- 172.21.15.2:0/1351668205 learned_addr learned my addr 172.21.15.2:0/1351668205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 -- 172.21.15.2:0/1351668205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa9c370 msgr2=0x5628bfa964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3f4822640 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa95ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa9c370 0x5628bfa964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 -- 172.21.15.2:0/1351668205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 msgr2=0x5628bfa95ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa95ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 -- 172.21.15.2:0/1351668205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628bfa96cb0 con 0x5628bfa915d0 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3e7fff640 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfaa4c40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00116b0 tx=0x7fe3e000abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab5119260587cad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.044+0000 7fe3cffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3cffff640 1 -- 172.21.15.2:0/1351668205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0048020 con 0x5628bfa915d0 2024-09-12T01:02:52.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3cffff640 1 -- 172.21.15.2:0/1351668205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fe3e0005100 con 0x5628bfa915d0 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1351668205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e002e070 con 0x5628bfa915d0 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3cffff640 1 -- 172.21.15.2:0/1351668205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe3e0015040 con 0x5628bfa915d0 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 10 client.17634 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1351668205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5628bfb16ab0 con 0x5628bfa915d0 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3cffff640 1 -- 172.21.15.2:0/1351668205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e002e070 con 0x5628bfa915d0 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3cffff640 1 -- 172.21.15.2:0/1351668205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe3e00047d0 con 0x5628bfa915d0 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 10 client.17634 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 10 client.17634 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 20 client.17634 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5628bfb171c0 0x5628bfb195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 4 client.17634 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.045+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1351668205 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628bf9fed70 con 0x5628bfb171c0 2024-09-12T01:02:52.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f4822640 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5628bfb171c0 0x5628bfb195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f4822640 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5628bfb171c0 0x5628bfb195e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b1d61dd079291360 server_cookie=402189abb3271ec in_seq=0 out_seq=0 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3cffff640 10 client.17634 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3cffff640 1 -- 172.21.15.2:0/1351668205 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628bf9fed70 con 0x5628bfb171c0 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3cffff640 10 client.17634 handle_command_reply: tid=0 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 client.17634 shutdown 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1351668205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 msgr2=0x5628bfaa4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfaa4c40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00116b0 tx=0x7fe3e000abb0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1351668205 shutdown_connections 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x5628bfb171c0 0x5628bfb195e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628bfa9c370 0x5628bfa964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628bfa92b40 0x5628bfa95ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3cffff640 0 client.17634 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:02:52.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 --2- 172.21.15.2:0/1351668205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628bfa915d0 0x5628bfaa4c40 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1351668205 >> 172.21.15.2:0/1351668205 conn(0x5628bfa5a310 msgr2=0x5628bfaa7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:52.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1351668205 shutdown_connections 2024-09-12T01:02:52.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.046+0000 7fe3f8e5f740 1 -- 172.21.15.2:0/1351668205 wait complete. 2024-09-12T01:02:52.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f8e5f740 20 client.17634 trim_cache size 0 max 16384 2024-09-12T01:02:52.051 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 -- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3d80a2d70 msgr2=0x7fe3d80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3d80a2d70 0x7fe3d80a5230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80bf360 tx=0x7fe3e802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 -- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0106a80 msgr2=0x7fe3f019bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0106a80 0x7fe3f019bc30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006010 tx=0x7fe3e8031d70 comp rx=0 tx=0).stop 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 -- 172.21.15.2:0/3859962707 shutdown_connections 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe3d80a2d70 0x7fe3d80a5230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f0106a80 0x7fe3f019bc30 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3f0101420 0x7fe3f01978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 --2- 172.21.15.2:0/3859962707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3f0100a80 0x7fe3f0197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 -- 172.21.15.2:0/3859962707 >> 172.21.15.2:0/3859962707 conn(0x7fe3f00fc7a0 msgr2=0x7fe3f00fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:52.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 -- 172.21.15.2:0/3859962707 shutdown_connections 2024-09-12T01:02:52.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:52.047+0000 7fe3f6a86640 1 -- 172.21.15.2:0/3859962707 wait complete. 2024-09-12T01:02:52.694 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:02:52.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:52 smithi071 ceph-mon[35276]: pgmap v307: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:52.952 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:52.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:52 smithi002 ceph-mon[31210]: pgmap v307: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:53.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:52 smithi167 ceph-mon[35234]: pgmap v307: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 -- 172.21.15.2:0/287470877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584106a80 msgr2=0x7fc584106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 --2- 172.21.15.2:0/287470877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584106a80 0x7fc584106e60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc574009930 tx=0x7fc57402a420 comp rx=0 tx=0).stop 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 -- 172.21.15.2:0/287470877 shutdown_connections 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 --2- 172.21.15.2:0/287470877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc584101420 0x7fc58410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 --2- 172.21.15.2:0/287470877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc584100a80 0x7fc584100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 --2- 172.21.15.2:0/287470877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584106a80 0x7fc584106e60 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 -- 172.21.15.2:0/287470877 >> 172.21.15.2:0/287470877 conn(0x7fc5840fc7a0 msgr2=0x7fc5840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 -- 172.21.15.2:0/287470877 shutdown_connections 2024-09-12T01:02:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.425+0000 7fc589832640 1 -- 172.21.15.2:0/287470877 wait complete. 2024-09-12T01:02:53.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc589832640 1 Processor -- start 2024-09-12T01:02:53.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc589832640 1 -- start start 2024-09-12T01:02:53.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc589832640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584100a80 0x7fc5841984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc589832640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc584101420 0x7fc584198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc589832640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc584106a80 0x7fc58419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc589832640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc584111fa0 con 0x7fc584100a80 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc589832640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc584111e20 con 0x7fc584101420 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc589832640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc584112120 con 0x7fc584106a80 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584100a80 0x7fc5841984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584100a80 0x7fc5841984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59640/0 (socket says 172.21.15.2:59640) 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc582ffd640 1 -- 172.21.15.2:0/2273754099 learned_addr learned my addr 172.21.15.2:0/2273754099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.426+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc584101420 0x7fc584198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc5837fe640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc584106a80 0x7fc58419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc582ffd640 1 -- 172.21.15.2:0/2273754099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc584106a80 msgr2=0x7fc58419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc582ffd640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc584106a80 0x7fc58419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc582ffd640 1 -- 172.21.15.2:0/2273754099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc584101420 msgr2=0x7fc584198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc582ffd640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc584101420 0x7fc584198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc582ffd640 1 -- 172.21.15.2:0/2273754099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58419d470 con 0x7fc584100a80 2024-09-12T01:02:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc582ffd640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584100a80 0x7fc5841984c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fc574009a50 tx=0x7fc574004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc588830640 1 -- 172.21.15.2:0/2273754099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57403f030 con 0x7fc584100a80 2024-09-12T01:02:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc589832640 1 -- 172.21.15.2:0/2273754099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58419d700 con 0x7fc584100a80 2024-09-12T01:02:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc588830640 1 -- 172.21.15.2:0/2273754099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc574003ad0 con 0x7fc584100a80 2024-09-12T01:02:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc588830640 1 -- 172.21.15.2:0/2273754099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574035070 con 0x7fc584100a80 2024-09-12T01:02:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.427+0000 7fc589832640 1 -- 172.21.15.2:0/2273754099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5841a5040 con 0x7fc584100a80 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc588830640 1 -- 172.21.15.2:0/2273754099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc574042030 con 0x7fc584100a80 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc58bc0b740 1 Processor -- start 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc58bc0b740 1 -- start start 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa3b40 0x55f25faa2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faa2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faad370 0x55f25faaf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f25fa082f0 con 0x55f25faa25d0 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f25f9afcf0 con 0x55f25faad370 2024-09-12T01:02:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f25fa042b0 con 0x55f25faa3b40 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faa2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faa2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59646/0 (socket says 172.21.15.2:59646) 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc582ffd640 1 -- 172.21.15.2:0/2602594823 learned_addr learned my addr 172.21.15.2:0/2602594823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc5837fe640 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa3b40 0x55f25faa2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.430+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faad370 0x55f25faaf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc588830640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc5700a2cf0 0x7fc5700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc582ffd640 1 -- 172.21.15.2:0/2602594823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa3b40 msgr2=0x55f25faa2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc582ffd640 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa3b40 0x55f25faa2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc582ffd640 1 -- 172.21.15.2:0/2602594823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faad370 msgr2=0x55f25faaf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc582ffd640 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faad370 0x55f25faaf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc582ffd640 1 -- 172.21.15.2:0/2602594823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25f9943a0 con 0x55f25faa25d0 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc5837fe640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc5700a2cf0 0x7fc5700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc588830640 1 -- 172.21.15.2:0/2273754099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fc5740ef3e0 con 0x7fc584100a80 2024-09-12T01:02:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc582ffd640 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faa2a10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fc5740eca20 tx=0x7fc5740e6410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d94844f6ca54a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc579ffb640 1 -- 172.21.15.2:0/2602594823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574049020 con 0x55f25faa25d0 2024-09-12T01:02:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc579ffb640 1 -- 172.21.15.2:0/2602594823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5740bbf80 con 0x55f25faa25d0 2024-09-12T01:02:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc579ffb640 1 -- 172.21.15.2:0/2602594823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740bb880 con 0x55f25faa25d0 2024-09-12T01:02:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.431+0000 7fc5837fe640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc5700a2cf0 0x7fc5700a51b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc57c007f30 tx=0x7fc57c004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:53.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 -- 172.21.15.2:0/2602594823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 msgr2=0x55f25faa2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faa2a10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fc5740eca20 tx=0x7fc5740e6410 comp rx=0 tx=0).stop 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 -- 172.21.15.2:0/2602594823 shutdown_connections 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faad370 0x55f25faaf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faa2a10 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/2602594823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa3b40 0x55f25faa2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 -- 172.21.15.2:0/2602594823 >> 172.21.15.2:0/2602594823 conn(0x55f25fa6b310 msgr2=0x55f25fa9ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 -- 172.21.15.2:0/2602594823 shutdown_connections 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 -- 172.21.15.2:0/2602594823 wait complete. 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.432+0000 7fc58bc0b740 1 -- start start 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc58bc0b740 1 Processor -- start 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faaccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25faa9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 0x55f25faaa520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f25faafe30 con 0x55f25faa25d0 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f25f9c3060 con 0x55f25faa3b40 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f25faaffb0 con 0x55f25faad370 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc58bc0b740 10 client.0 _ll_register_callbacks cb 0x55f25f7168c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faaccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faaccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59654/0 (socket says 172.21.15.2:59654) 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc582ffd640 1 -- 172.21.15.2:0/1618384876 learned_addr learned my addr 172.21.15.2:0/1618384876 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc5837fe640 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 0x55f25faaa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25faa9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc582ffd640 1 -- 172.21.15.2:0/1618384876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 msgr2=0x55f25faaa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc582ffd640 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 0x55f25faaa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc582ffd640 1 -- 172.21.15.2:0/1618384876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 msgr2=0x55f25faa9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc582ffd640 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25faa9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.433+0000 7fc582ffd640 1 -- 172.21.15.2:0/1618384876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25f7793c0 con 0x55f25faa25d0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc582ffd640 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faaccf0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc574000c00 tx=0x7fc57402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925e550014c5f3ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc562ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc562ffd640 1 -- 172.21.15.2:0/1618384876 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574049070 con 0x55f25faa25d0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc562ffd640 1 -- 172.21.15.2:0/1618384876 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fc5740cfa60 con 0x55f25faa25d0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 1 -- 172.21.15.2:0/1618384876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5740bbf80 con 0x55f25faa25d0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc562ffd640 1 -- 172.21.15.2:0/1618384876 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc5740bb1e0 con 0x55f25faa25d0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 10 client.17646 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 1 -- 172.21.15.2:0/1618384876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f25faafe30 con 0x55f25faa25d0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc562ffd640 1 -- 172.21.15.2:0/1618384876 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5740bbf80 con 0x55f25faa25d0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc562ffd640 1 -- 172.21.15.2:0/1618384876 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc5740ebbf0 con 0x55f25faa25d0 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 10 client.17646 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 10 client.17646 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 20 client.17646 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55f25fabca80 0x55f25fabeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 4 client.17646 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.434+0000 7fc58bc0b740 1 -- 172.21.15.2:0/1618384876 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f25fa15860 con 0x55f25fabca80 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.435+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55f25fabca80 0x55f25fabeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.435+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55f25fabca80 0x55f25fabeec0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=747c8951e646676f server_cookie=a899d2f6f36e1a88 in_seq=0 out_seq=0 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.435+0000 7fc562ffd640 10 client.17646 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc562ffd640 1 -- 172.21.15.2:0/1618384876 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f25fa15860 con 0x55f25fabca80 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc562ffd640 10 client.17646 handle_command_reply: tid=0 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 client.17646 shutdown 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 -- 172.21.15.2:0/1618384876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 msgr2=0x55f25faaccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faaccf0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc574000c00 tx=0x7fc57402a420 comp rx=0 tx=0).stop 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 -- 172.21.15.2:0/1618384876 shutdown_connections 2024-09-12T01:02:53.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55f25fabca80 0x55f25fabeec0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 0x55f25faaa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25faa9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/1618384876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25faaccf0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 -- 172.21.15.2:0/1618384876 >> 172.21.15.2:0/1618384876 conn(0x55f25fa6b310 msgr2=0x55f25faa4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:53.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc562ffd640 0 client.17646 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:02:53.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 -- 172.21.15.2:0/1618384876 shutdown_connections 2024-09-12T01:02:53.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 1 -- 172.21.15.2:0/1618384876 wait complete. 2024-09-12T01:02:53.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.436+0000 7fc58bc0b740 20 client.17646 trim_cache size 0 max 16384 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.449+0000 7fc58bc0b740 1 Processor -- start 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.449+0000 7fc58bc0b740 1 -- start start 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.449+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa25d0 0x55f25fab9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.449+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25faa8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.449+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faad370 0x55f25faa5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.449+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841b0400 con 0x55f25faad370 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.449+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841adcd0 con 0x55f25faa3b40 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.449+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841abb40 con 0x55f25faa25d0 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faad370 0x55f25faa5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faad370 0x55f25faa5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59662/0 (socket says 172.21.15.2:59662) 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 -- 172.21.15.2:0/4130446018 learned_addr learned my addr 172.21.15.2:0/4130446018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc582ffd640 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa25d0 0x55f25fab9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25faa8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 -- 172.21.15.2:0/4130446018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa25d0 msgr2=0x55f25fab9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa25d0 0x55f25fab9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 -- 172.21.15.2:0/4130446018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 msgr2=0x55f25faa8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25faa8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 -- 172.21.15.2:0/4130446018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25fa9f960 con 0x55f25faad370 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5837fe640 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faad370 0x55f25faa5120 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc57c01e7a0 tx=0x7fc57c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8ef24ce74fd034 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5797fa640 1 -- 172.21.15.2:0/4130446018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c012c20 con 0x55f25faad370 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5797fa640 1 -- 172.21.15.2:0/4130446018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc57c016070 con 0x55f25faad370 2024-09-12T01:02:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.450+0000 7fc5797fa640 1 -- 172.21.15.2:0/4130446018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c005980 con 0x55f25faad370 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4130446018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faad370 msgr2=0x55f25faa5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faad370 0x55f25faa5120 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc57c01e7a0 tx=0x7fc57c014000 comp rx=0 tx=0).stop 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4130446018 shutdown_connections 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faad370 0x55f25faa5120 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25faa8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4130446018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faa25d0 0x55f25fab9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4130446018 >> 172.21.15.2:0/4130446018 conn(0x55f25fa6b310 msgr2=0x55f25faa8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4130446018 shutdown_connections 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4130446018 wait complete. 2024-09-12T01:02:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 -- start start 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.451+0000 7fc58bc0b740 1 Processor -- start 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25fab5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25fab5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc58bc0b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 0x55f25faa67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841ac190 con 0x55f25faa25d0 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841ad600 con 0x55f25faa3b40 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc58bc0b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841ac860 con 0x55f25faad370 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc58bc0b740 10 client.0 _ll_register_callbacks cb 0x7fc56c0093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25fab5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25fab5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59678/0 (socket says 172.21.15.2:59678) 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 -- 172.21.15.2:0/4189407217 learned_addr learned my addr 172.21.15.2:0/4189407217 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25fab5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc5837fe640 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 0x55f25faa67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 -- 172.21.15.2:0/4189407217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 msgr2=0x55f25faa67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 0x55f25faa67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 -- 172.21.15.2:0/4189407217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 msgr2=0x55f25fab5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25fab5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 -- 172.21.15.2:0/4189407217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25faa6e70 con 0x55f25faa25d0 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25fab5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc582ffd640 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25fab5330 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fc57403d040 tx=0x7fc574005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e38deecf6846a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc562ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.452+0000 7fc562ffd640 1 -- 172.21.15.2:0/4189407217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574049070 con 0x55f25faa25d0 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc562ffd640 1 -- 172.21.15.2:0/4189407217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fc5740a60b0 con 0x55f25faa25d0 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4189407217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc57c016070 con 0x55f25faa25d0 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc562ffd640 1 -- 172.21.15.2:0/4189407217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc5740bcbb0 con 0x55f25faa25d0 2024-09-12T01:02:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 10 client.17652 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4189407217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f25faa6e70 con 0x55f25faa25d0 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc562ffd640 1 -- 172.21.15.2:0/4189407217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc57c016070 con 0x55f25faa25d0 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc562ffd640 1 -- 172.21.15.2:0/4189407217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc5740ebf70 con 0x55f25faa25d0 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 10 client.17652 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 10 client.17652 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 20 client.17652 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55f25fb27400 0x55f25fb297f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 4 client.17652 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4189407217 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f25fa0fd70 con 0x55f25fb27400 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.453+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55f25fb27400 0x55f25fb297f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc57a7fc640 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55f25fb27400 0x55f25fb297f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d413cf8d70f6aa3 server_cookie=1da6c5d469714cfe in_seq=0 out_seq=0 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc562ffd640 10 client.17652 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:02:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc562ffd640 1 -- 172.21.15.2:0/4189407217 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f25fa0fd70 con 0x55f25fb27400 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc562ffd640 10 client.17652 handle_command_reply: tid=0 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 client.17652 shutdown 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4189407217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 msgr2=0x55f25fab5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25fab5330 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fc57403d040 tx=0x7fc574005890 comp rx=0 tx=0).stop 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4189407217 shutdown_connections 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55f25fb27400 0x55f25fb297f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f25faad370 0x55f25faa67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f25faa3b40 0x55f25fab5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc562ffd640 0 client.17652 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 --2- 172.21.15.2:0/4189407217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f25faa25d0 0x55f25fab5330 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4189407217 >> 172.21.15.2:0/4189407217 conn(0x55f25fa6b310 msgr2=0x55f25faa9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4189407217 shutdown_connections 2024-09-12T01:02:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.454+0000 7fc58bc0b740 1 -- 172.21.15.2:0/4189407217 wait complete. 2024-09-12T01:02:53.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc58bc0b740 20 client.17652 trim_cache size 0 max 16384 2024-09-12T01:02:53.459 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:02:53.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 -- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc5700a2cf0 msgr2=0x7fc5700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc5700a2cf0 0x7fc5700a51b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc57c007f30 tx=0x7fc57c004a40 comp rx=0 tx=0).stop 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 -- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584100a80 msgr2=0x7fc5841984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584100a80 0x7fc5841984c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fc574009a50 tx=0x7fc574004270 comp rx=0 tx=0).stop 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 -- 172.21.15.2:0/2273754099 shutdown_connections 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc5700a2cf0 0x7fc5700a51b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc584106a80 0x7fc58419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc584101420 0x7fc584198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 --2- 172.21.15.2:0/2273754099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc584100a80 0x7fc5841984c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 -- 172.21.15.2:0/2273754099 >> 172.21.15.2:0/2273754099 conn(0x7fc5840fc7a0 msgr2=0x7fc5840fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 -- 172.21.15.2:0/2273754099 shutdown_connections 2024-09-12T01:02:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:53.455+0000 7fc589832640 1 -- 172.21.15.2:0/2273754099 wait complete. 2024-09-12T01:02:54.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:02:54.623 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:54.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:54 smithi071 ceph-mon[35276]: pgmap v308: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:54.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:54 smithi002 ceph-mon[31210]: pgmap v308: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:55.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:54 smithi167 ceph-mon[35234]: pgmap v308: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 -- 172.21.15.2:0/2862731317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 msgr2=0x7fb210114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 --2- 172.21.15.2:0/2862731317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 0x7fb210114f80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fb208009ca0 tx=0x7fb20802a950 comp rx=0 tx=0).stop 2024-09-12T01:02:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 -- 172.21.15.2:0/2862731317 shutdown_connections 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 --2- 172.21.15.2:0/2862731317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 0x7fb210114f80 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 --2- 172.21.15.2:0/2862731317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb210074eb0 0x7fb210112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 --2- 172.21.15.2:0/2862731317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb210074590 0x7fb210074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 -- 172.21.15.2:0/2862731317 >> 172.21.15.2:0/2862731317 conn(0x7fb2100fd880 msgr2=0x7fb2100ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 -- 172.21.15.2:0/2862731317 shutdown_connections 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.077+0000 7fb21705d640 1 -- 172.21.15.2:0/2862731317 wait complete. 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb21705d640 1 Processor -- start 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb21705d640 1 -- start start 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb21705d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb210074590 0x7fb2101a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb21705d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb210074eb0 0x7fb2101a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb21705d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 0x7fb21019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb21705d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101185e0 con 0x7fb210112b90 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb21705d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb210118460 con 0x7fb210074eb0 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb21705d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb210118760 con 0x7fb210074590 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb2155fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 0x7fb21019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb2155fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 0x7fb21019e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59692/0 (socket says 172.21.15.2:59692) 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb2155fa640 1 -- 172.21.15.2:0/4021766220 learned_addr learned my addr 172.21.15.2:0/4021766220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb20ffff640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb210074eb0 0x7fb2101a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.078+0000 7fb214df9640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb210074590 0x7fb2101a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb2155fa640 1 -- 172.21.15.2:0/4021766220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb210074590 msgr2=0x7fb2101a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb2155fa640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb210074590 0x7fb2101a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb2155fa640 1 -- 172.21.15.2:0/4021766220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb210074eb0 msgr2=0x7fb2101a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb2155fa640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb210074eb0 0x7fb2101a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb2155fa640 1 -- 172.21.15.2:0/4021766220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21019f0c0 con 0x7fb210112b90 2024-09-12T01:02:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb2155fa640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 0x7fb21019e990 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fb208006010 tx=0x7fb20802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb20dffb640 1 -- 172.21.15.2:0/4021766220 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208034040 con 0x7fb210112b90 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb20dffb640 1 -- 172.21.15.2:0/4021766220 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb208003e00 con 0x7fb210112b90 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb21705d640 1 -- 172.21.15.2:0/4021766220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21019f350 con 0x7fb210112b90 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb20dffb640 1 -- 172.21.15.2:0/4021766220 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208045480 con 0x7fb210112b90 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.079+0000 7fb21705d640 1 -- 172.21.15.2:0/4021766220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2101ab6a0 con 0x7fb210112b90 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb20dffb640 1 -- 172.21.15.2:0/4021766220 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fb208037020 con 0x7fb210112b90 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb219436740 1 Processor -- start 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb219436740 1 -- start start 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb219436740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2902090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb219436740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f2902a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb219436740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb219436740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b7f28682f0 con 0x55b7f2903b40 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb219436740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b7f280fcf0 con 0x55b7f290d370 2024-09-12T01:02:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb219436740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b7f28642b0 con 0x55b7f29025d0 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb20dffb640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb1fc0a2cf0 0x7fb1fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.082+0000 7fb20ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2902090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2902090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59702/0 (socket says 172.21.15.2:59702) 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 -- 172.21.15.2:0/69059284 learned_addr learned my addr 172.21.15.2:0/69059284 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb214df9640 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f2902a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb2155fa640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb1fc0a2cf0 0x7fb1fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20dffb640 1 -- 172.21.15.2:0/4021766220 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fb2080f0440 con 0x7fb210112b90 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 -- 172.21.15.2:0/69059284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 msgr2=0x55b7f2902a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f2902a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 -- 172.21.15.2:0/69059284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 msgr2=0x55b7f290f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 -- 172.21.15.2:0/69059284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f27f43a0 con 0x55b7f2903b40 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb2155fa640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb1fc0a2cf0 0x7fb1fc0a51b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2080b8ee0 tx=0x7fb2080b8da0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb20ffff640 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2902090 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb20000afd0 tx=0x7fb20000a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c910b66cac319f98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb206ffd640 1 -- 172.21.15.2:0/69059284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200019030 con 0x55b7f2903b40 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb206ffd640 1 -- 172.21.15.2:0/69059284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb200005500 con 0x55b7f2903b40 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.083+0000 7fb206ffd640 1 -- 172.21.15.2:0/69059284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200004e60 con 0x55b7f2903b40 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 -- 172.21.15.2:0/69059284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 msgr2=0x55b7f2902090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2902090 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb20000afd0 tx=0x7fb20000a720 comp rx=0 tx=0).stop 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 -- 172.21.15.2:0/69059284 shutdown_connections 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f2902a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 --2- 172.21.15.2:0/69059284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2902090 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 -- 172.21.15.2:0/69059284 >> 172.21.15.2:0/69059284 conn(0x55b7f28cb310 msgr2=0x55b7f28fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 -- 172.21.15.2:0/69059284 shutdown_connections 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 -- 172.21.15.2:0/69059284 wait complete. 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.084+0000 7fb219436740 1 -- start start 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb219436740 1 Processor -- start 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb219436740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f290cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb219436740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f290a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb219436740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb219436740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b7f2910070 con 0x55b7f2903b40 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb219436740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b7f2823060 con 0x55b7f290d370 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb219436740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b7f29101f0 con 0x55b7f29025d0 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb219436740 10 client.0 _ll_register_callbacks cb 0x55b7f25768c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb214df9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f290a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb214df9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f290a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59718/0 (socket says 172.21.15.2:59718) 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb214df9640 1 -- 172.21.15.2:0/3778179003 learned_addr learned my addr 172.21.15.2:0/3778179003 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb20ffff640 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f290cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb20ffff640 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.085+0000 7fb214df9640 1 -- 172.21.15.2:0/3778179003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 msgr2=0x55b7f290cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb214df9640 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f290cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb214df9640 1 -- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 msgr2=0x55b7f290a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb214df9640 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb214df9640 1 -- 172.21.15.2:0/3778179003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f25d93c0 con 0x55b7f2903b40 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb20ffff640 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb214df9640 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f290a000 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8011570 tx=0x7fb1f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7024a8e52d3e5ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb1effff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb1effff640 1 -- 172.21.15.2:0/3778179003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8013670 con 0x55b7f2903b40 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb1effff640 1 -- 172.21.15.2:0/3778179003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fb1f8013810 con 0x55b7f2903b40 2024-09-12T01:02:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb219436740 1 -- 172.21.15.2:0/3778179003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb200005500 con 0x55b7f2903b40 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb1effff640 1 -- 172.21.15.2:0/3778179003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb1f8013a10 con 0x55b7f2903b40 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb219436740 10 client.17664 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb219436740 1 -- 172.21.15.2:0/3778179003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b7f291bb80 con 0x55b7f2903b40 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb1effff640 1 -- 172.21.15.2:0/3778179003 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb200005500 con 0x55b7f2903b40 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.086+0000 7fb1effff640 1 -- 172.21.15.2:0/3778179003 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb1f8014440 con 0x55b7f2903b40 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb219436740 10 client.17664 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb219436740 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb219436740 20 client.17664 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb219436740 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b7f291d090 0x55b7f291f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb219436740 4 client.17664 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb219436740 1 -- 172.21.15.2:0/3778179003 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7f2875860 con 0x55b7f291d090 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb20ffff640 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b7f291d090 0x55b7f291f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb1effff640 10 client.17664 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.087+0000 7fb20ffff640 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b7f291d090 0x55b7f291f4b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d1a9c0727896096 server_cookie=8c446e0090146911 in_seq=0 out_seq=0 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb1effff640 1 -- 172.21.15.2:0/3778179003 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7f2875860 con 0x55b7f291d090 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb1effff640 10 client.17664 handle_command_reply: tid=0 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 client.17664 shutdown 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 -- 172.21.15.2:0/3778179003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 msgr2=0x55b7f290a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f290a000 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8011570 tx=0x7fb1f8009f90 comp rx=0 tx=0).stop 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 -- 172.21.15.2:0/3778179003 shutdown_connections 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b7f291d090 0x55b7f291f4b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f290d370 0x55b7f290a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f290a000 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 --2- 172.21.15.2:0/3778179003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f290cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb1effff640 0 client.17664 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:55.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 -- 172.21.15.2:0/3778179003 >> 172.21.15.2:0/3778179003 conn(0x55b7f28cb310 msgr2=0x55b7f2904930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:55.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 -- 172.21.15.2:0/3778179003 shutdown_connections 2024-09-12T01:02:55.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 1 -- 172.21.15.2:0/3778179003 wait complete. 2024-09-12T01:02:55.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.088+0000 7fb219436740 20 client.17664 trim_cache size 0 max 16384 2024-09-12T01:02:55.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.101+0000 7fb219436740 1 Processor -- start 2024-09-12T01:02:55.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb219436740 1 -- start start 2024-09-12T01:02:55.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb219436740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f29025d0 0x55b7f2919340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb219436740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2908fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb219436740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f290d370 0x55b7f2924d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb219436740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101b6920 con 0x55b7f2903b40 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb219436740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101b41f0 con 0x55b7f29025d0 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb219436740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101b2060 con 0x55b7f290d370 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2908fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2908fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59726/0 (socket says 172.21.15.2:59726) 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 -- 172.21.15.2:0/1155871434 learned_addr learned my addr 172.21.15.2:0/1155871434 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb20ffff640 1 --2- 172.21.15.2:0/1155871434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f29025d0 0x55b7f2919340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 -- 172.21.15.2:0/1155871434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f290d370 msgr2=0x55b7f2924d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 --2- 172.21.15.2:0/1155871434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f290d370 0x55b7f2924d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 -- 172.21.15.2:0/1155871434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f29025d0 msgr2=0x55b7f2919340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 --2- 172.21.15.2:0/1155871434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f29025d0 0x55b7f2919340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 -- 172.21.15.2:0/1155871434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f28fede0 con 0x55b7f2903b40 2024-09-12T01:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb214df9640 1 --2- 172.21.15.2:0/1155871434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2908fe0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009730 tx=0x7fb1f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdccf2d1bd827695 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.102+0000 7fb2067fc640 1 -- 172.21.15.2:0/1155871434 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8013870 con 0x55b7f2903b40 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb2067fc640 1 -- 172.21.15.2:0/1155871434 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1f8014440 con 0x55b7f2903b40 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb2067fc640 1 -- 172.21.15.2:0/1155871434 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f801d960 con 0x55b7f2903b40 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 -- 172.21.15.2:0/1155871434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 msgr2=0x55b7f2908fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 --2- 172.21.15.2:0/1155871434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2908fe0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009730 tx=0x7fb1f80046c0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 -- 172.21.15.2:0/1155871434 shutdown_connections 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 --2- 172.21.15.2:0/1155871434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f290d370 0x55b7f2924d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 --2- 172.21.15.2:0/1155871434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f2903b40 0x55b7f2908fe0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 --2- 172.21.15.2:0/1155871434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f29025d0 0x55b7f2919340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 -- 172.21.15.2:0/1155871434 >> 172.21.15.2:0/1155871434 conn(0x55b7f28cb310 msgr2=0x55b7f29088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 -- 172.21.15.2:0/1155871434 shutdown_connections 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.103+0000 7fb219436740 1 -- 172.21.15.2:0/1155871434 wait complete. 2024-09-12T01:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 1 -- start start 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 1 Processor -- start 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f2911170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f2903b40 0x55b7f29116b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f290d370 0x55b7f2911bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101b26b0 con 0x55b7f290d370 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101b3b20 con 0x55b7f2903b40 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101b2d80 con 0x55b7f29025d0 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb219436740 10 client.0 _ll_register_callbacks cb 0x7fb1f8009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb20ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f290d370 0x55b7f2911bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb20ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f290d370 0x55b7f2911bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59740/0 (socket says 172.21.15.2:59740) 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb20ffff640 1 -- 172.21.15.2:0/30854687 learned_addr learned my addr 172.21.15.2:0/30854687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb214df9640 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f2903b40 0x55b7f29116b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.104+0000 7fb20ffff640 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f2911170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb20ffff640 1 -- 172.21.15.2:0/30854687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 msgr2=0x55b7f2911170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb20ffff640 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f2911170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb20ffff640 1 -- 172.21.15.2:0/30854687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f2903b40 msgr2=0x55b7f29116b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb20ffff640 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f2903b40 0x55b7f29116b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb20ffff640 1 -- 172.21.15.2:0/30854687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f290a940 con 0x55b7f290d370 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb20ffff640 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f290d370 0x55b7f2911bf0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x55b7f291fd00 tx=0x7fb200021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad7e0163a13adc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb1effff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb1effff640 1 -- 172.21.15.2:0/30854687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200019040 con 0x55b7f290d370 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb1effff640 1 -- 172.21.15.2:0/30854687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fb20002de80 con 0x55b7f290d370 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb219436740 1 -- 172.21.15.2:0/30854687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1f8014440 con 0x55b7f290d370 2024-09-12T01:02:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb1effff640 1 -- 172.21.15.2:0/30854687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb200013070 con 0x55b7f290d370 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb219436740 10 client.17670 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb219436740 1 -- 172.21.15.2:0/30854687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b7f2987da0 con 0x55b7f290d370 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.105+0000 7fb1effff640 1 -- 172.21.15.2:0/30854687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1f8014440 con 0x55b7f290d370 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb1effff640 1 -- 172.21.15.2:0/30854687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb2000117b0 con 0x55b7f290d370 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb219436740 10 client.17670 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb219436740 10 client.17670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb219436740 20 client.17670 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb219436740 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b7f2988380 0x55b7f298a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb219436740 4 client.17670 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb219436740 1 -- 172.21.15.2:0/30854687 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7f286fd70 con 0x55b7f2988380 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb214df9640 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b7f2988380 0x55b7f298a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb214df9640 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b7f2988380 0x55b7f298a770 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917af24f778b1a40 server_cookie=6ec48b2398051ca0 in_seq=0 out_seq=0 2024-09-12T01:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.106+0000 7fb1effff640 10 client.17670 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb1effff640 1 -- 172.21.15.2:0/30854687 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7f286fd70 con 0x55b7f2988380 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb1effff640 10 client.17670 handle_command_reply: tid=0 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 client.17670 shutdown 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 -- 172.21.15.2:0/30854687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f290d370 msgr2=0x55b7f2911bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f290d370 0x55b7f2911bf0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x55b7f291fd00 tx=0x7fb200021040 comp rx=0 tx=0).stop 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 -- 172.21.15.2:0/30854687 shutdown_connections 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55b7f2988380 0x55b7f298a770 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7f290d370 0x55b7f2911bf0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7f2903b40 0x55b7f29116b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 --2- 172.21.15.2:0/30854687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7f29025d0 0x55b7f2911170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 -- 172.21.15.2:0/30854687 >> 172.21.15.2:0/30854687 conn(0x55b7f28cb310 msgr2=0x55b7f28fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb1effff640 0 client.17670 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 -- 172.21.15.2:0/30854687 shutdown_connections 2024-09-12T01:02:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 1 -- 172.21.15.2:0/30854687 wait complete. 2024-09-12T01:02:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb219436740 20 client.17670 trim_cache size 0 max 16384 2024-09-12T01:02:55.120 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb21705d640 1 -- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb1fc0a2cf0 msgr2=0x7fb1fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.107+0000 7fb21705d640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb1fc0a2cf0 0x7fb1fc0a51b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2080b8ee0 tx=0x7fb2080b8da0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 -- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 msgr2=0x7fb21019e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 0x7fb21019e990 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fb208006010 tx=0x7fb20802f710 comp rx=0 tx=0).stop 2024-09-12T01:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 -- 172.21.15.2:0/4021766220 shutdown_connections 2024-09-12T01:02:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fb1fc0a2cf0 0x7fb1fc0a51b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb210112b90 0x7fb21019e990 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb210074eb0 0x7fb2101a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 --2- 172.21.15.2:0/4021766220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb210074590 0x7fb2101a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 -- 172.21.15.2:0/4021766220 >> 172.21.15.2:0/4021766220 conn(0x7fb2100fd880 msgr2=0x7fb2100fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 -- 172.21.15.2:0/4021766220 shutdown_connections 2024-09-12T01:02:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:55.108+0000 7fb21705d640 1 -- 172.21.15.2:0/4021766220 wait complete. 2024-09-12T01:02:56.770 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:02:56.770 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:02:56.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:56 smithi071 ceph-mon[35276]: pgmap v309: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:56.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:56 smithi002 ceph-mon[31210]: pgmap v309: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:57.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:56 smithi167 ceph-mon[35234]: pgmap v309: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:02:57.041 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 -- 172.21.15.2:0/3067401854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd61010c2f0 msgr2=0x7fd61010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 --2- 172.21.15.2:0/3067401854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd61010c2f0 0x7fd61010e790 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd608009ca0 tx=0x7fd60802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 -- 172.21.15.2:0/3067401854 shutdown_connections 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 --2- 172.21.15.2:0/3067401854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd61010c2f0 0x7fd61010e790 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 --2- 172.21.15.2:0/3067401854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6101037a0 0x7fd61010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 --2- 172.21.15.2:0/3067401854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd610102df0 0x7fd6101031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 -- 172.21.15.2:0/3067401854 >> 172.21.15.2:0/3067401854 conn(0x7fd6100fc7d0 msgr2=0x7fd6100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 -- 172.21.15.2:0/3067401854 shutdown_connections 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.459+0000 7fd616116640 1 -- 172.21.15.2:0/3067401854 wait complete. 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd616116640 1 Processor -- start 2024-09-12T01:02:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd616116640 1 -- start start 2024-09-12T01:02:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd616116640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd610102df0 0x7fd610100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd616116640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6101037a0 0x7fd610100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd616116640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61010c2f0 0x7fd6101014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd616116640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101121d0 con 0x7fd6101037a0 2024-09-12T01:02:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd616116640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd610112050 con 0x7fd610102df0 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd616116640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd610112350 con 0x7fd61010c2f0 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6101037a0 0x7fd610100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6101037a0 0x7fd610100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34538/0 (socket says 172.21.15.2:34538) 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd606ffd640 1 -- 172.21.15.2:0/1845187624 learned_addr learned my addr 172.21.15.2:0/1845187624 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.460+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd610102df0 0x7fd610100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd60ffff640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61010c2f0 0x7fd6101014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd606ffd640 1 -- 172.21.15.2:0/1845187624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61010c2f0 msgr2=0x7fd6101014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61010c2f0 0x7fd6101014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd606ffd640 1 -- 172.21.15.2:0/1845187624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd610102df0 msgr2=0x7fd610100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd610102df0 0x7fd610100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd606ffd640 1 -- 172.21.15.2:0/1845187624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6101a6b30 con 0x7fd6101037a0 2024-09-12T01:02:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd610102df0 0x7fd610100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6101037a0 0x7fd610100f90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8006fd0 tx=0x7fd5f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd60d7fa640 1 -- 172.21.15.2:0/1845187624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8011830 con 0x7fd6101037a0 2024-09-12T01:02:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd616116640 1 -- 172.21.15.2:0/1845187624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6101a6e20 con 0x7fd6101037a0 2024-09-12T01:02:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd60d7fa640 1 -- 172.21.15.2:0/1845187624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5f8016070 con 0x7fd6101037a0 2024-09-12T01:02:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd60d7fa640 1 -- 172.21.15.2:0/1845187624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800f2e0 con 0x7fd6101037a0 2024-09-12T01:02:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.461+0000 7fd616116640 1 -- 172.21.15.2:0/1845187624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6101a72d0 con 0x7fd6101037a0 2024-09-12T01:02:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.463+0000 7fd60d7fa640 1 -- 172.21.15.2:0/1845187624 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fd5f801b460 con 0x7fd6101037a0 2024-09-12T01:02:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd6184ef740 1 Processor -- start 2024-09-12T01:02:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd6184ef740 1 -- start start 2024-09-12T01:02:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 0x563184441f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184442480 0x56318444c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56318444cd40 0x56318444f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd6184ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5631843a7280 con 0x56318444cd40 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd6184ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56318434eb10 con 0x563184442480 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd6184ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5631843a3240 con 0x563184441b60 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56318444cd40 0x56318444f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56318444cd40 0x56318444f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34542/0 (socket says 172.21.15.2:34542) 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd606ffd640 1 -- 172.21.15.2:0/2322467550 learned_addr learned my addr 172.21.15.2:0/2322467550 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.464+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184442480 0x56318444c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60ffff640 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 0x563184441f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60d7fa640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd5fc0a2cf0 0x7fd5fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60ffff640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd5fc0a2cf0 0x7fd5fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60f7fe640 1 -- 172.21.15.2:0/2322467550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 msgr2=0x563184441f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 0x563184441f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60f7fe640 1 -- 172.21.15.2:0/2322467550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56318444cd40 msgr2=0x56318444f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56318444cd40 0x56318444f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60f7fe640 1 -- 172.21.15.2:0/2322467550 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318435b1f0 con 0x563184442480 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60d7fa640 1 -- 172.21.15.2:0/1845187624 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fd5f80ceb40 con 0x7fd6101037a0 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184442480 0x56318444c800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd600007760 tx=0x7fd600007c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af6b03fcf7fc5f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd60ffff640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd5fc0a2cf0 0x7fd5fc0a51b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd608005cc0 tx=0x7fd60802a8e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd605ffb640 1 -- 172.21.15.2:0/2322467550 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60000d950 con 0x563184442480 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd605ffb640 1 -- 172.21.15.2:0/2322467550 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd600018070 con 0x563184442480 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.465+0000 7fd605ffb640 1 -- 172.21.15.2:0/2322467550 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6000123e0 con 0x563184442480 2024-09-12T01:02:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 -- 172.21.15.2:0/2322467550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184442480 msgr2=0x56318444c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184442480 0x56318444c800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd600007760 tx=0x7fd600007c20 comp rx=0 tx=0).stop 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 -- 172.21.15.2:0/2322467550 shutdown_connections 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56318444cd40 0x56318444f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184442480 0x56318444c800 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 --2- 172.21.15.2:0/2322467550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 0x563184441f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 -- 172.21.15.2:0/2322467550 >> 172.21.15.2:0/2322467550 conn(0x56318443e0f0 msgr2=0x56318443e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 -- 172.21.15.2:0/2322467550 shutdown_connections 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 -- 172.21.15.2:0/2322467550 wait complete. 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.466+0000 7fd6184ef740 1 -- start start 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd6184ef740 1 Processor -- start 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x56318444c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184449b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 0x56318444a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd6184ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56318444f910 con 0x563184442480 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd6184ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563184361f10 con 0x563184441b60 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd6184ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56318444fa90 con 0x56318444cd40 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd6184ef740 10 client.0 _ll_register_callbacks cb 0x56318432aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184449b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x56318444c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x56318444c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:54064/0 (socket says 172.21.15.2:54064) 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184449b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34556/0 (socket says 172.21.15.2:34556) 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd60f7fe640 1 -- 172.21.15.2:0/1291497596 learned_addr learned my addr 172.21.15.2:0/1291497596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.467+0000 7fd60ffff640 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 0x56318444a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd606ffd640 1 -- 172.21.15.2:0/1291497596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 msgr2=0x56318444a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 0x56318444a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd606ffd640 1 -- 172.21.15.2:0/1291497596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 msgr2=0x56318444c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x56318444c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd606ffd640 1 -- 172.21.15.2:0/1291497596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631841186a0 con 0x563184442480 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x56318444c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184449b30 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x56318443f470 tx=0x7fd5f8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9126589494a35cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd5eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1291497596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f809b790 con 0x563184442480 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1291497596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fd5f8097700 con 0x563184442480 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd6184ef740 1 -- 172.21.15.2:0/1291497596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd600018070 con 0x563184442480 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1291497596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd5f8021250 con 0x563184442480 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd6184ef740 10 client.17682 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd6184ef740 1 -- 172.21.15.2:0/1291497596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56318445b4e0 con 0x563184442480 2024-09-12T01:02:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1291497596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd600018070 con 0x563184442480 2024-09-12T01:02:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.468+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1291497596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd5f809f0c0 con 0x563184442480 2024-09-12T01:02:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd6184ef740 10 client.17682 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd6184ef740 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd6184ef740 20 client.17682 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56318445c8f0 0x56318445ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd6184ef740 4 client.17682 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd6184ef740 1 -- 172.21.15.2:0/1291497596 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631843b47f0 con 0x56318445c8f0 2024-09-12T01:02:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56318445c8f0 0x56318445ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd5eeffd640 10 client.17682 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.469+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56318445c8f0 0x56318445ed60 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=314ccbd50c81a070 server_cookie=7df3d6222f1156ea in_seq=0 out_seq=0 2024-09-12T01:02:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1291497596 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631843b47f0 con 0x56318445c8f0 2024-09-12T01:02:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd5eeffd640 10 client.17682 handle_command_reply: tid=0 2024-09-12T01:02:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 client.17682 shutdown 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 -- 172.21.15.2:0/1291497596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 msgr2=0x563184449b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184449b30 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x56318443f470 tx=0x7fd5f8009360 comp rx=0 tx=0).stop 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 -- 172.21.15.2:0/1291497596 shutdown_connections 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56318445c8f0 0x56318445ed60 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 0x56318444a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd5eeffd640 0 client.17682 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184449b30 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1291497596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x56318444c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 -- 172.21.15.2:0/1291497596 >> 172.21.15.2:0/1291497596 conn(0x56318443e0f0 msgr2=0x563184443dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 -- 172.21.15.2:0/1291497596 shutdown_connections 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.470+0000 7fd6184ef740 1 -- 172.21.15.2:0/1291497596 wait complete. 2024-09-12T01:02:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.471+0000 7fd6184ef740 20 client.17682 trim_cache size 0 max 16384 2024-09-12T01:02:57.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd6184ef740 1 Processor -- start 2024-09-12T01:02:57.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd6184ef740 1 -- start start 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 0x563184464600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184464b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56318444cd40 0x563184446db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd6184ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b2660 con 0x563184442480 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd6184ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101aff30 con 0x56318444cd40 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd6184ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101adda0 con 0x563184441b60 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184464b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184464b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34566/0 (socket says 172.21.15.2:34566) 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd606ffd640 1 -- 172.21.15.2:0/3400835924 learned_addr learned my addr 172.21.15.2:0/3400835924 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 0x563184464600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd60ffff640 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56318444cd40 0x563184446db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd606ffd640 1 -- 172.21.15.2:0/3400835924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 msgr2=0x563184464600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd606ffd640 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 0x563184464600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd606ffd640 1 -- 172.21.15.2:0/3400835924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56318444cd40 msgr2=0x563184446db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd606ffd640 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56318444cd40 0x563184446db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd606ffd640 1 -- 172.21.15.2:0/3400835924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318443df20 con 0x563184442480 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.488+0000 7fd60ffff640 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56318444cd40 0x563184446db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd606ffd640 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184464b40 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8097a60 tx=0x7fd5f80995a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3a31c6c64ba684 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6057fa640 1 -- 172.21.15.2:0/3400835924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f809b790 con 0x563184442480 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6057fa640 1 -- 172.21.15.2:0/3400835924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5f809b090 con 0x563184442480 2024-09-12T01:02:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6057fa640 1 -- 172.21.15.2:0/3400835924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f809a530 con 0x563184442480 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 -- 172.21.15.2:0/3400835924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 msgr2=0x563184464b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184464b40 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8097a60 tx=0x7fd5f80995a0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 -- 172.21.15.2:0/3400835924 shutdown_connections 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56318444cd40 0x563184446db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184464b40 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 --2- 172.21.15.2:0/3400835924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563184441b60 0x563184464600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 -- 172.21.15.2:0/3400835924 >> 172.21.15.2:0/3400835924 conn(0x56318443e0f0 msgr2=0x563184448c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 -- 172.21.15.2:0/3400835924 shutdown_connections 2024-09-12T01:02:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.489+0000 7fd6184ef740 1 -- 172.21.15.2:0/3400835924 wait complete. 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 1 -- start start 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 1 Processor -- start 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x563184454f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184455460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 0x563184451d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101ae3f0 con 0x563184442480 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101af860 con 0x563184441b60 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101aeac0 con 0x56318444cd40 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd6184ef740 10 client.0 _ll_register_callbacks cb 0x7fd5f80107e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.490+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184455460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184455460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34570/0 (socket says 172.21.15.2:34570) 2024-09-12T01:02:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd606ffd640 1 -- 172.21.15.2:0/1235346186 learned_addr learned my addr 172.21.15.2:0/1235346186 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x563184454f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd60ffff640 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 0x563184451d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd606ffd640 1 -- 172.21.15.2:0/1235346186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 msgr2=0x563184451d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 0x563184451d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd606ffd640 1 -- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 msgr2=0x563184454f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x563184454f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd606ffd640 1 -- 172.21.15.2:0/1235346186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563184452580 con 0x563184442480 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x563184454f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd606ffd640 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184455460 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd5f809b020 tx=0x7fd5f80cee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94b5a595f0759c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd5eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1235346186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f809b790 con 0x563184442480 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1235346186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7fd5f809a730 con 0x563184442480 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd6184ef740 1 -- 172.21.15.2:0/1235346186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5f809b090 con 0x563184442480 2024-09-12T01:02:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1235346186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd5f809ae60 con 0x563184442480 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd6184ef740 10 client.17688 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.491+0000 7fd6184ef740 1 -- 172.21.15.2:0/1235346186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5631844c80f0 con 0x563184442480 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1235346186 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5f809b090 con 0x563184442480 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1235346186 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd5f8099f50 con 0x563184442480 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd6184ef740 10 client.17688 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd6184ef740 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd6184ef740 20 client.17688 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56318445c8f0 0x5631844ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd6184ef740 4 client.17688 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd6184ef740 1 -- 172.21.15.2:0/1235346186 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5631843aed00 con 0x56318445c8f0 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.492+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56318445c8f0 0x5631844ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.493+0000 7fd60f7fe640 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56318445c8f0 0x5631844ca4e0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a362eb9f592d2dbe server_cookie=9816a7740e3f2b14 in_seq=0 out_seq=0 2024-09-12T01:02:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.493+0000 7fd5eeffd640 10 client.17688 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd5eeffd640 1 -- 172.21.15.2:0/1235346186 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5631843aed00 con 0x56318445c8f0 2024-09-12T01:02:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd5eeffd640 10 client.17688 handle_command_reply: tid=0 2024-09-12T01:02:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 client.17688 shutdown 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 -- 172.21.15.2:0/1235346186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 msgr2=0x563184455460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184455460 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd5f809b020 tx=0x7fd5f80cee80 comp rx=0 tx=0).stop 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 -- 172.21.15.2:0/1235346186 shutdown_connections 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x56318445c8f0 0x5631844ca4e0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56318444cd40 0x563184451d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563184442480 0x563184455460 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd5eeffd640 0 client.17688 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 --2- 172.21.15.2:0/1235346186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563184441b60 0x563184454f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 -- 172.21.15.2:0/1235346186 >> 172.21.15.2:0/1235346186 conn(0x56318443e0f0 msgr2=0x56318443ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 -- 172.21.15.2:0/1235346186 shutdown_connections 2024-09-12T01:02:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 1 -- 172.21.15.2:0/1235346186 wait complete. 2024-09-12T01:02:57.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.494+0000 7fd6184ef740 20 client.17688 trim_cache size 0 max 16384 2024-09-12T01:02:57.498 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:02:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-12T01:02:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "3f2a251e-7e2d-4559-80c6-f70d553fd0d6", 2024-09-12T01:02:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-12T01:02:57.498 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 -- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd5fc0a2cf0 msgr2=0x7fd5fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd5fc0a2cf0 0x7fd5fc0a51b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd608005cc0 tx=0x7fd60802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 -- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6101037a0 msgr2=0x7fd610100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6101037a0 0x7fd610100f90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8006fd0 tx=0x7fd5f800b8e0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 -- 172.21.15.2:0/1845187624 shutdown_connections 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fd5fc0a2cf0 0x7fd5fc0a51b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61010c2f0 0x7fd6101014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6101037a0 0x7fd610100f90 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 --2- 172.21.15.2:0/1845187624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd610102df0 0x7fd610100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 -- 172.21.15.2:0/1845187624 >> 172.21.15.2:0/1845187624 conn(0x7fd6100fc7d0 msgr2=0x7fd6100fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 -- 172.21.15.2:0/1845187624 shutdown_connections 2024-09-12T01:02:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:57.495+0000 7fd616116640 1 -- 172.21.15.2:0/1845187624 wait complete. 2024-09-12T01:02:58.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:02:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:02:58.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:58 smithi002 ceph-mon[31210]: pgmap v310: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:58.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:58 smithi002 ceph-mon[31210]: scrub queued for path: / 2024-09-12T01:02:58.914 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:58 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:58.914 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:58 smithi002 ceph-mon[31210]: scrub summary: active paths [/] 2024-09-12T01:02:58.914 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:02:58 smithi002 ceph-mon[31210]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 -- 172.21.15.2:0/1589687870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 msgr2=0x7f4ee010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/1589687870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 0x7f4ee010ec40 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009930 tx=0x7f4ed802a420 comp rx=0 tx=0).stop 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 -- 172.21.15.2:0/1589687870 shutdown_connections 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/1589687870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 0x7f4ee010ec40 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/1589687870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee01036e0 0x7f4ee0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/1589687870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ee0102d30 0x7f4ee0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 -- 172.21.15.2:0/1589687870 >> 172.21.15.2:0/1589687870 conn(0x7f4ee00fc7d0 msgr2=0x7f4ee00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 -- 172.21.15.2:0/1589687870 shutdown_connections 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.915+0000 7f4ee58a4640 1 -- 172.21.15.2:0/1589687870 wait complete. 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ee58a4640 1 Processor -- start 2024-09-12T01:02:58.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ee58a4640 1 -- start start 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ee58a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ee0102d30 0x7f4ee019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ee58a4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee01036e0 0x7f4ee019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ee58a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 0x7f4ee019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ee58a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee01120a0 con 0x7f4ee01082a0 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ee58a4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee0111f20 con 0x7f4ee0102d30 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ee58a4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee0112220 con 0x7f4ee01036e0 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4edf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 0x7f4ee019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4edf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 0x7f4ee019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34582/0 (socket says 172.21.15.2:34582) 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4edf7fe640 1 -- 172.21.15.2:0/3484102355 learned_addr learned my addr 172.21.15.2:0/3484102355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee01036e0 0x7f4ee019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.916+0000 7f4edeffd640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ee0102d30 0x7f4ee019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4edf7fe640 1 -- 172.21.15.2:0/3484102355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee01036e0 msgr2=0x7f4ee019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4edf7fe640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee01036e0 0x7f4ee019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4edf7fe640 1 -- 172.21.15.2:0/3484102355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ee0102d30 msgr2=0x7f4ee019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4edf7fe640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ee0102d30 0x7f4ee019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4edf7fe640 1 -- 172.21.15.2:0/3484102355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee019f6a0 con 0x7f4ee01082a0 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4edf7fe640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 0x7f4ee019efc0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8005ab0 tx=0x7f4ed80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4ee48a2640 1 -- 172.21.15.2:0/3484102355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed803f030 con 0x7f4ee01082a0 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4ee48a2640 1 -- 172.21.15.2:0/3484102355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed8003ce0 con 0x7f4ee01082a0 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4ee58a4640 1 -- 172.21.15.2:0/3484102355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee019f930 con 0x7f4ee01082a0 2024-09-12T01:02:58.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4ee48a2640 1 -- 172.21.15.2:0/3484102355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8035070 con 0x7f4ee01082a0 2024-09-12T01:02:58.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.917+0000 7f4ee58a4640 1 -- 172.21.15.2:0/3484102355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee01a7270 con 0x7f4ee01082a0 2024-09-12T01:02:58.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.919+0000 7f4ee48a2640 1 -- 172.21.15.2:0/3484102355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f4ed8042030 con 0x7f4ee01082a0 2024-09-12T01:02:58.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee7c7d740 1 Processor -- start 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee7c7d740 1 -- start start 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec06880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec11140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec11680 0x55bd1ec13a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bd1eb6c2e0 con 0x55bd1ec064a0 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bd1eb13ce0 con 0x55bd1ec06dc0 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bd1eb682a0 con 0x55bd1ec11680 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee48a2640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ec80a2cf0 0x7f4ec80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ede7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec06880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ede7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec06880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34598/0 (socket says 172.21.15.2:34598) 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ede7fc640 1 -- 172.21.15.2:0/472232868 learned_addr learned my addr 172.21.15.2:0/472232868 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4edf7fe640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ec80a2cf0 0x7f4ec80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4edeffd640 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec11140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ee48a2640 1 -- 172.21.15.2:0/3484102355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f4ed80efc70 con 0x7f4ee01082a0 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ede7fc640 1 -- 172.21.15.2:0/472232868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec11680 msgr2=0x55bd1ec13a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec11680 0x55bd1ec13a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ede7fc640 1 -- 172.21.15.2:0/472232868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 msgr2=0x55bd1ec11140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec11140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4ede7fc640 1 -- 172.21.15.2:0/472232868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd1eaf8440 con 0x55bd1ec064a0 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.920+0000 7f4edeffd640 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec11140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.921+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec06880 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009fd0 tx=0x7f4ed4010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b10db4bf319b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.921+0000 7f4edf7fe640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ec80a2cf0 0x7f4ec80a51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80ed3f0 tx=0x7f4ed8031400 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.921+0000 7f4ec5ffb640 1 -- 172.21.15.2:0/472232868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4004d20 con 0x55bd1ec064a0 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.921+0000 7f4ec5ffb640 1 -- 172.21.15.2:0/472232868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed4004030 con 0x55bd1ec064a0 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.921+0000 7f4ec5ffb640 1 -- 172.21.15.2:0/472232868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4012730 con 0x55bd1ec064a0 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/472232868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 msgr2=0x55bd1ec06880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec06880 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009fd0 tx=0x7f4ed4010850 comp rx=0 tx=0).stop 2024-09-12T01:02:58.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/472232868 shutdown_connections 2024-09-12T01:02:58.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec11680 0x55bd1ec13a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec11140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/472232868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec06880 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/472232868 >> 172.21.15.2:0/472232868 conn(0x55bd1ec02a30 msgr2=0x55bd1ec02e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:58.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/472232868 shutdown_connections 2024-09-12T01:02:58.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/472232868 wait complete. 2024-09-12T01:02:58.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 -- start start 2024-09-12T01:02:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.922+0000 7f4ee7c7d740 1 Processor -- start 2024-09-12T01:02:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec10f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec0e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec11680 0x55bd1ec0e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bd1ec14250 con 0x55bd1ec064a0 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bd1eb27050 con 0x55bd1ec11680 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bd1ec143d0 con 0x55bd1ec06dc0 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ee7c7d740 10 client.0 _ll_register_callbacks cb 0x55bd1eb67160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec10f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec10f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34600/0 (socket says 172.21.15.2:34600) 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 -- 172.21.15.2:0/2516664437 learned_addr learned my addr 172.21.15.2:0/2516664437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4edeffd640 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec0e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 -- 172.21.15.2:0/2516664437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec06dc0 msgr2=0x55bd1ec0e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec0e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 -- 172.21.15.2:0/2516664437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec11680 msgr2=0x55bd1ec0e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec11680 0x55bd1ec0e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 -- 172.21.15.2:0/2516664437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd1e8dd3c0 con 0x55bd1ec064a0 2024-09-12T01:02:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec10f30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4006010 tx=0x7f4ed4003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ed1afe575ac1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ebeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.923+0000 7f4ebeffd640 1 -- 172.21.15.2:0/2516664437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4023070 con 0x55bd1ec064a0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ebeffd640 1 -- 172.21.15.2:0/2516664437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f4ed4004a40 con 0x55bd1ec064a0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/2516664437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ed4004030 con 0x55bd1ec064a0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ebeffd640 1 -- 172.21.15.2:0/2516664437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4ed4004c40 con 0x55bd1ec064a0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 10 client.17700 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/2516664437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bd1ec1fb70 con 0x55bd1ec064a0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ebeffd640 1 -- 172.21.15.2:0/2516664437 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed4004030 con 0x55bd1ec064a0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ebeffd640 1 -- 172.21.15.2:0/2516664437 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f4ed402d070 con 0x55bd1ec064a0 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 10 client.17700 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 10 client.17700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 20 client.17700 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55bd1ec21030 0x55bd1ec23420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 4 client.17700 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.924+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/2516664437 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd1eb79850 con 0x55bd1ec21030 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.925+0000 7f4edeffd640 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55bd1ec21030 0x55bd1ec23420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.925+0000 7f4edeffd640 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55bd1ec21030 0x55bd1ec23420 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=589e82f43ad659ad server_cookie=5d0ff9a693600555 in_seq=0 out_seq=0 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.925+0000 7f4ebeffd640 10 client.17700 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ebeffd640 1 -- 172.21.15.2:0/2516664437 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd1eb79850 con 0x55bd1ec21030 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ebeffd640 10 client.17700 handle_command_reply: tid=0 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 client.17700 shutdown 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/2516664437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 msgr2=0x55bd1ec10f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec10f30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4006010 tx=0x7f4ed4003c90 comp rx=0 tx=0).stop 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/2516664437 shutdown_connections 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55bd1ec21030 0x55bd1ec23420 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec11680 0x55bd1ec0e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec0e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/2516664437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec10f30 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/2516664437 >> 172.21.15.2:0/2516664437 conn(0x55bd1ec02a30 msgr2=0x55bd1ec08760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ebeffd640 0 client.17700 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/2516664437 shutdown_connections 2024-09-12T01:02:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/2516664437 wait complete. 2024-09-12T01:02:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.926+0000 7f4ee7c7d740 20 client.17700 trim_cache size 0 max 16384 2024-09-12T01:02:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:58 smithi071 ceph-mon[35276]: pgmap v310: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:58 smithi071 ceph-mon[35276]: scrub queued for path: / 2024-09-12T01:02:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:58 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:58 smithi071 ceph-mon[35276]: scrub summary: active paths [/] 2024-09-12T01:02:58.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:02:58 smithi071 ceph-mon[35276]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.943+0000 7f4ee7c7d740 1 Processor -- start 2024-09-12T01:02:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ee7c7d740 1 -- start start 2024-09-12T01:02:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec02a30 0x55bd1ec097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec064a0 0x55bd1ec26060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec265a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee01b2520 con 0x55bd1ec02a30 2024-09-12T01:02:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee01afdf0 con 0x55bd1ec06dc0 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee01adc60 con 0x55bd1ec064a0 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec02a30 0x55bd1ec097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec02a30 0x55bd1ec097f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34602/0 (socket says 172.21.15.2:34602) 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 -- 172.21.15.2:0/1293716373 learned_addr learned my addr 172.21.15.2:0/1293716373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 -- 172.21.15.2:0/1293716373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec064a0 msgr2=0x55bd1ec26060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/1293716373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec064a0 0x55bd1ec26060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 -- 172.21.15.2:0/1293716373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 msgr2=0x55bd1ec265a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/1293716373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec265a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 -- 172.21.15.2:0/1293716373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd1ec02860 con 0x55bd1ec02a30 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.944+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/1293716373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec02a30 0x55bd1ec097f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009eb0 tx=0x7f4ed4009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1996506150957c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ec57fa640 1 -- 172.21.15.2:0/1293716373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4023070 con 0x55bd1ec02a30 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ec57fa640 1 -- 172.21.15.2:0/1293716373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed4033020 con 0x55bd1ec02a30 2024-09-12T01:02:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ec57fa640 1 -- 172.21.15.2:0/1293716373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40051f0 con 0x55bd1ec02a30 2024-09-12T01:02:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/1293716373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec02a30 msgr2=0x55bd1ec097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/1293716373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec02a30 0x55bd1ec097f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009eb0 tx=0x7f4ed4009cc0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/1293716373 shutdown_connections 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/1293716373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec265a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/1293716373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec064a0 0x55bd1ec26060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/1293716373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec02a30 0x55bd1ec097f0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/1293716373 >> 172.21.15.2:0/1293716373 conn(0x55bd1ec0e880 msgr2=0x55bd1ec090e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/1293716373 shutdown_connections 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.945+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/1293716373 wait complete. 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 1 -- start start 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 1 Processor -- start 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec02a30 0x55bd1ec266b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec23a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec23f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee01ae2b0 con 0x55bd1ec064a0 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee01af720 con 0x55bd1ec06dc0 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee01ae980 con 0x55bd1ec02a30 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ee7c7d740 10 client.0 _ll_register_callbacks cb 0x7f4ed4009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4edeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec23a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4edeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec23a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34614/0 (socket says 172.21.15.2:34614) 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4edeffd640 1 -- 172.21.15.2:0/630504565 learned_addr learned my addr 172.21.15.2:0/630504565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.946+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec23f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec02a30 0x55bd1ec266b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4edeffd640 1 -- 172.21.15.2:0/630504565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec02a30 msgr2=0x55bd1ec266b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4edeffd640 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec02a30 0x55bd1ec266b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4edeffd640 1 -- 172.21.15.2:0/630504565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 msgr2=0x55bd1ec23f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:02:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4edeffd640 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec23f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4edeffd640 1 -- 172.21.15.2:0/630504565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd1ec24680 con 0x55bd1ec064a0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4edeffd640 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec23a50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x55bd1ec0f820 tx=0x7f4ed0013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128aa51fce936fec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ebeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ebeffd640 1 -- 172.21.15.2:0/630504565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0022070 con 0x55bd1ec064a0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/630504565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ed4033020 con 0x55bd1ec064a0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ebeffd640 1 -- 172.21.15.2:0/630504565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8643+0+0 (secure 0 0 0) 0x7f4ed000fb50 con 0x55bd1ec064a0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ebeffd640 1 -- 172.21.15.2:0/630504565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4ed002b050 con 0x55bd1ec064a0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ee7c7d740 10 client.17706 fetch_fsmap learned FSMap version 35 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/630504565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bd1ec8b8f0 con 0x55bd1ec064a0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.947+0000 7f4ebeffd640 1 -- 172.21.15.2:0/630504565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed4033020 con 0x55bd1ec064a0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ebeffd640 1 -- 172.21.15.2:0/630504565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f4ed0025020 con 0x55bd1ec064a0 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ee7c7d740 10 client.17706 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ee7c7d740 10 client.17706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:02:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ee7c7d740 20 client.17706 populate_metadata read hostname 'smithi002' 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55bd1ec11680 0x55bd1ec8e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ee7c7d740 4 client.17706 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/630504565 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bd1eb73d60 con 0x55bd1ec11680 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55bd1ec11680 0x55bd1ec8e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ede7fc640 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55bd1ec11680 0x55bd1ec8e0e0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50fffa2667015c50 server_cookie=3c68b201095ab88d in_seq=0 out_seq=0 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ebeffd640 10 client.17706 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ebeffd640 1 -- 172.21.15.2:0/630504565 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55bd1eb73d60 con 0x55bd1ec11680 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ebeffd640 10 client.17706 handle_command_reply: tid=0 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.948+0000 7f4ee7c7d740 1 client.17706 shutdown 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/630504565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 msgr2=0x55bd1ec23a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec23a50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x55bd1ec0f820 tx=0x7f4ed0013b70 comp rx=0 tx=0).stop 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/630504565 shutdown_connections 2024-09-12T01:02:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x55bd1ec11680 0x55bd1ec8e0e0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd1ec06dc0 0x55bd1ec23f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bd1ec064a0 0x55bd1ec23a50 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 --2- 172.21.15.2:0/630504565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd1ec02a30 0x55bd1ec266b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ebeffd640 0 client.17706 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/630504565 >> 172.21.15.2:0/630504565 conn(0x55bd1ec0e880 msgr2=0x55bd1ec01b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/630504565 shutdown_connections 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 1 -- 172.21.15.2:0/630504565 wait complete. 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee7c7d740 20 client.17706 trim_cache size 0 max 16384 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:02:58.953 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:02:58.954 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-12T01:02:58.954 INFO:teuthology.orchestra.run.smithi002.stdout: "3f2a251e-7e2d-4559-80c6-f70d553fd0d6": { 2024-09-12T01:02:58.954 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-12T01:02:58.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "3f2a251e-7e2d-4559-80c6-f70d553fd0d6", 2024-09-12T01:02:58.954 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-12T01:02:58.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:02:58.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:02:58.954 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee58a4640 1 -- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ec80a2cf0 msgr2=0x7f4ec80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ec80a2cf0 0x7f4ec80a51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80ed3f0 tx=0x7f4ed8031400 comp rx=0 tx=0).stop 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee58a4640 1 -- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 msgr2=0x7f4ee019efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 0x7f4ee019efc0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8005ab0 tx=0x7f4ed80042f0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.949+0000 7f4ee58a4640 1 -- 172.21.15.2:0/3484102355 shutdown_connections 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.950+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f4ec80a2cf0 0x7f4ec80a51b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.950+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee01082a0 0x7f4ee019efc0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.950+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee01036e0 0x7f4ee019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.950+0000 7f4ee58a4640 1 --2- 172.21.15.2:0/3484102355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ee0102d30 0x7f4ee019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:02:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.950+0000 7f4ee58a4640 1 -- 172.21.15.2:0/3484102355 >> 172.21.15.2:0/3484102355 conn(0x7f4ee00fc7d0 msgr2=0x7f4ee00fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:02:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.950+0000 7f4ee58a4640 1 -- 172.21.15.2:0/3484102355 shutdown_connections 2024-09-12T01:02:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:02:58.950+0000 7f4ee58a4640 1 -- 172.21.15.2:0/3484102355 wait complete. 2024-09-12T01:02:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:58 smithi167 ceph-mon[35234]: pgmap v310: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:02:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:58 smithi167 ceph-mon[35234]: scrub queued for path: / 2024-09-12T01:02:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:58 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:58 smithi167 ceph-mon[35234]: scrub summary: active paths [/] 2024-09-12T01:02:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:02:58 smithi167 ceph-mon[35234]: scrub summary: idle+waiting paths [/] 2024-09-12T01:02:59.659 INFO:tasks.cephfs.filesystem:scrub status for tag:3f2a251e-7e2d-4559-80c6-f70d553fd0d6 - {'path': '/', 'tag': '3f2a251e-7e2d-4559-80c6-f70d553fd0d6', 'options': 'recursive,force'} 2024-09-12T01:03:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:00 smithi071 ceph-mon[35276]: pgmap v311: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:00.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:00 smithi002 ceph-mon[31210]: pgmap v311: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:01.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:00 smithi167 ceph-mon[35234]: pgmap v311: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:01.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:01 smithi071 ceph-mon[35276]: scrub summary: idle 2024-09-12T01:03:01.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:01 smithi002 ceph-mon[31210]: scrub summary: idle 2024-09-12T01:03:02.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:01 smithi167 ceph-mon[35234]: scrub summary: idle 2024-09-12T01:03:02.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:02 smithi071 ceph-mon[35276]: pgmap v312: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T01:03:02.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:02 smithi002 ceph-mon[31210]: pgmap v312: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T01:03:03.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:02 smithi167 ceph-mon[35234]: pgmap v312: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-12T01:03:04.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:04 smithi071 ceph-mon[35276]: pgmap v313: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-12T01:03:04.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:04 smithi002 ceph-mon[31210]: pgmap v313: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-12T01:03:05.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:04 smithi167 ceph-mon[35234]: pgmap v313: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-12T01:03:06.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:06 smithi002 ceph-mon[31210]: pgmap v314: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-12T01:03:07.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:06 smithi167 ceph-mon[35234]: pgmap v314: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-12T01:03:07.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T01:03:07.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:06 smithi071 ceph-mon[35276]: pgmap v314: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.224+0000 7f23eebac640 1 -- 172.21.15.2:0/2658991174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0095520 msgr2=0x7f23e0099170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.224+0000 7f23eebac640 1 --2- 172.21.15.2:0/2658991174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0095520 0x7f23e0099170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009890 tx=0x7f23d802a360 comp rx=0 tx=0).stop 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.224+0000 7f23eebac640 1 -- 172.21.15.2:0/2658991174 shutdown_connections 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.225+0000 7f23eebac640 1 --2- 172.21.15.2:0/2658991174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e0099880 0x7f23e00a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.225+0000 7f23eebac640 1 --2- 172.21.15.2:0/2658991174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0095520 0x7f23e0099170 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.225+0000 7f23eebac640 1 --2- 172.21.15.2:0/2658991174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0094b70 0x7f23e0094f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.225+0000 7f23eebac640 1 -- 172.21.15.2:0/2658991174 >> 172.21.15.2:0/2658991174 conn(0x7f23e000a1e0 msgr2=0x7f23e000a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.225+0000 7f23eebac640 1 -- 172.21.15.2:0/2658991174 shutdown_connections 2024-09-12T01:03:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.225+0000 7f23eebac640 1 -- 172.21.15.2:0/2658991174 wait complete. 2024-09-12T01:03:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.227+0000 7f23eebac640 1 Processor -- start 2024-09-12T01:03:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.227+0000 7f23eebac640 1 -- start start 2024-09-12T01:03:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.227+0000 7f23eebac640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0094b70 0x7f23e012ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.227+0000 7f23eebac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0099880 0x7f23e012b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.227+0000 7f23eebac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e012f6a0 0x7f23e012fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.227+0000 7f23eebac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00a4890 con 0x7f23e012f6a0 2024-09-12T01:03:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.227+0000 7f23eebac640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00a4710 con 0x7f23e0094b70 2024-09-12T01:03:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.227+0000 7f23eebac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00a4a10 con 0x7f23e0099880 2024-09-12T01:03:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ee3ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e012f6a0 0x7f23e012fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ee3ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e012f6a0 0x7f23e012fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48728/0 (socket says 172.21.15.2:48728) 2024-09-12T01:03:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ed3a9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0099880 0x7f23e012b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ed3a9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0099880 0x7f23e012b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:46988/0 (socket says 172.21.15.2:46988) 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ed3a9640 1 -- 172.21.15.2:0/976637775 learned_addr learned my addr 172.21.15.2:0/976637775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23edbaa640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0094b70 0x7f23e012ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ee3ab640 1 -- 172.21.15.2:0/976637775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0099880 msgr2=0x7f23e012b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ee3ab640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0099880 0x7f23e012b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ee3ab640 1 -- 172.21.15.2:0/976637775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0094b70 msgr2=0x7f23e012ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ee3ab640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0094b70 0x7f23e012ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ee3ab640 1 -- 172.21.15.2:0/976637775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e0130190 con 0x7f23e012f6a0 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23ed3a9640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0099880 0x7f23e012b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.228+0000 7f23edbaa640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0094b70 0x7f23e012ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:03:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.229+0000 7f23ee3ab640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e012f6a0 0x7f23e012fb50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009fd0 tx=0x7f23e400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.229+0000 7f23deffd640 1 -- 172.21.15.2:0/976637775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4004220 con 0x7f23e012f6a0 2024-09-12T01:03:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.230+0000 7f23deffd640 1 -- 172.21.15.2:0/976637775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23e400cd90 con 0x7f23e012f6a0 2024-09-12T01:03:07.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.230+0000 7f23deffd640 1 -- 172.21.15.2:0/976637775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4004a00 con 0x7f23e012f6a0 2024-09-12T01:03:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.232+0000 7f23eebac640 1 -- 172.21.15.2:0/976637775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e0130480 con 0x7f23e012f6a0 2024-09-12T01:03:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.232+0000 7f23eebac640 1 -- 172.21.15.2:0/976637775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e00049e0 con 0x7f23e012f6a0 2024-09-12T01:03:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.234+0000 7f23dcff9640 1 -- 172.21.15.2:0/976637775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e0094f50 con 0x7f23e012f6a0 2024-09-12T01:03:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.238+0000 7f23deffd640 1 -- 172.21.15.2:0/976637775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f23e4004ba0 con 0x7f23e012f6a0 2024-09-12T01:03:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.239+0000 7f23deffd640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f23d40a7260 0x7f23d40a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.239+0000 7f23deffd640 1 -- 172.21.15.2:0/976637775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8687+0+0 (secure 0 0 0) 0x7f23e40043c0 con 0x7f23e012f6a0 2024-09-12T01:03:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.240+0000 7f23edbaa640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f23d40a7260 0x7f23d40a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.241+0000 7f23edbaa640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f23d40a7260 0x7f23d40a9720 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23e8067c40 tx=0x7f23e8067ad0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.249+0000 7f23deffd640 1 -- 172.21.15.2:0/976637775 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23e401c020 con 0x7f23e012f6a0 2024-09-12T01:03:07.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.657+0000 7f23dcff9640 1 -- 172.21.15.2:0/976637775 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f23e012c130 con 0x7f23d40a7260 2024-09-12T01:03:07.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.670+0000 7f23deffd640 1 -- 172.21.15.2:0/976637775 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f23e012c130 con 0x7f23d40a7260 2024-09-12T01:03:07.670 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T00:53:05", "first": "2024-09-12T00:54:00", "last": "2024-09-12T01:03:00", "last_pruned": "2024-09-12T01:03:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-12T01:03:07.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.673+0000 7f23dcff9640 1 -- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f23d40a7260 msgr2=0x7f23d40a9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:07.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.673+0000 7f23dcff9640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f23d40a7260 0x7f23d40a9720 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23e8067c40 tx=0x7f23e8067ad0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.673+0000 7f23dcff9640 1 -- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e012f6a0 msgr2=0x7f23e012fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:07.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.673+0000 7f23dcff9640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e012f6a0 0x7f23e012fb50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009fd0 tx=0x7f23e400eba0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.674+0000 7f23dcff9640 1 -- 172.21.15.2:0/976637775 shutdown_connections 2024-09-12T01:03:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.674+0000 7f23dcff9640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f23d40a7260 0x7f23d40a9720 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.674+0000 7f23dcff9640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e012f6a0 0x7f23e012fb50 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.674+0000 7f23dcff9640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0099880 0x7f23e012b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.674+0000 7f23dcff9640 1 --2- 172.21.15.2:0/976637775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23e0094b70 0x7f23e012ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.674+0000 7f23dcff9640 1 -- 172.21.15.2:0/976637775 >> 172.21.15.2:0/976637775 conn(0x7f23e000a1e0 msgr2=0x7f23e0092ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.675+0000 7f23dcff9640 1 -- 172.21.15.2:0/976637775 shutdown_connections 2024-09-12T01:03:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.675+0000 7f23dcff9640 1 -- 172.21.15.2:0/976637775 wait complete. 2024-09-12T01:03:07.694 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T01:03:07.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 -- 172.21.15.2:0/3309870943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3744100800 msgr2=0x7f3744100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:07.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 --2- 172.21.15.2:0/3309870943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3744100800 0x7f3744100be0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3740009860 tx=0x7f374002a340 comp rx=0 tx=0).stop 2024-09-12T01:03:07.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 -- 172.21.15.2:0/3309870943 shutdown_connections 2024-09-12T01:03:07.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 --2- 172.21.15.2:0/3309870943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f374410e3b0 0x7f37441107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 --2- 172.21.15.2:0/3309870943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37441011b0 0x7f374410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 --2- 172.21.15.2:0/3309870943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3744100800 0x7f3744100be0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 -- 172.21.15.2:0/3309870943 >> 172.21.15.2:0/3309870943 conn(0x7f37440779a0 msgr2=0x7f37440fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:07.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 -- 172.21.15.2:0/3309870943 shutdown_connections 2024-09-12T01:03:07.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.857+0000 7f374be23640 1 -- 172.21.15.2:0/3309870943 wait complete. 2024-09-12T01:03:07.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.858+0000 7f374be23640 1 Processor -- start 2024-09-12T01:03:07.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.858+0000 7f374be23640 1 -- start start 2024-09-12T01:03:07.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.858+0000 7f374be23640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3744100800 0x7f3744108310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:07.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.858+0000 7f374be23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37441011b0 0x7f3744108850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:07.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.858+0000 7f3749bbf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3744100800 0x7f3744108310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f374be23640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374410e3b0 0x7f3744102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f374be23640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37441140b0 con 0x7f37441011b0 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f374be23640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3744113f30 con 0x7f3744100800 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f374be23640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3744114230 con 0x7f374410e3b0 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f37493be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37441011b0 0x7f3744108850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f37493be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37441011b0 0x7f3744108850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48738/0 (socket says 172.21.15.2:48738) 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f37493be640 1 -- 172.21.15.2:0/472034741 learned_addr learned my addr 172.21.15.2:0/472034741 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f374a3c0640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374410e3b0 0x7f3744102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f3749bbf640 1 -- 172.21.15.2:0/472034741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374410e3b0 msgr2=0x7f3744102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f3749bbf640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374410e3b0 0x7f3744102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f3749bbf640 1 -- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37441011b0 msgr2=0x7f3744108850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:07.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f3749bbf640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37441011b0 0x7f3744108850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f3749bbf640 1 -- 172.21.15.2:0/472034741 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37441031b0 con 0x7f3744100800 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f37493be640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37441011b0 0x7f3744108850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f3749bbf640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3744100800 0x7f3744108310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f374002a860 tx=0x7f3740033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f373affd640 1 -- 172.21.15.2:0/472034741 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740037040 con 0x7f3744100800 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.859+0000 7f373affd640 1 -- 172.21.15.2:0/472034741 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3740030550 con 0x7f3744100800 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.860+0000 7f373affd640 1 -- 172.21.15.2:0/472034741 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740003b60 con 0x7f3744100800 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.860+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3744103440 con 0x7f3744100800 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.860+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374410d0f0 con 0x7f3744100800 2024-09-12T01:03:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.861+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374406a2e0 con 0x7f3744100800 2024-09-12T01:03:07.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.863+0000 7f373affd640 1 -- 172.21.15.2:0/472034741 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f3740044030 con 0x7f3744100800 2024-09-12T01:03:07.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.863+0000 7f373affd640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37300a2cf0 0x7f37300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:07.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.864+0000 7f373affd640 1 -- 172.21.15.2:0/472034741 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8687+0+0 (secure 0 0 0) 0x7f37400eefd0 con 0x7f3744100800 2024-09-12T01:03:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.864+0000 7f37493be640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37300a2cf0 0x7f37300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:07.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.864+0000 7f37493be640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37300a2cf0 0x7f37300a51b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f37441a1ca0 tx=0x7f373400a380 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:07.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:07.867+0000 7f373affd640 1 -- 172.21.15.2:0/472034741 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f374004b060 con 0x7f3744100800 2024-09-12T01:03:07.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:07 smithi002 ceph-mon[31210]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:03:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:07 smithi167 ceph-mon[35234]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:03:08.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.064+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 --> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f3744110380 con 0x7f37300a2cf0 2024-09-12T01:03:08.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.070+0000 7f373affd640 1 -- 172.21.15.2:0/472034741 <== mgr.15132 v2:172.21.15.2:6800/606710864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f3744110380 con 0x7f37300a2cf0 2024-09-12T01:03:08.070 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-09-12T01:03:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37300a2cf0 msgr2=0x7f37300a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37300a2cf0 0x7f37300a51b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f37441a1ca0 tx=0x7f373400a380 comp rx=0 tx=0).stop 2024-09-12T01:03:08.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3744100800 msgr2=0x7f3744108310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3744100800 0x7f3744108310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f374002a860 tx=0x7f3740033d90 comp rx=0 tx=0).stop 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 shutdown_connections 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f37300a2cf0 0x7f37300a51b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374410e3b0 0x7f3744102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37441011b0 0x7f3744108850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 --2- 172.21.15.2:0/472034741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3744100800 0x7f3744108310 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 >> 172.21.15.2:0/472034741 conn(0x7f37440779a0 msgr2=0x7f374410fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 shutdown_connections 2024-09-12T01:03:08.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:08.072+0000 7f374be23640 1 -- 172.21.15.2:0/472034741 wait complete. 2024-09-12T01:03:08.083 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T01:03:08.095 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T01:03:08.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:07 smithi071 ceph-mon[35276]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:03:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:08 smithi002 ceph-mon[31210]: pgmap v316: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-12T01:03:08.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:08 smithi002 ceph-mon[31210]: from='client.17712 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:03:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:08 smithi167 ceph-mon[35234]: pgmap v316: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-12T01:03:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:08 smithi167 ceph-mon[35234]: from='client.17712 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:03:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:08 smithi071 ceph-mon[35276]: pgmap v316: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-12T01:03:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:08 smithi071 ceph-mon[35276]: from='client.17712 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:03:09.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:09 smithi002 ceph-mon[31210]: from='client.26930 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:03:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:09 smithi167 ceph-mon[35234]: from='client.26930 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:03:10.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:09 smithi071 ceph-mon[35276]: from='client.26930 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:03:10.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:10 smithi002 ceph-mon[31210]: pgmap v317: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-12T01:03:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:10 smithi167 ceph-mon[35234]: pgmap v317: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-12T01:03:11.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:10 smithi071 ceph-mon[35276]: pgmap v317: 97 pgs: 97 active+clean; 244 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-12T01:03:11.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:11 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:03:12.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:11 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:03:12.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:11 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:03:12.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:12 smithi002 ceph-mon[31210]: pgmap v318: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T01:03:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:12 smithi167 ceph-mon[35234]: pgmap v318: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T01:03:13.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:12 smithi071 ceph-mon[35276]: pgmap v318: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T01:03:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: pgmap v319: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T01:03:14.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: Unable to set osd_memory_target on smithi167 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-12T01:03:14.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:03:14.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:03:14.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.445 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:14 smithi071 ceph-mon[35276]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:03:14.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: pgmap v319: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T01:03:14.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-12T01:03:14.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: Unable to set osd_memory_target on smithi167 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:14 smithi002 ceph-mon[31210]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:03:14.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: pgmap v319: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T01:03:14.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-12T01:03:14.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: Unable to set osd_memory_target on smithi167 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:03:14.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:14 smithi167 ceph-mon[35234]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:03:16.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:16 smithi071 ceph-mon[35276]: pgmap v321: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 122 B/s wr, 7 op/s 2024-09-12T01:03:16.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:16 smithi002 ceph-mon[31210]: pgmap v321: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 122 B/s wr, 7 op/s 2024-09-12T01:03:16.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:16 smithi167 ceph-mon[35234]: pgmap v321: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 122 B/s wr, 7 op/s 2024-09-12T01:03:18.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:18 smithi071 ceph-mon[35276]: pgmap v322: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-12T01:03:18.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:18 smithi002 ceph-mon[31210]: pgmap v322: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-12T01:03:18.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:18 smithi167 ceph-mon[35234]: pgmap v322: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-12T01:03:20.355 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:20 smithi167 ceph-mon[35234]: pgmap v323: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-12T01:03:20.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:20 smithi071 ceph-mon[35276]: pgmap v323: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-12T01:03:20.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:20 smithi002 ceph-mon[31210]: pgmap v323: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-12T01:03:22.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:22 smithi071 ceph-mon[35276]: pgmap v324: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:03:22.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:22 smithi002 ceph-mon[31210]: pgmap v324: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:03:22.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:22 smithi167 ceph-mon[35234]: pgmap v324: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:03:24.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:24 smithi071 ceph-mon[35276]: pgmap v325: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:03:24.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:24 smithi002 ceph-mon[31210]: pgmap v325: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:03:24.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:24 smithi167 ceph-mon[35234]: pgmap v325: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-12T01:03:26.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:26 smithi071 ceph-mon[35276]: pgmap v326: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:03:26.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:26 smithi002 ceph-mon[31210]: pgmap v326: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:03:26.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:26 smithi167 ceph-mon[35234]: pgmap v326: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 89 B/s wr, 5 op/s 2024-09-12T01:03:28.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:28 smithi071 ceph-mon[35276]: pgmap v327: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:03:28.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:28 smithi002 ceph-mon[31210]: pgmap v327: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:03:28.536 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:28 smithi167 ceph-mon[35234]: pgmap v327: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-12T01:03:29.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:03:29.931 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:30.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:30 smithi002 ceph-mon[31210]: pgmap v328: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:30.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.393+0000 7f9bcf540640 1 -- 172.21.15.2:0/2014546513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8101de0 msgr2=0x7f9bc81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.393+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2014546513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8101de0 0x7f9bc81021c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009900 tx=0x7f9bc402a410 comp rx=0 tx=0).stop 2024-09-12T01:03:30.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.393+0000 7f9bcf540640 1 -- 172.21.15.2:0/2014546513 shutdown_connections 2024-09-12T01:03:30.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.393+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2014546513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bc8106f10 0x7f9bc810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.393+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2014546513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bc8102790 0x7f9bc81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.393+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2014546513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8101de0 0x7f9bc81021c0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.393+0000 7f9bcf540640 1 -- 172.21.15.2:0/2014546513 >> 172.21.15.2:0/2014546513 conn(0x7f9bc80fd8c0 msgr2=0x7f9bc80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:30.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 -- 172.21.15.2:0/2014546513 shutdown_connections 2024-09-12T01:03:30.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 -- 172.21.15.2:0/2014546513 wait complete. 2024-09-12T01:03:30.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 Processor -- start 2024-09-12T01:03:30.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 -- start start 2024-09-12T01:03:30.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bc8101de0 0x7f9bc80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bc8102790 0x7f9bc8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8106f10 0x7f9bc8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc8111f70 con 0x7f9bc8106f10 2024-09-12T01:03:30.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc8111df0 con 0x7f9bc8101de0 2024-09-12T01:03:30.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.394+0000 7f9bcf540640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc81120f0 con 0x7f9bc8102790 2024-09-12T01:03:30.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8106f10 0x7f9bc8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8106f10 0x7f9bc8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58902/0 (socket says 172.21.15.2:58902) 2024-09-12T01:03:30.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 -- 172.21.15.2:0/2236939818 learned_addr learned my addr 172.21.15.2:0/2236939818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:30.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bccadb640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bc8102790 0x7f9bc8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bc8101de0 0x7f9bc80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 -- 172.21.15.2:0/2236939818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bc8102790 msgr2=0x7f9bc8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bc8102790 0x7f9bc8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 -- 172.21.15.2:0/2236939818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bc8101de0 msgr2=0x7f9bc80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bc8101de0 0x7f9bc80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 -- 172.21.15.2:0/2236939818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc81a6830 con 0x7f9bc8106f10 2024-09-12T01:03:30.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcdadd640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8106f10 0x7f9bc8074f70 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f9bc000eaa0 tx=0x7f9bc000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:30.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bbe7fc640 1 -- 172.21.15.2:0/2236939818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0004d20 con 0x7f9bc8106f10 2024-09-12T01:03:30.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bbe7fc640 1 -- 172.21.15.2:0/2236939818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bc0005020 con 0x7f9bc8106f10 2024-09-12T01:03:30.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcf540640 1 -- 172.21.15.2:0/2236939818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc81a6b20 con 0x7f9bc8106f10 2024-09-12T01:03:30.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bbe7fc640 1 -- 172.21.15.2:0/2236939818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00116d0 con 0x7f9bc8106f10 2024-09-12T01:03:30.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.395+0000 7f9bcf540640 1 -- 172.21.15.2:0/2236939818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc81a7060 con 0x7f9bc8106f10 2024-09-12T01:03:30.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bbe7fc640 1 -- 172.21.15.2:0/2236939818 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f9bc00051d0 con 0x7f9bc8106f10 2024-09-12T01:03:30.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bd1919740 1 Processor -- start 2024-09-12T01:03:30.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bd1919740 1 -- start start 2024-09-12T01:03:30.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d7874a0 0x557b2d787880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d792140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d792680 0x557b2d794a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bd1919740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b2d6ed2e0 con 0x557b2d7874a0 2024-09-12T01:03:30.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bd1919740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b2d694ce0 con 0x557b2d792680 2024-09-12T01:03:30.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bd1919740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557b2d6e92a0 con 0x557b2d787dc0 2024-09-12T01:03:30.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.398+0000 7f9bccadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d7874a0 0x557b2d787880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d7874a0 0x557b2d787880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58910/0 (socket says 172.21.15.2:58910) 2024-09-12T01:03:30.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 -- 172.21.15.2:0/4146041660 learned_addr learned my addr 172.21.15.2:0/4146041660 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:30.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d792140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bbe7fc640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bb40a2cf0 0x7f9bb40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d792680 0x557b2d794a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 -- 172.21.15.2:0/4146041660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 msgr2=0x557b2d792140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:30.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d792140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 -- 172.21.15.2:0/4146041660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d792680 msgr2=0x557b2d794a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:30.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d792680 0x557b2d794a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 -- 172.21.15.2:0/4146041660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2d679440 con 0x557b2d7874a0 2024-09-12T01:03:30.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bbe7fc640 1 -- 172.21.15.2:0/2236939818 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f9bc00cf5b0 con 0x7f9bc8106f10 2024-09-12T01:03:30.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bcdadd640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bb40a2cf0 0x7f9bb40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bccadb640 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d7874a0 0x557b2d787880 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800aee0 tx=0x7f9bb800a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fe7b06cc852dab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:30.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bb37fe640 1 -- 172.21.15.2:0/4146041660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800f650 con 0x557b2d7874a0 2024-09-12T01:03:30.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bb37fe640 1 -- 172.21.15.2:0/4146041660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb8017030 con 0x557b2d7874a0 2024-09-12T01:03:30.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.399+0000 7f9bb37fe640 1 -- 172.21.15.2:0/4146041660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8012910 con 0x557b2d7874a0 2024-09-12T01:03:30.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 -- 172.21.15.2:0/4146041660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d7874a0 msgr2=0x557b2d787880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d7874a0 0x557b2d787880 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800aee0 tx=0x7f9bb800a800 comp rx=0 tx=0).stop 2024-09-12T01:03:30.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bcdadd640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bb40a2cf0 0x7f9bb40a51b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0098420 tx=0x7f9bc0084f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:30.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 -- 172.21.15.2:0/4146041660 shutdown_connections 2024-09-12T01:03:30.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d792680 0x557b2d794a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d792140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 --2- 172.21.15.2:0/4146041660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d7874a0 0x557b2d787880 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 -- 172.21.15.2:0/4146041660 >> 172.21.15.2:0/4146041660 conn(0x557b2d783a30 msgr2=0x557b2d783e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:30.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 -- 172.21.15.2:0/4146041660 shutdown_connections 2024-09-12T01:03:30.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 -- 172.21.15.2:0/4146041660 wait complete. 2024-09-12T01:03:30.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.400+0000 7f9bd1919740 1 -- start start 2024-09-12T01:03:30.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bd1919740 1 Processor -- start 2024-09-12T01:03:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 0x557b2d792010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d78f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bd1919740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b2d795250 con 0x557b2d792680 2024-09-12T01:03:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bd1919740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b2d6a8050 con 0x557b2d7874a0 2024-09-12T01:03:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bd1919740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557b2d7953d0 con 0x557b2d787dc0 2024-09-12T01:03:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bd1919740 10 client.0 _ll_register_callbacks cb 0x557b2d6e8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:03:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58912/0 (socket says 172.21.15.2:58912) 2024-09-12T01:03:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 -- 172.21.15.2:0/1208683525 learned_addr learned my addr 172.21.15.2:0/1208683525 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d78f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 0x557b2d792010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 -- 172.21.15.2:0/1208683525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 msgr2=0x557b2d78f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d78f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 -- 172.21.15.2:0/1208683525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 msgr2=0x557b2d792010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 0x557b2d792010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bccadb640 1 -- 172.21.15.2:0/1208683525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b2d45e3c0 con 0x557b2d792680 2024-09-12T01:03:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.401+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d78f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bccadb640 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78f840 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80125f0 tx=0x7f9bb800a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23b8f435f8965f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:03:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/1208683525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800f860 con 0x557b2d792680 2024-09-12T01:03:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/1208683525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f9bb800fa00 con 0x557b2d792680 2024-09-12T01:03:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bd1919740 1 -- 172.21.15.2:0/1208683525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bb8017030 con 0x557b2d792680 2024-09-12T01:03:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/1208683525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9bb800a9f0 con 0x557b2d792680 2024-09-12T01:03:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bd1919740 10 client.17730 fetch_fsmap learned FSMap version 35 2024-09-12T01:03:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bd1919740 1 -- 172.21.15.2:0/1208683525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557b2d7a0c40 con 0x557b2d792680 2024-09-12T01:03:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/1208683525 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb8017030 con 0x557b2d792680 2024-09-12T01:03:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/1208683525 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9bb8004990 con 0x557b2d792680 2024-09-12T01:03:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bd1919740 10 client.17730 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:03:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bd1919740 10 client.17730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:03:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bd1919740 20 client.17730 populate_metadata read hostname 'smithi002' 2024-09-12T01:03:30.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.402+0000 7f9bd1919740 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b2d7a2050 0x557b2d7a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.403+0000 7f9bd1919740 4 client.17730 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:03:30.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.403+0000 7f9bd1919740 1 -- 172.21.15.2:0/1208683525 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b2d6fa850 con 0x557b2d7a2050 2024-09-12T01:03:30.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.403+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b2d7a2050 0x557b2d7a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.403+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b2d7a2050 0x557b2d7a4440 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d8ce55d241b92ae server_cookie=396b7074139a9bba in_seq=0 out_seq=0 2024-09-12T01:03:30.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.403+0000 7f9bb0ff9640 10 client.17730 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:03:30.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/1208683525 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b2d6fa850 con 0x557b2d7a2050 2024-09-12T01:03:30.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bb0ff9640 10 client.17730 handle_command_reply: tid=0 2024-09-12T01:03:30.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 client.17730 shutdown 2024-09-12T01:03:30.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 -- 172.21.15.2:0/1208683525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 msgr2=0x557b2d78f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78f840 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80125f0 tx=0x7f9bb800a870 comp rx=0 tx=0).stop 2024-09-12T01:03:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 -- 172.21.15.2:0/1208683525 shutdown_connections 2024-09-12T01:03:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b2d7a2050 0x557b2d7a4440 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bb0ff9640 0 client.17730 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:03:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78f840 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d78f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 --2- 172.21.15.2:0/1208683525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 0x557b2d792010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 -- 172.21.15.2:0/1208683525 >> 172.21.15.2:0/1208683525 conn(0x557b2d783a30 msgr2=0x557b2d789760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 -- 172.21.15.2:0/1208683525 shutdown_connections 2024-09-12T01:03:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 1 -- 172.21.15.2:0/1208683525 wait complete. 2024-09-12T01:03:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.404+0000 7f9bd1919740 20 client.17730 trim_cache size 0 max 16384 2024-09-12T01:03:30.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bd1919740 1 Processor -- start 2024-09-12T01:03:30.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bd1919740 1 -- start start 2024-09-12T01:03:30.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7874a0 0x557b2d78a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d787dc0 0x557b2d791230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bd1919740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc81b24b0 con 0x557b2d792680 2024-09-12T01:03:30.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bd1919740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc81afd80 con 0x557b2d787dc0 2024-09-12T01:03:30.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bd1919740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc81adbf0 con 0x557b2d7874a0 2024-09-12T01:03:30.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58924/0 (socket says 172.21.15.2:58924) 2024-09-12T01:03:30.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 -- 172.21.15.2:0/619630123 learned_addr learned my addr 172.21.15.2:0/619630123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:30.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d787dc0 0x557b2d791230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 -- 172.21.15.2:0/619630123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7874a0 msgr2=0x557b2d78a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:30.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7874a0 0x557b2d78a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 -- 172.21.15.2:0/619630123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d787dc0 msgr2=0x557b2d791230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d787dc0 0x557b2d791230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 -- 172.21.15.2:0/619630123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2d78d810 con 0x557b2d792680 2024-09-12T01:03:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d787dc0 0x557b2d791230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.422+0000 7f9bccadb640 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78c520 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800a8e0 tx=0x7f9bb8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ba1ce1ec95c46f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bb2ffd640 1 -- 172.21.15.2:0/619630123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb801c420 con 0x557b2d792680 2024-09-12T01:03:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bb2ffd640 1 -- 172.21.15.2:0/619630123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb8017040 con 0x557b2d792680 2024-09-12T01:03:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bb2ffd640 1 -- 172.21.15.2:0/619630123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb801c720 con 0x557b2d792680 2024-09-12T01:03:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 -- 172.21.15.2:0/619630123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 msgr2=0x557b2d78c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78c520 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800a8e0 tx=0x7f9bb8000bc0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 -- 172.21.15.2:0/619630123 shutdown_connections 2024-09-12T01:03:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d78c520 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d787dc0 0x557b2d791230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 --2- 172.21.15.2:0/619630123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7874a0 0x557b2d78a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 -- 172.21.15.2:0/619630123 >> 172.21.15.2:0/619630123 conn(0x557b2d783a30 msgr2=0x557b2d790b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 -- 172.21.15.2:0/619630123 shutdown_connections 2024-09-12T01:03:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.423+0000 7f9bd1919740 1 -- 172.21.15.2:0/619630123 wait complete. 2024-09-12T01:03:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 1 -- start start 2024-09-12T01:03:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 1 Processor -- start 2024-09-12T01:03:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 0x557b2d7a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d7a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d7a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc81ae240 con 0x557b2d792680 2024-09-12T01:03:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc81af6b0 con 0x557b2d7874a0 2024-09-12T01:03:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc81ae910 con 0x557b2d787dc0 2024-09-12T01:03:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bd1919740 10 client.0 _ll_register_callbacks cb 0x7f9bc4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:03:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bccadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d7a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bccadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d7a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58940/0 (socket says 172.21.15.2:58940) 2024-09-12T01:03:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bccadb640 1 -- 172.21.15.2:0/2094994310 learned_addr learned my addr 172.21.15.2:0/2094994310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.424+0000 7f9bccadb640 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 0x557b2d7a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d7a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bccadb640 1 -- 172.21.15.2:0/2094994310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 msgr2=0x557b2d7a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bccadb640 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d7a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bccadb640 1 -- 172.21.15.2:0/2094994310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 msgr2=0x557b2d7a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bccadb640 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 0x557b2d7a7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bccadb640 1 -- 172.21.15.2:0/2094994310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b2d80b990 con 0x557b2d792680 2024-09-12T01:03:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bccadb640 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d7a5800 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8005780 tx=0x7f9bb800f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7a8fcf27084597 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:03:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/2094994310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb801c720 con 0x557b2d792680 2024-09-12T01:03:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bd1919740 1 -- 172.21.15.2:0/2094994310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bb8017040 con 0x557b2d792680 2024-09-12T01:03:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/2094994310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f9bb801cb50 con 0x557b2d792680 2024-09-12T01:03:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/2094994310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9bb801cd50 con 0x557b2d792680 2024-09-12T01:03:30.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bd1919740 10 client.17736 fetch_fsmap learned FSMap version 35 2024-09-12T01:03:30.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bd1919740 1 -- 172.21.15.2:0/2094994310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557b2d80ca70 con 0x557b2d792680 2024-09-12T01:03:30.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.425+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/2094994310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb8017040 con 0x557b2d792680 2024-09-12T01:03:30.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.426+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/2094994310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9bb8041020 con 0x557b2d792680 2024-09-12T01:03:30.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.426+0000 7f9bd1919740 10 client.17736 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:03:30.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.426+0000 7f9bd1919740 10 client.17736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:03:30.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.426+0000 7f9bd1919740 20 client.17736 populate_metadata read hostname 'smithi002' 2024-09-12T01:03:30.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.426+0000 7f9bd1919740 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b2d7a2050 0x557b2d80f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:30.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.426+0000 7f9bd1919740 4 client.17736 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:03:30.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.426+0000 7f9bd1919740 1 -- 172.21.15.2:0/2094994310 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557b2d6f4d60 con 0x557b2d7a2050 2024-09-12T01:03:30.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.426+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b2d7a2050 0x557b2d80f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:30.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bcd2dc640 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b2d7a2050 0x557b2d80f150 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85ee5b6eafb24e5d server_cookie=6eef1f97ee4ba3f9 in_seq=0 out_seq=0 2024-09-12T01:03:30.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bb0ff9640 10 client.17736 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:03:30.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bb0ff9640 1 -- 172.21.15.2:0/2094994310 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557b2d6f4d60 con 0x557b2d7a2050 2024-09-12T01:03:30.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bb0ff9640 10 client.17736 handle_command_reply: tid=0 2024-09-12T01:03:30.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 client.17736 shutdown 2024-09-12T01:03:30.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 -- 172.21.15.2:0/2094994310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 msgr2=0x557b2d7a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d7a5800 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8005780 tx=0x7f9bb800f810 comp rx=0 tx=0).stop 2024-09-12T01:03:30.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 -- 172.21.15.2:0/2094994310 shutdown_connections 2024-09-12T01:03:30.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x557b2d7a2050 0x557b2d80f150 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b2d792680 0x557b2d7a5800 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d787dc0 0x557b2d7a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 --2- 172.21.15.2:0/2094994310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b2d7874a0 0x557b2d7a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 -- 172.21.15.2:0/2094994310 >> 172.21.15.2:0/2094994310 conn(0x557b2d783a30 msgr2=0x557b2d791340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:30.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bb0ff9640 0 client.17736 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:03:30.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 -- 172.21.15.2:0/2094994310 shutdown_connections 2024-09-12T01:03:30.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 1 -- 172.21.15.2:0/2094994310 wait complete. 2024-09-12T01:03:30.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.427+0000 7f9bd1919740 20 client.17736 trim_cache size 0 max 16384 2024-09-12T01:03:30.471 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:03:30.471 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-12T01:03:30.472 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-12T01:03:30.472 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:03:30.472 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:30 smithi071 ceph-mon[35276]: pgmap v328: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:30.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 -- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bb40a2cf0 msgr2=0x7f9bb40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bb40a2cf0 0x7f9bb40a51b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0098420 tx=0x7f9bc0084f90 comp rx=0 tx=0).stop 2024-09-12T01:03:30.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 -- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8106f10 msgr2=0x7f9bc8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:30.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8106f10 0x7f9bc8074f70 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f9bc000eaa0 tx=0x7f9bc000eea0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 -- 172.21.15.2:0/2236939818 shutdown_connections 2024-09-12T01:03:30.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f9bb40a2cf0 0x7f9bb40a51b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bc8106f10 0x7f9bc8074f70 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bc8102790 0x7f9bc8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 --2- 172.21.15.2:0/2236939818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bc8101de0 0x7f9bc80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:30.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 -- 172.21.15.2:0/2236939818 >> 172.21.15.2:0/2236939818 conn(0x7f9bc80fd8c0 msgr2=0x7f9bc80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:30.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 -- 172.21.15.2:0/2236939818 shutdown_connections 2024-09-12T01:03:30.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:30.428+0000 7f9bcf540640 1 -- 172.21.15.2:0/2236939818 wait complete. 2024-09-12T01:03:30.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:30 smithi167 ceph-mon[35234]: pgmap v328: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:31.237 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:03:31.237 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:03:31.499 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 -- 172.21.15.2:0/2113586394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c105f40 msgr2=0x7fa74c1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 --2- 172.21.15.2:0/2113586394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c105f40 0x7fa74c1063d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa744009ca0 tx=0x7fa74402a940 comp rx=0 tx=0).stop 2024-09-12T01:03:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 -- 172.21.15.2:0/2113586394 shutdown_connections 2024-09-12T01:03:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 --2- 172.21.15.2:0/2113586394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c105f40 0x7fa74c1063d0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 --2- 172.21.15.2:0/2113586394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c101450 0x7fa74c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 --2- 172.21.15.2:0/2113586394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa74c100b30 0x7fa74c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 -- 172.21.15.2:0/2113586394 >> 172.21.15.2:0/2113586394 conn(0x7fa74c0fc7a0 msgr2=0x7fa74c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 -- 172.21.15.2:0/2113586394 shutdown_connections 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.973+0000 7fa753083640 1 -- 172.21.15.2:0/2113586394 wait complete. 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa753083640 1 Processor -- start 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa753083640 1 -- start start 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa753083640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c100b30 0x7fa74c1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa753083640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c101450 0x7fa74c1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa753083640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa74c105f40 0x7fa74c19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa753083640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c118560 con 0x7fa74c101450 2024-09-12T01:03:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa753083640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c1183e0 con 0x7fa74c105f40 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa753083640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c1186e0 con 0x7fa74c100b30 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.974+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c101450 0x7fa74c1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c101450 0x7fa74c1a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58958/0 (socket says 172.21.15.2:58958) 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa750e1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c100b30 0x7fa74c1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa74bfff640 1 -- 172.21.15.2:0/4206045326 learned_addr learned my addr 172.21.15.2:0/4206045326 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa751620640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa74c105f40 0x7fa74c19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa74bfff640 1 -- 172.21.15.2:0/4206045326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c100b30 msgr2=0x7fa74c1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa74bfff640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c100b30 0x7fa74c1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa74bfff640 1 -- 172.21.15.2:0/4206045326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa74c105f40 msgr2=0x7fa74c19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa74bfff640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa74c105f40 0x7fa74c19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa74bfff640 1 -- 172.21.15.2:0/4206045326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c19efc0 con 0x7fa74c101450 2024-09-12T01:03:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa751620640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa74c105f40 0x7fa74c19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa74bfff640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c101450 0x7fa74c1a4c10 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa73800d740 tx=0x7fa73800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa749ffb640 1 -- 172.21.15.2:0/4206045326 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738017070 con 0x7fa74c101450 2024-09-12T01:03:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa749ffb640 1 -- 172.21.15.2:0/4206045326 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa73800de50 con 0x7fa74c101450 2024-09-12T01:03:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c19f2b0 con 0x7fa74c101450 2024-09-12T01:03:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.975+0000 7fa749ffb640 1 -- 172.21.15.2:0/4206045326 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73800f620 con 0x7fa74c101450 2024-09-12T01:03:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.976+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c1ab5a0 con 0x7fa74c101450 2024-09-12T01:03:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.977+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c105920 con 0x7fa74c101450 2024-09-12T01:03:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.978+0000 7fa749ffb640 1 -- 172.21.15.2:0/4206045326 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fa738009c30 con 0x7fa74c101450 2024-09-12T01:03:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.978+0000 7fa749ffb640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa73c0a2cf0 0x7fa73c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.978+0000 7fa750e1f640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa73c0a2cf0 0x7fa73c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.978+0000 7fa749ffb640 1 -- 172.21.15.2:0/4206045326 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7fa7380cf040 con 0x7fa74c101450 2024-09-12T01:03:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.979+0000 7fa750e1f640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa73c0a2cf0 0x7fa73c0a51b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa74c19f9d0 tx=0x7fa740005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:31.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:31.983+0000 7fa749ffb640 1 -- 172.21.15.2:0/4206045326 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa73809bbe0 con 0x7fa74c101450 2024-09-12T01:03:32.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.191+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa74c1ab770 con 0x7fa74c101450 2024-09-12T01:03:32.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:32 smithi002 ceph-mon[31210]: pgmap v329: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:32.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.192+0000 7fa749ffb640 1 -- 172.21.15.2:0/4206045326 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11899 (secure 0 0 0) 0x7fa73809b4e0 con 0x7fa74c101450 2024-09-12T01:03:32.192 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:03:32.192 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":35,"btime":"2024-09-12T01:01:35:630451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T01:01:35.219926+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T01:03:32.192 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 35 2024-09-12T01:03:32.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.194+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa73c0a2cf0 msgr2=0x7fa73c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.194+0000 7fa753083640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa73c0a2cf0 0x7fa73c0a51b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa74c19f9d0 tx=0x7fa740005f90 comp rx=0 tx=0).stop 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.194+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c101450 msgr2=0x7fa74c1a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.194+0000 7fa753083640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c101450 0x7fa74c1a4c10 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa73800d740 tx=0x7fa73800dc00 comp rx=0 tx=0).stop 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.195+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 shutdown_connections 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.195+0000 7fa753083640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fa73c0a2cf0 0x7fa73c0a51b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.195+0000 7fa753083640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa74c105f40 0x7fa74c19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.195+0000 7fa753083640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa74c101450 0x7fa74c1a4c10 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.195+0000 7fa753083640 1 --2- 172.21.15.2:0/4206045326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c100b30 0x7fa74c1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.195+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 >> 172.21.15.2:0/4206045326 conn(0x7fa74c0fc7a0 msgr2=0x7fa74c1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.195+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 shutdown_connections 2024-09-12T01:03:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:32.195+0000 7fa753083640 1 -- 172.21.15.2:0/4206045326 wait complete. 2024-09-12T01:03:32.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:32 smithi071 ceph-mon[35276]: pgmap v329: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:32.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:32 smithi167 ceph-mon[35234]: pgmap v329: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:32.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:03:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:33.370 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:33 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4206045326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:03:33.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:33 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4206045326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:03:33.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:33 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4206045326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:03:33.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/4017413304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48102790 msgr2=0x7ffb481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/4017413304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48102790 0x7ffb481067e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009900 tx=0x7ffb3002a410 comp rx=0 tx=0).stop 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/4017413304 shutdown_connections 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/4017413304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb48106f10 0x7ffb4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/4017413304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48102790 0x7ffb481067e0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/4017413304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb48101de0 0x7ffb481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/4017413304 >> 172.21.15.2:0/4017413304 conn(0x7ffb480fd8c0 msgr2=0x7ffb480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/4017413304 shutdown_connections 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.633+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/4017413304 wait complete. 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb4dfc9640 1 Processor -- start 2024-09-12T01:03:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb4dfc9640 1 -- start start 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb4dfc9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb48101de0 0x7ffb4819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb4dfc9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb48102790 0x7ffb4819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb4dfc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48106f10 0x7ffb4819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb4dfc9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48111fc0 con 0x7ffb48106f10 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb4dfc9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48111e40 con 0x7ffb48102790 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb4dfc9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48112140 con 0x7ffb48101de0 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48106f10 0x7ffb4819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48106f10 0x7ffb4819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58984/0 (socket says 172.21.15.2:58984) 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb47fff640 1 -- 172.21.15.2:0/2965800471 learned_addr learned my addr 172.21.15.2:0/2965800471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:33.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb3effd640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb48102790 0x7ffb4819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb47fff640 1 -- 172.21.15.2:0/2965800471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb48101de0 msgr2=0x7ffb4819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb477fe640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb48101de0 0x7ffb4819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb47fff640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb48101de0 0x7ffb4819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb47fff640 1 -- 172.21.15.2:0/2965800471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb48102790 msgr2=0x7ffb4819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb47fff640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb48102790 0x7ffb4819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb47fff640 1 -- 172.21.15.2:0/2965800471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4819f690 con 0x7ffb48106f10 2024-09-12T01:03:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.634+0000 7ffb3effd640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb48102790 0x7ffb4819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.635+0000 7ffb47fff640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48106f10 0x7ffb4819efb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000eaa0 tx=0x7ffb4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.635+0000 7ffb457fa640 1 -- 172.21.15.2:0/2965800471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000cdb0 con 0x7ffb48106f10 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.635+0000 7ffb457fa640 1 -- 172.21.15.2:0/2965800471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb40005020 con 0x7ffb48106f10 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.635+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/2965800471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4819f980 con 0x7ffb48106f10 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.635+0000 7ffb457fa640 1 -- 172.21.15.2:0/2965800471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400116b0 con 0x7ffb48106f10 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.635+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/2965800471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb481a7260 con 0x7ffb48106f10 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.637+0000 7ffb457fa640 1 -- 172.21.15.2:0/2965800471 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7ffb40005560 con 0x7ffb48106f10 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.637+0000 7ffb503a2740 1 Processor -- start 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb503a2740 1 -- start start 2024-09-12T01:03:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 0x558b2653c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b2653ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b26547370 0x558b26549760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb503a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b264a22f0 con 0x558b2653c5d0 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb503a2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558b26449cf0 con 0x558b2653db40 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb503a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558b2649e2b0 con 0x558b26547370 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb457fa640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffb340a2d70 0x7ffb340a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b2653ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b2653ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58990/0 (socket says 172.21.15.2:58990) 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb477fe640 1 -- 172.21.15.2:0/1514402513 learned_addr learned my addr 172.21.15.2:0/1514402513 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb47fff640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffb340a2d70 0x7ffb340a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb457fa640 1 -- 172.21.15.2:0/2965800471 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7ffb400cf760 con 0x7ffb48106f10 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb3effd640 1 --2- 172.21.15.2:0/1514402513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 0x558b2653c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb477fe640 1 -- 172.21.15.2:0/1514402513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b26547370 msgr2=0x558b26549760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb477fe640 1 --2- 172.21.15.2:0/1514402513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b26547370 0x558b26549760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb477fe640 1 -- 172.21.15.2:0/1514402513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 msgr2=0x558b2653c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb477fe640 1 --2- 172.21.15.2:0/1514402513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 0x558b2653c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.638+0000 7ffb477fe640 1 -- 172.21.15.2:0/1514402513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b2642e3a0 con 0x558b2653c5d0 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb477fe640 1 --2- 172.21.15.2:0/1514402513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b2653ca10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800baa0 tx=0x7ffb3800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9726efb09deb011b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb47fff640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffb340a2d70 0x7ffb340a5230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb400cce30 tx=0x7ffb4004b040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb3dffb640 1 -- 172.21.15.2:0/1514402513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38017420 con 0x558b2653c5d0 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb3dffb640 1 -- 172.21.15.2:0/1514402513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb38017aa0 con 0x558b2653c5d0 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb3dffb640 1 -- 172.21.15.2:0/1514402513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3800fb20 con 0x558b2653c5d0 2024-09-12T01:03:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb503a2740 1 -- 172.21.15.2:0/1514402513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 msgr2=0x558b2653ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1514402513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b2653ca10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800baa0 tx=0x7ffb3800bf60 comp rx=0 tx=0).stop 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb503a2740 1 -- 172.21.15.2:0/1514402513 shutdown_connections 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1514402513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b26547370 0x558b26549760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1514402513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b2653ca10 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1514402513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 0x558b2653c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb503a2740 1 -- 172.21.15.2:0/1514402513 >> 172.21.15.2:0/1514402513 conn(0x558b26505310 msgr2=0x558b26538c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.639+0000 7ffb503a2740 1 -- 172.21.15.2:0/1514402513 shutdown_connections 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 -- 172.21.15.2:0/1514402513 wait complete. 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 -- start start 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 Processor -- start 2024-09-12T01:03:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26546d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 0x558b26543fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b26547370 0x558b26544530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b2654a070 con 0x558b2653c5d0 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558b2645d060 con 0x558b2653db40 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558b2654a1f0 con 0x558b26547370 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb503a2740 10 client.0 _ll_register_callbacks cb 0x558b261b08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26546d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26546d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59006/0 (socket says 172.21.15.2:59006) 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.640+0000 7ffb3effd640 1 -- 172.21.15.2:0/1251456780 learned_addr learned my addr 172.21.15.2:0/1251456780 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb477fe640 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 0x558b26543fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb3effd640 1 -- 172.21.15.2:0/1251456780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b26547370 msgr2=0x558b26544530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb3effd640 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b26547370 0x558b26544530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb3effd640 1 -- 172.21.15.2:0/1251456780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 msgr2=0x558b26543fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb3effd640 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 0x558b26543fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb3effd640 1 -- 172.21.15.2:0/1251456780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b262133c0 con 0x558b2653c5d0 2024-09-12T01:03:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb3effd640 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26546d00 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ffb30005ab0 tx=0x7ffb30005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87142a675d894cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:03:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb26ffd640 1 -- 172.21.15.2:0/1251456780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30035040 con 0x558b2653c5d0 2024-09-12T01:03:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb26ffd640 1 -- 172.21.15.2:0/1251456780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7ffb30003cb0 con 0x558b2653c5d0 2024-09-12T01:03:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb503a2740 1 -- 172.21.15.2:0/1251456780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb38017aa0 con 0x558b2653c5d0 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb26ffd640 1 -- 172.21.15.2:0/1251456780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffb30005020 con 0x558b2653c5d0 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb503a2740 10 client.17754 fetch_fsmap learned FSMap version 35 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.641+0000 7ffb503a2740 1 -- 172.21.15.2:0/1251456780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558b26555aa0 con 0x558b2653c5d0 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb26ffd640 1 -- 172.21.15.2:0/1251456780 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb38017aa0 con 0x558b2653c5d0 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb26ffd640 1 -- 172.21.15.2:0/1251456780 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ffb3004b070 con 0x558b2653c5d0 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb503a2740 10 client.17754 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb503a2740 10 client.17754 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb503a2740 20 client.17754 populate_metadata read hostname 'smithi002' 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558b26556eb0 0x558b265592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb503a2740 4 client.17754 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb503a2740 1 -- 172.21.15.2:0/1251456780 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b264af860 con 0x558b26556eb0 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.642+0000 7ffb477fe640 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558b26556eb0 0x558b265592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.643+0000 7ffb26ffd640 10 client.17754 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:03:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.643+0000 7ffb477fe640 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558b26556eb0 0x558b265592a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ddb2939e77451b2 server_cookie=823523f6d4c8edb in_seq=0 out_seq=0 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.643+0000 7ffb26ffd640 1 -- 172.21.15.2:0/1251456780 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b264af860 con 0x558b26556eb0 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.643+0000 7ffb26ffd640 10 client.17754 handle_command_reply: tid=0 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.643+0000 7ffb503a2740 1 client.17754 shutdown 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 -- 172.21.15.2:0/1251456780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 msgr2=0x558b26546d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26546d00 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ffb30005ab0 tx=0x7ffb30005d70 comp rx=0 tx=0).stop 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 -- 172.21.15.2:0/1251456780 shutdown_connections 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558b26556eb0 0x558b265592a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b26547370 0x558b26544530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb26ffd640 0 client.17754 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:03:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653db40 0x558b26543fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 --2- 172.21.15.2:0/1251456780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26546d00 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 -- 172.21.15.2:0/1251456780 >> 172.21.15.2:0/1251456780 conn(0x558b26505310 msgr2=0x558b2653e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 -- 172.21.15.2:0/1251456780 shutdown_connections 2024-09-12T01:03:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 1 -- 172.21.15.2:0/1251456780 wait complete. 2024-09-12T01:03:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.644+0000 7ffb503a2740 20 client.17754 trim_cache size 0 max 16384 2024-09-12T01:03:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb503a2740 1 Processor -- start 2024-09-12T01:03:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb503a2740 1 -- start start 2024-09-12T01:03:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26538e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b26553310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b26547370 0x558b2655eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb503a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481b2530 con 0x558b2653c5d0 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb503a2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481afe00 con 0x558b26547370 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb503a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481adc70 con 0x558b2653db40 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26538e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26538e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59012/0 (socket says 172.21.15.2:59012) 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb3effd640 1 -- 172.21.15.2:0/2525057581 learned_addr learned my addr 172.21.15.2:0/2525057581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb3effd640 1 -- 172.21.15.2:0/2525057581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 msgr2=0x558b26553310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.657+0000 7ffb477fe640 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b26553310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb3effd640 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b26553310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb3effd640 1 -- 172.21.15.2:0/2525057581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b26547370 msgr2=0x558b2655eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb3effd640 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b26547370 0x558b2655eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb3effd640 1 -- 172.21.15.2:0/2525057581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b2653c2d0 con 0x558b2653c5d0 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb477fe640 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b26553310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb3effd640 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26538e10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ffb3002a930 tx=0x7ffb3002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f279472c2a7396 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb3d7fa640 1 -- 172.21.15.2:0/2525057581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30051070 con 0x558b2653c5d0 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb3d7fa640 1 -- 172.21.15.2:0/2525057581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb30031cd0 con 0x558b2653c5d0 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb3d7fa640 1 -- 172.21.15.2:0/2525057581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30035030 con 0x558b2653c5d0 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb503a2740 1 -- 172.21.15.2:0/2525057581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 msgr2=0x558b26538e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb503a2740 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26538e10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ffb3002a930 tx=0x7ffb3002a410 comp rx=0 tx=0).stop 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb503a2740 1 -- 172.21.15.2:0/2525057581 shutdown_connections 2024-09-12T01:03:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb503a2740 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b26547370 0x558b2655eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb503a2740 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b26553310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.658+0000 7ffb503a2740 1 --2- 172.21.15.2:0/2525057581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b2653c5d0 0x558b26538e10 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 -- 172.21.15.2:0/2525057581 >> 172.21.15.2:0/2525057581 conn(0x558b26505310 msgr2=0x558b26538700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 -- 172.21.15.2:0/2525057581 shutdown_connections 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 -- 172.21.15.2:0/2525057581 wait complete. 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 -- start start 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 Processor -- start 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653c5d0 0x558b2654fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b2654b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b26547370 0x558b2654b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481ae2c0 con 0x558b26547370 2024-09-12T01:03:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481af730 con 0x558b2653c5d0 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481ae990 con 0x558b2653db40 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.659+0000 7ffb503a2740 10 client.0 _ll_register_callbacks cb 0x7ffb30009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b26547370 0x558b2654b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b26547370 0x558b2654b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59020/0 (socket says 172.21.15.2:59020) 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 -- 172.21.15.2:0/3738463373 learned_addr learned my addr 172.21.15.2:0/3738463373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653c5d0 0x558b2654fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb477fe640 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b2654b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 -- 172.21.15.2:0/3738463373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 msgr2=0x558b2654b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b2654b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 -- 172.21.15.2:0/3738463373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653c5d0 msgr2=0x558b2654fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653c5d0 0x558b2654fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 -- 172.21.15.2:0/3738463373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b265c0b20 con 0x558b26547370 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb477fe640 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b2654b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb3effd640 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b26547370 0x558b2654b810 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ffb300316a0 tx=0x7ffb300056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da628c698e5a037e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb26ffd640 1 -- 172.21.15.2:0/3738463373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30051070 con 0x558b26547370 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb26ffd640 1 -- 172.21.15.2:0/3738463373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7ffb30004960 con 0x558b26547370 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb503a2740 1 -- 172.21.15.2:0/3738463373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb30031cd0 con 0x558b26547370 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb26ffd640 1 -- 172.21.15.2:0/3738463373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffb30035040 con 0x558b26547370 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.660+0000 7ffb503a2740 10 client.17760 fetch_fsmap learned FSMap version 35 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb503a2740 1 -- 172.21.15.2:0/3738463373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558b265c1c20 con 0x558b26547370 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb26ffd640 1 -- 172.21.15.2:0/3738463373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb30031cd0 con 0x558b26547370 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb26ffd640 1 -- 172.21.15.2:0/3738463373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ffb3004b040 con 0x558b26547370 2024-09-12T01:03:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb503a2740 10 client.17760 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb503a2740 10 client.17760 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb503a2740 20 client.17760 populate_metadata read hostname 'smithi002' 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb503a2740 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558b265c2280 0x558b265c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb503a2740 4 client.17760 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb503a2740 1 -- 172.21.15.2:0/3738463373 --> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b264a9d70 con 0x558b265c2280 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.661+0000 7ffb477fe640 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558b265c2280 0x558b265c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb477fe640 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558b265c2280 0x558b265c4670 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9bbc1cdf47292265 server_cookie=f319e36584dc7756 in_seq=0 out_seq=0 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb26ffd640 10 client.17760 ms_handle_connect on v2:172.21.15.71:6836/2619227560 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb26ffd640 1 -- 172.21.15.2:0/3738463373 <== mds.2 v2:172.21.15.71:6836/2619227560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b264a9d70 con 0x558b265c2280 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb26ffd640 10 client.17760 handle_command_reply: tid=0 2024-09-12T01:03:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 client.17760 shutdown 2024-09-12T01:03:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 -- 172.21.15.2:0/3738463373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b26547370 msgr2=0x558b2654b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b26547370 0x558b2654b810 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ffb300316a0 tx=0x7ffb300056c0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 -- 172.21.15.2:0/3738463373 shutdown_connections 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.71:6836/2619227560,v1:172.21.15.71:6837/2619227560] conn(0x558b265c2280 0x558b265c4670 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb26ffd640 0 client.17760 ms_handle_reset on v2:172.21.15.71:6836/2619227560 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b26547370 0x558b2654b810 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b2653db40 0x558b2654b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 --2- 172.21.15.2:0/3738463373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558b2653c5d0 0x558b2654fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 -- 172.21.15.2:0/3738463373 >> 172.21.15.2:0/3738463373 conn(0x558b26505310 msgr2=0x558b265374e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 -- 172.21.15.2:0/3738463373 shutdown_connections 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 1 -- 172.21.15.2:0/3738463373 wait complete. 2024-09-12T01:03:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.662+0000 7ffb503a2740 20 client.17760 trim_cache size 0 max 16384 2024-09-12T01:03:33.669 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:03:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffb340a2d70 msgr2=0x7ffb340a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffb340a2d70 0x7ffb340a5230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb400cce30 tx=0x7ffb4004b040 comp rx=0 tx=0).stop 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48106f10 msgr2=0x7ffb4819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48106f10 0x7ffb4819efb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000eaa0 tx=0x7ffb4000ef60 comp rx=0 tx=0).stop 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/2965800471 shutdown_connections 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7ffb340a2d70 0x7ffb340a5230 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb48106f10 0x7ffb4819efb0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb48102790 0x7ffb4819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 --2- 172.21.15.2:0/2965800471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb48101de0 0x7ffb4819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/2965800471 >> 172.21.15.2:0/2965800471 conn(0x7ffb480fd8c0 msgr2=0x7ffb480febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/2965800471 shutdown_connections 2024-09-12T01:03:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:33.663+0000 7ffb4dfc9640 1 -- 172.21.15.2:0/2965800471 wait complete. 2024-09-12T01:03:34.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:03:34.675 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:34.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:34 smithi002 ceph-mon[31210]: pgmap v330: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:34.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:34 smithi071 ceph-mon[35276]: pgmap v330: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:35.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:34 smithi167 ceph-mon[35234]: pgmap v330: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:35.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 -- 172.21.15.2:0/394431937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 msgr2=0x7f645010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 --2- 172.21.15.2:0/394431937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 0x7f645010bb50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6438009900 tx=0x7f643802a480 comp rx=0 tx=0).stop 2024-09-12T01:03:35.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 -- 172.21.15.2:0/394431937 shutdown_connections 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 --2- 172.21.15.2:0/394431937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f645010c170 0x7f645010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 --2- 172.21.15.2:0/394431937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 0x7f645010bb50 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 --2- 172.21.15.2:0/394431937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6450102d40 0x7f6450103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 -- 172.21.15.2:0/394431937 >> 172.21.15.2:0/394431937 conn(0x7f64500fc7a0 msgr2=0x7f64500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 -- 172.21.15.2:0/394431937 shutdown_connections 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 -- 172.21.15.2:0/394431937 wait complete. 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 Processor -- start 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.142+0000 7f6456b8e640 1 -- start start 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f6456b8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6450102d40 0x7f64501009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f6456b8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 0x7f6450100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f6456b8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f645010c170 0x7f6450101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f6456b8e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6450111f70 con 0x7f6450103660 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f6456b8e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6450111df0 con 0x7f6450102d40 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f6456b8e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64501120f0 con 0x7f645010c170 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 0x7f6450100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 0x7f6450100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59044/0 (socket says 172.21.15.2:59044) 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 -- 172.21.15.2:0/563545969 learned_addr learned my addr 172.21.15.2:0/563545969 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f645512b640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f645010c170 0x7f6450101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f645492a640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6450102d40 0x7f64501009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 -- 172.21.15.2:0/563545969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f645010c170 msgr2=0x7f6450101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f645010c170 0x7f6450101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 -- 172.21.15.2:0/563545969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6450102d40 msgr2=0x7f64501009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6450102d40 0x7f64501009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 -- 172.21.15.2:0/563545969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64501a6930 con 0x7f6450103660 2024-09-12T01:03:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f645492a640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6450102d40 0x7f64501009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644ffff640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 0x7f6450100ee0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f6438006010 tx=0x7f64380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644dffb640 1 -- 172.21.15.2:0/563545969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643803f030 con 0x7f6450103660 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f644dffb640 1 -- 172.21.15.2:0/563545969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6438003ce0 con 0x7f6450103660 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.143+0000 7f6456b8e640 1 -- 172.21.15.2:0/563545969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64501a6bc0 con 0x7f6450103660 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.144+0000 7f644dffb640 1 -- 172.21.15.2:0/563545969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438035070 con 0x7f6450103660 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.144+0000 7f6456b8e640 1 -- 172.21.15.2:0/563545969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64501a70a0 con 0x7f6450103660 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.146+0000 7f644dffb640 1 -- 172.21.15.2:0/563545969 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f6438042030 con 0x7f6450103660 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.146+0000 7f6458f67740 1 Processor -- start 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.146+0000 7f6458f67740 1 -- start start 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f6458f67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ccd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f6458f67740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383ccd5d0 0x55c383ccda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f6458f67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cd8370 0x55c383cda760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f6458f67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c383c332f0 con 0x55c383cceb40 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f6458f67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c383bdacf0 con 0x55c383cd8370 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f6458f67740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c383c2f2b0 con 0x55c383ccd5d0 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f644dffb640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f643c0a2cf0 0x7f643c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ccd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ccd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59046/0 (socket says 172.21.15.2:59046) 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 -- 172.21.15.2:0/2371767754 learned_addr learned my addr 172.21.15.2:0/2371767754 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f644ffff640 1 --2- 172.21.15.2:0/2371767754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cd8370 0x55c383cda760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f643c0a2cf0 0x7f643c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f644dffb640 1 -- 172.21.15.2:0/563545969 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f64380efb10 con 0x7f6450103660 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 -- 172.21.15.2:0/2371767754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383ccd5d0 msgr2=0x55c383ccda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 --2- 172.21.15.2:0/2371767754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383ccd5d0 0x55c383ccda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 -- 172.21.15.2:0/2371767754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cd8370 msgr2=0x55c383cda760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 --2- 172.21.15.2:0/2371767754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cd8370 0x55c383cda760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 -- 172.21.15.2:0/2371767754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383bbf3a0 con 0x55c383cceb40 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.147+0000 7f645512b640 1 --2- 172.21.15.2:0/2371767754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ccd090 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f644800a780 tx=0x7f6448013e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f04f1557eedeb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6446ffd640 1 -- 172.21.15.2:0/2371767754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448013250 con 0x55c383cceb40 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6446ffd640 1 -- 172.21.15.2:0/2371767754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f644801de50 con 0x55c383cceb40 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6446ffd640 1 -- 172.21.15.2:0/2371767754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448012c10 con 0x55c383cceb40 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 -- 172.21.15.2:0/2371767754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 msgr2=0x55c383ccd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f645512b640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f643c0a2cf0 0x7f643c0a51b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6448020000 tx=0x7f644801e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 --2- 172.21.15.2:0/2371767754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ccd090 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f644800a780 tx=0x7f6448013e80 comp rx=0 tx=0).stop 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 -- 172.21.15.2:0/2371767754 shutdown_connections 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 --2- 172.21.15.2:0/2371767754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cd8370 0x55c383cda760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 --2- 172.21.15.2:0/2371767754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383ccd5d0 0x55c383ccda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 --2- 172.21.15.2:0/2371767754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ccd090 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 -- 172.21.15.2:0/2371767754 >> 172.21.15.2:0/2371767754 conn(0x55c383c96310 msgr2=0x55c383cc9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 -- 172.21.15.2:0/2371767754 shutdown_connections 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.148+0000 7f6458f67740 1 -- 172.21.15.2:0/2371767754 wait complete. 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 1 -- start start 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 1 Processor -- start 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cd7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cd4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cd5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c383cdb070 con 0x55c383ccd5d0 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c383bee060 con 0x55c383cceb40 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c383cdb1f0 con 0x55c383cd8370 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f6458f67740 10 client.0 _ll_register_callbacks cb 0x55c3839418c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f645492a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cd7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f645492a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cd7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59056/0 (socket says 172.21.15.2:59056) 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f645492a640 1 -- 172.21.15.2:0/1038402092 learned_addr learned my addr 172.21.15.2:0/1038402092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.149+0000 7f644ffff640 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cd4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f645512b640 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cd5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f645492a640 1 -- 172.21.15.2:0/1038402092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 msgr2=0x55c383cd5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f645492a640 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cd5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f645492a640 1 -- 172.21.15.2:0/1038402092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 msgr2=0x55c383cd4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f645492a640 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cd4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f645492a640 1 -- 172.21.15.2:0/1038402092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3839a43c0 con 0x55c383ccd5d0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f645492a640 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cd7d00 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f644000bdf0 tx=0x7f644000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d28ac2a7ddd4c69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f642ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f642ffff640 1 -- 172.21.15.2:0/1038402092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440015070 con 0x55c383ccd5d0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f642ffff640 1 -- 172.21.15.2:0/1038402092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f6440004020 con 0x55c383ccd5d0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f6458f67740 1 -- 172.21.15.2:0/1038402092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f644801de50 con 0x55c383ccd5d0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f642ffff640 1 -- 172.21.15.2:0/1038402092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6440004220 con 0x55c383ccd5d0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f6458f67740 10 client.17772 fetch_fsmap learned FSMap version 35 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f6458f67740 1 -- 172.21.15.2:0/1038402092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c383ce6b30 con 0x55c383ccd5d0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f642ffff640 1 -- 172.21.15.2:0/1038402092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f644801de50 con 0x55c383ccd5d0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.150+0000 7f642ffff640 1 -- 172.21.15.2:0/1038402092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6440003930 con 0x55c383ccd5d0 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f6458f67740 10 client.17772 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f6458f67740 10 client.17772 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f6458f67740 20 client.17772 populate_metadata read hostname 'smithi002' 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f6458f67740 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c383ce7ff0 0x55c383cea400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f6458f67740 4 client.17772 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f6458f67740 1 -- 172.21.15.2:0/1038402092 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c383c40860 con 0x55c383ce7ff0 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f644ffff640 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c383ce7ff0 0x55c383cea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f644ffff640 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c383ce7ff0 0x55c383cea400 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99373d0c8e3773d1 server_cookie=d0f36e5f77dc2ced in_seq=0 out_seq=0 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.151+0000 7f642ffff640 10 client.17772 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f642ffff640 1 -- 172.21.15.2:0/1038402092 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c383c40860 con 0x55c383ce7ff0 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f642ffff640 10 client.17772 handle_command_reply: tid=0 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 client.17772 shutdown 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 -- 172.21.15.2:0/1038402092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 msgr2=0x55c383cd7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cd7d00 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f644000bdf0 tx=0x7f644000f730 comp rx=0 tx=0).stop 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 -- 172.21.15.2:0/1038402092 shutdown_connections 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c383ce7ff0 0x55c383cea400 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cd5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cd4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f642ffff640 0 client.17772 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 --2- 172.21.15.2:0/1038402092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cd7d00 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 -- 172.21.15.2:0/1038402092 >> 172.21.15.2:0/1038402092 conn(0x55c383c96310 msgr2=0x55c383ccf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 -- 172.21.15.2:0/1038402092 shutdown_connections 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 1 -- 172.21.15.2:0/1038402092 wait complete. 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.152+0000 7f6458f67740 20 client.17772 trim_cache size 0 max 16384 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.166+0000 7f6458f67740 1 Processor -- start 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.166+0000 7f6458f67740 1 -- start start 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.166+0000 7f6458f67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.166+0000 7f6458f67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cc4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.166+0000 7f6458f67740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cc8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.166+0000 7f6458f67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64501b24a0 con 0x55c383ccd5d0 2024-09-12T01:03:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.166+0000 7f6458f67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64501afd70 con 0x55c383cceb40 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.166+0000 7f6458f67740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64501adbe0 con 0x55c383cd8370 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59064/0 (socket says 172.21.15.2:59064) 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 -- 172.21.15.2:0/1632140407 learned_addr learned my addr 172.21.15.2:0/1632140407 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f644ffff640 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cc4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645512b640 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cc8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 -- 172.21.15.2:0/1632140407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 msgr2=0x55c383cc8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cc8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 -- 172.21.15.2:0/1632140407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 msgr2=0x55c383cc4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cc4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 -- 172.21.15.2:0/1632140407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383cd5860 con 0x55c383ccd5d0 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f644ffff640 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cc4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:03:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f645492a640 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cce300 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f6440003d50 tx=0x7f644000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ada6ea349c36c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f64467fc640 1 -- 172.21.15.2:0/1632140407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644002e070 con 0x55c383ccd5d0 2024-09-12T01:03:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f64467fc640 1 -- 172.21.15.2:0/1632140407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6440003ad0 con 0x55c383ccd5d0 2024-09-12T01:03:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.167+0000 7f64467fc640 1 -- 172.21.15.2:0/1632140407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440015070 con 0x55c383ccd5d0 2024-09-12T01:03:35.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 -- 172.21.15.2:0/1632140407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 msgr2=0x55c383cce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cce300 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f6440003d50 tx=0x7f644000ffd0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 -- 172.21.15.2:0/1632140407 shutdown_connections 2024-09-12T01:03:35.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cc8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383cceb40 0x55c383cc4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 --2- 172.21.15.2:0/1632140407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383ccd5d0 0x55c383cce300 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 -- 172.21.15.2:0/1632140407 >> 172.21.15.2:0/1632140407 conn(0x55c383c96310 msgr2=0x55c383cc84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 -- 172.21.15.2:0/1632140407 shutdown_connections 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 -- 172.21.15.2:0/1632140407 wait complete. 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.168+0000 7f6458f67740 1 -- start start 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f6458f67740 1 Processor -- start 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f6458f67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383ccd5d0 0x55c383ce0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f6458f67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ce0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f6458f67740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cdbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f6458f67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64501ae230 con 0x55c383cceb40 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f6458f67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64501af6a0 con 0x55c383ccd5d0 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f6458f67740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64501ae900 con 0x55c383cd8370 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f6458f67740 10 client.0 _ll_register_callbacks cb 0x7f644000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f644ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ce0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f644ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ce0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59078/0 (socket says 172.21.15.2:59078) 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f645492a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383ccd5d0 0x55c383ce0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f644ffff640 1 -- 172.21.15.2:0/231631432 learned_addr learned my addr 172.21.15.2:0/231631432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f645512b640 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cdbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f644ffff640 1 -- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 msgr2=0x55c383cdbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f644ffff640 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cdbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f644ffff640 1 -- 172.21.15.2:0/231631432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383ccd5d0 msgr2=0x55c383ce0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f644ffff640 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383ccd5d0 0x55c383ce0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f644ffff640 1 -- 172.21.15.2:0/231631432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c383cdc3a0 con 0x55c383cceb40 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.169+0000 7f645512b640 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cdbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f645492a640 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383ccd5d0 0x55c383ce0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f644ffff640 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ce0cd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f64380ed1e0 tx=0x7f643803b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbef1fa230521a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f642ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f642ffff640 1 -- 172.21.15.2:0/231631432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438049040 con 0x55c383cceb40 2024-09-12T01:03:35.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f642ffff640 1 -- 172.21.15.2:0/231631432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f64380b8680 con 0x55c383cceb40 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 1 -- 172.21.15.2:0/231631432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6440003ad0 con 0x55c383cceb40 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f642ffff640 1 -- 172.21.15.2:0/231631432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f64380044e0 con 0x55c383cceb40 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 10 client.17778 fetch_fsmap learned FSMap version 35 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 1 -- 172.21.15.2:0/231631432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c383d52820 con 0x55c383cceb40 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f642ffff640 1 -- 172.21.15.2:0/231631432 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6440003ad0 con 0x55c383cceb40 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f642ffff640 1 -- 172.21.15.2:0/231631432 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f64380ed400 con 0x55c383cceb40 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 10 client.17778 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 10 client.17778 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 20 client.17778 populate_metadata read hostname 'smithi002' 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c383ce7ff0 0x55c383d54fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 4 client.17778 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.170+0000 7f6458f67740 1 -- 172.21.15.2:0/231631432 --> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c383c3ad70 con 0x55c383ce7ff0 2024-09-12T01:03:35.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.171+0000 7f645492a640 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c383ce7ff0 0x55c383d54fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.171+0000 7f645492a640 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c383ce7ff0 0x55c383d54fe0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57aa2a1aeabd5d53 server_cookie=243e022d350a507b in_seq=0 out_seq=0 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.171+0000 7f642ffff640 10 client.17778 ms_handle_connect on v2:172.21.15.167:6838/3375026686 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.171+0000 7f642ffff640 1 -- 172.21.15.2:0/231631432 <== mds.1 v2:172.21.15.167:6838/3375026686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c383c3ad70 con 0x55c383ce7ff0 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.171+0000 7f642ffff640 10 client.17778 handle_command_reply: tid=0 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.171+0000 7f6458f67740 1 client.17778 shutdown 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 -- 172.21.15.2:0/231631432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 msgr2=0x55c383ce0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ce0cd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f64380ed1e0 tx=0x7f643803b5d0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 -- 172.21.15.2:0/231631432 shutdown_connections 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:6838/3375026686,v1:172.21.15.167:6839/3375026686] conn(0x55c383ce7ff0 0x55c383d54fe0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f642ffff640 0 client.17778 ms_handle_reset on v2:172.21.15.167:6838/3375026686 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c383cd8370 0x55c383cdbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c383cceb40 0x55c383ce0cd0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 --2- 172.21.15.2:0/231631432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c383ccd5d0 0x55c383ce0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 -- 172.21.15.2:0/231631432 >> 172.21.15.2:0/231631432 conn(0x55c383c96310 msgr2=0x55c383cc84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 -- 172.21.15.2:0/231631432 shutdown_connections 2024-09-12T01:03:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 1 -- 172.21.15.2:0/231631432 wait complete. 2024-09-12T01:03:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6458f67740 20 client.17778 trim_cache size 0 max 16384 2024-09-12T01:03:35.186 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:03:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 -- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f643c0a2cf0 msgr2=0x7f643c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f643c0a2cf0 0x7f643c0a51b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6448020000 tx=0x7f644801e000 comp rx=0 tx=0).stop 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 -- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 msgr2=0x7f6450100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 0x7f6450100ee0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f6438006010 tx=0x7f64380042f0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 -- 172.21.15.2:0/563545969 shutdown_connections 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f643c0a2cf0 0x7f643c0a51b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f645010c170 0x7f6450101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6450103660 0x7f6450100ee0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.172+0000 7f6456b8e640 1 --2- 172.21.15.2:0/563545969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6450102d40 0x7f64501009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.173+0000 7f6456b8e640 1 -- 172.21.15.2:0/563545969 >> 172.21.15.2:0/563545969 conn(0x7f64500fc7a0 msgr2=0x7f64500fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.173+0000 7f6456b8e640 1 -- 172.21.15.2:0/563545969 shutdown_connections 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:35.173+0000 7f6456b8e640 1 -- 172.21.15.2:0/563545969 wait complete. 2024-09-12T01:03:35.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:03:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:36.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/967910938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64108290 msgr2=0x7f2e6410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/967910938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64108290 0x7f2e6410ec30 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009cd0 tx=0x7f2e5c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/967910938 shutdown_connections 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/967910938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64108290 0x7f2e6410ec30 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/967910938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64103740 0x7f2e64107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/967910938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e64102d90 0x7f2e64103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/967910938 >> 172.21.15.2:0/967910938 conn(0x7f2e640fc7d0 msgr2=0x7f2e640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/967910938 shutdown_connections 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/967910938 wait complete. 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.666+0000 7f2e6a2e8640 1 Processor -- start 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e6a2e8640 1 -- start start 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e6a2e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64102d90 0x7f2e641009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e6a2e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64103740 0x7f2e64100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e6a2e8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e64108290 0x7f2e64101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e6a2e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641120f0 con 0x7f2e64103740 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e6a2e8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64111f70 con 0x7f2e64108290 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e6a2e8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64112270 con 0x7f2e64102d90 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64103740 0x7f2e64100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64103740 0x7f2e64100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53244/0 (socket says 172.21.15.2:53244) 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 -- 172.21.15.2:0/2038796612 learned_addr learned my addr 172.21.15.2:0/2038796612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e68885640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e64108290 0x7f2e64101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e63fff640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64102d90 0x7f2e641009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 -- 172.21.15.2:0/2038796612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64102d90 msgr2=0x7f2e641009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64102d90 0x7f2e641009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 -- 172.21.15.2:0/2038796612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e64108290 msgr2=0x7f2e64101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e64108290 0x7f2e64101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 -- 172.21.15.2:0/2038796612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e641a6a80 con 0x7f2e64103740 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e63fff640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64102d90 0x7f2e641009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e68885640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e64108290 0x7f2e64101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.667+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64103740 0x7f2e64100f30 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00c970 tx=0x7f2e4c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.668+0000 7f2e61ffb640 1 -- 172.21.15.2:0/2038796612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c007bb0 con 0x7f2e64103740 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.668+0000 7f2e61ffb640 1 -- 172.21.15.2:0/2038796612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e4c007d50 con 0x7f2e64103740 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.668+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/2038796612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e641a6d70 con 0x7f2e64103740 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.668+0000 7f2e61ffb640 1 -- 172.21.15.2:0/2038796612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0187a0 con 0x7f2e64103740 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.668+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/2038796612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e641a7200 con 0x7f2e64103740 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e61ffb640 1 -- 172.21.15.2:0/2038796612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f2e4c00f450 con 0x7f2e64103740 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e6c6c1740 1 Processor -- start 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e6c6c1740 1 -- start start 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b8659a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659a5d0 0x559b8659aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559b865002f0 con 0x559b8659bb40 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559b864a7cf0 con 0x559b8659a5d0 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.670+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559b864fc2b0 con 0x559b865a5370 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b8659a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b8659a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53252/0 (socket says 172.21.15.2:53252) 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 -- 172.21.15.2:0/3782716164 learned_addr learned my addr 172.21.15.2:0/3782716164 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e63fff640 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659a5d0 0x559b8659aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 -- 172.21.15.2:0/3782716164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 msgr2=0x559b865a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 -- 172.21.15.2:0/3782716164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659a5d0 msgr2=0x559b8659aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659a5d0 0x559b8659aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 -- 172.21.15.2:0/3782716164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8648c3a0 con 0x559b8659bb40 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e61ffb640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2e500a2cf0 0x7f2e500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e68885640 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b8659a090 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c031570 tx=0x7f2e5c0315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfe6f9bd4acecbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e63fff640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2e500a2cf0 0x7f2e500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e61ffb640 1 -- 172.21.15.2:0/2038796612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f2e4c0cf630 con 0x7f2e64103740 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e5a7fc640 1 -- 172.21.15.2:0/3782716164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c031ac0 con 0x559b8659bb40 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e5a7fc640 1 -- 172.21.15.2:0/3782716164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e5c036040 con 0x559b8659bb40 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.671+0000 7f2e5a7fc640 1 -- 172.21.15.2:0/3782716164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0047b0 con 0x559b8659bb40 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/3782716164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 msgr2=0x559b8659a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e63fff640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2e500a2cf0 0x7f2e500a51b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559b86597ac0 tx=0x7f2e54008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b8659a090 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c031570 tx=0x7f2e5c0315a0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/3782716164 shutdown_connections 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659a5d0 0x559b8659aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/3782716164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b8659a090 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/3782716164 >> 172.21.15.2:0/3782716164 conn(0x559b86563310 msgr2=0x559b86596c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/3782716164 shutdown_connections 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/3782716164 wait complete. 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.672+0000 7f2e6c6c1740 1 -- start start 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e6c6c1740 1 Processor -- start 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 0x559b865a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559b865a8010 con 0x559b8659a5d0 2024-09-12T01:03:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559b864bb060 con 0x559b8659bb40 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559b865a8190 con 0x559b865a5370 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e6c6c1740 10 client.0 _ll_register_callbacks cb 0x559b8620e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53266/0 (socket says 172.21.15.2:53266) 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e63fff640 1 -- 172.21.15.2:0/1202422504 learned_addr learned my addr 172.21.15.2:0/1202422504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 0x559b865a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e68885640 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e63fff640 1 -- 172.21.15.2:0/1202422504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 msgr2=0x559b865a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e63fff640 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e63fff640 1 -- 172.21.15.2:0/1202422504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 msgr2=0x559b865a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e63fff640 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 0x559b865a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e63fff640 1 -- 172.21.15.2:0/1202422504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b862713c0 con 0x559b8659a5d0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.673+0000 7f2e68885640 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e63fff640 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a4ce0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2e540136d0 tx=0x7f2e540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f6cc05e5be7140 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e437fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e437fe640 1 -- 172.21.15.2:0/1202422504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5401a050 con 0x559b8659a5d0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e437fe640 1 -- 172.21.15.2:0/1202422504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f2e54014890 con 0x559b8659a5d0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/1202422504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e5c036040 con 0x559b8659a5d0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e437fe640 1 -- 172.21.15.2:0/1202422504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2e54014a90 con 0x559b8659a5d0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e6c6c1740 10 client.17790 fetch_fsmap learned FSMap version 35 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/1202422504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559b865b3ae0 con 0x559b8659a5d0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e437fe640 1 -- 172.21.15.2:0/1202422504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e5c036040 con 0x559b8659a5d0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e437fe640 1 -- 172.21.15.2:0/1202422504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2e54006420 con 0x559b8659a5d0 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e6c6c1740 10 client.17790 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e6c6c1740 10 client.17790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e6c6c1740 20 client.17790 populate_metadata read hostname 'smithi002' 2024-09-12T01:03:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559b865b4fa0 0x559b865b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.674+0000 7f2e6c6c1740 4 client.17790 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.675+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/1202422504 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b8650d860 con 0x559b865b4fa0 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.675+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559b865b4fa0 0x559b865b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.675+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559b865b4fa0 0x559b865b73d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26b09f369087943d server_cookie=3f86e3f963a75715 in_seq=0 out_seq=0 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.675+0000 7f2e437fe640 10 client.17790 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e437fe640 1 -- 172.21.15.2:0/1202422504 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b8650d860 con 0x559b865b4fa0 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e437fe640 10 client.17790 handle_command_reply: tid=0 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 client.17790 shutdown 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/1202422504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 msgr2=0x559b865a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a4ce0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2e540136d0 tx=0x7f2e540046c0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/1202422504 shutdown_connections 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559b865b4fa0 0x559b865b73d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b865a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e437fe640 0 client.17790 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 0x559b865a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/1202422504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a4ce0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/1202422504 >> 172.21.15.2:0/1202422504 conn(0x559b86563310 msgr2=0x559b8659c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/1202422504 shutdown_connections 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/1202422504 wait complete. 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.676+0000 7f2e6c6c1740 20 client.17790 trim_cache size 0 max 16384 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.689+0000 7f2e6c6c1740 1 Processor -- start 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.689+0000 7f2e6c6c1740 1 -- start start 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.689+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 0x559b8659d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b8659d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641b2530 con 0x559b8659a5d0 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641afe00 con 0x559b8659bb40 2024-09-12T01:03:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641adc70 con 0x559b865a5370 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53272/0 (socket says 172.21.15.2:53272) 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 -- 172.21.15.2:0/2085215480 learned_addr learned my addr 172.21.15.2:0/2085215480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 0x559b8659d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e68885640 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b8659d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 -- 172.21.15.2:0/2085215480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 msgr2=0x559b8659d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b8659d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 -- 172.21.15.2:0/2085215480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 msgr2=0x559b8659d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 0x559b8659d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 -- 172.21.15.2:0/2085215480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b865a0f40 con 0x559b8659a5d0 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e68885640 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b8659d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e63fff640 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a0860 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004810 tx=0x7f2e54014a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bca0992eb8544 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e59ffb640 1 -- 172.21.15.2:0/2085215480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5401a070 con 0x559b8659a5d0 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e59ffb640 1 -- 172.21.15.2:0/2085215480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e54024070 con 0x559b8659a5d0 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.690+0000 7f2e59ffb640 1 -- 172.21.15.2:0/2085215480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5401f880 con 0x559b8659a5d0 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/2085215480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 msgr2=0x559b865a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a0860 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004810 tx=0x7f2e54014a20 comp rx=0 tx=0).stop 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/2085215480 shutdown_connections 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b865a5370 0x559b8659d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b8659bb40 0x559b8659d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/2085215480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659a5d0 0x559b865a0860 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/2085215480 >> 172.21.15.2:0/2085215480 conn(0x559b86563310 msgr2=0x559b865a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/2085215480 shutdown_connections 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/2085215480 wait complete. 2024-09-12T01:03:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.691+0000 7f2e6c6c1740 1 -- start start 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e6c6c1740 1 Processor -- start 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b8659a5d0 0x559b865ad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b865ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e6c6c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b865a5370 0x559b865aa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641ae2c0 con 0x559b8659bb40 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641af730 con 0x559b865a5370 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e6c6c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641ae990 con 0x559b8659a5d0 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e6c6c1740 10 client.0 _ll_register_callbacks cb 0x7f2e5400a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b865ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b865ad9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53288/0 (socket says 172.21.15.2:53288) 2024-09-12T01:03:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 -- 172.21.15.2:0/70859136 learned_addr learned my addr 172.21.15.2:0/70859136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e68885640 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b865a5370 0x559b865aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e63fff640 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b8659a5d0 0x559b865ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 -- 172.21.15.2:0/70859136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b8659a5d0 msgr2=0x559b865ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b8659a5d0 0x559b865ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 -- 172.21.15.2:0/70859136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b865a5370 msgr2=0x559b865aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b865a5370 0x559b865aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 -- 172.21.15.2:0/70859136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b865aa990 con 0x559b8659bb40 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e5bfff640 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b865ad9c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0984f0 tx=0x7f2e4c00fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0528c49d5c6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.692+0000 7f2e437fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e437fe640 1 -- 172.21.15.2:0/70859136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0b3070 con 0x559b8659bb40 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e437fe640 1 -- 172.21.15.2:0/70859136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f2e4c00f740 con 0x559b8659bb40 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/70859136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e54024070 con 0x559b8659bb40 2024-09-12T01:03:36.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e437fe640 1 -- 172.21.15.2:0/70859136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2e4c0a46e0 con 0x559b8659bb40 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 10 client.17796 fetch_fsmap learned FSMap version 35 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/70859136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559b866202d0 con 0x559b8659bb40 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e437fe640 1 -- 172.21.15.2:0/70859136 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e54024070 con 0x559b8659bb40 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e437fe640 1 -- 172.21.15.2:0/70859136 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2e4c020030 con 0x559b8659bb40 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 10 client.17796 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 10 client.17796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 20 client.17796 populate_metadata read hostname 'smithi002' 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559b865b4fa0 0x559b86622a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 4 client.17796 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/70859136 --> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b86507d70 con 0x559b865b4fa0 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.693+0000 7f2e63fff640 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559b865b4fa0 0x559b86622a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e63fff640 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559b865b4fa0 0x559b86622a20 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6f855b157a61737 server_cookie=929560f0cfcbba91 in_seq=0 out_seq=0 2024-09-12T01:03:36.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e437fe640 10 client.17796 ms_handle_connect on v2:172.21.15.71:6838/3061730891 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e437fe640 1 -- 172.21.15.2:0/70859136 <== mds.0 v2:172.21.15.71:6838/3061730891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b86507d70 con 0x559b865b4fa0 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e437fe640 10 client.17796 handle_command_reply: tid=0 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 client.17796 shutdown 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/70859136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 msgr2=0x559b865ad9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b865ad9c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0984f0 tx=0x7f2e4c00fe00 comp rx=0 tx=0).stop 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/70859136 shutdown_connections 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.71:6838/3061730891,v1:172.21.15.71:6839/3061730891] conn(0x559b865b4fa0 0x559b86622a20 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b865a5370 0x559b865aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b8659bb40 0x559b865ad9c0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e437fe640 0 client.17796 ms_handle_reset on v2:172.21.15.71:6838/3061730891 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 --2- 172.21.15.2:0/70859136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b8659a5d0 0x559b865ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/70859136 >> 172.21.15.2:0/70859136 conn(0x559b86563310 msgr2=0x559b86595d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/70859136 shutdown_connections 2024-09-12T01:03:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 1 -- 172.21.15.2:0/70859136 wait complete. 2024-09-12T01:03:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.694+0000 7f2e6c6c1740 20 client.17796 trim_cache size 0 max 16384 2024-09-12T01:03:36.715 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-12T01:03:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2e500a2cf0 msgr2=0x7f2e500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2e500a2cf0 0x7f2e500a51b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559b86597ac0 tx=0x7f2e54008040 comp rx=0 tx=0).stop 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64103740 msgr2=0x7f2e64100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64103740 0x7f2e64100f30 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00c970 tx=0x7f2e4c00ce30 comp rx=0 tx=0).stop 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/2038796612 shutdown_connections 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f2e500a2cf0 0x7f2e500a51b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e64108290 0x7f2e64101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e64103740 0x7f2e64100f30 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 --2- 172.21.15.2:0/2038796612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64102d90 0x7f2e641009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/2038796612 >> 172.21.15.2:0/2038796612 conn(0x7f2e640fc7d0 msgr2=0x7f2e64106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/2038796612 shutdown_connections 2024-09-12T01:03:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:36.695+0000 7f2e6a2e8640 1 -- 172.21.15.2:0/2038796612 wait complete. 2024-09-12T01:03:36.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:36 smithi071 ceph-mon[35276]: pgmap v331: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:36.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:36 smithi002 ceph-mon[31210]: pgmap v331: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:37.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:36 smithi167 ceph-mon[35234]: pgmap v331: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:37.391 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T01:03:37.392 INFO:tasks.fwd_scrub:done joining 2024-09-12T01:03:37.393 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T01:03:37.403 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:03:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.513+0000 7f19f62d9640 1 -- 172.21.15.2:0/1130650685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f01035c0 msgr2=0x7f19f010baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.513+0000 7f19f62d9640 1 --2- 172.21.15.2:0/1130650685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f01035c0 0x7f19f010baa0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009900 tx=0x7f19e002a480 comp rx=0 tx=0).stop 2024-09-12T01:03:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.513+0000 7f19f62d9640 1 -- 172.21.15.2:0/1130650685 shutdown_connections 2024-09-12T01:03:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.513+0000 7f19f62d9640 1 --2- 172.21.15.2:0/1130650685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f010c0f0 0x7f19f010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.513+0000 7f19f62d9640 1 --2- 172.21.15.2:0/1130650685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f01035c0 0x7f19f010baa0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.513+0000 7f19f62d9640 1 --2- 172.21.15.2:0/1130650685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f0102ca0 0x7f19f0103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 -- 172.21.15.2:0/1130650685 >> 172.21.15.2:0/1130650685 conn(0x7f19f00fc6b0 msgr2=0x7f19f00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 -- 172.21.15.2:0/1130650685 shutdown_connections 2024-09-12T01:03:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 -- 172.21.15.2:0/1130650685 wait complete. 2024-09-12T01:03:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 Processor -- start 2024-09-12T01:03:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 -- start start 2024-09-12T01:03:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0102ca0 0x7f19f0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f01035c0 0x7f19f01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f010c0f0 0x7f19f019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0111ed0 con 0x7f19f010c0f0 2024-09-12T01:03:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0111d50 con 0x7f19f01035c0 2024-09-12T01:03:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.514+0000 7f19f62d9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0112050 con 0x7f19f0102ca0 2024-09-12T01:03:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f010c0f0 0x7f19f019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f010c0f0 0x7f19f019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53296/0 (socket says 172.21.15.2:53296) 2024-09-12T01:03:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 -- 172.21.15.2:0/3475164085 learned_addr learned my addr 172.21.15.2:0/3475164085 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19effff640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0102ca0 0x7f19f0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19ef7fe640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f01035c0 0x7f19f01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 -- 172.21.15.2:0/3475164085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0102ca0 msgr2=0x7f19f0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0102ca0 0x7f19f0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 -- 172.21.15.2:0/3475164085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f01035c0 msgr2=0x7f19f01989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f01035c0 0x7f19f01989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 -- 172.21.15.2:0/3475164085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f019d450 con 0x7f19f010c0f0 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19ef7fe640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f01035c0 0x7f19f01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f4876640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f010c0f0 0x7f19f019cd20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f19e800cad0 tx=0x7f19e800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19ed7fa640 1 -- 172.21.15.2:0/3475164085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e800ae20 con 0x7f19f010c0f0 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19ed7fa640 1 -- 172.21.15.2:0/3475164085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8005020 con 0x7f19f010c0f0 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f019d740 con 0x7f19f010c0f0 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19ed7fa640 1 -- 172.21.15.2:0/3475164085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e800f6f0 con 0x7f19f010c0f0 2024-09-12T01:03:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.515+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f01a4fd0 con 0x7f19f010c0f0 2024-09-12T01:03:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.516+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f0103080 con 0x7f19f010c0f0 2024-09-12T01:03:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.517+0000 7f19ed7fa640 1 -- 172.21.15.2:0/3475164085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f19e80051d0 con 0x7f19f010c0f0 2024-09-12T01:03:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.518+0000 7f19ed7fa640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f19d80a2d80 0x7f19d80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.518+0000 7f19effff640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f19d80a2d80 0x7f19d80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.518+0000 7f19ed7fa640 1 -- 172.21.15.2:0/3475164085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f19e80cf790 con 0x7f19f010c0f0 2024-09-12T01:03:37.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.519+0000 7f19effff640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f19d80a2d80 0x7f19d80a5240 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19e400bbe0 tx=0x7f19e400b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:37.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.522+0000 7f19ed7fa640 1 -- 172.21.15.2:0/3475164085 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19e8014030 con 0x7f19f010c0f0 2024-09-12T01:03:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.703+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19f0106bb0 con 0x7f19f010c0f0 2024-09-12T01:03:37.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.705+0000 7f19ed7fa640 1 -- 172.21.15.2:0/3475164085 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23271 (secure 0 0 0) 0x7f19e809c2d0 con 0x7f19f010c0f0 2024-09-12T01:03:37.706 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:03:37.706 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T01:03:13.616429+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/761407779":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3529963366":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/838113285":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/17217547":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6800/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/780422410":"2024-09-13T00:52:54.829221+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:03:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f19d80a2d80 msgr2=0x7f19d80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f19d80a2d80 0x7f19d80a5240 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19e400bbe0 tx=0x7f19e400b390 comp rx=0 tx=0).stop 2024-09-12T01:03:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f010c0f0 msgr2=0x7f19f019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f010c0f0 0x7f19f019cd20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f19e800cad0 tx=0x7f19e800cf90 comp rx=0 tx=0).stop 2024-09-12T01:03:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 shutdown_connections 2024-09-12T01:03:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f19d80a2d80 0x7f19d80a5240 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f010c0f0 0x7f19f019cd20 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f01035c0 0x7f19f01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 --2- 172.21.15.2:0/3475164085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0102ca0 0x7f19f0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 >> 172.21.15.2:0/3475164085 conn(0x7f19f00fc6b0 msgr2=0x7f19f00fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 shutdown_connections 2024-09-12T01:03:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.707+0000 7f19f62d9640 1 -- 172.21.15.2:0/3475164085 wait complete. 2024-09-12T01:03:37.717 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T00:46:35.272846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T00:51:07.745388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T00:51:09.978808+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:03:37.718 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:03:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 -- 172.21.15.2:0/3454938773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f284810c0e0 msgr2=0x7f284810e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 --2- 172.21.15.2:0/3454938773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f284810c0e0 0x7f284810e530 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2840009ca0 tx=0x7f284002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 -- 172.21.15.2:0/3454938773 shutdown_connections 2024-09-12T01:03:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 --2- 172.21.15.2:0/3454938773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f284810c0e0 0x7f284810e530 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 --2- 172.21.15.2:0/3454938773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2848103590 0x7f284810ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 --2- 172.21.15.2:0/3454938773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2848102be0 0x7f2848102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 -- 172.21.15.2:0/3454938773 >> 172.21.15.2:0/3454938773 conn(0x7f28480fc6a0 msgr2=0x7f28480feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 -- 172.21.15.2:0/3454938773 shutdown_connections 2024-09-12T01:03:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.826+0000 7f285003c640 1 -- 172.21.15.2:0/3454938773 wait complete. 2024-09-12T01:03:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f285003c640 1 Processor -- start 2024-09-12T01:03:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f285003c640 1 -- start start 2024-09-12T01:03:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f285003c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2848102be0 0x7f2848198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f285003c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2848103590 0x7f2848198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f285003c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284810c0e0 0x7f284819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f285003c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2848111e90 con 0x7f2848103590 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f285003c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2848111d10 con 0x7f2848102be0 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f285003c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112010 con 0x7f284810c0e0 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284d5d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2848103590 0x7f2848198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284d5d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2848103590 0x7f2848198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53316/0 (socket says 172.21.15.2:53316) 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284d5d7640 1 -- 172.21.15.2:0/864787225 learned_addr learned my addr 172.21.15.2:0/864787225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284ddd8640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2848102be0 0x7f2848198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284e5d9640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284810c0e0 0x7f284819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284d5d7640 1 -- 172.21.15.2:0/864787225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284810c0e0 msgr2=0x7f284819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284d5d7640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284810c0e0 0x7f284819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284d5d7640 1 -- 172.21.15.2:0/864787225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2848102be0 msgr2=0x7f2848198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284d5d7640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2848102be0 0x7f2848198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.827+0000 7f284d5d7640 1 -- 172.21.15.2:0/864787225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284819d330 con 0x7f2848103590 2024-09-12T01:03:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.828+0000 7f284d5d7640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2848103590 0x7f2848198880 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f283800c890 tx=0x7f283800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.828+0000 7f283effd640 1 -- 172.21.15.2:0/864787225 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838004220 con 0x7f2848103590 2024-09-12T01:03:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.828+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284819d620 con 0x7f2848103590 2024-09-12T01:03:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.828+0000 7f283effd640 1 -- 172.21.15.2:0/864787225 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28380043c0 con 0x7f2848103590 2024-09-12T01:03:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.828+0000 7f283effd640 1 -- 172.21.15.2:0/864787225 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838004a00 con 0x7f2848103590 2024-09-12T01:03:37.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.828+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28481a4eb0 con 0x7f2848103590 2024-09-12T01:03:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.829+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2848102fc0 con 0x7f2848103590 2024-09-12T01:03:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.830+0000 7f283effd640 1 -- 172.21.15.2:0/864787225 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f28380079b0 con 0x7f2848103590 2024-09-12T01:03:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.831+0000 7f283effd640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28340a2d00 0x7f28340a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.831+0000 7f284ddd8640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28340a2d00 0x7f28340a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:37.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.831+0000 7f283effd640 1 -- 172.21.15.2:0/864787225 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f28380cf560 con 0x7f2848103590 2024-09-12T01:03:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.831+0000 7f284ddd8640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28340a2d00 0x7f28340a51c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2844005d00 tx=0x7f284400b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:37.834+0000 7f283effd640 1 -- 172.21.15.2:0/864787225 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2838014030 con 0x7f2848103590 2024-09-12T01:03:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.008+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f284802d7c0 con 0x7f2848103590 2024-09-12T01:03:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.008+0000 7f283effd640 1 -- 172.21.15.2:0/864787225 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f283809c0a0 con 0x7f2848103590 2024-09-12T01:03:38.007 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-12T01:03:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28340a2d00 msgr2=0x7f28340a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28340a2d00 0x7f28340a51c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2844005d00 tx=0x7f284400b410 comp rx=0 tx=0).stop 2024-09-12T01:03:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2848103590 msgr2=0x7f2848198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2848103590 0x7f2848198880 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f283800c890 tx=0x7f283800cd50 comp rx=0 tx=0).stop 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 shutdown_connections 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f28340a2d00 0x7f28340a51c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284810c0e0 0x7f284819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2848103590 0x7f2848198880 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 --2- 172.21.15.2:0/864787225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2848102be0 0x7f2848198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 >> 172.21.15.2:0/864787225 conn(0x7f28480fc6a0 msgr2=0x7f28480fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 shutdown_connections 2024-09-12T01:03:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.010+0000 7f285003c640 1 -- 172.21.15.2:0/864787225 wait complete. 2024-09-12T01:03:38.020 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T01:03:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 -- 172.21.15.2:0/2782341766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec10c0a0 msgr2=0x7f44ec10e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 --2- 172.21.15.2:0/2782341766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec10c0a0 0x7f44ec10e540 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009ca0 tx=0x7f44e402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 -- 172.21.15.2:0/2782341766 shutdown_connections 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 --2- 172.21.15.2:0/2782341766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec10c0a0 0x7f44ec10e540 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 --2- 172.21.15.2:0/2782341766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec1035f0 0x7f44ec10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 --2- 172.21.15.2:0/2782341766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec102cd0 0x7f44ec1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 -- 172.21.15.2:0/2782341766 >> 172.21.15.2:0/2782341766 conn(0x7f44ec0fc6a0 msgr2=0x7f44ec0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 -- 172.21.15.2:0/2782341766 shutdown_connections 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.128+0000 7f44f3131640 1 -- 172.21.15.2:0/2782341766 wait complete. 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f3131640 1 Processor -- start 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f3131640 1 -- start start 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f3131640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec102cd0 0x7f44ec198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f3131640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec1035f0 0x7f44ec198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f3131640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec10c0a0 0x7f44ec19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f3131640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec111ea0 con 0x7f44ec1035f0 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f3131640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec111d20 con 0x7f44ec10c0a0 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f3131640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec112020 con 0x7f44ec102cd0 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec1035f0 0x7f44ec198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec1035f0 0x7f44ec198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53324/0 (socket says 172.21.15.2:53324) 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44ebfff640 1 -- 172.21.15.2:0/1143978419 learned_addr learned my addr 172.21.15.2:0/1143978419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f0ecd640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec102cd0 0x7f44ec198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.129+0000 7f44f16ce640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec10c0a0 0x7f44ec19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44ebfff640 1 -- 172.21.15.2:0/1143978419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec102cd0 msgr2=0x7f44ec198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44ebfff640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec102cd0 0x7f44ec198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44ebfff640 1 -- 172.21.15.2:0/1143978419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec10c0a0 msgr2=0x7f44ec19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44ebfff640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec10c0a0 0x7f44ec19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44ebfff640 1 -- 172.21.15.2:0/1143978419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ec19d340 con 0x7f44ec1035f0 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44f16ce640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec10c0a0 0x7f44ec19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44ebfff640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec1035f0 0x7f44ec198890 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f44d800d950 tx=0x7f44d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44e9ffb640 1 -- 172.21.15.2:0/1143978419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8017070 con 0x7f44ec1035f0 2024-09-12T01:03:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44e9ffb640 1 -- 172.21.15.2:0/1143978419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44d8009c30 con 0x7f44ec1035f0 2024-09-12T01:03:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ec19d630 con 0x7f44ec1035f0 2024-09-12T01:03:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44e9ffb640 1 -- 172.21.15.2:0/1143978419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d800f600 con 0x7f44ec1035f0 2024-09-12T01:03:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.130+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ec1a4ec0 con 0x7f44ec1035f0 2024-09-12T01:03:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.131+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44ec1030b0 con 0x7f44ec1035f0 2024-09-12T01:03:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.132+0000 7f44e9ffb640 1 -- 172.21.15.2:0/1143978419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f44d801a070 con 0x7f44ec1035f0 2024-09-12T01:03:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.133+0000 7f44e9ffb640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f44dc0a2d00 0x7f44dc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.133+0000 7f44f0ecd640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f44dc0a2d00 0x7f44dc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.133+0000 7f44e9ffb640 1 -- 172.21.15.2:0/1143978419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f44d80cef00 con 0x7f44ec1035f0 2024-09-12T01:03:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.134+0000 7f44f0ecd640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f44dc0a2d00 0x7f44dc0a51c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44e000bbe0 tx=0x7f44e000b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:38.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.136+0000 7f44e9ffb640 1 -- 172.21.15.2:0/1143978419 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44d8009de0 con 0x7f44ec1035f0 2024-09-12T01:03:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.311+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f44ec106bc0 con 0x7f44ec1035f0 2024-09-12T01:03:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.311+0000 7f44e9ffb640 1 -- 172.21.15.2:0/1143978419 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f44d809ba40 con 0x7f44ec1035f0 2024-09-12T01:03:38.311 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-12T01:03:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f44dc0a2d00 msgr2=0x7f44dc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f44dc0a2d00 0x7f44dc0a51c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44e000bbe0 tx=0x7f44e000b390 comp rx=0 tx=0).stop 2024-09-12T01:03:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec1035f0 msgr2=0x7f44ec198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec1035f0 0x7f44ec198890 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f44d800d950 tx=0x7f44d800de10 comp rx=0 tx=0).stop 2024-09-12T01:03:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 shutdown_connections 2024-09-12T01:03:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f44dc0a2d00 0x7f44dc0a51c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec10c0a0 0x7f44ec19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ec1035f0 0x7f44ec198890 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 --2- 172.21.15.2:0/1143978419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec102cd0 0x7f44ec198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 >> 172.21.15.2:0/1143978419 conn(0x7f44ec0fc6a0 msgr2=0x7f44ec0fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 shutdown_connections 2024-09-12T01:03:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.313+0000 7f44f3131640 1 -- 172.21.15.2:0/1143978419 wait complete. 2024-09-12T01:03:38.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T01:03:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 -- 172.21.15.2:0/3824934146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801069b0 msgr2=0x7f1780106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 --2- 172.21.15.2:0/3824934146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801069b0 0x7f1780106d90 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f177c009930 tx=0x7f177c02a420 comp rx=0 tx=0).stop 2024-09-12T01:03:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 -- 172.21.15.2:0/3824934146 shutdown_connections 2024-09-12T01:03:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 --2- 172.21.15.2:0/3824934146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1780101340 0x7f178010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 --2- 172.21.15.2:0/3824934146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17801009a0 0x7f1780100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 --2- 172.21.15.2:0/3824934146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801069b0 0x7f1780106d90 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 -- 172.21.15.2:0/3824934146 >> 172.21.15.2:0/3824934146 conn(0x7f17800fc6a0 msgr2=0x7f17800feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 -- 172.21.15.2:0/3824934146 shutdown_connections 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.430+0000 7f1787c0a640 1 -- 172.21.15.2:0/3824934146 wait complete. 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f1787c0a640 1 Processor -- start 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f1787c0a640 1 -- start start 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f1787c0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801009a0 0x7f1780198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f1787c0a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1780101340 0x7f1780198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f1787c0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17801069b0 0x7f178019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f1787c0a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1780110dc0 con 0x7f17801009a0 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f1787c0a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1780110c40 con 0x7f1780101340 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f1787c0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1780110f40 con 0x7f17801069b0 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17859a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801009a0 0x7f1780198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17859a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801009a0 0x7f1780198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53354/0 (socket says 172.21.15.2:53354) 2024-09-12T01:03:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17859a6640 1 -- 172.21.15.2:0/969493773 learned_addr learned my addr 172.21.15.2:0/969493773 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17851a5640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1780101340 0x7f1780198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17859a6640 1 -- 172.21.15.2:0/969493773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17801069b0 msgr2=0x7f178019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17859a6640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17801069b0 0x7f178019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17859a6640 1 -- 172.21.15.2:0/969493773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1780101340 msgr2=0x7f1780198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17859a6640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1780101340 0x7f1780198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17859a6640 1 -- 172.21.15.2:0/969493773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178019d3f0 con 0x7f17801009a0 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.431+0000 7f17851a5640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1780101340 0x7f1780198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.432+0000 7f17859a6640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801009a0 0x7f1780198400 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f177c009230 tx=0x7f177c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.432+0000 7f1776ffd640 1 -- 172.21.15.2:0/969493773 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c03f030 con 0x7f17801009a0 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.432+0000 7f1776ffd640 1 -- 172.21.15.2:0/969493773 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f177c003ad0 con 0x7f17801009a0 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.432+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178019d680 con 0x7f17801009a0 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.432+0000 7f1776ffd640 1 -- 172.21.15.2:0/969493773 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c035070 con 0x7f17801009a0 2024-09-12T01:03:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.432+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17801a4f70 con 0x7f17801009a0 2024-09-12T01:03:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.433+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1780100e00 con 0x7f17801009a0 2024-09-12T01:03:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.434+0000 7f1776ffd640 1 -- 172.21.15.2:0/969493773 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f177c042030 con 0x7f17801009a0 2024-09-12T01:03:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.435+0000 7f1776ffd640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f176c0a2d80 0x7f176c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.435+0000 7f17851a5640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f176c0a2d80 0x7f176c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.435+0000 7f1776ffd640 1 -- 172.21.15.2:0/969493773 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f177c0ef7c0 con 0x7f17801009a0 2024-09-12T01:03:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.435+0000 7f17851a5640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f176c0a2d80 0x7f176c0a5240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f178006b2c0 tx=0x7f1770005e50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:38.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.439+0000 7f1776ffd640 1 -- 172.21.15.2:0/969493773 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f177c0bc360 con 0x7f17801009a0 2024-09-12T01:03:38.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.613+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f17801a51d0 con 0x7f17801009a0 2024-09-12T01:03:38.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.613+0000 7f1776ffd640 1 -- 172.21.15.2:0/969493773 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f177c0bbc60 con 0x7f17801009a0 2024-09-12T01:03:38.612 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-12T01:03:38.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f176c0a2d80 msgr2=0x7f176c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f176c0a2d80 0x7f176c0a5240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f178006b2c0 tx=0x7f1770005e50 comp rx=0 tx=0).stop 2024-09-12T01:03:38.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801009a0 msgr2=0x7f1780198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801009a0 0x7f1780198400 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f177c009230 tx=0x7f177c004270 comp rx=0 tx=0).stop 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 shutdown_connections 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f176c0a2d80 0x7f176c0a5240 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17801069b0 0x7f178019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1780101340 0x7f1780198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 --2- 172.21.15.2:0/969493773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17801009a0 0x7f1780198400 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 >> 172.21.15.2:0/969493773 conn(0x7f17800fc6a0 msgr2=0x7f17801047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 shutdown_connections 2024-09-12T01:03:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.615+0000 7f1787c0a640 1 -- 172.21.15.2:0/969493773 wait complete. 2024-09-12T01:03:38.625 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T01:03:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 -- 172.21.15.2:0/2687240376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f401035c0 msgr2=0x7f5f4010baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 --2- 172.21.15.2:0/2687240376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f401035c0 0x7f5f4010baa0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009900 tx=0x7f5f3402a480 comp rx=0 tx=0).stop 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 -- 172.21.15.2:0/2687240376 shutdown_connections 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 --2- 172.21.15.2:0/2687240376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f4010c0f0 0x7f5f4010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 --2- 172.21.15.2:0/2687240376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f401035c0 0x7f5f4010baa0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 --2- 172.21.15.2:0/2687240376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f40102ca0 0x7f5f40103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 -- 172.21.15.2:0/2687240376 >> 172.21.15.2:0/2687240376 conn(0x7f5f400fc6b0 msgr2=0x7f5f400fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 -- 172.21.15.2:0/2687240376 shutdown_connections 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.730+0000 7f5f45877640 1 -- 172.21.15.2:0/2687240376 wait complete. 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f45877640 1 Processor -- start 2024-09-12T01:03:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f45877640 1 -- start start 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f45877640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f40102ca0 0x7f5f401984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f45877640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401035c0 0x7f5f401989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f45877640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f4010c0f0 0x7f5f4019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f45877640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f40111f60 con 0x7f5f4010c0f0 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f45877640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f40111de0 con 0x7f5f401035c0 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f45877640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f401120e0 con 0x7f5f40102ca0 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f4010c0f0 0x7f5f4019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f4010c0f0 0x7f5f4019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53370/0 (socket says 172.21.15.2:53370) 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f3f7fe640 1 -- 172.21.15.2:0/3986086719 learned_addr learned my addr 172.21.15.2:0/3986086719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f3e7fc640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401035c0 0x7f5f401989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.731+0000 7f5f3effd640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f40102ca0 0x7f5f401984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f3f7fe640 1 -- 172.21.15.2:0/3986086719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f40102ca0 msgr2=0x7f5f401984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f3f7fe640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f40102ca0 0x7f5f401984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f3f7fe640 1 -- 172.21.15.2:0/3986086719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401035c0 msgr2=0x7f5f401989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f3f7fe640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401035c0 0x7f5f401989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f3f7fe640 1 -- 172.21.15.2:0/3986086719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4019d4a0 con 0x7f5f4010c0f0 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f3effd640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f40102ca0 0x7f5f401984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f3e7fc640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401035c0 0x7f5f401989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f3f7fe640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f4010c0f0 0x7f5f4019cd70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009fd0 tx=0x7f5f3800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f44875640 1 -- 172.21.15.2:0/3986086719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38017070 con 0x7f5f4010c0f0 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f44875640 1 -- 172.21.15.2:0/3986086719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f38003e50 con 0x7f5f4010c0f0 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4019d790 con 0x7f5f4010c0f0 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f44875640 1 -- 172.21.15.2:0/3986086719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f380106c0 con 0x7f5f4010c0f0 2024-09-12T01:03:38.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.732+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f401a5020 con 0x7f5f4010c0f0 2024-09-12T01:03:38.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.733+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f40103080 con 0x7f5f4010c0f0 2024-09-12T01:03:38.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.734+0000 7f5f44875640 1 -- 172.21.15.2:0/3986086719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f5f38003970 con 0x7f5f4010c0f0 2024-09-12T01:03:38.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.735+0000 7f5f44875640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f280a2d80 0x7f5f280a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:38.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.735+0000 7f5f3effd640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f280a2d80 0x7f5f280a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:38.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.735+0000 7f5f44875640 1 -- 172.21.15.2:0/3986086719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f5f380cf2f0 con 0x7f5f4010c0f0 2024-09-12T01:03:38.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.735+0000 7f5f3effd640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f280a2d80 0x7f5f280a5240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f30006fd0 tx=0x7f5f30008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.739+0000 7f5f44875640 1 -- 172.21.15.2:0/3986086719 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f3809be30 con 0x7f5f4010c0f0 2024-09-12T01:03:38.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:38 smithi071 ceph-mon[35276]: pgmap v332: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:38.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:38 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3475164085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:03:38.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:38 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/864787225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:03:38.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:38 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1143978419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:03:38.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:38 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/969493773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:03:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.963+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f5f40106bb0 con 0x7f5f4010c0f0 2024-09-12T01:03:38.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.971+0000 7f5f44875640 1 -- 172.21.15.2:0/3986086719 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740890 (secure 0 0 0) 0x7f5f3809b730 con 0x7f5f4010c0f0 2024-09-12T01:03:38.980 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:03:38.980 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 25, 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "active_gid": 15132, 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "active_name": "x", 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addrs": { 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 606710864 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-12T01:03:38.981 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 606710864 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addr": "172.21.15.2:6801/606710864", 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "active_change": "2024-09-12T00:52:54.829432+0000", 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "available": true, 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "standbys": [ 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24826, 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "z", 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-09-12T01:03:38.982 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.985 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.986 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:38.987 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.988 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-12T01:03:38.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.992 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-12T01:03:38.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:38.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:38.998 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:38.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.000 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-12T01:03:39.001 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:03:39.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-12T01:03:39.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.008 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.009 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.012 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.019 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.023 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.026 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.027 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.030 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.036 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.037 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-12T01:03:39.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-12T01:03:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.042 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:03:39.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:03:39.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.050 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.065 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.069 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.083 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.094 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.103 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.105 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.110 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.112 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.114 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:03:39.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:03:39.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:03:39.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:03:39.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.121 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.129 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.130 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.136 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.138 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.143 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.149 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-12T01:03:39.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.156 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.165 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.167 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.171 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.175 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-12T01:03:39.176 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-12T01:03:39.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.180 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.183 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.185 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.186 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-12T01:03:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.192 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-12T01:03:39.202 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.208 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-12T01:03:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.212 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-12T01:03:39.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.217 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-12T01:03:39.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-12T01:03:39.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.221 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.222 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.228 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.229 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.230 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.232 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.233 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.239 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-12T01:03:39.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.245 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.249 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.254 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.256 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.259 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.261 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-12T01:03:39.263 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.264 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-12T01:03:39.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.268 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.269 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.270 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.271 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-12T01:03:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.275 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.276 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.279 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.280 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.283 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.286 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.289 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.291 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.292 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.293 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.294 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.295 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.296 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.297 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.298 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.299 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.303 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.304 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.305 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-12T01:03:39.307 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.308 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.309 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.316 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.318 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.319 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.324 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.325 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.326 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.327 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.331 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.332 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.334 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.335 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.336 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.337 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.341 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.342 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.346 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.347 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.348 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.351 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-12T01:03:39.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.358 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.360 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.361 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-12T01:03:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-12T01:03:39.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-12T01:03:39.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-12T01:03:39.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.367 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.371 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.376 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.378 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.383 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.384 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.386 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.387 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.389 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.392 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.393 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-12T01:03:39.395 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.397 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.399 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.402 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.403 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.404 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24869, 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "y", 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.411 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.413 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.415 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-12T01:03:39.421 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-12T01:03:39.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:03:39.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.424 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-12T01:03:39.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-12T01:03:39.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-12T01:03:39.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.429 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.430 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.435 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.436 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.439 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-12T01:03:39.441 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.442 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.447 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.448 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:03:39.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.451 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-12T01:03:39.453 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.456 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:03:39.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:03:39.462 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.463 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.464 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.472 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.476 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.479 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.482 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.484 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.488 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-12T01:03:39.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.496 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-12T01:03:39.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-12T01:03:39.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-12T01:03:39.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.502 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.503 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.504 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.505 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.506 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-12T01:03:39.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-12T01:03:39.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.514 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-12T01:03:39.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.518 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.524 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.530 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.538 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.548 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.561 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.565 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.567 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-12T01:03:39.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.575 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-12T01:03:39.580 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.581 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-12T01:03:39.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.585 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.587 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.589 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-12T01:03:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.597 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.603 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.604 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.609 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.618 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.619 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.621 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.622 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.623 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.628 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.633 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.634 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.637 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-12T01:03:39.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.640 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-12T01:03:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.649 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.651 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.653 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.661 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.663 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.665 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.667 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.672 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.673 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.674 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.676 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.680 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.681 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.682 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.685 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-12T01:03:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:03:39.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-12T01:03:39.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.695 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.700 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.701 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.704 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.706 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.707 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.708 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-12T01:03:39.709 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:03:39.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.713 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.718 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.754 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-12T01:03:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-12T01:03:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.769 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.770 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.776 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.777 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.778 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.789 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.790 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.791 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.793 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:03:39.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:03:39.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.799 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.801 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.808 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.809 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.810 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.816 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.818 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.821 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.822 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:03:39.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.827 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:03:39.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.835 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: "modules": [ 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard", 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "iostat", 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "nfs", 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "restful", 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_schedule" 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.842 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-12T01:03:39.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:03:39.855 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-12T01:03:39.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-12T01:03:39.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-12T01:03:39.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-12T01:03:39.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.863 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:03:39.864 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:03:39.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.869 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.870 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.872 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.876 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-12T01:03:39.877 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-12T01:03:39.884 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.888 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.892 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.897 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.900 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.902 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.907 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.908 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.911 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:03:39.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.916 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.919 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.920 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-12T01:03:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:03:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-12T01:03:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-12T01:03:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-12T01:03:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-12T01:03:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-12T01:03:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-12T01:03:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-12T01:03:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-12T01:03:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-12T01:03:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:03:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:03:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:03:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:03:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:03:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:03:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:03:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:03:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:03:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:03:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:03:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.971 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:03:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:03:39.973 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.974 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.975 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.976 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.979 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.982 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.983 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.987 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.989 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.992 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:39.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.995 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-12T01:03:39.998 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:39.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.001 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.011 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-12T01:03:40.012 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.016 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.026 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.028 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.031 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.033 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-12T01:03:40.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:40.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-12T01:03:40.037 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.042 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.044 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.045 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-12T01:03:40.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.049 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.052 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.053 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.056 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.059 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.061 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.062 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-12T01:03:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-12T01:03:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:03:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.078 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.080 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.082 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.084 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.087 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.088 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.089 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.093 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.094 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.098 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.100 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.108 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.110 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.113 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.115 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.117 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.118 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.122 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-12T01:03:40.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:03:40.125 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-12T01:03:40.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.129 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.130 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:03:40.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.137 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.142 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:03:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:03:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-12T01:03:40.148 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-12T01:03:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.152 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-12T01:03:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:03:40.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-12T01:03:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.167 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.171 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.173 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.174 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.179 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.181 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.183 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.186 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.193 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.199 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.203 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-12T01:03:40.204 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.205 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.213 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.215 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.217 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.218 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.222 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.223 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.226 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-12T01:03:40.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.236 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.238 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.243 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.244 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.245 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.247 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.248 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.253 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.254 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.257 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-12T01:03:40.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-12T01:03:40.260 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-12T01:03:40.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-12T01:03:40.262 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.263 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-12T01:03:40.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-12T01:03:40.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-12T01:03:40.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-12T01:03:40.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.270 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "services": { 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard": "https://172.21.15.2:8443/" 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "always_on_modules": { 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "octopus": [ 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-12T01:03:40.271 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "pacific": [ 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-12T01:03:40.272 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "quincy": [ 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "reef": [ 2024-09-12T01:03:40.273 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "squid": [ 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-12T01:03:40.274 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "last_failure_osd_epoch": 84, 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "active_clients": [ 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2160947034 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "libcephsqlite", 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1993424936 2024-09-12T01:03:40.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1457992074 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.277 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2165000889 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-12T01:03:40.278 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 4186491418 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2283058465 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:40.279 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:40.280 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-12T01:03:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:03:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.976+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f280a2d80 msgr2=0x7f5f280a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.976+0000 7f5f45877640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f280a2d80 0x7f5f280a5240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f30006fd0 tx=0x7f5f30008040 comp rx=0 tx=0).stop 2024-09-12T01:03:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f4010c0f0 msgr2=0x7f5f4019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f4010c0f0 0x7f5f4019cd70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009fd0 tx=0x7f5f3800b260 comp rx=0 tx=0).stop 2024-09-12T01:03:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 shutdown_connections 2024-09-12T01:03:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f5f280a2d80 0x7f5f280a5240 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f4010c0f0 0x7f5f4019cd70 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401035c0 0x7f5f401989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 --2- 172.21.15.2:0/3986086719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f40102ca0 0x7f5f401984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 >> 172.21.15.2:0/3986086719 conn(0x7f5f400fc6b0 msgr2=0x7f5f400fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 shutdown_connections 2024-09-12T01:03:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:38.977+0000 7f5f45877640 1 -- 172.21.15.2:0/3986086719 wait complete. 2024-09-12T01:03:40.282 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:39 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3986086719' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:03:40.282 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:38 smithi002 ceph-mon[31210]: pgmap v332: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:40.282 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:38 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3475164085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:03:40.282 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:38 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/864787225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:03:40.283 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:38 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1143978419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:03:40.283 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:38 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/969493773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:03:40.283 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:38 smithi167 ceph-mon[35234]: pgmap v332: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:40.283 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:38 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3475164085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:03:40.283 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:38 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/864787225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:03:40.283 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:38 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1143978419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:03:40.283 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:38 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/969493773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:03:40.283 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:39 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3986086719' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:03:40.344 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T01:03:40.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T01:03:40.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:39 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3986086719' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:03:40.614 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:40.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:40 smithi002 ceph-mon[31210]: pgmap v333: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:40.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:40 smithi071 ceph-mon[35276]: pgmap v333: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:41.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:40 smithi167 ceph-mon[35234]: pgmap v333: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4, 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4, 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3072, 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 448, 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.003586476, 2024-09-12T01:03:41.113 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000033170, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002359816, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.004218021, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.001406007 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T01:03:41.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 215, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 205, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1441408, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 125984, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.039269690, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.014572874, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.035906562, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:41.115 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 204, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.010134437, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000049678 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1441408, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-12T01:03:41.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 158, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 185136, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.013181433, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.008834913, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002055946, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 155, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.015802765, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000101953 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 185136 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148994, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:41.121 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 217, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1411129, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 217, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 217, 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1411129, 2024-09-12T01:03:41.124 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-12T01:03:41.124 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:41.124 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:41.124 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:41.124 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:41.124 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:03:41.835 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-12T01:03:41.835 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-12T01:03:41.835 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-12T01:03:41.836 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-12T01:03:41.836 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-12T01:03:41.836 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-12T01:03:41.836 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-12T01:03:41.836 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-12T01:03:41.836 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T01:03:41.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T01:03:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:03:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 220, 2024-09-12T01:03:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 210, 2024-09-12T01:03:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1442768, 2024-09-12T01:03:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 129184, 2024-09-12T01:03:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.040591793, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.013357421, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.037891242, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 209, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.010756525, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000051466 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1442768, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 129184 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 6, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 163, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3392, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 186112, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-12T01:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.014007062, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.007873506, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.004093357, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 161, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.021107208, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000131100 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 186112 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000334808, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000250182, 2024-09-12T01:03:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149017, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-12T01:03:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 222, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1411779, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 222, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 222, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1411779, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:03:42.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:42 smithi002 ceph-mon[31210]: pgmap v334: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:42.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:42 smithi071 ceph-mon[35276]: pgmap v334: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:43.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:42 smithi167 ceph-mon[35234]: pgmap v334: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:43.275 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T01:03:43.275 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T01:03:43.275 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-12T01:03:43.275 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-12T01:03:43.275 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-12T01:03:43.275 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-12T01:03:43.275 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-12T01:03:43.275 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-12T01:03:43.276 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T01:03:43.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T01:03:43.533 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:03:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-12T01:03:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-12T01:03:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-12T01:03:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-12T01:03:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-12T01:03:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-12T01:03:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.001386253, 2024-09-12T01:03:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T01:03:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000194593, 2024-09-12T01:03:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:03:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:03:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 221, 2024-09-12T01:03:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 209, 2024-09-12T01:03:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1445024, 2024-09-12T01:03:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 127712, 2024-09-12T01:03:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-12T01:03:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-12T01:03:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.038973394, 2024-09-12T01:03:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.013928890, 2024-09-12T01:03:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.036795442, 2024-09-12T01:03:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 209, 2024-09-12T01:03:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.014149447, 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000067700 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1445024, 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 127712 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-12T01:03:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 158, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 185136, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.013300067, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.008993623, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002182399, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 155, 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.008841278, 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000057040 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 185136 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-12T01:03:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-12T01:03:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-12T01:03:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-12T01:03:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148994, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 219, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1411389, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 219, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-12T01:03:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 219, 2024-09-12T01:03:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1411389, 2024-09-12T01:03:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-12T01:03:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:03:44.667 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-12T01:03:44.667 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-12T01:03:44.667 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-12T01:03:44.667 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-12T01:03:44.667 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-12T01:03:44.667 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-12T01:03:44.667 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-12T01:03:44.667 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-12T01:03:44.667 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T01:03:44.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T01:03:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:44.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:44 smithi071 ceph-mon[35276]: pgmap v335: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:44.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:44 smithi002 ceph-mon[31210]: pgmap v335: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:45.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:44 smithi167 ceph-mon[35234]: pgmap v335: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:45.446 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-12T01:03:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4, 2024-09-12T01:03:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4, 2024-09-12T01:03:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3072, 2024-09-12T01:03:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 448, 2024-09-12T01:03:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.003385142, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000040635, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002376927, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.004239649, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.001413216 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.447 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 222, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 212, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1443312, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 130464, 2024-09-12T01:03:45.448 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.038412841, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.014904862, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.035064957, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 211, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.011689333, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000055399 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:45.449 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1443312, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 130464 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 162, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 185840, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.014301653, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.009967611, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.001837351, 2024-09-12T01:03:45.450 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 159, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.009743111, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000061277 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 185840 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-12T01:03:45.451 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:45.452 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148994, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-09-12T01:03:45.454 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-12T01:03:45.455 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 224, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1412039, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:45.456 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 224, 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 224, 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1412039, 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-12T01:03:45.457 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-12T01:03:46.131 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T01:03:46.131 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T01:03:46.131 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-12T01:03:46.131 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-12T01:03:46.131 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-12T01:03:46.131 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-12T01:03:46.131 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-12T01:03:46.131 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-12T01:03:46.132 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T01:03:46.132 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T01:03:46.390 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:03:46.761 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:46 smithi071 ceph-mon[35276]: pgmap v336: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 52965, 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 53965, 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 13667891, 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 95925445, 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 30, 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-12T01:03:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 3.201112438, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 1.197762660, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.853483074, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.962807292, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 53963, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2.145118048, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000039751 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 8311, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001489316, 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000179 2024-09-12T01:03:46.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 308848, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 87200 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 38982, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 38892, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 10701769, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 78628869, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 165, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 7, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 2.289779217, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.814320904, 2024-09-12T01:03:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.573888040, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.742124313, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 38888, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.452662480, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000037355 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 545, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000074999, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000137 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 142016, 2024-09-12T01:03:46.881 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 483952 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 69315, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 131740, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 25260599, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 81608046, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 12, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 6, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 4.998862690, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 2.347116017, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 3.331311649, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.282114207, 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:46.882 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 131740, 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 3.837050142, 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000029125 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 148608, 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.022419372, 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000150 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 21507296, 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 57554592 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-12T01:03:46.883 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 107567, 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 38.285013928, 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000355917 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T01:03:46.884 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 10871, 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 3.221068871, 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000296299 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 28741, 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 28667, 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 28667, 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 108.286585278, 2024-09-12T01:03:46.885 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.003777395 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 74, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 212, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 24, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 2, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 11277, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 219, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 11038, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 20, 2024-09-12T01:03:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 10963, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 212, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 3, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 3, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 5, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 34114, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 33361, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 74, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 1, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 2, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 13, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 182, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 13, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 427, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 26415, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 26415, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-12T01:03:46.888 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 495, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 20, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 475, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 25920, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 20, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 18536, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 22962, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 7861, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 21027, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 14290, 2024-09-12T01:03:46.889 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 4335, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 16648 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 419, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 3, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 2, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 2, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 586, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 60, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 6987, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 6924, 2024-09-12T01:03:46.890 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 3, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 5, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 17521, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 20, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 13, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 26, 2024-09-12T01:03:46.891 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 57173, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 57173, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 75, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-12T01:03:46.892 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 75, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 6, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 175038344, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 27772, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 62.071546025, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002235040 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.893 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 6140, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 13261, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 7121, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 234, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 281, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 47, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 11277, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 18516, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 7239, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 3, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 15643, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 15640, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 124060, 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 231712 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 47230, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 401, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 28741, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 49, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 834, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 7093, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 33.782621864, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.004762811 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.895 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 165, 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 4.792720104, 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.029046788 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3, 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.007809895, 2024-09-12T01:03:46.896 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002603298 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4412, 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.848839642, 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000419047 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-09-12T01:03:46.897 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000247962, 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000247962 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-12T01:03:46.898 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 10, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002331598, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000233159 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 72, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.065124780, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000904510 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.899 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 10, 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.061058937, 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.006105893 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 419, 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.119380545, 2024-09-12T01:03:46.900 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000284917 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 453, 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.353591594, 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002988060 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 81, 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.166602533, 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002056821 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-12T01:03:46.901 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 72, 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2.288671655, 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.031787106 2024-09-12T01:03:46.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.020693347, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.005173336 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 8991, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 53.073738923, 2024-09-12T01:03:46.903 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.005902985 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 8, 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002590200, 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000323775 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-12T01:03:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 8, 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.020962677, 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002620334 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 5, 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.003176813, 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000635362 2024-09-12T01:03:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 6860, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 10.676422209, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001556329 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-12T01:03:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 6, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 4, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 713, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 356, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 619, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:46.909 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 962657, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 4842, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:46.910 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8480, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 186, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 22442990, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 205855, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:46.911 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 99093, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 175114569, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 32, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 99093, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 99093, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 211.414202157, 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002133492 2024-09-12T01:03:46.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 99093, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 99456 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 99093, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 26544, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 72549, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 11, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 109, 2024-09-12T01:03:46.913 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 27861, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 74, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 8, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 7538, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 26435, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 22, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-12T01:03:46.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 36715, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-12T01:03:46.915 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 92, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 13, 2024-09-12T01:03:46.916 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 12, 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 12, 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 617, 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 66 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-12T01:03:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-09-12T01:03:46.920 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:03:46.920 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-12T01:03:46.920 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-12T01:03:46.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.920 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-12T01:03:46.920 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 17517 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 28, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 10, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 6954, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 6924, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 161258, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 32470219, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 161258, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 161258, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 32470219, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 99093, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 175951381, 2024-09-12T01:03:46.923 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 99093, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 175951381, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T01:03:46.924 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 99093, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 99093, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 99093, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 99093, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:03:46.925 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 6924, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 836812, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 6924, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 89, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 836812, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.926 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55da83bf0500": { 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 57173, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 170844040, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 57173, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 27772, 2024-09-12T01:03:46.927 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 170844040, 2024-09-12T01:03:46.928 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:46.928 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:46.928 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:46.928 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:46.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:46.928 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T01:03:46.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:46 smithi002 ceph-mon[31210]: pgmap v336: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:47.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:46 smithi167 ceph-mon[35234]: pgmap v336: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:47.921 INFO:tasks.check_counter:Daemon mds.b mds.exported=13 2024-09-12T01:03:47.922 INFO:tasks.check_counter:Daemon mds.b mds.imported=13 2024-09-12T01:03:47.922 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=419 2024-09-12T01:03:47.922 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=3 2024-09-12T01:03:47.922 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-12T01:03:47.922 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-12T01:03:47.922 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-12T01:03:47.922 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=24 2024-09-12T01:03:47.922 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T01:03:47.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T01:03:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:03:48.692 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T01:03:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 780, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 911, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1954884, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 570098, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 6, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.075106982, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.032167395, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.018203856, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.016867488, 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 910, 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.046128537, 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000050690 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 323584 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 657, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 685, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 161762, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 330343, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 6, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.057682454, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.017975936, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.013369322, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.020515324, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 682, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.024544511, 2024-09-12T01:03:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000035989 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 122048 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 996, 2024-09-12T01:03:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 974, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1766560, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 369996, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 3, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.125500095, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.039907318, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.064342344, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.028069427, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 973, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.050369204, 2024-09-12T01:03:48.697 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000051766 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1515904, 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 132768 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-12T01:03:48.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3609, 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.098737832, 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000027358 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.699 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-12T01:03:48.700 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 213, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 213, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 213, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-12T01:03:48.701 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 1, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-12T01:03:48.702 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:03:48.703 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.704 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-12T01:03:48.705 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-12T01:03:48.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 951, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-12T01:03:48.707 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 5942683, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 5940595, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 951 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.708 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 4, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 375, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 371, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 2, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 24, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 22, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 213, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 519, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 306, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 51560, 2024-09-12T01:03:48.709 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 215328 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.710 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.714 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-12T01:03:48.715 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.715 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.715 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.715 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-12T01:03:48.715 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.715 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.717 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.719 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.720 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 4, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 2, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 3, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 2570, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-12T01:03:48.723 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:48.724 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 181343, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 47, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:48.726 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8480, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 186, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:48.727 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 165176, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 887, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 2176, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 21, 2024-09-12T01:03:48.728 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 3, 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 2176, 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2176, 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2.137960867, 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000982518 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2176, 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2177 2024-09-12T01:03:48.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 2176, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 2176, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 1399, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 775, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-12T01:03:48.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 1, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-12T01:03:48.731 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-12T01:03:48.732 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 92, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 12, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 4, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 4, 2024-09-12T01:03:48.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-12T01:03:48.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:48.735 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 2429, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 3648781, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 2429, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2429, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 3648781, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.736 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2176, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 1748384, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2176, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1748384, 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:48.737 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2176, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 2176, 2024-09-12T01:03:48.738 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2176, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2176, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:48.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x5640a14c26e0": { 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:48.740 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:48.741 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T01:03:48.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:48 smithi071 ceph-mon[35276]: pgmap v337: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:48.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:48 smithi002 ceph-mon[31210]: pgmap v337: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:49.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:48 smithi167 ceph-mon[35234]: pgmap v337: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:49.558 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T01:03:49.558 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T01:03:49.558 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-12T01:03:49.558 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-12T01:03:49.558 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-12T01:03:49.558 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:03:49.558 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:03:49.559 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-12T01:03:49.559 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T01:03:49.559 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T01:03:49.803 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:03:50.285 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T01:03:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 5327, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 3747, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 5775853, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 3025228, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 10, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.328590551, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.145230817, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.211373189, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.016683920, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3749, 2024-09-12T01:03:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.245754273, 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000065551 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 7420, 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001029653, 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000138 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1530096, 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 144192 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 446, 2024-09-12T01:03:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 632, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 109221, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 1154985, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 54, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 8, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.050698713, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.014725632, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.023695065, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.007529893, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 629, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.047381121, 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000075327 2024-09-12T01:03:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 100, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000015267, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000152 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3856, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 456528 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1872, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 2538, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 687856, 2024-09-12T01:03:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 1566551, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 12, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 7, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.122060754, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.050180121, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.073531710, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.011648879, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2534, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.522694963, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000206272 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2822, 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000439006, 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000155 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 503152, 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 1322800 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-12T01:03:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T01:03:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T01:03:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 879, 2024-09-12T01:03:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.585712215, 2024-09-12T01:03:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000666339 2024-09-12T01:03:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 361, 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.036592801, 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000101365 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 731, 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 636, 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-12T01:03:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 636, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.632092575, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000993856 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 95, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 11, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 20, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 4, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 6, 2024-09-12T01:03:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 10, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 13, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 430, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 1, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 1, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 4, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 1654, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 1173, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 92, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 88, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-12T01:03:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 9, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 290, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 9, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 145, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 868, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 868, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:03:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 868, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 303, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 294, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 576, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 209, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 11, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 469 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 31, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 548, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 313, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 322, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 31, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 212, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 212, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-12T01:03:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 5, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 736, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 9, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 951, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-12T01:03:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 951, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 2, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 5942683, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-12T01:03:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 119, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.328938967, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002764193 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 25, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 466, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 441, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 24, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 286, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 262, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 20, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 666, 2024-09-12T01:03:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 646, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 1, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 482, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 481, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 59724, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 223520 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 1023, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 8, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 731, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 23, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 306, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 69, 2024-09-12T01:03:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.074379465, 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001077963 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4, 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000655035, 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000163758 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-12T01:03:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 288, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.139811102, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000485455 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-12T01:03:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-12T01:03:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 21, 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.008692697, 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000413937 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-12T01:03:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 42, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.026296530, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000626107 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-12T01:03:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 212, 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.382257746, 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001803102 2024-09-12T01:03:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 4, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 2, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-09-12T01:03:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 316, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 158, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 579, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 287671, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 102, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8480, 2024-09-12T01:03:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 186, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 120493, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 427, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-12T01:03:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 1294, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 1814653, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 27, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 1294, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1294, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.708968963, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001320686 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1294, 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1337 2024-09-12T01:03:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 1294, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 878, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 416, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 10, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 10, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 129, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 20, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-12T01:03:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 224, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 868, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 20, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:03:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-12T01:03:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 92, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 13, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 12, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 12, 2024-09-12T01:03:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 47, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 9 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 741 2024-09-12T01:03:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 10, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 212, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 212, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 7641, 2024-09-12T01:03:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 5802323, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 7641, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 7641, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 5802323, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 1294, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 1840689, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1294, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1840689, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 1294, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 1294, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1294, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1294, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 212, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 26036, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 212, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 10, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 26036, 2024-09-12T01:03:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55fffb7f2500": { 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 951, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1748379, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 951, 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 119, 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1748379, 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T01:03:50.912 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:50 smithi071 ceph-mon[35276]: pgmap v338: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:50.938 INFO:tasks.check_counter:Daemon mds.h mds.exported=9 2024-09-12T01:03:50.939 INFO:tasks.check_counter:Daemon mds.h mds.imported=9 2024-09-12T01:03:50.939 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=31 2024-09-12T01:03:50.939 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=548 2024-09-12T01:03:50.939 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-12T01:03:50.939 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:03:50.939 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:03:50.939 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-12T01:03:50.939 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T01:03:50.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T01:03:50.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:50 smithi002 ceph-mon[31210]: pgmap v338: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:51.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:50 smithi167 ceph-mon[35234]: pgmap v338: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:51.186 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:03:51.676 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T01:03:51.676 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:51.676 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 0, 2024-09-12T01:03:51.676 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 2, 2024-09-12T01:03:51.676 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 0, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 0, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 4, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 0, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.001164729, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.000268197, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 2, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 165, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 320, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 186368, 2024-09-12T01:03:51.678 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.010706596, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.006773808, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.001812687, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 162, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.017015758, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000105035 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:51.679 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 186368 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 228, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 216, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1446928, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 132192, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 2, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 1, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.041984417, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.013638137, 2024-09-12T01:03:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.041784420, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 216, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.016443287, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000076126 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1446928, 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 132192 2024-09-12T01:03:51.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:51.682 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:51.684 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 148967, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 29, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:51.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 928, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 2, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 226, 2024-09-12T01:03:51.686 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1412299, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 226, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 226, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1412299, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T01:03:52.494 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-12T01:03:52.494 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-12T01:03:52.494 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-12T01:03:52.494 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-12T01:03:52.494 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-12T01:03:52.494 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-12T01:03:52.494 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-12T01:03:52.494 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-12T01:03:52.494 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T01:03:52.495 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T01:03:52.756 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:03:52.786 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:52 smithi167 ceph-mon[35234]: pgmap v339: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:52.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:52 smithi071 ceph-mon[35276]: pgmap v339: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:52.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:52 smithi002 ceph-mon[31210]: pgmap v339: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:53.301 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 931, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 907, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 39441223, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 348345, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 7, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.125046223, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.037207327, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.076400264, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.019209317, 2024-09-12T01:03:53.302 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 907, 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.040572914, 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000044733 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1519136, 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 133376 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.303 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 1357, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 1516, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 67522163, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 877433, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 9, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 7, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.172675932, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.046540496, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.072416486, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.040095460, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1513, 2024-09-12T01:03:53.304 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.071713378, 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000047398 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 446800 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 646, 2024-09-12T01:03:53.305 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 648, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 66159059, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 205443, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 6, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.080855071, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.019814106, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.042129350, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.014005175, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 646, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.025557546, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000039562 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.306 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-12T01:03:53.307 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4339, 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.110894917, 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000025557 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 0, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 0, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 0, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 0, 2024-09-12T01:03:53.309 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 17887, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 17887, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 17887, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 2, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 0, 2024-09-12T01:03:53.310 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-09-12T01:03:53.311 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 6, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:03:53.312 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 0 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 0, 2024-09-12T01:03:53.313 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:03:53.314 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 57173, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-09-12T01:03:53.315 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 0, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 75, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 6, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 175038344, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 175038232, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.316 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 57173 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 6138, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 13238, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 7100, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 232, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 278, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 46, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 17887, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 18076, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 189, 2024-09-12T01:03:53.317 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 85176, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 215328 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.318 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.319 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.320 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-09-12T01:03:53.321 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.323 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-09-12T01:03:53.324 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.326 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.327 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:03:53.329 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 2, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 6, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 4, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 5, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 0, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 0, 2024-09-12T01:03:53.330 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 6761, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:53.332 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:53.333 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 469673, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 6301, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8480, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 186, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:53.334 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 27111050, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 225930, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 2676, 2024-09-12T01:03:53.335 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 26, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 4, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 2676, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2676, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.629953396, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000982792 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2676, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2677 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.336 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 2676, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 2676, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 1639, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 1034, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-12T01:03:53.337 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 2, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-12T01:03:53.338 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-12T01:03:53.339 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 92, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 12, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 11, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 11, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 2, 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-12T01:03:53.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 0, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-09-12T01:03:53.341 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 0, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 0, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 0, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 2930, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 172842884, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 2930, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:53.342 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2930, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 172842884, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:53.343 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2676, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 170858223, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2676, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 170858223, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-09-12T01:03:53.344 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2676, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2676, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2676, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2676, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.345 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-12T01:03:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x56538dfbe6e0": { 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:53.347 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:53.348 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-12T01:03:54.076 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T01:03:54.076 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-12T01:03:54.076 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-12T01:03:54.077 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-12T01:03:54.077 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-12T01:03:54.077 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:03:54.077 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:03:54.077 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-12T01:03:54.077 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T01:03:54.077 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T01:03:54.329 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:03:54.743 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:54 smithi167 ceph-mon[35234]: pgmap v340: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:54.851 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-12T01:03:54.851 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:54.851 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 1004, 2024-09-12T01:03:54.851 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 982, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1769184, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 372862, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 5, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 1, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.129924558, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.041261782, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.065080801, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.028925186, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 981, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.053284792, 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000054316 2024-09-12T01:03:54.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1516176, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 133408 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 8, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 166, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 3948, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 446330, 2024-09-12T01:03:54.853 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 6, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.011861727, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.006316334, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.003613825, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000071100, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 164, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.020013881, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000122035 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 445632 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 1442, 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 1444, 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1193589, 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 458563, 2024-09-12T01:03:54.855 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 4, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.097291626, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.031957616, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.025029898, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.033578662, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1442, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.049143884, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000034080 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.856 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3726, 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.097518589, 2024-09-12T01:03:54.857 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000026172 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 0, 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 0, 2024-09-12T01:03:54.858 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 113, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 0, 2024-09-12T01:03:54.859 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 113, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 113, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 1, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-09-12T01:03:54.860 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-09-12T01:03:54.861 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:03:54.862 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 0 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-09-12T01:03:54.863 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-09-12T01:03:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 428, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 2, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 2, 2024-09-12T01:03:54.865 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 5020468, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 5017434, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 428 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 20, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 175, 2024-09-12T01:03:54.866 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 155, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 3, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 19, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 16, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 113, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 272, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 159, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 0, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 0, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 51828, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 215328 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-09-12T01:03:54.867 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 0, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 0, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 0, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 0, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.871 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.872 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.874 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.875 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.876 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-09-12T01:03:54.877 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 5, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 4, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 4, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 0, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 0, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 5719, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-12T01:03:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 181966, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 65, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-12T01:03:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8480, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 186, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 135897, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 998, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 2197, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 21, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 3, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 2197, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2197, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.204978704, 2024-09-12T01:03:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000548465 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2197, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2198 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 2197, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 2197, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 1412, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-12T01:03:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 783, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-12T01:03:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 1, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-12T01:03:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 92, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 12, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 4, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 4, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 2, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 0, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 0, 2024-09-12T01:03:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 0, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 0, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 2450, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 2730354, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 2450, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2450, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2730354, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2197, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 826169, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2197, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 826169, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2197, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2197, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2197, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2197, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x562f349786e0": { 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:54.898 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-12T01:03:54.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:54 smithi071 ceph-mon[35276]: pgmap v340: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:54.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:54 smithi002 ceph-mon[31210]: pgmap v340: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:55.586 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T01:03:55.586 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T01:03:55.586 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-12T01:03:55.586 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-12T01:03:55.587 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-12T01:03:55.587 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:03:55.587 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:03:55.587 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-12T01:03:55.587 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T01:03:55.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T01:03:55.836 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 771, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 750, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1665561, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 1570147, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 48, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 9, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.094824974, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.028544341, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.068979354, 2024-09-12T01:03:56.388 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.007654291, 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 747, 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.038558079, 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000051617 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 263, 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000044759, 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000170 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1536816, 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 152448 2024-09-12T01:03:56.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 5414, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 4265, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 4271833, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 1685564, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 11, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.294357866, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.115147139, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.217115770, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.009750750, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4265, 2024-09-12T01:03:56.390 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.150383817, 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000035259 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8767, 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001378127, 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000157 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 252144, 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 734560 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 167, 2024-09-12T01:03:56.391 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 302, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 52388, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 530517, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 18, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.024011569, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.008803177, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.008628742, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.004236743, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 300, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.058179043, 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000193930 2024-09-12T01:03:56.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10, 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000777, 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000077 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 327072 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-09-12T01:03:56.393 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 623, 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.207865477, 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000333652 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 162, 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.009212011, 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000056864 2024-09-12T01:03:56.394 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 485, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 388, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 388, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.398534544, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001027150 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 97, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-09-12T01:03:56.395 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 11, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 45, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 1, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 1, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 43, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 43, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 257, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 1, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 1, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 3, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 1263, 2024-09-12T01:03:56.396 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 743, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 96, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 61, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 7, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 4, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 137, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 4, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 37, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 418, 2024-09-12T01:03:56.397 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 6, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 418, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 5, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 5, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 413, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 119, 2024-09-12T01:03:56.398 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 181, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 2, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 187, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 67, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 8, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 223 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 11, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 509, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 284, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 307, 2024-09-12T01:03:56.399 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 15, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 1, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 80, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 79, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 5, 2024-09-12T01:03:56.400 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 423, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 4, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 428, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 428, 2024-09-12T01:03:56.401 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 2, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 2, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 2, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 5020468, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 144, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.279434852, 2024-09-12T01:03:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001940519 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 32, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 237, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 205, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 16, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 265, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 249, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 45, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 415, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 370, 2024-09-12T01:03:56.403 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 1, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 168, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 167, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 55852, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 223520 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 726, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 8, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 485, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 24, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 127, 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-09-12T01:03:56.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 45, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.079138289, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001758628 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001142188, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000571094 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.405 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 222, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.059552826, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000268255 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.406 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000129839, 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000129839 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.408 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.409 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.409 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-09-12T01:03:56.409 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-09-12T01:03:56.409 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.002515056, 2024-09-12T01:03:56.409 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002515056 2024-09-12T01:03:56.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.409 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 12, 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.002268801, 2024-09-12T01:03:56.410 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000189066 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 9, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.006488872, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000720985 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 13, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.022993486, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001768729 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.411 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.053563565, 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.053563565 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.412 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2, 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.007723150, 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003861575 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-09-12T01:03:56.413 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000535035, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000535035 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 79, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.162483437, 2024-09-12T01:03:56.415 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002056752 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 5, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 4, 2024-09-12T01:03:56.416 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 170, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 170, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 634, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:56.417 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:56.418 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:56.419 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 288247, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 119, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:56.420 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8480, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 186, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 139969, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 1054, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-12T01:03:56.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 731, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 860097, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 28, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 731, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 731, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.054981398, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001443203 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-12T01:03:56.422 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 731, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 778 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 731, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 424, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 307, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 10, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 6, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 150, 2024-09-12T01:03:56.423 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 19, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 91, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 418, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 20, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-12T01:03:56.424 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 2, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-12T01:03:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 92, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 13, 2024-09-12T01:03:56.426 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 49, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 13 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-09-12T01:03:56.427 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 428 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 10, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 79, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 79, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.428 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 6348, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 5367446, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 6348, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 6348, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 5367446, 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:56.429 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 731, 2024-09-12T01:03:56.430 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 870164, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 731, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 870164, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-12T01:03:56.431 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 731, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 731, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 731, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 731, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:03:56.432 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 79, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 10067, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 79, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 6, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 10067, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.433 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x562418c66500": { 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 428, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 826164, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 428, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 144, 2024-09-12T01:03:56.434 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 826164, 2024-09-12T01:03:56.435 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:56.435 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:56.435 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:56.435 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:56.435 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.435 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:56.435 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-12T01:03:56.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:56 smithi071 ceph-mon[35276]: pgmap v341: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:56.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:56 smithi002 ceph-mon[31210]: pgmap v341: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:57.036 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:56 smithi167 ceph-mon[35234]: pgmap v341: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:03:57.185 INFO:tasks.check_counter:Daemon mds.i mds.exported=4 2024-09-12T01:03:57.185 INFO:tasks.check_counter:Daemon mds.i mds.imported=4 2024-09-12T01:03:57.185 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=11 2024-09-12T01:03:57.185 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=509 2024-09-12T01:03:57.185 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-12T01:03:57.186 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:03:57.186 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:03:57.186 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-12T01:03:57.186 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T01:03:57.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T01:03:57.432 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:03:57.963 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-12T01:03:57.963 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 0, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 2, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 0, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 0, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 4, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 0, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.001154308, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.000311587, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:57.964 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 2, 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 166, 2024-09-12T01:03:57.965 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 320, 2024-09-12T01:03:57.966 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 186544, 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 5, 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.010974446, 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.007401128, 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.001316185, 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 163, 2024-09-12T01:03:57.968 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.017576804, 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000107833 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 186544 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:03:57.969 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 230, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 218, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1447472, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 133472, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 2, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 1, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.043886945, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.014945286, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.041037120, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 218, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.015823745, 2024-09-12T01:03:57.970 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000072585 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1447472, 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 133472 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 0, 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-12T01:03:57.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:03:57.972 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:03:57.973 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:03:57.974 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 148967, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 29, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:03:57.975 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 928, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 2, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-12T01:03:57.976 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 228, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 1412559, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 228, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 228, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 1412559, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-12T01:03:57.977 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-12T01:03:58.753 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-12T01:03:58.753 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-12T01:03:58.753 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-12T01:03:58.753 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-12T01:03:58.753 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-12T01:03:58.753 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-12T01:03:58.753 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-12T01:03:58.753 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-12T01:03:58.754 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T01:03:58.764 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T01:03:58.764 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T01:03:58.764 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:03:58.786 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-12T01:03:58.786 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:03:58.848 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T01:03:58.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:03:58 smithi071 ceph-mon[35276]: pgmap v342: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:58.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:03:58 smithi002 ceph-mon[31210]: pgmap v342: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:59.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:03:58 smithi167 ceph-mon[35234]: pgmap v342: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T01:03:59.156 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:03:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 -- 172.21.15.2:0/1307768658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41036e0 msgr2=0x7fc3d4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/1307768658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41036e0 0x7fc3d4107b90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009930 tx=0x7fc3c402a420 comp rx=0 tx=0).stop 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 -- 172.21.15.2:0/1307768658 shutdown_connections 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/1307768658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d41082a0 0x7fc3d410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/1307768658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41036e0 0x7fc3d4107b90 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/1307768658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d4102d30 0x7fc3d4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 -- 172.21.15.2:0/1307768658 >> 172.21.15.2:0/1307768658 conn(0x7fc3d40fc7d0 msgr2=0x7fc3d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 -- 172.21.15.2:0/1307768658 shutdown_connections 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.619+0000 7fc3dc33c640 1 -- 172.21.15.2:0/1307768658 wait complete. 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3dc33c640 1 Processor -- start 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3dc33c640 1 -- start start 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3dc33c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d4102d30 0x7fc3d4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3dc33c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d41036e0 0x7fc3d4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3dc33c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41082a0 0x7fc3d419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3dc33c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4112060 con 0x7fc3d41082a0 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3dc33c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4111ee0 con 0x7fc3d4102d30 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3dc33c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d41121e0 con 0x7fc3d41036e0 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da8d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41082a0 0x7fc3d419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da8d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41082a0 0x7fc3d419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35226/0 (socket says 172.21.15.2:35226) 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da8d9640 1 -- 172.21.15.2:0/4070381233 learned_addr learned my addr 172.21.15.2:0/4070381233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3d98d7640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d41036e0 0x7fc3d4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da0d8640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d4102d30 0x7fc3d4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da8d9640 1 -- 172.21.15.2:0/4070381233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d41036e0 msgr2=0x7fc3d4198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da8d9640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d41036e0 0x7fc3d4198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da8d9640 1 -- 172.21.15.2:0/4070381233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d4102d30 msgr2=0x7fc3d4198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da8d9640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d4102d30 0x7fc3d4198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da8d9640 1 -- 172.21.15.2:0/4070381233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d419d610 con 0x7fc3d41082a0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3d98d7640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d41036e0 0x7fc3d4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.620+0000 7fc3da0d8640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d4102d30 0x7fc3d4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.621+0000 7fc3da8d9640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41082a0 0x7fc3d419cf30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00d750 tx=0x7fc3cc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.621+0000 7fc3cb7fe640 1 -- 172.21.15.2:0/4070381233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc017070 con 0x7fc3d41082a0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.621+0000 7fc3cb7fe640 1 -- 172.21.15.2:0/4070381233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3cc005500 con 0x7fc3d41082a0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.621+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d419d900 con 0x7fc3d41082a0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.621+0000 7fc3cb7fe640 1 -- 172.21.15.2:0/4070381233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc004d90 con 0x7fc3d41082a0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.621+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d41a51e0 con 0x7fc3d41082a0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.622+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d4103110 con 0x7fc3d41082a0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.623+0000 7fc3cb7fe640 1 -- 172.21.15.2:0/4070381233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc3cc004f30 con 0x7fc3d41082a0 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.623+0000 7fc3cb7fe640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3c00a2cf0 0x7fc3c00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:03:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.624+0000 7fc3da0d8640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3c00a2cf0 0x7fc3c00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:03:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.624+0000 7fc3cb7fe640 1 -- 172.21.15.2:0/4070381233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7fc3cc0ceef0 con 0x7fc3d41082a0 2024-09-12T01:03:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.624+0000 7fc3da0d8640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3c00a2cf0 0x7fc3c00a51b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0005c40 tx=0x7fc3d000a430 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:03:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.628+0000 7fc3cb7fe640 1 -- 172.21.15.2:0/4070381233 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3cc09ba90 con 0x7fc3d41082a0 2024-09-12T01:03:59.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.815+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc3d410a2b0 con 0x7fc3d41082a0 2024-09-12T01:03:59.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.816+0000 7fc3cb7fe640 1 -- 172.21.15.2:0/4070381233 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v92) ==== 81+0+976 (secure 0 0 0) 0x7fc3cc09b390 con 0x7fc3d41082a0 2024-09-12T01:03:59.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/761407779 2024-09-13T00:52:54.829221+0000 2024-09-12T01:03:59.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2592542324 2024-09-13T00:43:55.741313+0000 2024-09-12T01:03:59.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2546110907 2024-09-13T00:43:55.741313+0000 2024-09-12T01:03:59.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3975664816 2024-09-13T00:44:20.763419+0000 2024-09-12T01:03:59.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3529963366 2024-09-13T00:52:54.829221+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2832737308 2024-09-13T00:44:20.763419+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/838113285 2024-09-13T00:52:54.829221+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/17217547 2024-09-13T00:52:54.829221+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/288268916 2024-09-13T00:52:54.829221+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/288268916 2024-09-13T00:52:54.829221+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1101153984 2024-09-13T00:43:55.741313+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/975752128 2024-09-13T00:44:20.763419+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/629527126 2024-09-13T00:43:55.741313+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1101153984 2024-09-13T00:43:55.741313+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/975752128 2024-09-13T00:44:20.763419+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/657242146 2024-09-13T00:44:20.763419+0000 2024-09-12T01:03:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/780422410 2024-09-13T00:52:54.829221+0000 2024-09-12T01:03:59.819 INFO:teuthology.orchestra.run.smithi002.stderr:listed 17 entries 2024-09-12T01:03:59.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3c00a2cf0 msgr2=0x7fc3c00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:59.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3c00a2cf0 0x7fc3c00a51b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0005c40 tx=0x7fc3d000a430 comp rx=0 tx=0).stop 2024-09-12T01:03:59.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41082a0 msgr2=0x7fc3d419cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:03:59.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41082a0 0x7fc3d419cf30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00d750 tx=0x7fc3cc00dc10 comp rx=0 tx=0).stop 2024-09-12T01:03:59.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 shutdown_connections 2024-09-12T01:03:59.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc3c00a2cf0 0x7fc3c00a51b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d41082a0 0x7fc3d419cf30 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d41036e0 0x7fc3d4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 --2- 172.21.15.2:0/4070381233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d4102d30 0x7fc3d4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:03:59.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 >> 172.21.15.2:0/4070381233 conn(0x7fc3d40fc7d0 msgr2=0x7fc3d4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:03:59.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 shutdown_connections 2024-09-12T01:03:59.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:03:59.818+0000 7fc3dc33c640 1 -- 172.21.15.2:0/4070381233 wait complete. 2024-09-12T01:04:00.610 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:04:00.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:04:00.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:04:00.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T01:04:00.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:04:00.719 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:04:00.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:04:00.752 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-12T01:04:00.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:04:00.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:04:00.839 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:04:00.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:00 smithi002 ceph-mon[31210]: pgmap v343: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:04:00.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:00 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4070381233' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:04:00.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:04:00.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-12T01:04:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:00 smithi071 ceph-mon[35276]: pgmap v343: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:04:00.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:00 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4070381233' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:04:00.976 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T01:04:00.988 INFO:tasks.cephadm:Teardown begin 2024-09-12T01:04:00.988 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:04:00.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:04:01.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:00 smithi167 ceph-mon[35234]: pgmap v343: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T01:04:01.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:00 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4070381233' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:04:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:04:01.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 -- 172.21.15.2:0/4045775017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c103ff0 msgr2=0x7f825c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:01.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4045775017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c103ff0 0x7f825c1043d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f824c009900 tx=0x7f824c02a410 comp rx=0 tx=0).stop 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 -- 172.21.15.2:0/4045775017 shutdown_connections 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4045775017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825c109120 0x7f825c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4045775017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f825c1049a0 0x7f825c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4045775017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c103ff0 0x7f825c1043d0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 -- 172.21.15.2:0/4045775017 >> 172.21.15.2:0/4045775017 conn(0x7f825c0ffab0 msgr2=0x7f825c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 -- 172.21.15.2:0/4045775017 shutdown_connections 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 -- 172.21.15.2:0/4045775017 wait complete. 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 Processor -- start 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.680+0000 7f8261f6d640 1 -- start start 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8261f6d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825c103ff0 0x7f825c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8261f6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c1049a0 0x7f825c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8261f6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f825c109120 0x7f825c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8261f6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f825c114120 con 0x7f825c1049a0 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8261f6d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f825c113fa0 con 0x7f825c103ff0 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8261f6d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f825c1142a0 con 0x7f825c109120 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c1049a0 0x7f825c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c1049a0 0x7f825c19ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35242/0 (socket says 172.21.15.2:35242) 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 -- 172.21.15.2:0/4112047215 learned_addr learned my addr 172.21.15.2:0/4112047215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f825b7fe640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825c103ff0 0x7f825c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f825bfff640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f825c109120 0x7f825c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 -- 172.21.15.2:0/4112047215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f825c109120 msgr2=0x7f825c19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f825c109120 0x7f825c19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 -- 172.21.15.2:0/4112047215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825c103ff0 msgr2=0x7f825c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825c103ff0 0x7f825c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 -- 172.21.15.2:0/4112047215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825c19f690 con 0x7f825c1049a0 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f8253fff640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c1049a0 0x7f825c19ac20 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f824400d950 tx=0x7f824400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.681+0000 7f82597fa640 1 -- 172.21.15.2:0/4112047215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244017070 con 0x7f825c1049a0 2024-09-12T01:04:01.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.682+0000 7f82597fa640 1 -- 172.21.15.2:0/4112047215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8244009c30 con 0x7f825c1049a0 2024-09-12T01:04:01.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.682+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825c19f980 con 0x7f825c1049a0 2024-09-12T01:04:01.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.682+0000 7f82597fa640 1 -- 172.21.15.2:0/4112047215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824400f6b0 con 0x7f825c1049a0 2024-09-12T01:04:01.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.682+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825c1a7260 con 0x7f825c1049a0 2024-09-12T01:04:01.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.683+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825c1043d0 con 0x7f825c1049a0 2024-09-12T01:04:01.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.684+0000 7f82597fa640 1 -- 172.21.15.2:0/4112047215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f82440109d0 con 0x7f825c1049a0 2024-09-12T01:04:01.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.685+0000 7f82597fa640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f82480a2d70 0x7f82480a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:01.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.685+0000 7f825b7fe640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f82480a2d70 0x7f82480a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:01.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.685+0000 7f82597fa640 1 -- 172.21.15.2:0/4112047215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f82440cf010 con 0x7f825c1049a0 2024-09-12T01:04:01.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.685+0000 7f825b7fe640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f82480a2d70 0x7f82480a5230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f824c009230 tx=0x7f824c0058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:01.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.689+0000 7f82597fa640 1 -- 172.21.15.2:0/4112047215 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8244009de0 con 0x7f825c1049a0 2024-09-12T01:04:01.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.898+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f825c10c300 con 0x7f825c1049a0 2024-09-12T01:04:01.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.899+0000 7f82597fa640 1 -- 172.21.15.2:0/4112047215 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11899 (secure 0 0 0) 0x7f824409b560 con 0x7f825c1049a0 2024-09-12T01:04:01.899 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:04:01.899 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":35,"btime":"2024-09-12T01:01:35:630451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T01:01:35.219926+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T01:04:01.900 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 35 2024-09-12T01:04:01.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f82480a2d70 msgr2=0x7f82480a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:01.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f82480a2d70 0x7f82480a5230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f824c009230 tx=0x7f824c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c1049a0 msgr2=0x7f825c19ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:01.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c1049a0 0x7f825c19ac20 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f824400d950 tx=0x7f824400de10 comp rx=0 tx=0).stop 2024-09-12T01:04:01.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 shutdown_connections 2024-09-12T01:04:01.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f82480a2d70 0x7f82480a5230 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f825c109120 0x7f825c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f825c1049a0 0x7f825c19ac20 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 --2- 172.21.15.2:0/4112047215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825c103ff0 0x7f825c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:01.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 >> 172.21.15.2:0/4112047215 conn(0x7f825c0ffab0 msgr2=0x7f825c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:01.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.901+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 shutdown_connections 2024-09-12T01:04:01.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:01.902+0000 7f8261f6d640 1 -- 172.21.15.2:0/4112047215 wait complete. 2024-09-12T01:04:02.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:04:02.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:02 smithi071 ceph-mon[35276]: pgmap v344: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-12T01:04:02.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:02 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/4112047215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:04:02.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:02 smithi002 ceph-mon[31210]: pgmap v344: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-12T01:04:02.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:02 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/4112047215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:04:03.029 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:04:03.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:02 smithi167 ceph-mon[35234]: pgmap v344: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-12T01:04:03.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:02 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/4112047215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 -- 172.21.15.2:0/2079172429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7024106f50 msgr2=0x7f702410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 --2- 172.21.15.2:0/2079172429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7024106f50 0x7f702410eaf0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f701c009cd0 tx=0x7f701c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 -- 172.21.15.2:0/2079172429 shutdown_connections 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 --2- 172.21.15.2:0/2079172429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7024106f50 0x7f702410eaf0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 --2- 172.21.15.2:0/2079172429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7024100ca0 0x7f7024106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 --2- 172.21.15.2:0/2079172429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70241002f0 0x7f70241006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 -- 172.21.15.2:0/2079172429 >> 172.21.15.2:0/2079172429 conn(0x7f7024077210 msgr2=0x7f70240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 -- 172.21.15.2:0/2079172429 shutdown_connections 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.486+0000 7f7029a4e640 1 -- 172.21.15.2:0/2079172429 wait complete. 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7029a4e640 1 Processor -- start 2024-09-12T01:04:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7029a4e640 1 -- start start 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7029a4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70241002f0 0x7f70241983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7029a4e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7024100ca0 0x7f7024198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7029a4e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7024106f50 0x7f702419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7029a4e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7024111ff0 con 0x7f70241002f0 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7029a4e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7024111e70 con 0x7f7024106f50 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7029a4e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7024112170 con 0x7f7024100ca0 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7022ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70241002f0 0x7f70241983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7022ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70241002f0 0x7f70241983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35260/0 (socket says 172.21.15.2:35260) 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f7022ffd640 1 -- 172.21.15.2:0/3528612480 learned_addr learned my addr 172.21.15.2:0/3528612480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f70237fe640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7024106f50 0x7f702419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.487+0000 7f70227fc640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7024100ca0 0x7f7024198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7022ffd640 1 -- 172.21.15.2:0/3528612480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7024100ca0 msgr2=0x7f7024198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7022ffd640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7024100ca0 0x7f7024198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7022ffd640 1 -- 172.21.15.2:0/3528612480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7024106f50 msgr2=0x7f702419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7022ffd640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7024106f50 0x7f702419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7022ffd640 1 -- 172.21.15.2:0/3528612480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702419d3a0 con 0x7f70241002f0 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7022ffd640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70241002f0 0x7f70241983f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f701400c920 tx=0x7f701400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7028a4c640 1 -- 172.21.15.2:0/3528612480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014007c70 con 0x7f70241002f0 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7028a4c640 1 -- 172.21.15.2:0/3528612480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7014007e10 con 0x7f70241002f0 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702419d690 con 0x7f70241002f0 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7028a4c640 1 -- 172.21.15.2:0/3528612480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014018890 con 0x7f70241002f0 2024-09-12T01:04:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.488+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70241a4f70 con 0x7f70241002f0 2024-09-12T01:04:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.489+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70241006d0 con 0x7f70241002f0 2024-09-12T01:04:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.490+0000 7f7028a4c640 1 -- 172.21.15.2:0/3528612480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f7014018a50 con 0x7f70241002f0 2024-09-12T01:04:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.491+0000 7f7028a4c640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f700c0a2cf0 0x7f700c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.491+0000 7f70227fc640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f700c0a2cf0 0x7f700c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.491+0000 7f7028a4c640 1 -- 172.21.15.2:0/3528612480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f70140cf5b0 con 0x7f70241002f0 2024-09-12T01:04:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.492+0000 7f70227fc640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f700c0a2cf0 0x7f700c0a51b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f70240ff630 tx=0x7f701800b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.495+0000 7f7028a4c640 1 -- 172.21.15.2:0/3528612480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7014014030 con 0x7f70241002f0 2024-09-12T01:04:03.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.709+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f702402d7c0 con 0x7f70241002f0 2024-09-12T01:04:03.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.710+0000 7f7028a4c640 1 -- 172.21.15.2:0/3528612480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11899 (secure 0 0 0) 0x7f701409c0f0 con 0x7f70241002f0 2024-09-12T01:04:03.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:04:03.710 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":35,"btime":"2024-09-12T01:01:35:630451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3365784178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3365784178},{"type":"v1","addr":"172.21.15.2:6835","nonce":3365784178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2798785367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2798785367},{"type":"v1","addr":"172.21.15.2:6837","nonce":2798785367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2069649482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2069649482},{"type":"v1","addr":"172.21.15.2:6839","nonce":2069649482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3604590372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3604590372},{"type":"v1","addr":"172.21.15.2:6841","nonce":3604590372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3994124611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3994124611},{"type":"v1","addr":"172.21.15.71:6833","nonce":3994124611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1821901024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1821901024},{"type":"v1","addr":"172.21.15.167:6833","nonce":1821901024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T00:51:11.599964+0000","modified":"2024-09-12T01:01:35.219926+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/659790149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":659790149},{"type":"v1","addr":"172.21.15.71:6835","nonce":659790149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3315294973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3315294973},{"type":"v1","addr":"172.21.15.167:6835","nonce":3315294973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/2094252120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2094252120},{"type":"v1","addr":"172.21.15.167:6837","nonce":2094252120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.71:6837/2619227560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2619227560},{"type":"v1","addr":"172.21.15.71:6837","nonce":2619227560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/3375026686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3375026686},{"type":"v1","addr":"172.21.15.167:6839","nonce":3375026686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3061730891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3061730891},{"type":"v1","addr":"172.21.15.71:6839","nonce":3061730891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24487,24470]},"id":1}]} 2024-09-12T01:04:03.710 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 35 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f700c0a2cf0 msgr2=0x7f700c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f700c0a2cf0 0x7f700c0a51b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f70240ff630 tx=0x7f701800b390 comp rx=0 tx=0).stop 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70241002f0 msgr2=0x7f70241983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70241002f0 0x7f70241983f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f701400c920 tx=0x7f701400cde0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 shutdown_connections 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f700c0a2cf0 0x7f700c0a51b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7024106f50 0x7f702419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7024100ca0 0x7f7024198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 --2- 172.21.15.2:0/3528612480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70241002f0 0x7f70241983f0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 >> 172.21.15.2:0/3528612480 conn(0x7f7024077210 msgr2=0x7f7024105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:03.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 shutdown_connections 2024-09-12T01:04:03.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:03.712+0000 7f7029a4e640 1 -- 172.21.15.2:0/3528612480 wait complete. 2024-09-12T01:04:04.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:04:04.693 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:04:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:04 smithi167 ceph-mon[35234]: pgmap v345: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:04:04.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:04 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3528612480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:04:04.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:04 smithi071 ceph-mon[35276]: pgmap v345: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:04:04.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:04 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3528612480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:04:04.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:04 smithi002 ceph-mon[31210]: pgmap v345: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:04:04.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:04 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3528612480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:04:05.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 -- 172.21.15.2:0/305853734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc101420 msgr2=0x7f0acc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:05.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 --2- 172.21.15.2:0/305853734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc101420 0x7f0acc10d950 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009cd0 tx=0x7f0ac402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 -- 172.21.15.2:0/305853734 shutdown_connections 2024-09-12T01:04:05.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 --2- 172.21.15.2:0/305853734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc101420 0x7f0acc10d950 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 --2- 172.21.15.2:0/305853734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0acc100a80 0x7f0acc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 --2- 172.21.15.2:0/305853734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc106a80 0x7f0acc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 -- 172.21.15.2:0/305853734 >> 172.21.15.2:0/305853734 conn(0x7f0acc0fc7a0 msgr2=0x7f0acc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:05.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 -- 172.21.15.2:0/305853734 shutdown_connections 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.190+0000 7f0ad273f640 1 -- 172.21.15.2:0/305853734 wait complete. 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad273f640 1 Processor -- start 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad273f640 1 -- start start 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad273f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc100a80 0x7f0acc0fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad273f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0acc101420 0x7f0acc0fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad273f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc106a80 0x7f0acc0fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad273f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc110ea0 con 0x7f0acc100a80 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad273f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc110d20 con 0x7f0acc101420 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad273f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc111020 con 0x7f0acc106a80 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0acbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc100a80 0x7f0acc0fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0acbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc100a80 0x7f0acc0fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35268/0 (socket says 172.21.15.2:35268) 2024-09-12T01:04:05.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0acbfff640 1 -- 172.21.15.2:0/2828396480 learned_addr learned my addr 172.21.15.2:0/2828396480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ac3fff640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0acc101420 0x7f0acc0fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad0cdc640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc106a80 0x7f0acc0fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0acbfff640 1 -- 172.21.15.2:0/2828396480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc106a80 msgr2=0x7f0acc0fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0acbfff640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc106a80 0x7f0acc0fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0acbfff640 1 -- 172.21.15.2:0/2828396480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0acc101420 msgr2=0x7f0acc0fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0acbfff640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0acc101420 0x7f0acc0fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0acbfff640 1 -- 172.21.15.2:0/2828396480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0acc1a6930 con 0x7f0acc100a80 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.191+0000 7f0ad0cdc640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc106a80 0x7f0acc0fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.192+0000 7f0acbfff640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc100a80 0x7f0acc0fcd40 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00b4a0 tx=0x7f0abc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.192+0000 7f0ac9ffb640 1 -- 172.21.15.2:0/2828396480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc014070 con 0x7f0acc100a80 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.192+0000 7f0ac9ffb640 1 -- 172.21.15.2:0/2828396480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0abc010af0 con 0x7f0acc100a80 2024-09-12T01:04:05.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.192+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0acc1a6c20 con 0x7f0acc100a80 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.192+0000 7f0ac9ffb640 1 -- 172.21.15.2:0/2828396480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc017d10 con 0x7f0acc100a80 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.192+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0acc1a7160 con 0x7f0acc100a80 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.193+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0acc100ee0 con 0x7f0acc100a80 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.194+0000 7f0ac9ffb640 1 -- 172.21.15.2:0/2828396480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f0abc017070 con 0x7f0acc100a80 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.195+0000 7f0ac9ffb640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0ab80a2cf0 0x7f0ab80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.195+0000 7f0ac9ffb640 1 -- 172.21.15.2:0/2828396480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8643+0+0 (secure 0 0 0) 0x7f0abc0ceb80 con 0x7f0acc100a80 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.195+0000 7f0ac3fff640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0ab80a2cf0 0x7f0ab80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.195+0000 7f0ac3fff640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0ab80a2cf0 0x7f0ab80a51b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0fe7d0 tx=0x7f0ab400b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:05.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.198+0000 7f0ac9ffb640 1 -- 172.21.15.2:0/2828396480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0abc09b7d0 con 0x7f0acc100a80 2024-09-12T01:04:05.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.374+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0acc0fe270 con 0x7f0acc100a80 2024-09-12T01:04:05.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.376+0000 7f0ac9ffb640 1 -- 172.21.15.2:0/2828396480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23271 (secure 0 0 0) 0x7f0acc0fe270 con 0x7f0acc100a80 2024-09-12T01:04:05.377 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-12T01:04:05.377 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"fsid":"c8315cee-709f-11ef-bcea-c7b262605968","created":"2024-09-12T00:43:32.673347+0000","modified":"2024-09-12T01:03:13.616429+0000","last_up_change":"2024-09-12T00:50:21.808536+0000","last_in_change":"2024-09-12T00:49:57.960246+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:46:35.272846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T00:51:07.745388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T00:51:09.978808+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0b4432c-3283-4d50-9efe-ebf233a7f1aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6803","nonce":791585591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6805","nonce":791585591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6809","nonce":791585591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":791585591},{"type":"v1","addr":"172.21.15.2:6807","nonce":791585591}]},"public_addr":"172.21.15.2:6803/791585591","cluster_addr":"172.21.15.2:6805/791585591","heartbeat_back_addr":"172.21.15.2:6809/791585591","heartbeat_front_addr":"172.21.15.2:6807/791585591","state":["exists","up"]},{"osd":1,"uuid":"e439cd3f-487d-4354-ab99-7d3cada1e585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6801","nonce":683459479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6803","nonce":683459479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6807","nonce":683459479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":683459479},{"type":"v1","addr":"172.21.15.71:6805","nonce":683459479}]},"public_addr":"172.21.15.71:6801/683459479","cluster_addr":"172.21.15.71:6803/683459479","heartbeat_back_addr":"172.21.15.71:6807/683459479","heartbeat_front_addr":"172.21.15.71:6805/683459479","state":["exists","up"]},{"osd":2,"uuid":"fa192766-bc23-47c9-b1ff-343437163ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6801","nonce":1652392713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6803","nonce":1652392713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6807","nonce":1652392713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1652392713},{"type":"v1","addr":"172.21.15.167:6805","nonce":1652392713}]},"public_addr":"172.21.15.167:6801/1652392713","cluster_addr":"172.21.15.167:6803/1652392713","heartbeat_back_addr":"172.21.15.167:6807/1652392713","heartbeat_front_addr":"172.21.15.167:6805/1652392713","state":["exists","up"]},{"osd":3,"uuid":"a26f41bb-17a5-4199-8781-40a93619bb05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6811","nonce":1194146354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6813","nonce":1194146354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6817","nonce":1194146354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1194146354},{"type":"v1","addr":"172.21.15.2:6815","nonce":1194146354}]},"public_addr":"172.21.15.2:6811/1194146354","cluster_addr":"172.21.15.2:6813/1194146354","heartbeat_back_addr":"172.21.15.2:6817/1194146354","heartbeat_front_addr":"172.21.15.2:6815/1194146354","state":["exists","up"]},{"osd":4,"uuid":"47671b0e-1a96-4bdb-b0f6-78d139586f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6809","nonce":3103093163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6811","nonce":3103093163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6815","nonce":3103093163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3103093163},{"type":"v1","addr":"172.21.15.71:6813","nonce":3103093163}]},"public_addr":"172.21.15.71:6809/3103093163","cluster_addr":"172.21.15.71:6811/3103093163","heartbeat_back_addr":"172.21.15.71:6815/3103093163","heartbeat_front_addr":"172.21.15.71:6813/3103093163","state":["exists","up"]},{"osd":5,"uuid":"4d03cf8b-e439-469f-96d6-35be185b6a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6809","nonce":2028440485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6811","nonce":2028440485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6815","nonce":2028440485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2028440485},{"type":"v1","addr":"172.21.15.167:6813","nonce":2028440485}]},"public_addr":"172.21.15.167:6809/2028440485","cluster_addr":"172.21.15.167:6811/2028440485","heartbeat_back_addr":"172.21.15.167:6815/2028440485","heartbeat_front_addr":"172.21.15.167:6813/2028440485","state":["exists","up"]},{"osd":6,"uuid":"3fa40635-b89d-46f4-95a2-19db122e4d3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6819","nonce":2590876261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6821","nonce":2590876261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6825","nonce":2590876261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2590876261},{"type":"v1","addr":"172.21.15.2:6823","nonce":2590876261}]},"public_addr":"172.21.15.2:6819/2590876261","cluster_addr":"172.21.15.2:6821/2590876261","heartbeat_back_addr":"172.21.15.2:6825/2590876261","heartbeat_front_addr":"172.21.15.2:6823/2590876261","state":["exists","up"]},{"osd":7,"uuid":"756dd9c7-23d4-49e5-bf61-aa62aa16dccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6817","nonce":1535182996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6819","nonce":1535182996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6823","nonce":1535182996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1535182996},{"type":"v1","addr":"172.21.15.71:6821","nonce":1535182996}]},"public_addr":"172.21.15.71:6817/1535182996","cluster_addr":"172.21.15.71:6819/1535182996","heartbeat_back_addr":"172.21.15.71:6823/1535182996","heartbeat_front_addr":"172.21.15.71:6821/1535182996","state":["exists","up"]},{"osd":8,"uuid":"1b6ae68b-311e-4fb8-a90b-8d392b44de12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6817","nonce":4071602175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6819","nonce":4071602175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6823","nonce":4071602175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":4071602175},{"type":"v1","addr":"172.21.15.167:6821","nonce":4071602175}]},"public_addr":"172.21.15.167:6817/4071602175","cluster_addr":"172.21.15.167:6819/4071602175","heartbeat_back_addr":"172.21.15.167:6823/4071602175","heartbeat_front_addr":"172.21.15.167:6821/4071602175","state":["exists","up"]},{"osd":9,"uuid":"12040e9d-e418-4d1a-a924-f4ef7d87ab15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6827","nonce":1523652680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6829","nonce":1523652680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6833","nonce":1523652680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1523652680},{"type":"v1","addr":"172.21.15.2:6831","nonce":1523652680}]},"public_addr":"172.21.15.2:6827/1523652680","cluster_addr":"172.21.15.2:6829/1523652680","heartbeat_back_addr":"172.21.15.2:6833/1523652680","heartbeat_front_addr":"172.21.15.2:6831/1523652680","state":["exists","up"]},{"osd":10,"uuid":"d33cc429-55b5-465a-b98d-d205e51e2b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6825","nonce":2261598225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6827","nonce":2261598225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6831","nonce":2261598225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2261598225},{"type":"v1","addr":"172.21.15.71:6829","nonce":2261598225}]},"public_addr":"172.21.15.71:6825/2261598225","cluster_addr":"172.21.15.71:6827/2261598225","heartbeat_back_addr":"172.21.15.71:6831/2261598225","heartbeat_front_addr":"172.21.15.71:6829/2261598225","state":["exists","up"]},{"osd":11,"uuid":"2c26a3b1-7bb2-46c7-91aa-35c21c4d19e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6825","nonce":792671265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6827","nonce":792671265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6831","nonce":792671265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":792671265},{"type":"v1","addr":"172.21.15.167:6829","nonce":792671265}]},"public_addr":"172.21.15.167:6825/792671265","cluster_addr":"172.21.15.167:6827/792671265","heartbeat_back_addr":"172.21.15.167:6831/792671265","heartbeat_front_addr":"172.21.15.167:6829/792671265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:45:43.237720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:08.145269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:33.218537+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:46:59.163443+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:23.068987+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:47:49.090060+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:14.502440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:48:39.222798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:04.730744+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:29.927424+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:49:54.767050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:50:20.247990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":7}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/761407779":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2592542324":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/2546110907":"2024-09-13T00:43:55.741313+0000","172.21.15.2:0/3975664816":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/3529963366":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/2832737308":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/838113285":"2024-09-13T00:52:54.829221+0000","172.21.15.2:0/17217547":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6800/288268916":"2024-09-13T00:52:54.829221+0000","172.21.15.2:6801/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/629527126":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6800/1101153984":"2024-09-13T00:43:55.741313+0000","172.21.15.2:6801/975752128":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/657242146":"2024-09-13T00:44:20.763419+0000","172.21.15.2:0/780422410":"2024-09-13T00:52:54.829221+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:04:05.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.378+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0ab80a2cf0 msgr2=0x7f0ab80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:05.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.378+0000 7f0ad273f640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0ab80a2cf0 0x7f0ab80a51b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0fe7d0 tx=0x7f0ab400b410 comp rx=0 tx=0).stop 2024-09-12T01:04:05.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.378+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc100a80 msgr2=0x7f0acc0fcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:05.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.378+0000 7f0ad273f640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc100a80 0x7f0acc0fcd40 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00b4a0 tx=0x7f0abc00b960 comp rx=0 tx=0).stop 2024-09-12T01:04:05.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.379+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 shutdown_connections 2024-09-12T01:04:05.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.379+0000 7f0ad273f640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f0ab80a2cf0 0x7f0ab80a51b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.379+0000 7f0ad273f640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc106a80 0x7f0acc0fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.379+0000 7f0ad273f640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0acc101420 0x7f0acc0fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.379+0000 7f0ad273f640 1 --2- 172.21.15.2:0/2828396480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc100a80 0x7f0acc0fcd40 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:05.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.379+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 >> 172.21.15.2:0/2828396480 conn(0x7f0acc0fc7a0 msgr2=0x7f0acc06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:05.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.379+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 shutdown_connections 2024-09-12T01:04:05.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:05.379+0000 7f0ad273f640 1 -- 172.21.15.2:0/2828396480 wait complete. 2024-09-12T01:04:05.941 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:05 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2828396480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:04:05.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:05 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2828396480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:04:06.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T01:04:06.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:05 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2828396480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:04:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:04:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.724+0000 7fe025146640 1 -- 172.21.15.2:0/1239188442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0201049a0 msgr2=0x7fe0201089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.724+0000 7fe025146640 1 --2- 172.21.15.2:0/1239188442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0201049a0 0x7fe0201089f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe014009900 tx=0x7fe01402a440 comp rx=0 tx=0).stop 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.726+0000 7fe025146640 1 -- 172.21.15.2:0/1239188442 shutdown_connections 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.726+0000 7fe025146640 1 --2- 172.21.15.2:0/1239188442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020109120 0x7fe020110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.726+0000 7fe025146640 1 --2- 172.21.15.2:0/1239188442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0201049a0 0x7fe0201089f0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.726+0000 7fe025146640 1 --2- 172.21.15.2:0/1239188442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe020103ff0 0x7fe0201043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.726+0000 7fe025146640 1 -- 172.21.15.2:0/1239188442 >> 172.21.15.2:0/1239188442 conn(0x7fe0200ffab0 msgr2=0x7fe020101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.726+0000 7fe025146640 1 -- 172.21.15.2:0/1239188442 shutdown_connections 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.727+0000 7fe025146640 1 -- 172.21.15.2:0/1239188442 wait complete. 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.728+0000 7fe025146640 1 Processor -- start 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.728+0000 7fe025146640 1 -- start start 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe025146640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe020103ff0 0x7fe02010f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe025146640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0201049a0 0x7fe02010fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe025146640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020109120 0x7fe0201aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe025146640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe020077590 con 0x7fe020103ff0 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe01ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe020103ff0 0x7fe02010f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe025146640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe020077410 con 0x7fe0201049a0 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe025146640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe020077710 con 0x7fe020109120 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe01e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0201049a0 0x7fe02010fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe01f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020109120 0x7fe0201aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe01f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020109120 0x7fe0201aa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.2:34478/0 (socket says 172.21.15.2:34478) 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe01e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0201049a0 0x7fe02010fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.2:34700/0 (socket says 172.21.15.2:34700) 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.729+0000 7fe01f59e640 1 -- 172.21.15.2:0/3891016216 learned_addr learned my addr 172.21.15.2:0/3891016216 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.730+0000 7fe01ed9d640 1 -- 172.21.15.2:0/3891016216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020109120 msgr2=0x7fe0201aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:06.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.730+0000 7fe01ed9d640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020109120 0x7fe0201aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.730+0000 7fe01ed9d640 1 -- 172.21.15.2:0/3891016216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0201049a0 msgr2=0x7fe02010fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.730+0000 7fe01ed9d640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0201049a0 0x7fe02010fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.730+0000 7fe01ed9d640 1 -- 172.21.15.2:0/3891016216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0201aaf30 con 0x7fe020103ff0 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.730+0000 7fe01f59e640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020109120 0x7fe0201aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.730+0000 7fe01e59c640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0201049a0 0x7fe02010fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.731+0000 7fe01ed9d640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe020103ff0 0x7fe02010f650 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe01000b3f0 tx=0x7fe01000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.731+0000 7fe007fff640 1 -- 172.21.15.2:0/3891016216 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010015020 con 0x7fe020103ff0 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.731+0000 7fe007fff640 1 -- 172.21.15.2:0/3891016216 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe010011d10 con 0x7fe020103ff0 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.731+0000 7fe007fff640 1 -- 172.21.15.2:0/3891016216 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01000f2e0 con 0x7fe020103ff0 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.731+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0201ab220 con 0x7fe020103ff0 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.731+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0201ab6e0 con 0x7fe020103ff0 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.734+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0201054d0 con 0x7fe020103ff0 2024-09-12T01:04:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.735+0000 7fe007fff640 1 -- 172.21.15.2:0/3891016216 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fe010018020 con 0x7fe020103ff0 2024-09-12T01:04:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.736+0000 7fe007fff640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0080a2e40 0x7fe0080a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.736+0000 7fe007fff640 1 -- 172.21.15.2:0/3891016216 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8687+0+0 (secure 0 0 0) 0x7fe0100cea60 con 0x7fe020103ff0 2024-09-12T01:04:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.740+0000 7fe01e59c640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0080a2e40 0x7fe0080a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.741+0000 7fe01e59c640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0080a2e40 0x7fe0080a5300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe014000c00 tx=0x7fe014031440 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:06.745+0000 7fe007fff640 1 -- 172.21.15.2:0/3891016216 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe01001f020 con 0x7fe020103ff0 2024-09-12T01:04:06.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:06 smithi071 ceph-mon[35276]: pgmap v346: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:04:06.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:06 smithi002 ceph-mon[31210]: pgmap v346: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:04:07.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:06 smithi167 ceph-mon[35234]: pgmap v346: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:04:07.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.137+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe0201aba00 con 0x7fe020103ff0 2024-09-12T01:04:07.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.141+0000 7fe007fff640 1 -- 172.21.15.2:0/3891016216 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) ==== 161+0+0 (secure 0 0 0) 0x7fe01009b6f0 con 0x7fe020103ff0 2024-09-12T01:04:07.141 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:04:07.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.146+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0080a2e40 msgr2=0x7fe0080a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:07.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.146+0000 7fe025146640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0080a2e40 0x7fe0080a5300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe014000c00 tx=0x7fe014031440 comp rx=0 tx=0).stop 2024-09-12T01:04:07.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.146+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe020103ff0 msgr2=0x7fe02010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:07.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.146+0000 7fe025146640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe020103ff0 0x7fe02010f650 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe01000b3f0 tx=0x7fe01000b8b0 comp rx=0 tx=0).stop 2024-09-12T01:04:07.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.147+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 shutdown_connections 2024-09-12T01:04:07.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.147+0000 7fe025146640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fe0080a2e40 0x7fe0080a5300 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:07.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.147+0000 7fe025146640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020109120 0x7fe0201aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:07.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.147+0000 7fe025146640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0201049a0 0x7fe02010fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:07.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.147+0000 7fe025146640 1 --2- 172.21.15.2:0/3891016216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe020103ff0 0x7fe02010f650 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:07.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.147+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 >> 172.21.15.2:0/3891016216 conn(0x7fe0200ffab0 msgr2=0x7fe020100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:07.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.149+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 shutdown_connections 2024-09-12T01:04:07.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:07.149+0000 7fe025146640 1 -- 172.21.15.2:0/3891016216 wait complete. 2024-09-12T01:04:07.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:07 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a[31206]: 2024-09-12T01:04:07.138+0000 7fc4cda07640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:04:07.537 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f[64993]: ignoring --setuser ceph since I am not root 2024-09-12T01:04:07.537 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f[64993]: ignoring --setgroup ceph since I am not root 2024-09-12T01:04:07.537 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f[64993]: starting mds.f at 2024-09-12T01:04:07.537 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c[65295]: ignoring --setuser ceph since I am not root 2024-09-12T01:04:07.537 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c[65295]: ignoring --setgroup ceph since I am not root 2024-09-12T01:04:07.538 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c[65295]: starting mds.c at 2024-09-12T01:04:07.538 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i[65605]: ignoring --setuser ceph since I am not root 2024-09-12T01:04:07.538 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i[65605]: ignoring --setgroup ceph since I am not root 2024-09-12T01:04:07.538 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-mds[65609]: -- 172.21.15.167:0/3891739494 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581ef6afc20 con 0x5581ef68d000 2024-09-12T01:04:07.538 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i[65605]: starting mds.i at 2024-09-12T01:04:07.691 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: ignoring --setuser ceph since I am not root 2024-09-12T01:04:07.692 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: ignoring --setgroup ceph since I am not root 2024-09-12T01:04:07.692 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: starting mds.b at 2024-09-12T01:04:07.692 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e[65361]: ignoring --setuser ceph since I am not root 2024-09-12T01:04:07.692 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e[65361]: ignoring --setgroup ceph since I am not root 2024-09-12T01:04:07.692 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e[65361]: starting mds.e at 2024-09-12T01:04:07.693 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h[65662]: ignoring --setuser ceph since I am not root 2024-09-12T01:04:07.693 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h[65662]: ignoring --setgroup ceph since I am not root 2024-09-12T01:04:07.693 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mds[65666]: -- 172.21.15.71:0/4131712641 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560ce14d2680 con 0x560ce14a7400 2024-09-12T01:04:07.693 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mds[65666]: -- 172.21.15.71:0/4131712641 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ce14c9860 con 0x560ce14a7400 2024-09-12T01:04:07.693 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h[65662]: starting mds.h at 2024-09-12T01:04:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:07 smithi002 ceph-mon[31210]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:04:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:07 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3891016216' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:04:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:07 smithi002 ceph-mon[31210]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:04:07.850 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:07 smithi002 ceph-mon[31210]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:04:07.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:07 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3891016216' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:04:07.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:07 smithi002 ceph-mon[31210]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:04:07.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:07 smithi002 ceph-mon[31210]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T01:04:07.898 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:04:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-mon[35234]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:04:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3891016216' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:04:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-mon[35234]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:04:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-mon[35234]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:04:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3891016216' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:04:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-mon[35234]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:04:08.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:07 smithi167 ceph-mon[35234]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T01:04:08.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mon[35276]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:04:08.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3891016216' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:04:08.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mon[35276]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:04:08.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mon[35276]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:04:08.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3891016216' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:04:08.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mon[35276]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:04:08.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:07 smithi071 ceph-mon[35276]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T01:04:08.198 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:04:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 -- 172.21.15.2:0/2362180853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281082a0 msgr2=0x7f102810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2362180853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281082a0 0x7f102810ec40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f1020009cd0 tx=0x7f102002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 -- 172.21.15.2:0/2362180853 shutdown_connections 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2362180853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281082a0 0x7f102810ec40 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2362180853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10281036e0 0x7f1028107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2362180853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1028102d30 0x7f1028103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 -- 172.21.15.2:0/2362180853 >> 172.21.15.2:0/2362180853 conn(0x7f10280fc7d0 msgr2=0x7f10280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 -- 172.21.15.2:0/2362180853 shutdown_connections 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.688+0000 7f102ffc0640 1 -- 172.21.15.2:0/2362180853 wait complete. 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102ffc0640 1 Processor -- start 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102ffc0640 1 -- start start 2024-09-12T01:04:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102ffc0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1028102d30 0x7f10281a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102ffc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281036e0 0x7f10281a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102ffc0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10281082a0 0x7f102819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102ffc0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f10281120a0 con 0x7f10281036e0 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102ffc0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1028111f20 con 0x7f10281082a0 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102ffc0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1028112220 con 0x7f1028102d30 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102d55b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281036e0 0x7f10281a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102d55b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281036e0 0x7f10281a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51490/0 (socket says 172.21.15.2:51490) 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102d55b640 1 -- 172.21.15.2:0/2678314678 learned_addr learned my addr 172.21.15.2:0/2678314678 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102dd5c640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1028102d30 0x7f10281a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102e55d640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10281082a0 0x7f102819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102d55b640 1 -- 172.21.15.2:0/2678314678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1028102d30 msgr2=0x7f10281a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102d55b640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1028102d30 0x7f10281a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102d55b640 1 -- 172.21.15.2:0/2678314678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10281082a0 msgr2=0x7f102819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102d55b640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10281082a0 0x7f102819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102d55b640 1 -- 172.21.15.2:0/2678314678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102819ace0 con 0x7f10281036e0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.689+0000 7f102e55d640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10281082a0 0x7f102819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.690+0000 7f102d55b640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281036e0 0x7f10281a0930 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f101800d750 tx=0x7f101800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.690+0000 7f101effd640 1 -- 172.21.15.2:0/2678314678 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018017070 con 0x7f10281036e0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.690+0000 7f101effd640 1 -- 172.21.15.2:0/2678314678 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1018005500 con 0x7f10281036e0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.690+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102819afd0 con 0x7f10281036e0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.690+0000 7f101effd640 1 -- 172.21.15.2:0/2678314678 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018004e00 con 0x7f10281036e0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.690+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10281a72c0 con 0x7f10281036e0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.691+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1028103110 con 0x7f10281036e0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.692+0000 7f101effd640 1 -- 172.21.15.2:0/2678314678 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f1018004fa0 con 0x7f10281036e0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.693+0000 7f101effd640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f10140a2d70 0x7f10140a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.693+0000 7f102dd5c640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f10140a2d70 0x7f10140a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.693+0000 7f101effd640 1 -- 172.21.15.2:0/2678314678 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8901+0+0 (secure 0 0 0) 0x7f10180cf340 con 0x7f10281036e0 2024-09-12T01:04:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.694+0000 7f102dd5c640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f10140a2d70 0x7f10140a5230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1024005fd0 tx=0x7f102400b590 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.697+0000 7f101effd640 1 -- 172.21.15.2:0/2678314678 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f101809be60 con 0x7f10281036e0 2024-09-12T01:04:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:08.910+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f102810c2c0 con 0x7f10281036e0 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: pgmap v348: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6834/114419411,v1:172.21.15.71:6835/114419411] up:boot 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.167:6834/788861779,v1:172.21.15.167:6835/788861779] up:boot 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6836/187771679,v1:172.21.15.71:6837/187771679] up:boot 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.71:6838/1867875982,v1:172.21.15.71:6839/1867875982] up:boot 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.167:6836/4235804547,v1:172.21.15.167:6837/4235804547] up:boot 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: mds.? [v2:172.21.15.167:6838/516650838,v1:172.21.15.167:6839/516650838] up:boot 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:04:08.911 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:04:08.911 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:04:08.911 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:04:08.911 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:04:08.911 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:08 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:04:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: pgmap v348: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-12T01:04:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6834/114419411,v1:172.21.15.71:6835/114419411] up:boot 2024-09-12T01:04:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.167:6834/788861779,v1:172.21.15.167:6835/788861779] up:boot 2024-09-12T01:04:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6836/187771679,v1:172.21.15.71:6837/187771679] up:boot 2024-09-12T01:04:09.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.71:6838/1867875982,v1:172.21.15.71:6839/1867875982] up:boot 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.167:6836/4235804547,v1:172.21.15.167:6837/4235804547] up:boot 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: mds.? [v2:172.21.15.167:6838/516650838,v1:172.21.15.167:6839/516650838] up:boot 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:04:09.038 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:08 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: pgmap v348: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6834/114419411,v1:172.21.15.71:6835/114419411] up:boot 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.167:6834/788861779,v1:172.21.15.167:6835/788861779] up:boot 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6836/187771679,v1:172.21.15.71:6837/187771679] up:boot 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.71:6838/1867875982,v1:172.21.15.71:6839/1867875982] up:boot 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.167:6836/4235804547,v1:172.21.15.167:6837/4235804547] up:boot 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: mds.? [v2:172.21.15.167:6838/516650838,v1:172.21.15.167:6839/516650838] up:boot 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T01:04:09.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:04:09.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:04:09.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:04:09.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:04:09.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:04:09.193 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:08 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.714+0000 7f101effd640 1 -- 172.21.15.2:0/2678314678 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f101809b760 con 0x7f10281036e0 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f10140a2d70 msgr2=0x7f10140a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f10140a2d70 0x7f10140a5230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1024005fd0 tx=0x7f102400b590 comp rx=0 tx=0).stop 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281036e0 msgr2=0x7f10281a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281036e0 0x7f10281a0930 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f101800d750 tx=0x7f101800dc10 comp rx=0 tx=0).stop 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 shutdown_connections 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f10140a2d70 0x7f10140a5230 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10281082a0 0x7f102819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10281036e0 0x7f10281a0930 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 --2- 172.21.15.2:0/2678314678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1028102d30 0x7f10281a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 >> 172.21.15.2:0/2678314678 conn(0x7f10280fc7d0 msgr2=0x7f10281011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 shutdown_connections 2024-09-12T01:04:09.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:09.717+0000 7f102ffc0640 1 -- 172.21.15.2:0/2678314678 wait complete. 2024-09-12T01:04:09.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:09 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2678314678' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:04:10.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:09 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2678314678' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:04:10.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:09 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2678314678' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:04:10.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:04:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:10 smithi002 ceph-mon[31210]: pgmap v350: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-09-12T01:04:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:10 smithi002 ceph-mon[31210]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:04:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:10 smithi002 ceph-mon[31210]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:04:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:10 smithi002 ceph-mon[31210]: Cluster is now healthy 2024-09-12T01:04:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:10 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/2678314678' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:04:10.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:10 smithi002 ceph-mon[31210]: fsmap 12 up:standby 2024-09-12T01:04:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:04:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:10 smithi167 ceph-mon[35234]: pgmap v350: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-09-12T01:04:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:10 smithi167 ceph-mon[35234]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:04:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:10 smithi167 ceph-mon[35234]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:04:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:10 smithi167 ceph-mon[35234]: Cluster is now healthy 2024-09-12T01:04:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:10 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/2678314678' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:04:11.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:10 smithi167 ceph-mon[35234]: fsmap 12 up:standby 2024-09-12T01:04:11.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:10 smithi071 ceph-mon[35276]: pgmap v350: 97 pgs: 97 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-09-12T01:04:11.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:10 smithi071 ceph-mon[35276]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:04:11.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:10 smithi071 ceph-mon[35276]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:04:11.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:10 smithi071 ceph-mon[35276]: Cluster is now healthy 2024-09-12T01:04:11.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:10 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/2678314678' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:04:11.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:10 smithi071 ceph-mon[35276]: fsmap 12 up:standby 2024-09-12T01:04:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 -- 172.21.15.2:0/2806368396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24641036e0 msgr2=0x7f2464107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 --2- 172.21.15.2:0/2806368396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24641036e0 0x7f2464107b90 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2458009930 tx=0x7f245802a420 comp rx=0 tx=0).stop 2024-09-12T01:04:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 -- 172.21.15.2:0/2806368396 shutdown_connections 2024-09-12T01:04:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 --2- 172.21.15.2:0/2806368396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24641082a0 0x7f246410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 --2- 172.21.15.2:0/2806368396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24641036e0 0x7f2464107b90 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 --2- 172.21.15.2:0/2806368396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2464102d30 0x7f2464103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 -- 172.21.15.2:0/2806368396 >> 172.21.15.2:0/2806368396 conn(0x7f24640fc7d0 msgr2=0x7f24640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 -- 172.21.15.2:0/2806368396 shutdown_connections 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.250+0000 7f24690f0640 1 -- 172.21.15.2:0/2806368396 wait complete. 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.251+0000 7f24690f0640 1 Processor -- start 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.251+0000 7f24690f0640 1 -- start start 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f24690f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464102d30 0x7f2464198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f24690f0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24641036e0 0x7f2464198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f24690f0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24641082a0 0x7f246419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f24690f0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24641120a0 con 0x7f2464102d30 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f24690f0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2464111f20 con 0x7f24641036e0 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f24690f0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2464112220 con 0x7f24641082a0 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464102d30 0x7f2464198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464102d30 0x7f2464198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51498/0 (socket says 172.21.15.2:51498) 2024-09-12T01:04:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 -- 172.21.15.2:0/3797398229 learned_addr learned my addr 172.21.15.2:0/3797398229 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f246259c640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24641036e0 0x7f2464198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f246359e640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24641082a0 0x7f246419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 -- 172.21.15.2:0/3797398229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24641082a0 msgr2=0x7f246419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24641082a0 0x7f246419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 -- 172.21.15.2:0/3797398229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24641036e0 msgr2=0x7f2464198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24641036e0 0x7f2464198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 -- 172.21.15.2:0/3797398229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246419d5c0 con 0x7f2464102d30 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f246359e640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24641082a0 0x7f246419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.252+0000 7f2462d9d640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464102d30 0x7f2464198610 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f245400c920 tx=0x7f245400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.253+0000 7f244bfff640 1 -- 172.21.15.2:0/3797398229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454007c70 con 0x7f2464102d30 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.253+0000 7f244bfff640 1 -- 172.21.15.2:0/3797398229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2454007e10 con 0x7f2464102d30 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.253+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f246419d8b0 con 0x7f2464102d30 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.253+0000 7f244bfff640 1 -- 172.21.15.2:0/3797398229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454018890 con 0x7f2464102d30 2024-09-12T01:04:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.253+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24641a5190 con 0x7f2464102d30 2024-09-12T01:04:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.254+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2464103110 con 0x7f2464102d30 2024-09-12T01:04:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.255+0000 7f244bfff640 1 -- 172.21.15.2:0/3797398229 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7f2454018a50 con 0x7f2464102d30 2024-09-12T01:04:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.256+0000 7f244bfff640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f244c0a2cf0 0x7f244c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.256+0000 7f246259c640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f244c0a2cf0 0x7f244c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.256+0000 7f244bfff640 1 -- 172.21.15.2:0/3797398229 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8901+0+0 (secure 0 0 0) 0x7f24540cf9b0 con 0x7f2464102d30 2024-09-12T01:04:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.256+0000 7f246259c640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f244c0a2cf0 0x7f244c0a51b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2458005940 tx=0x7f24580058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.259+0000 7f244bfff640 1 -- 172.21.15.2:0/3797398229 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2454014030 con 0x7f2464102d30 2024-09-12T01:04:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.434+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2464199970 con 0x7f2464102d30 2024-09-12T01:04:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.716+0000 7f244bfff640 1 -- 172.21.15.2:0/3797398229 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7f2464199970 con 0x7f2464102d30 2024-09-12T01:04:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:04:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f244c0a2cf0 msgr2=0x7f244c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f244c0a2cf0 0x7f244c0a51b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2458005940 tx=0x7f24580058d0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464102d30 msgr2=0x7f2464198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464102d30 0x7f2464198610 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f245400c920 tx=0x7f245400cde0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 shutdown_connections 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7f244c0a2cf0 0x7f244c0a51b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24641082a0 0x7f246419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24641036e0 0x7f2464198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 --2- 172.21.15.2:0/3797398229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464102d30 0x7f2464198610 secure :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f245400c920 tx=0x7f245400cde0 comp rx=0 tx=0).stop 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.719+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 >> 172.21.15.2:0/3797398229 conn(0x7f24640fc7d0 msgr2=0x7f2464105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.720+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 shutdown_connections 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:11.720+0000 7f24690f0640 1 -- 172.21.15.2:0/3797398229 wait complete. 2024-09-12T01:04:11.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:11 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3797398229' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:04:12.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:11 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3797398229' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:04:12.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:11 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3797398229' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:04:12.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c8315cee-709f-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:04:12.820 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:04:12.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:12 smithi002 ceph-mon[31210]: pgmap v351: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-09-12T01:04:12.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:12 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/3797398229' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:04:12.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:12 smithi002 ceph-mon[31210]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T01:04:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:12 smithi167 ceph-mon[35234]: pgmap v351: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-09-12T01:04:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:12 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/3797398229' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:04:13.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:12 smithi167 ceph-mon[35234]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T01:04:13.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:12 smithi071 ceph-mon[35276]: pgmap v351: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-09-12T01:04:13.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:12 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/3797398229' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:04:13.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:12 smithi071 ceph-mon[35276]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T01:04:13.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/2030954706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d010c180 msgr2=0x7fc7d010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:13.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/2030954706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d010c180 0x7fc7d010e610 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009ca0 tx=0x7fc7c802a950 comp rx=0 tx=0).stop 2024-09-12T01:04:13.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/2030954706 shutdown_connections 2024-09-12T01:04:13.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/2030954706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d010c180 0x7fc7d010e610 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/2030954706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d0103700 0x7fc7d010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/2030954706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7d0102de0 0x7fc7d01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/2030954706 >> 172.21.15.2:0/2030954706 conn(0x7fc7d00fc7a0 msgr2=0x7fc7d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/2030954706 shutdown_connections 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.289+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/2030954706 wait complete. 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d6d5e640 1 Processor -- start 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d6d5e640 1 -- start start 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d6d5e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7d0102de0 0x7fc7d019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d6d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d0103700 0x7fc7d019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:13.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d6d5e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d010c180 0x7fc7d019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:13.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d6d5e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0111fc0 con 0x7fc7d0103700 2024-09-12T01:04:13.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d6d5e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0111e40 con 0x7fc7d010c180 2024-09-12T01:04:13.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d6d5e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0112140 con 0x7fc7d0102de0 2024-09-12T01:04:13.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d0103700 0x7fc7d019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:13.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d0103700 0x7fc7d019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51516/0 (socket says 172.21.15.2:51516) 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7cffff640 1 -- 172.21.15.2:0/1554419570 learned_addr learned my addr 172.21.15.2:0/1554419570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.290+0000 7fc7d52fb640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d010c180 0x7fc7d019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7d4afa640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7d0102de0 0x7fc7d019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cffff640 1 -- 172.21.15.2:0/1554419570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7d0102de0 msgr2=0x7fc7d019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cffff640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7d0102de0 0x7fc7d019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cffff640 1 -- 172.21.15.2:0/1554419570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d010c180 msgr2=0x7fc7d019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cffff640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d010c180 0x7fc7d019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cffff640 1 -- 172.21.15.2:0/1554419570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d019f590 con 0x7fc7d0103700 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7d4afa640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7d0102de0 0x7fc7d019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cffff640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d0103700 0x7fc7d019ab20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400d950 tx=0x7fc7c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cdffb640 1 -- 172.21.15.2:0/1554419570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4017070 con 0x7fc7d0103700 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cdffb640 1 -- 172.21.15.2:0/1554419570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c4009c30 con 0x7fc7d0103700 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d019f880 con 0x7fc7d0103700 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7cdffb640 1 -- 172.21.15.2:0/1554419570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400f6b0 con 0x7fc7d0103700 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.291+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d01a7160 con 0x7fc7d0103700 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.292+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d01031c0 con 0x7fc7d0103700 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.293+0000 7fc7cdffb640 1 -- 172.21.15.2:0/1554419570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 137963+0+0 (secure 0 0 0) 0x7fc7c40109d0 con 0x7fc7d0103700 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.294+0000 7fc7cdffb640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc7b80a2cf0 0x7fc7b80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.294+0000 7fc7d4afa640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc7b80a2cf0 0x7fc7b80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.295+0000 7fc7cdffb640 1 -- 172.21.15.2:0/1554419570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8318+0+0 (secure 0 0 0) 0x7fc7c40cef70 con 0x7fc7d0103700 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.295+0000 7fc7d4afa640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc7b80a2cf0 0x7fc7b80a51b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0005fd0 tx=0x7fc7c0005ea0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.299+0000 7fc7cdffb640 1 -- 172.21.15.2:0/1554419570 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7c4009de0 con 0x7fc7d0103700 2024-09-12T01:04:13.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.475+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc7d01a73c0 con 0x7fc7d0103700 2024-09-12T01:04:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.632+0000 7fc7cdffb640 1 -- 172.21.15.2:0/1554419570 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7fc7c409bc00 con 0x7fc7d0103700 2024-09-12T01:04:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-09-12T01:04:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc7b80a2cf0 msgr2=0x7fc7b80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc7b80a2cf0 0x7fc7b80a51b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0005fd0 tx=0x7fc7c0005ea0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d0103700 msgr2=0x7fc7d019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:04:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d0103700 0x7fc7d019ab20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400d950 tx=0x7fc7c400de10 comp rx=0 tx=0).stop 2024-09-12T01:04:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 shutdown_connections 2024-09-12T01:04:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:6800/606710864,v1:172.21.15.2:6801/606710864] conn(0x7fc7b80a2cf0 0x7fc7b80a51b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d010c180 0x7fc7d019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7d0103700 0x7fc7d019ab20 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 --2- 172.21.15.2:0/1554419570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7d0102de0 0x7fc7d019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:04:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 >> 172.21.15.2:0/1554419570 conn(0x7fc7d00fc7a0 msgr2=0x7fc7d00fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:04:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 shutdown_connections 2024-09-12T01:04:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-12T01:04:13.636+0000 7fc7d6d5e640 1 -- 172.21.15.2:0/1554419570 wait complete. 2024-09-12T01:04:13.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:13 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1554419570' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:04:13.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:13 smithi002 ceph-mon[31210]: from='client.? 172.21.15.2:0/1554419570' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:04:13.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:13 smithi002 ceph-mon[31210]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T01:04:13.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:13 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:04:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:13 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1554419570' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:04:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:13 smithi167 ceph-mon[35234]: from='client.? 172.21.15.2:0/1554419570' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:04:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:13 smithi167 ceph-mon[35234]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T01:04:14.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:13 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:04:14.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:13 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1554419570' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:04:14.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:13 smithi071 ceph-mon[35276]: from='client.? 172.21.15.2:0/1554419570' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:04:14.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:13 smithi071 ceph-mon[35276]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T01:04:14.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:13 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:04:14.501 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:04:14.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:04:14.556 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:04:14.583 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T01:04:14.583 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:04:14.599 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:04:14.615 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:04:14.638 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T01:04:14.638 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T01:04:14.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a 2024-09-12T01:04:14.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:14 smithi002 systemd[1]: Stopping Ceph mon.a for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:14.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:14 smithi002 ceph-mon[31210]: pgmap v353: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:04:14.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:04:14.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:04:14.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:14 smithi002 ceph-mon[31210]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:04:14.942 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:14 smithi071 ceph-mon[35276]: pgmap v353: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:04:15.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:04:15.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:04:15.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:14 smithi071 ceph-mon[35276]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:04:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:14 smithi167 ceph-mon[35234]: pgmap v353: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:04:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:04:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:04:15.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:14 smithi167 ceph-mon[35234]: from='mgr.15132 172.21.15.2:0/3105931613' entity='mgr.x' 2024-09-12T01:04:15.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a[31206]: 2024-09-12T01:04:14.937+0000 7fc4d3212640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:15.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a[31206]: 2024-09-12T01:04:14.937+0000 7fc4d3212640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T01:04:15.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:15 smithi002 podman[130458]: 2024-09-12 01:04:15.162781835 +0000 UTC m=+0.319661789 container died d0b1da0b7a44889e0725620949f78bcb5084f6d52037e72b5091539afe7d0b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T01:04:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:15 smithi002 podman[130458]: 2024-09-12 01:04:15.679462851 +0000 UTC m=+0.836342806 container cleanup d0b1da0b7a44889e0725620949f78bcb5084f6d52037e72b5091539afe7d0b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:04:15.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:15 smithi002 bash[130458]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a 2024-09-12T01:04:16.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:16 smithi002 podman[130472]: 2024-09-12 01:04:16.006270653 +0000 UTC m=+0.838047601 container remove d0b1da0b7a44889e0725620949f78bcb5084f6d52037e72b5091539afe7d0b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:04:16.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:16 smithi002 systemd[1]: ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T01:04:16.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 12 01:04:16 smithi002 systemd[1]: Stopped Ceph mon.a for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T01:04:16.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T01:04:16.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:16.303 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T01:04:16.303 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T01:04:16.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.b 2024-09-12T01:04:16.614 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:16 smithi071 systemd[1]: Stopping Ceph mon.b for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:16.869 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-b[35272]: 2024-09-12T01:04:16.614+0000 7f0d4b659640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:16.869 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-b[35272]: 2024-09-12T01:04:16.614+0000 7f0d4b659640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T01:04:17.148 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:16 smithi071 podman[71328]: 2024-09-12 01:04:16.87056541 +0000 UTC m=+0.367967051 container died 0c4c712afd0711a7bfa27152b7f56a98966e53e4f03556b1a363089ab26d5d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T01:04:17.431 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:17 smithi071 podman[71328]: 2024-09-12 01:04:17.207066961 +0000 UTC m=+0.704468605 container cleanup 0c4c712afd0711a7bfa27152b7f56a98966e53e4f03556b1a363089ab26d5d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T01:04:17.432 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:17 smithi071 bash[71328]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-b 2024-09-12T01:04:17.685 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 01:04:17 smithi071 podman[71341]: 2024-09-12 01:04:17.433211923 +0000 UTC m=+0.564334439 container remove 0c4c712afd0711a7bfa27152b7f56a98966e53e4f03556b1a363089ab26d5d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-b, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T01:04:17.690 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T01:04:17.742 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:17.742 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T01:04:17.742 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T01:04:17.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.c 2024-09-12T01:04:18.037 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:17 smithi167 systemd[1]: Stopping Ceph mon.c for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:18.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:18 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c[35212]: 2024-09-12T01:04:18.046+0000 7efcc5678640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:18.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:18 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c[35212]: 2024-09-12T01:04:18.046+0000 7efcc5678640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T01:04:18.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:18 smithi167 podman[71270]: 2024-09-12 01:04:18.240277598 +0000 UTC m=+0.299848889 container died bf55787134d2277c7af328ddec0a19b7a33229482ad09e230e3707adb6a8abd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T01:04:18.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:18 smithi167 podman[71270]: 2024-09-12 01:04:18.67147608 +0000 UTC m=+0.731047369 container cleanup bf55787134d2277c7af328ddec0a19b7a33229482ad09e230e3707adb6a8abd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:04:18.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:18 smithi167 bash[71270]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c 2024-09-12T01:04:19.230 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 12 01:04:18 smithi167 podman[71283]: 2024-09-12 01:04:18.981319775 +0000 UTC m=+0.738775366 container remove bf55787134d2277c7af328ddec0a19b7a33229482ad09e230e3707adb6a8abd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T01:04:19.235 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T01:04:19.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:19.284 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T01:04:19.284 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T01:04:19.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.x 2024-09-12T01:04:19.574 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 01:04:19 smithi002 systemd[1]: Stopping Ceph mgr.x for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:19.874 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 01:04:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x[31436]: 2024-09-12T01:04:19.575+0000 7f0f2f96f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:19.875 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 01:04:19 smithi002 podman[130582]: 2024-09-12 01:04:19.606563422 +0000 UTC m=+0.122702636 container died ef1c39039cff0cd1f31e51687e60ad5930734f894e1fe7e6097168b692318f56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T01:04:20.245 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 01:04:20 smithi002 podman[130582]: 2024-09-12 01:04:20.02568645 +0000 UTC m=+0.541825706 container cleanup ef1c39039cff0cd1f31e51687e60ad5930734f894e1fe7e6097168b692318f56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T01:04:20.245 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 01:04:20 smithi002 bash[130582]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x 2024-09-12T01:04:20.590 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 12 01:04:20 smithi002 podman[130594]: 2024-09-12 01:04:20.311088616 +0000 UTC m=+0.699320136 container remove ef1c39039cff0cd1f31e51687e60ad5930734f894e1fe7e6097168b692318f56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-x, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:04:20.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T01:04:20.648 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:20.648 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T01:04:20.648 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T01:04:20.648 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.y 2024-09-12T01:04:20.941 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 01:04:20 smithi071 systemd[1]: Stopping Ceph mgr.y for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:21.293 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 01:04:20 smithi071 podman[71448]: 2024-09-12 01:04:20.989695027 +0000 UTC m=+0.131578389 container died eb9232484a384512bbc84e08111ffbda874abfda2dae3155b4cbbd6a6b276f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T01:04:21.626 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 01:04:21 smithi071 podman[71448]: 2024-09-12 01:04:21.394029281 +0000 UTC m=+0.535912645 container cleanup eb9232484a384512bbc84e08111ffbda874abfda2dae3155b4cbbd6a6b276f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T01:04:21.627 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 01:04:21 smithi071 bash[71448]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-y 2024-09-12T01:04:21.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T01:04:21.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:21.797 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T01:04:21.797 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T01:04:21.797 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.z 2024-09-12T01:04:22.129 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 01:04:21 smithi167 systemd[1]: Stopping Ceph mgr.z for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:22.433 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 01:04:22 smithi167 podman[71405]: 2024-09-12 01:04:22.130007723 +0000 UTC m=+0.126109804 container died 925b74cc6ea276796b9be5806fb82acf59ded3f563e41c0e6937886618b596c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-12T01:04:22.776 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 01:04:22 smithi167 podman[71405]: 2024-09-12 01:04:22.534573739 +0000 UTC m=+0.530675820 container cleanup 925b74cc6ea276796b9be5806fb82acf59ded3f563e41c0e6937886618b596c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T01:04:22.776 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 12 01:04:22 smithi167 bash[71405]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mgr-z 2024-09-12T01:04:22.948 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T01:04:22.984 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:22.985 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T01:04:22.985 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T01:04:22.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.0 2024-09-12T01:04:23.297 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:23 smithi002 systemd[1]: Stopping Ceph osd.0 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:23.745 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:23 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:04:23.298+0000 7f0f0a3f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:23.745 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:23 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:04:23.298+0000 7f0f0a3f6640 -1 osd.0 96 *** Got signal Terminated *** 2024-09-12T01:04:23.745 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:23 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:04:23.298+0000 7f0f0a3f6640 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:04:29.180 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:28 smithi002 podman[130703]: 2024-09-12 01:04:28.829789607 +0000 UTC m=+5.637120674 container died 40c2ad13e743711225a9595a9ee5c860603041fdd1a2c2709a64cea9562f1d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:04:29.464 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:29 smithi002 podman[130703]: 2024-09-12 01:04:29.181925752 +0000 UTC m=+5.989256872 container cleanup 40c2ad13e743711225a9595a9ee5c860603041fdd1a2c2709a64cea9562f1d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:04:29.465 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:29 smithi002 bash[130703]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0 2024-09-12T01:04:29.744 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:29 smithi002 podman[130718]: 2024-09-12 01:04:29.466566537 +0000 UTC m=+0.632288468 container remove 40c2ad13e743711225a9595a9ee5c860603041fdd1a2c2709a64cea9562f1d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T01:04:30.093 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:29 smithi002 podman[130810]: 2024-09-12 01:04:29.709708455 +0000 UTC m=+0.016522733 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:04:30.093 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:29 smithi002 podman[130810]: 2024-09-12 01:04:29.85104123 +0000 UTC m=+0.157855500 container create b3c440a82a06842e6731465cd9b97f157c1093b400cd98a7f9b1fac29df06b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:04:30.093 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:30 smithi002 podman[130810]: 2024-09-12 01:04:30.095200161 +0000 UTC m=+0.402014437 container init b3c440a82a06842e6731465cd9b97f157c1093b400cd98a7f9b1fac29df06b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T01:04:30.495 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:30 smithi002 podman[130810]: 2024-09-12 01:04:30.098802985 +0000 UTC m=+0.405617254 container start b3c440a82a06842e6731465cd9b97f157c1093b400cd98a7f9b1fac29df06b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:04:30.495 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:30 smithi002 podman[130810]: 2024-09-12 01:04:30.220664935 +0000 UTC m=+0.527479206 container attach b3c440a82a06842e6731465cd9b97f157c1093b400cd98a7f9b1fac29df06b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T01:04:30.496 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 12 01:04:30 smithi002 podman[130810]: 2024-09-12 01:04:30.299871421 +0000 UTC m=+0.606685701 container died b3c440a82a06842e6731465cd9b97f157c1093b400cd98a7f9b1fac29df06b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T01:04:30.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T01:04:31.022 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:31.022 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T01:04:31.023 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T01:04:31.023 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.1 2024-09-12T01:04:31.329 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:31 smithi071 systemd[1]: Stopping Ceph osd.1 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:31.691 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1[39754]: 2024-09-12T01:04:31.330+0000 7fc221a70640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:31.692 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1[39754]: 2024-09-12T01:04:31.330+0000 7fc221a70640 -1 osd.1 96 *** Got signal Terminated *** 2024-09-12T01:04:31.692 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1[39754]: 2024-09-12T01:04:31.330+0000 7fc221a70640 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:04:37.096 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:36 smithi071 podman[71572]: 2024-09-12 01:04:36.820656477 +0000 UTC m=+5.606828201 container died fe36d1f1a681303f9b294e620164ebafd7bcc21d187116525942f8330f4021d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T01:04:37.442 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:37 smithi071 podman[71572]: 2024-09-12 01:04:37.197067674 +0000 UTC m=+5.983239397 container cleanup fe36d1f1a681303f9b294e620164ebafd7bcc21d187116525942f8330f4021d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T01:04:37.442 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:37 smithi071 bash[71572]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1 2024-09-12T01:04:37.768 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:37 smithi071 podman[71587]: 2024-09-12 01:04:37.448098376 +0000 UTC m=+0.626012959 container remove fe36d1f1a681303f9b294e620164ebafd7bcc21d187116525942f8330f4021d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:04:38.067 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:37 smithi071 podman[71679]: 2024-09-12 01:04:37.672887617 +0000 UTC m=+0.015489914 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:04:38.067 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:37 smithi071 podman[71679]: 2024-09-12 01:04:37.857234768 +0000 UTC m=+0.199837055 container create 94e09810f62eb6a6eef41a9731de9167b1337eba7222d01f52950bc22b397df3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:04:38.323 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:38 smithi071 podman[71679]: 2024-09-12 01:04:38.201820921 +0000 UTC m=+0.544423205 container init 94e09810f62eb6a6eef41a9731de9167b1337eba7222d01f52950bc22b397df3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T01:04:38.324 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:38 smithi071 podman[71679]: 2024-09-12 01:04:38.205120098 +0000 UTC m=+0.547722392 container start 94e09810f62eb6a6eef41a9731de9167b1337eba7222d01f52950bc22b397df3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T01:04:38.324 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:38 smithi071 podman[71679]: 2024-09-12 01:04:38.325295915 +0000 UTC m=+0.667898217 container attach 94e09810f62eb6a6eef41a9731de9167b1337eba7222d01f52950bc22b397df3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T01:04:38.692 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 01:04:38 smithi071 podman[71679]: 2024-09-12 01:04:38.398278369 +0000 UTC m=+0.740880671 container died 94e09810f62eb6a6eef41a9731de9167b1337eba7222d01f52950bc22b397df3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T01:04:39.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T01:04:39.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:39.071 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T01:04:39.071 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T01:04:39.071 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.2 2024-09-12T01:04:39.387 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:39 smithi167 systemd[1]: Stopping Ceph osd.2 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:39.787 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:39 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2[40203]: 2024-09-12T01:04:39.387+0000 7f9c38d29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:39.787 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:39 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2[40203]: 2024-09-12T01:04:39.387+0000 7f9c38d29640 -1 osd.2 96 *** Got signal Terminated *** 2024-09-12T01:04:39.787 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:39 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2[40203]: 2024-09-12T01:04:39.387+0000 7f9c38d29640 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:04:45.037 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:44 smithi167 podman[71532]: 2024-09-12 01:04:44.771295913 +0000 UTC m=+5.505301063 container died 60c3cffe6e65679b9bc9d95c5e03e046427fac585911af5f49df656775b51a78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T01:04:45.422 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:45 smithi167 podman[71532]: 2024-09-12 01:04:45.164216839 +0000 UTC m=+5.898221990 container cleanup 60c3cffe6e65679b9bc9d95c5e03e046427fac585911af5f49df656775b51a78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T01:04:45.422 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:45 smithi167 bash[71532]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2 2024-09-12T01:04:45.777 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:45 smithi167 podman[71549]: 2024-09-12 01:04:45.423765052 +0000 UTC m=+0.648385443 container remove 60c3cffe6e65679b9bc9d95c5e03e046427fac585911af5f49df656775b51a78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T01:04:46.037 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:45 smithi167 podman[71635]: 2024-09-12 01:04:45.681523495 +0000 UTC m=+0.015843390 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:04:46.037 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:45 smithi167 podman[71635]: 2024-09-12 01:04:45.824727434 +0000 UTC m=+0.159047313 container create 37d3fb3caffde54d2a238c34aeb145e96d4709ea75867fb377d15e5da7eb03f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T01:04:46.311 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:46 smithi167 podman[71635]: 2024-09-12 01:04:46.077120146 +0000 UTC m=+0.411440029 container init 37d3fb3caffde54d2a238c34aeb145e96d4709ea75867fb377d15e5da7eb03f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T01:04:46.311 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:46 smithi167 podman[71635]: 2024-09-12 01:04:46.081010235 +0000 UTC m=+0.415330116 container start 37d3fb3caffde54d2a238c34aeb145e96d4709ea75867fb377d15e5da7eb03f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T01:04:46.311 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:46 smithi167 podman[71635]: 2024-09-12 01:04:46.177160952 +0000 UTC m=+0.511480844 container attach 37d3fb3caffde54d2a238c34aeb145e96d4709ea75867fb377d15e5da7eb03f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T01:04:46.311 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 12 01:04:46 smithi167 podman[71635]: 2024-09-12 01:04:46.280661032 +0000 UTC m=+0.614980933 container died 37d3fb3caffde54d2a238c34aeb145e96d4709ea75867fb377d15e5da7eb03f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T01:04:46.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T01:04:46.912 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:46.913 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T01:04:46.913 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T01:04:46.913 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.3 2024-09-12T01:04:47.216 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:46 smithi002 systemd[1]: Stopping Ceph osd.3 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:47.495 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:47 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T01:04:47.216+0000 7ff8cf0f0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:47.495 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:47 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T01:04:47.216+0000 7ff8cf0f0640 -1 osd.3 96 *** Got signal Terminated *** 2024-09-12T01:04:47.495 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:47 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T01:04:47.216+0000 7ff8cf0f0640 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:04:49.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:49 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:49.569+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:50.245 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:49 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T01:04:49.993+0000 7ff8cb6f5640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.625812+0000 front 2024-09-12T01:04:24.625893+0000 (oldest deadline 2024-09-12T01:04:49.926097+0000) 2024-09-12T01:04:50.990 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:50.555+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:51.244 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:50 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T01:04:50.991+0000 7ff8cb6f5640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.625812+0000 front 2024-09-12T01:04:24.625893+0000 (oldest deadline 2024-09-12T01:04:49.926097+0000) 2024-09-12T01:04:51.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:51.014+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:51.524 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:51 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:51.210+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:51.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:51 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:51.524+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:51.945 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:51.548+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:52.244 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:51 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3[51613]: 2024-09-12T01:04:51.946+0000 7ff8cb6f5640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.625812+0000 front 2024-09-12T01:04:24.625893+0000 (oldest deadline 2024-09-12T01:04:49.926097+0000) 2024-09-12T01:04:52.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:52.026+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:52.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:51.799+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:04:52.442 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:52 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:52.186+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:52.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:52 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:52.548+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:52.966 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:52 smithi002 podman[130912]: 2024-09-12 01:04:52.571951179 +0000 UTC m=+5.456610425 container died 019e6b0b805182ee4b61b5b3551ae31ddf4c8ebee00591c4c6891c5ef9470c76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T01:04:52.967 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:52 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:52.639+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:04:52.967 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:52 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:52.588+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:53.244 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:53 smithi002 podman[130912]: 2024-09-12 01:04:53.159374625 +0000 UTC m=+6.044033871 container cleanup 019e6b0b805182ee4b61b5b3551ae31ddf4c8ebee00591c4c6891c5ef9470c76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T01:04:53.245 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:53 smithi002 bash[130912]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3 2024-09-12T01:04:53.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:53.002+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:53.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:52.848+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:04:53.441 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:53.149+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:53.743 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:53 smithi002 podman[130929]: 2024-09-12 01:04:53.402542857 +0000 UTC m=+0.826355533 container remove 019e6b0b805182ee4b61b5b3551ae31ddf4c8ebee00591c4c6891c5ef9470c76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T01:04:53.743 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:53.650+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:04:53.743 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:53 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:53.636+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:53.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:53 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:53.558+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:53.995 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:53 smithi002 podman[131018]: 2024-09-12 01:04:53.647095251 +0000 UTC m=+0.016452597 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:04:53.995 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:53 smithi002 podman[131018]: 2024-09-12 01:04:53.744920389 +0000 UTC m=+0.114277734 container create 3ffbf0178d248f347068766191d7957003fbbbe69d928cb28a329a3b9a8c524c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T01:04:53.995 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:53 smithi002 podman[131018]: 2024-09-12 01:04:53.989132954 +0000 UTC m=+0.358490300 container init 3ffbf0178d248f347068766191d7957003fbbbe69d928cb28a329a3b9a8c524c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T01:04:53.995 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:53 smithi002 podman[131018]: 2024-09-12 01:04:53.992514532 +0000 UTC m=+0.361871888 container start 3ffbf0178d248f347068766191d7957003fbbbe69d928cb28a329a3b9a8c524c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T01:04:54.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:53.992+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:54.288 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:53.806+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:04:54.442 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:54 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:54.168+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:54.495 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:54 smithi002 podman[131018]: 2024-09-12 01:04:54.080767722 +0000 UTC m=+0.450125070 container attach 3ffbf0178d248f347068766191d7957003fbbbe69d928cb28a329a3b9a8c524c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T01:04:54.495 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 12 01:04:54 smithi002 podman[131018]: 2024-09-12 01:04:54.194624673 +0000 UTC m=+0.563982019 container died 3ffbf0178d248f347068766191d7957003fbbbe69d928cb28a329a3b9a8c524c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T01:04:54.907 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:54.698+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:04:54.907 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:54 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:54.670+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:54.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T01:04:54.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:54 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:54.525+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:54.980 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:04:54.981 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T01:04:54.981 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T01:04:54.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.4 2024-09-12T01:04:55.280 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:55 smithi071 systemd[1]: Stopping Ceph osd.4 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:04:55.280 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:55 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:55.142+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:55.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:54.945+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:55.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:54.797+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:04:55.562 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:55 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:55.280+0000 7fdf8bdc2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:04:55.563 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:55 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:55.280+0000 7fdf8bdc2640 -1 osd.4 96 *** Got signal Terminated *** 2024-09-12T01:04:55.563 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:55 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:55.280+0000 7fdf8bdc2640 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:04:55.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:55 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:55.564+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:55.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:55.667+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:04:55.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:55 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:55.682+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:56.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:55.951+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:56.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:55.812+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:04:56.441 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:56 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:56.172+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:56.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:56 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:56.540+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:56.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:56.662+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:04:56.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:56 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:56.643+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:57.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:56 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:56.964+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:57.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:56 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:56.814+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:04:57.442 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:57 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:57.168+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:57.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:57 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:57.522+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:57.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:57 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:57.676+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:04:57.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:57 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:57.624+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:58.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:57 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:57.992+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:58.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:57 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:57.860+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:04:58.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:04:57 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:04:57.898+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:04:58.441 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:58 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:58.186+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:58.505 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:58 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:58.504+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:58.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:58 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:58.504+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:04:58.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:58 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:58.661+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:58.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:58 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:58.668+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:04:58.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:58 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:58.668+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:04:59.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:04:59 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:04:59.023+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:04:59.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:04:58 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:04:58.862+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:04:59.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:58 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:58.858+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:04:59.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:58 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:58.858+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:04:59.533 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:04:59 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:04:59.197+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:04:59.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:59 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:59.534+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:04:59.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:04:59 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:04:59.534+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:04:59.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:04:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:04:59.631+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:04:59.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:59.697+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:04:59.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:04:59 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:04:59.697+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:00.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:00 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:00.061+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:00.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:59 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:59.828+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:00.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:04:59 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:04:59.828+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:00.288 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:04:59 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:04:59.834+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:00.569 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:00 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4[46679]: 2024-09-12T01:05:00.205+0000 7fdf843bf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:24.778276+0000 front 2024-09-12T01:04:24.778344+0000 (oldest deadline 2024-09-12T01:04:50.678043+0000) 2024-09-12T01:05:00.942 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:00 smithi071 podman[71795]: 2024-09-12 01:05:00.714757883 +0000 UTC m=+5.540363708 container died 2898adedd646d4ae97de5fb804c6e800b3102d95a55dd28d37d838994a2874a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:05:00.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:00 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:00.721+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:00.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:00 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:00.569+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:00.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:00 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:00.569+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:00.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:00.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:00.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:00.697+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:00.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:00 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:00.697+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:01.193 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:00 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:00.855+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:01.193 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:01 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:01.018+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:01.194 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:00 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:00.874+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:01.194 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:00 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:00.874+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:01.364 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:01 smithi071 podman[71795]: 2024-09-12 01:05:01.105916531 +0000 UTC m=+5.931522353 container cleanup 2898adedd646d4ae97de5fb804c6e800b3102d95a55dd28d37d838994a2874a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T01:05:01.364 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:01 smithi071 bash[71795]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4 2024-09-12T01:05:01.692 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:01 smithi071 podman[71814]: 2024-09-12 01:05:01.365472097 +0000 UTC m=+0.649081565 container remove 2898adedd646d4ae97de5fb804c6e800b3102d95a55dd28d37d838994a2874a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T01:05:01.692 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:01 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:01.601+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:01.692 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:01 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:01.601+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:01.975 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:01 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:01.740+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:01.976 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:01 smithi071 podman[71901]: 2024-09-12 01:05:01.624981969 +0000 UTC m=+0.015644755 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:05:01.976 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:01 smithi071 podman[71901]: 2024-09-12 01:05:01.732936291 +0000 UTC m=+0.123599119 container create 3ce8760c076f15102906c24cc927d676397bafcc9963ba121c01a516183c00a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T01:05:01.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:01 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:01.656+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:01.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:01 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:01.656+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:01.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:01 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:01.674+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:01.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:01 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:01.674+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:02.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:01 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:01.830+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:02.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:01 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:01.878+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:02.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:01 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:01.878+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:02.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:02 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:02.057+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:02.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:02 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:02.057+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:02.442 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:01 smithi071 podman[71901]: 2024-09-12 01:05:01.976887061 +0000 UTC m=+0.367549847 container init 3ce8760c076f15102906c24cc927d676397bafcc9963ba121c01a516183c00a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:05:02.442 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:01 smithi071 podman[71901]: 2024-09-12 01:05:01.980428495 +0000 UTC m=+0.371091282 container start 3ce8760c076f15102906c24cc927d676397bafcc9963ba121c01a516183c00a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:05:02.442 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:02 smithi071 podman[71901]: 2024-09-12 01:05:02.060115003 +0000 UTC m=+0.450777790 container attach 3ce8760c076f15102906c24cc927d676397bafcc9963ba121c01a516183c00a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:05:02.442 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:02 smithi071 podman[71901]: 2024-09-12 01:05:02.167167135 +0000 UTC m=+0.557829922 container died 3ce8760c076f15102906c24cc927d676397bafcc9963ba121c01a516183c00a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:05:02.726 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 01:05:02 smithi071 podman[71924]: 2024-09-12 01:05:02.71356016 +0000 UTC m=+0.535612222 container remove 3ce8760c076f15102906c24cc927d676397bafcc9963ba121c01a516183c00a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T01:05:02.727 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:02 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:02.612+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:02.727 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:02 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:02.612+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:02.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T01:05:02.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:05:02.769 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T01:05:02.769 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T01:05:02.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.5 2024-09-12T01:05:02.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:02 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:02.625+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:02.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:02 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:02.625+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:02.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:02 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:02.652+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:02.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:02 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:02.652+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:03.070 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:02 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:02.811+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:03.071 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:02 smithi167 systemd[1]: Stopping Ceph osd.5 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:05:03.071 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:02 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:02.878+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:03.071 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:02 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:02.878+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:03.191 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:02 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:02.759+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:03.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:03.072+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:03.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:03.072+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:03.537 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:03.112+0000 7f1a5bfc2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:05:03.537 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:03.112+0000 7f1a5bfc2640 -1 osd.5 96 *** Got signal Terminated *** 2024-09-12T01:05:03.537 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:03.112+0000 7f1a5bfc2640 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:05:03.941 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:03 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:03.790+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:03.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:03 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:03.656+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:03.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:03 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:03.656+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:03.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:03 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:03.617+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:03.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:03 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:03.617+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:03.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:03 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:03.699+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:03.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:03 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:03.699+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:04.067 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:03.801+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:04.067 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:03.832+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:04.067 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:03 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:03.832+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:04.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:04 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:04.068+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:04.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:04 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:04.068+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:04.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:04 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:04.765+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:04.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:04 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:04.683+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:04.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:04 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:04.683+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:04.994 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:04 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:04.615+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:04.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:04 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:04.615+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:04.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:04 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:04.731+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:04.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:04 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:04.731+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:05.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:04 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:04.844+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:05.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:04 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:04.844+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:05.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:04 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:04.843+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:05.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:05 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:05.042+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:05.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:05 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:05.042+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:05.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:05 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:05.797+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:05.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:05 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:05.797+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:05.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:05 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:05.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:05.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:05 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:05.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:05.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:05 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:05.603+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:05.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:05 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:05.603+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:05.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:05 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:05.735+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:05.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:05 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:05.735+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:06.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:05 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:05.879+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:06.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:05 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:05.893+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:06.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:05 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:05.893+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:06.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:06.015+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:06.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:06.015+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:06.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:06 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:06.792+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:06.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:06 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:06.792+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:06.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:06 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:06.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:06.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:06 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:06.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:06.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:06 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:06.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:06.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:06 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:06.726+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:06.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:06 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:06.726+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:06.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:06 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:06.651+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:06.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:06 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:06.651+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:06.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:06 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:06.651+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:07.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:06.840+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:07.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:06.933+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:07.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:06.933+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:07.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:06.933+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:44.274975+0000 front 2024-09-12T01:04:44.274947+0000 (oldest deadline 2024-09-12T01:05:05.975063+0000) 2024-09-12T01:05:07.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:06.984+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:07.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:06.984+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:07.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:06 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:06.984+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:07.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:07.773+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:07.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:07.773+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:07.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:07.623+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:07.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:07.623+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:07.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:07 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:07.623+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:07.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:07 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:07.656+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:07.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:07 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:07.656+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:07.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:07 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:07.656+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:07.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:07 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:07.731+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:07.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:07 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:07.731+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:07.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:07 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:07.731+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:08.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:07.860+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:08.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:07.912+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.372018+0000 front 2024-09-12T01:04:27.372163+0000 (oldest deadline 2024-09-12T01:04:50.871994+0000) 2024-09-12T01:05:08.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:07.912+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.074029+0000 front 2024-09-12T01:04:36.074094+0000 (oldest deadline 2024-09-12T01:04:58.373792+0000) 2024-09-12T01:05:08.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5[47143]: 2024-09-12T01:05:07.912+0000 7f1a545bf640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:44.274975+0000 front 2024-09-12T01:04:44.274947+0000 (oldest deadline 2024-09-12T01:05:05.975063+0000) 2024-09-12T01:05:08.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:07.976+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:08.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:07.976+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:08.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:07 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:07.976+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:08.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:08 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:08.778+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:08.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:08 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:08.778+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:08.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:08 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:08.667+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:08.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:08 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:08.667+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:08.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:08 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:08.667+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:08.975 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:08 smithi167 podman[71753]: 2024-09-12 01:05:08.664075846 +0000 UTC m=+5.698652870 container died 7f86e501eb7a29dd5952fbaa97dbf7f237cce3efd31deebff5991c9b3532985a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T01:05:08.975 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:08 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:08.864+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:08.975 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:08 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:08.864+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:08.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:08 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:08.688+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:08.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:08 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:08.688+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:08.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:08 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:08.688+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:08.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:08 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:08.709+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:08.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:08 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:08.709+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:08.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:08 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:08.709+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:09.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:09 smithi167 podman[71753]: 2024-09-12 01:05:09.083656873 +0000 UTC m=+6.118233895 container cleanup 7f86e501eb7a29dd5952fbaa97dbf7f237cce3efd31deebff5991c9b3532985a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:05:09.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:09 smithi167 bash[71753]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5 2024-09-12T01:05:09.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:09 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:09.026+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:09.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:09 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:09.026+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:09.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:09 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:09.026+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:09.723 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:09 smithi167 podman[71770]: 2024-09-12 01:05:09.310008814 +0000 UTC m=+0.647161661 container remove 7f86e501eb7a29dd5952fbaa97dbf7f237cce3efd31deebff5991c9b3532985a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T01:05:09.978 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:09 smithi167 podman[71857]: 2024-09-12 01:05:09.627500221 +0000 UTC m=+0.016127222 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:05:09.978 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:09 smithi167 podman[71857]: 2024-09-12 01:05:09.735906039 +0000 UTC m=+0.124533020 container create 11a11341b09b013b9c79defcf29190304d8d853e6b798ce3596e7c932e92ee67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T01:05:09.978 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:09 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:09.859+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:09.978 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:09 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:09.859+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:09.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:09 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:09.719+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:09.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:09 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:09.719+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:09.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:09 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:09.719+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:09.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:09 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:09.753+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:09.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:09 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:09.753+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:09.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:09 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:09.753+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:10.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:09 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:09.771+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:10.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:09 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:09.771+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:10.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:09 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:09.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:10.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:09 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:09.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:10.193 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:09 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:09.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:10.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:10 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:10.067+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:10.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:10 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:10.067+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:10.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:10 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:10.067+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:10.287 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:09 smithi167 podman[71857]: 2024-09-12 01:05:09.98008399 +0000 UTC m=+0.368710979 container init 11a11341b09b013b9c79defcf29190304d8d853e6b798ce3596e7c932e92ee67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T01:05:10.288 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:09 smithi167 podman[71857]: 2024-09-12 01:05:09.983694803 +0000 UTC m=+0.372321786 container start 11a11341b09b013b9c79defcf29190304d8d853e6b798ce3596e7c932e92ee67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:05:10.288 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:10 smithi167 podman[71857]: 2024-09-12 01:05:10.071725854 +0000 UTC m=+0.460352845 container attach 11a11341b09b013b9c79defcf29190304d8d853e6b798ce3596e7c932e92ee67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-12T01:05:10.288 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 12 01:05:10 smithi167 podman[71857]: 2024-09-12 01:05:10.176666583 +0000 UTC m=+0.565293568 container died 11a11341b09b013b9c79defcf29190304d8d853e6b798ce3596e7c932e92ee67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:05:10.797 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T01:05:10.836 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:05:10.836 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T01:05:10.836 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T01:05:10.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.6 2024-09-12T01:05:10.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:10 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:10.768+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:10.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:10 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:10.768+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:10.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:10 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:10.768+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:10.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:10 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:10.686+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:10.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:10 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:10.686+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:10.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:10 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:10.686+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:10.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:10 smithi002 systemd[1]: Stopping Ceph osd.6 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:05:11.028 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:10 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:10.832+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:11.029 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:10 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:10.832+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:11.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:10 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:10.771+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:11.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:10 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:10.771+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:11.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:10 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:10.706+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:11.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:10 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:10.706+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:11.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:10 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:10.706+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:11.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:11 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:11.030+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:11.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:11 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:11.030+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:11.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:11 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:11.030+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:11.495 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:11.136+0000 7ffacc221640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:05:11.495 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:11.136+0000 7ffacc221640 -1 osd.6 96 *** Got signal Terminated *** 2024-09-12T01:05:11.495 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:11.136+0000 7ffacc221640 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:05:11.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:11.730+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:11.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:11.730+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:11.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:11.730+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:11.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:11.723+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:11.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:11.723+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:11.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:11 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:11.723+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:12.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:12 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:12.034+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:12.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:12 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:12.034+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:12.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:12 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:12.034+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:12.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:11 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:11.786+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:12.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:11 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:11.786+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:12.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:11 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:11.775+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:12.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:11 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:11.775+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:12.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:11 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:11.730+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:12.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:11 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:11.730+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:12.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:11 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:11.730+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:12.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:12 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:12.702+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:12.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:12 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:12.702+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:12.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:12 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:12.702+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:12.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:12 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:12.703+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:12.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:12 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:12.703+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:12.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:12 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:12.703+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:13.061 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:12 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:12.804+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:13.061 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:12 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:12.804+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:13.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:12 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:12.734+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:13.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:12 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:12.734+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:13.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:12 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:12.728+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:13.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:12 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:12.728+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:13.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:12 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:12.728+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:13.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:13 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:13.062+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:13.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:13 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:13.062+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:13.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:13 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:13.062+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:13.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:13 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:13.658+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:13.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:13 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:13.658+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:13.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:13 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:13.658+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:13.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:13 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:13.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:13.996 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:13 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:13.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:13.996 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:13 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:13.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:13.996 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:13 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:13.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:14.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:13 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:13.763+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:14.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:13 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:13.763+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:14.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:13 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:13.701+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:14.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:13 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:13.701+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:14.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:13 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:13.701+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:14.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:14 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:14.050+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:14.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:14 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:14.050+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:14.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:14 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:14.050+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:14.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:13 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:13.844+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:14.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:13 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:13.844+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:14.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:13 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:13.844+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:14.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:14 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:14.812+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:14.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:14 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:14.812+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:14.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:14 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:14.812+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:14.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:14 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:14.688+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:14.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:14 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:14.688+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:14.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:14 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:14.688+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:14.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:14.658+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:14.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:14.658+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:14.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:14.658+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:14.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:14.644+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:14.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:14.644+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:14.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:14.644+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:14.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:14 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:14.644+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:15.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:15 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:15.033+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:15.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:15 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:15.033+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:15.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:15 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:15.033+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:15.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:14 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:14.795+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:15.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:14 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:14.795+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:15.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:14 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:14.795+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:15.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:15 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:15.819+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:15.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:15 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:15.819+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:15.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:15 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:15.819+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:15.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:15 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:15.651+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:15.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:15 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:15.651+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:15.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:15 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:15.651+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:15.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:15 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:15.651+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:15.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:15.698+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:26.723869+0000 front 2024-09-12T01:04:26.723540+0000 (oldest deadline 2024-09-12T01:04:52.623627+0000) 2024-09-12T01:05:15.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:15.698+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.724588+0000 front 2024-09-12T01:04:33.724745+0000 (oldest deadline 2024-09-12T01:04:57.824662+0000) 2024-09-12T01:05:15.995 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6[58136]: 2024-09-12T01:05:15.698+0000 7ffac481e640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:40.125814+0000 front 2024-09-12T01:04:40.125845+0000 (oldest deadline 2024-09-12T01:05:06.025713+0000) 2024-09-12T01:05:15.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:15.643+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:15.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:15.643+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:15.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:15.643+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:15.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:15 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:15.643+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:16.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:16 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:16.049+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:16.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:16 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:16.049+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:16.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:16 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:16.049+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:16.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:15 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:15.827+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:16.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:15 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:15.827+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:16.288 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:15 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:15.827+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:16.745 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:16 smithi002 podman[131121]: 2024-09-12 01:05:16.477346076 +0000 UTC m=+5.436168694 container died 7053addc255420a8a2f86ce5a36369872a1037f54376a76aa9eaa9659d01513a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T01:05:16.745 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:16.600+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:16.745 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:16.600+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:16.745 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:16.600+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:16.745 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:16 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:16.600+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:16.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:16.802+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:16.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:16.802+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:16.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:16.802+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:16.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:16.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:16.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:16.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:16.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:16.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:16.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:16 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:16.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:17.044 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:16 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:16.790+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:17.044 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:16 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:16.790+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:17.044 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:16 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:16.790+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:17.245 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:16 smithi002 podman[131121]: 2024-09-12 01:05:16.92716215 +0000 UTC m=+5.885984764 container cleanup 7053addc255420a8a2f86ce5a36369872a1037f54376a76aa9eaa9659d01513a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:05:17.245 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:16 smithi002 bash[131121]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6 2024-09-12T01:05:17.245 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:17 smithi002 podman[131136]: 2024-09-12 01:05:17.103622768 +0000 UTC m=+0.616805173 container remove 7053addc255420a8a2f86ce5a36369872a1037f54376a76aa9eaa9659d01513a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T01:05:17.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:17 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:17.045+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:17.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:17 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:17.045+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:17.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:17 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:17.045+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:17.839 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:17 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:17.650+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:17.839 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:17 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:17.650+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:17.839 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:17 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:17.650+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:17.839 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:17 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:17.650+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:17.840 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:17 smithi002 podman[131225]: 2024-09-12 01:05:17.437030896 +0000 UTC m=+0.016487932 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:05:17.840 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:17 smithi002 podman[131225]: 2024-09-12 01:05:17.545985774 +0000 UTC m=+0.125442818 container create 0c7384c60501f35ba441b41c4703b726e076b4934b2f68d5c4c557be8b3aa401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:05:17.840 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:17 smithi002 podman[131225]: 2024-09-12 01:05:17.757293139 +0000 UTC m=+0.336750188 container init 0c7384c60501f35ba441b41c4703b726e076b4934b2f68d5c4c557be8b3aa401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:05:17.840 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:17 smithi002 podman[131225]: 2024-09-12 01:05:17.760730471 +0000 UTC m=+0.340187507 container start 0c7384c60501f35ba441b41c4703b726e076b4934b2f68d5c4c557be8b3aa401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T01:05:17.840 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:17 smithi002 podman[131225]: 2024-09-12 01:05:17.840479004 +0000 UTC m=+0.419936060 container attach 0c7384c60501f35ba441b41c4703b726e076b4934b2f68d5c4c557be8b3aa401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T01:05:18.015 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:17 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:17.755+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:18.015 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:17 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:17.755+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:18.015 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:17 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:17.755+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:18.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:17.753+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:18.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:17.753+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:18.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:17.753+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:18.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:17.707+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:18.193 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:17.707+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:18.193 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:17.707+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:18.193 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:17.707+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:18.241 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 12 01:05:17 smithi002 podman[131225]: 2024-09-12 01:05:17.95359171 +0000 UTC m=+0.533048746 container died 0c7384c60501f35ba441b41c4703b726e076b4934b2f68d5c4c557be8b3aa401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T01:05:18.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:18 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:18.017+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:18.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:18 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:18.017+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:18.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:18 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:18.017+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:18.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T01:05:18.556 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:05:18.556 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T01:05:18.556 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T01:05:18.556 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.7 2024-09-12T01:05:18.745 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:18 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:18.600+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:18.745 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:18 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:18.600+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:18.745 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:18 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:18.600+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:18.745 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:18 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:18.600+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:18.889 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:18.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:18.890 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:18.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:18.890 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:18.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:18.890 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:18.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:18.890 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:18 smithi071 systemd[1]: Stopping Ceph osd.7 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:05:18.891 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:18.786+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:18.891 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:18.786+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:18.891 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:18.786+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:18.891 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:18.890+0000 7f5a2125f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:05:18.892 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:18.890+0000 7f5a2125f640 -1 osd.7 96 *** Got signal Terminated *** 2024-09-12T01:05:18.892 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:18 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:18.890+0000 7f5a2125f640 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:05:19.001 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:18 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:18.743+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:19.001 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:18 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:18.743+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:19.001 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:18 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:18.743+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:19.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:19.002+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:19.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:19.002+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:19.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:19.002+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:19.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:19.617+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:19.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:19.617+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:19.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:19.617+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:19.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:19 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:19.617+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:20.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:19 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:19.754+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:20.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:19 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:19.754+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:20.192 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:19 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:19.754+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:20.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:19 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:19.700+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:20.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:19 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:19.700+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:20.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:19 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:19.700+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:20.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:19 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:19.700+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:20.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:19.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:20.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:19.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:20.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:19.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:20.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:19.789+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:20.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:19.789+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:20.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:19 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:19.789+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:20.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:20.805+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:20.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:20.805+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:20.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:20.805+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:20.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:20.654+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:20.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:20.654+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:20.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:20.654+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:20.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:20.654+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:20.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:20 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:20.620+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:20.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:20 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:20.620+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:20.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:20 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:20.620+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:20.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:20 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:20.620+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:21.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:20.974+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:21.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:20.974+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:21.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:20.974+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:21.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:20.782+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:21.038 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:20.782+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:21.038 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:20 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:20.782+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:21.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:21.766+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:21.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:21.766+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:21.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:21.766+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:21.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:21.664+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:21.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:21.664+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:21.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:21.664+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:21.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:21 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:21.664+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:21.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:21 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:21.666+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:21.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:21 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:21.666+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:21.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:21 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:21.666+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:21.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:21 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:21.666+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:22.275 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:21.793+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:22.276 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:21.793+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:22.276 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:21.793+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:22.276 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:21.962+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:22.276 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:21.962+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:22.276 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:21 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:21.962+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:22.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:22.773+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:22.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:22.773+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:22.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:22.773+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:22.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:22.618+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:22.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:22.618+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:22.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:22.618+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:22.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:22 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:22.618+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:22.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:22.672+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:22.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:22.672+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:22.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:22.672+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:22.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:22 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:22.672+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:23.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:22.808+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:23.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:22.808+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:23.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:22.808+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:23.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:22.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:23.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:22.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:23.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:22 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:22.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:23.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:23.750+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:35.033236+0000 front 2024-09-12T01:04:35.033357+0000 (oldest deadline 2024-09-12T01:04:59.733442+0000) 2024-09-12T01:05:23.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:23.750+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.434336+0000 front 2024-09-12T01:04:41.434315+0000 (oldest deadline 2024-09-12T01:05:05.534329+0000) 2024-09-12T01:05:23.942 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7[53551]: 2024-09-12T01:05:23.750+0000 7f5a1d864640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:51.935883+0000 front 2024-09-12T01:04:51.935845+0000 (oldest deadline 2024-09-12T01:05:14.235851+0000) 2024-09-12T01:05:23.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:23.611+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:23.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:23.611+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:23.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:23.611+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:23.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:23.611+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:23.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:23 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:23.611+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:23.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:23 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:23.683+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:23.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:23 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:23.683+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:23.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:23 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:23.683+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:23.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:23 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:23.683+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:23.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:23 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:23.683+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:24.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:23 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:23.800+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:24.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:23 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:23.800+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:24.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:23 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:23.800+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:24.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:23 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:23.956+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:24.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:23 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:23.956+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:24.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:23 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:23.956+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:24.746 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:24 smithi071 podman[72017]: 2024-09-12 01:05:24.458913521 +0000 UTC m=+5.712367693 container died e2e6f7d8dc027ddee7b58f8183a6967fbcdc512cddc9d8a804e685976ba2f9b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T01:05:24.747 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:24.634+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:24.747 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:24.634+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:24.747 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:24.634+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:24.747 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:24.634+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:24.747 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:24.634+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:24.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:24.681+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:24.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:24.681+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:24.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:24.681+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:24.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:24.681+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:24.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:24 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:24.681+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:25.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:24 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:24.769+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:25.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:24 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:24.769+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:25.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:24 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:24.769+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:25.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:24 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:24.769+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.363144+0000 front 2024-09-12T01:04:59.363033+0000 (oldest deadline 2024-09-12T01:05:24.663042+0000) 2024-09-12T01:05:25.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:24 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:24.991+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:25.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:24 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:24.991+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:25.038 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:24 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:24.991+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:25.047 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:24 smithi071 podman[72017]: 2024-09-12 01:05:24.847641862 +0000 UTC m=+6.101096034 container cleanup e2e6f7d8dc027ddee7b58f8183a6967fbcdc512cddc9d8a804e685976ba2f9b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T01:05:25.047 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:24 smithi071 bash[72017]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7 2024-09-12T01:05:25.441 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:25 smithi071 podman[72032]: 2024-09-12 01:05:25.048743459 +0000 UTC m=+0.591564953 container remove e2e6f7d8dc027ddee7b58f8183a6967fbcdc512cddc9d8a804e685976ba2f9b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T01:05:25.758 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:25.624+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:25.758 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:25.624+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:25.759 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:25.624+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:25.759 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:25.624+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:25.759 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:25 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:25.624+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:25.759 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:25 smithi071 podman[72124]: 2024-09-12 01:05:25.458085208 +0000 UTC m=+0.109296800 container create 5f5692a879c9e6a15492796d0363bd9f192244b4b99fe44062f925cfd2727b5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T01:05:25.759 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:25 smithi071 podman[72124]: 2024-09-12 01:05:25.36438024 +0000 UTC m=+0.015591847 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:05:25.759 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:25 smithi071 podman[72124]: 2024-09-12 01:05:25.660272985 +0000 UTC m=+0.311484585 container init 5f5692a879c9e6a15492796d0363bd9f192244b4b99fe44062f925cfd2727b5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T01:05:25.759 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:25 smithi071 podman[72124]: 2024-09-12 01:05:25.663785607 +0000 UTC m=+0.314997202 container start 5f5692a879c9e6a15492796d0363bd9f192244b4b99fe44062f925cfd2727b5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T01:05:25.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:25 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:25.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:25.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:25 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:25.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:25.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:25 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:25.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:25.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:25 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:25.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:25.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:25 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:25.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:26.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:25 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:25.772+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:26.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:25 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:25.772+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:26.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:25 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:25.772+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:26.037 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:25 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:25.772+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.363144+0000 front 2024-09-12T01:04:59.363033+0000 (oldest deadline 2024-09-12T01:05:24.663042+0000) 2024-09-12T01:05:26.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:25 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:25.948+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:26.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:25 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:25.948+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:26.037 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:25 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:25.948+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:26.038 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:25 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:25.948+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:26.144 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:25 smithi071 podman[72124]: 2024-09-12 01:05:25.760295824 +0000 UTC m=+0.411507428 container attach 5f5692a879c9e6a15492796d0363bd9f192244b4b99fe44062f925cfd2727b5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:05:26.145 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 01:05:25 smithi071 podman[72124]: 2024-09-12 01:05:25.85690481 +0000 UTC m=+0.508116403 container died 5f5692a879c9e6a15492796d0363bd9f192244b4b99fe44062f925cfd2727b5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:05:26.453 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T01:05:26.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:05:26.491 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T01:05:26.491 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T01:05:26.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.8 2024-09-12T01:05:26.692 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:26 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:26.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:26.757 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:26 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:26.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:26.757 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:26 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:26.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:26.758 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:26 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:26.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:26.758 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:26 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:26.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:26.787 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:26 smithi167 systemd[1]: Stopping Ceph osd.8 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:05:26.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:26 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:26.674+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:26.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:26 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:26.674+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:26.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:26 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:26.674+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:26.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:26 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:26.674+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:26.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:26 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:26.674+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:27.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:26.948+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:27.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:26.948+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:27.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:26.948+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:27.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:26.948+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:27.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:26.795+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:27.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:26.795+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:27.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:26.795+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:27.288 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:26.795+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.363144+0000 front 2024-09-12T01:04:59.363033+0000 (oldest deadline 2024-09-12T01:05:24.663042+0000) 2024-09-12T01:05:27.288 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:26.895+0000 7f40acc75640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:05:27.288 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:26.895+0000 7f40acc75640 -1 osd.8 96 *** Got signal Terminated *** 2024-09-12T01:05:27.288 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:26 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:26.895+0000 7f40acc75640 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:05:27.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:27 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:27.675+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:27.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:27 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:27.675+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:27.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:27 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:27.675+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:27.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:27 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:27.675+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:27.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:27 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:27.675+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:27.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:27 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:27.630+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:27.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:27 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:27.630+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:27.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:27 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:27.630+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:27.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:27 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:27.630+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:27.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:27 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:27.630+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:28.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:27 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:27.843+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:28.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:27 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:27.843+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:28.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:27 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:27.843+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:28.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:27 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:27.843+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.363144+0000 front 2024-09-12T01:04:59.363033+0000 (oldest deadline 2024-09-12T01:05:24.663042+0000) 2024-09-12T01:05:28.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:27 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:27.992+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:28.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:27 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:27.992+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:28.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:27 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:27.992+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:28.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:27 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:27.992+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:28.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:28 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:28.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:28.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:28 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:28.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:28.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:28 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:28.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:28.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:28 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:28.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:28.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:28 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:28.677+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:28.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:28 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:28.658+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:28.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:28 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:28.658+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:28.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:28 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:28.658+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:28.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:28 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:28.658+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:28.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:28 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:28.658+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:29.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:28 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:28.871+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:29.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:28 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:28.871+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:29.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:28 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:28.871+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:29.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:28 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:28.871+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.363144+0000 front 2024-09-12T01:04:59.363033+0000 (oldest deadline 2024-09-12T01:05:24.663042+0000) 2024-09-12T01:05:29.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:29 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:29.000+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:29.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:29 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:29.000+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:29.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:29 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:29.000+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:29.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:29 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:29.000+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:29.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:29 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:29.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:29.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:29 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:29.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:29.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:29 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:29.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:29.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:29 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:29.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:29.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:29 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:29.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:29.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:29 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:29.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:29.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:29 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:29.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:29.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:29 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:29.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:29.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:29 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:29.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:29.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:29 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:29.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:29.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:29 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:29.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:29.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:29 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:29.691+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:30.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:29 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:29.913+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:30.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:29 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:29.913+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:30.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:29 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:29.913+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:30.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:29 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:29.913+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.363144+0000 front 2024-09-12T01:04:59.363033+0000 (oldest deadline 2024-09-12T01:05:24.663042+0000) 2024-09-12T01:05:30.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:30.036+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:30.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:30.036+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:30.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:30.036+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:30.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:30.036+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:30.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:30 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:30.653+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:30.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:30 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:30.653+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:30.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:30 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:30.653+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:30.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:30 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:30.653+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:30.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:30 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:30.653+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:30.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:30 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:30.653+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:30.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:30 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:30.652+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:30.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:30 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:30.652+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:30.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:30 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:30.652+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:30.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:30 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:30.652+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:30.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:30 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:30.652+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:30.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:30 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:30.652+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:31.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:30.925+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:33.158497+0000 front 2024-09-12T01:04:33.158400+0000 (oldest deadline 2024-09-12T01:04:57.858606+0000) 2024-09-12T01:05:31.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:30.925+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:42.960355+0000 front 2024-09-12T01:04:42.960334+0000 (oldest deadline 2024-09-12T01:05:08.260570+0000) 2024-09-12T01:05:31.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:30.925+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:48.261539+0000 front 2024-09-12T01:04:48.261480+0000 (oldest deadline 2024-09-12T01:05:13.561401+0000) 2024-09-12T01:05:31.287 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8[53675]: 2024-09-12T01:05:30.925+0000 7f40a927a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.363144+0000 front 2024-09-12T01:04:59.363033+0000 (oldest deadline 2024-09-12T01:05:24.663042+0000) 2024-09-12T01:05:31.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:31 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:31.033+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:31.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:31 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:31.033+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:31.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:31 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:31.033+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:31.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:31 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:31.033+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:31.944 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:31.682+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:31.944 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:31.682+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:31.944 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:31.682+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:31.944 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:31.682+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:31.944 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:31.682+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:31.944 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:31 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:31.682+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:31.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:31 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:31.624+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:31.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:31 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:31.624+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:31.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:31 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:31.624+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:31.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:31 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:31.624+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:31.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:31 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:31.624+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:31.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:31 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:31.624+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:32.355 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:32 smithi167 podman[71973]: 2024-09-12 01:05:32.299058279 +0000 UTC m=+5.603056848 container died 8533729c1a903264ea8ee81eb4e82dbee66a0d760798928a47856ee5d010f743 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T01:05:32.355 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:32 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:32.066+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:32.355 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:32 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:32.066+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:32.355 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:32 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:32.066+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:32.355 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:32 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:32.066+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:32.355 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:32 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:32.066+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:32.927 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:32 smithi167 podman[71973]: 2024-09-12 01:05:32.668935412 +0000 UTC m=+5.972933975 container cleanup 8533729c1a903264ea8ee81eb4e82dbee66a0d760798928a47856ee5d010f743 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T01:05:32.927 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:32 smithi167 bash[71973]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8 2024-09-12T01:05:32.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:32 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:32.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:32.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:32 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:32.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:32.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:32 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:32.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:32.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:32 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:32.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:32.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:32 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:32.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:32.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:32 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:32.638+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:33.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:32 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:32.695+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:33.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:32 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:32.695+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:33.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:32 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:32.695+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:33.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:32 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:32.695+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:33.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:32 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:32.695+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:33.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:32 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:32.695+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:33.234 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:32 smithi167 podman[71990]: 2024-09-12 01:05:32.928725905 +0000 UTC m=+0.626831233 container remove 8533729c1a903264ea8ee81eb4e82dbee66a0d760798928a47856ee5d010f743 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T01:05:33.235 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:33 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:33.057+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:33.235 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:33 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:33.057+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:33.235 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:33 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:33.057+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:33.235 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:33 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:33.058+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:33.235 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:33 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:33.058+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:33.537 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:33 smithi167 podman[72080]: 2024-09-12 01:05:33.139189606 +0000 UTC m=+0.016341464 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:05:33.537 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:33 smithi167 podman[72080]: 2024-09-12 01:05:33.24598162 +0000 UTC m=+0.123133546 container create 369dd052e6ff85bdca5c6808d492805a804eb5899bc1a8aa5f6ebb5303025e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T01:05:33.537 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:33 smithi167 podman[72080]: 2024-09-12 01:05:33.473200033 +0000 UTC m=+0.350351890 container init 369dd052e6ff85bdca5c6808d492805a804eb5899bc1a8aa5f6ebb5303025e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:05:33.537 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:33 smithi167 podman[72080]: 2024-09-12 01:05:33.476366514 +0000 UTC m=+0.353518371 container start 369dd052e6ff85bdca5c6808d492805a804eb5899bc1a8aa5f6ebb5303025e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T01:05:33.944 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:33 smithi167 podman[72080]: 2024-09-12 01:05:33.575563104 +0000 UTC m=+0.452714963 container attach 369dd052e6ff85bdca5c6808d492805a804eb5899bc1a8aa5f6ebb5303025e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T01:05:33.944 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 12 01:05:33 smithi167 podman[72080]: 2024-09-12 01:05:33.668870715 +0000 UTC m=+0.546022574 container died 369dd052e6ff85bdca5c6808d492805a804eb5899bc1a8aa5f6ebb5303025e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T01:05:33.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:33 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:33.655+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:33.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:33 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:33.655+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:33.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:33 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:33.655+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:33.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:33 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:33.655+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:33.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:33 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:33.655+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:33.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:33 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:33.655+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:34.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:33 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:33.699+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:34.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:33 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:33.699+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:34.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:33 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:33.699+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:34.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:33 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:33.699+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:34.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:33 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:33.699+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:34.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:33 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:33.699+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:34.244 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:34 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:34.016+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:34.244 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:34 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:34.016+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:34.245 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:34 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:34.016+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:34.245 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:34 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:34.016+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:34.245 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:34 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:34.016+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:34.272 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T01:05:34.313 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:05:34.313 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T01:05:34.313 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T01:05:34.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.9 2024-09-12T01:05:34.619 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 systemd[1]: Stopping Ceph osd.9 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.619+0000 7f22dbf3b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.619+0000 7f22dbf3b640 -1 osd.9 96 *** Got signal Terminated *** 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.619+0000 7f22dbf3b640 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.640+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.640+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.640+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.640+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.640+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:34.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:34 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:34.640+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:35.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:34 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:34.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:35.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:34 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:34.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:35.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:34 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:34.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:35.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:34 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:34.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:35.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:34 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:34.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:35.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:34 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:34.697+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:35.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.031+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:35.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.031+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:35.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.031+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:35.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.031+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:35.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.031+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:35.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:35 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:35.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:35.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:35 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:35.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:35.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:35 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:35.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:35.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:35 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:35.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:35.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:35 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:35.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:35.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:35 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:35.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:35.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:35 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:35.636+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:35.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:35 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:35.636+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:35.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:35 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:35.636+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:35.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:35 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:35.636+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:35.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:35 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:35.636+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:35.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:35 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:35.636+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:36.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.987+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:36.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.987+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:36.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.987+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:36.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.987+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:36.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:35 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:35.987+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:36.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:36 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:36.689+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:36.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:36 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:36.689+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:36.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:36 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:36.689+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:36.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:36 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:36.689+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:36.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:36 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:36.689+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:36.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:36 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:36.689+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:36.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:36 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:36.654+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:36.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:36 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:36.654+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:36.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:36 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:36.654+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:36.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:36 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:36.654+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:36.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:36 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:36.654+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:36.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:36 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:36.654+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:37.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:36 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:36.953+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:37.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:36 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:36.953+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:37.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:36 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:36.953+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:37.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:36 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:36.953+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:37.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:36 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:36.953+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:37.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:37 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:37.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:37.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:37 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:37.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:37.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:37 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:37.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:37.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:37 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:37.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:37.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:37 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:37.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:37.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:37 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:37.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:37.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:37 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:37.661+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:37.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:37 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:37.662+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:37.994 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:37 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:37.662+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:37.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:37 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:37.662+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:37.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:37 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:37.662+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:37.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:37 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:37.662+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:37.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:37 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:37.662+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:38.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:37 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:37.907+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:38.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:37 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:37.907+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:38.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:37 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:37.907+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:38.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:37 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:37.907+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:38.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:37 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:37.907+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:38.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:38 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:38.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:38.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:38 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:38.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:38.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:38 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:38.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:38.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:38 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:38.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:38.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:38 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:38.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:38.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:38 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:38.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:38.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:38 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:38.643+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:38.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:38 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:38.649+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:28.274672+0000 front 2024-09-12T01:04:28.274597+0000 (oldest deadline 2024-09-12T01:04:49.374792+0000) 2024-09-12T01:05:38.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:38 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:38.649+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:34.676156+0000 front 2024-09-12T01:04:34.676253+0000 (oldest deadline 2024-09-12T01:05:01.076719+0000) 2024-09-12T01:05:38.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:38 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:38.649+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.077350+0000 front 2024-09-12T01:04:41.077518+0000 (oldest deadline 2024-09-12T01:05:06.977198+0000) 2024-09-12T01:05:38.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:38 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:38.649+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:49.278092+0000 front 2024-09-12T01:04:49.278141+0000 (oldest deadline 2024-09-12T01:05:13.378163+0000) 2024-09-12T01:05:38.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:38 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:38.649+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.179983+0000 front 2024-09-12T01:04:59.179924+0000 (oldest deadline 2024-09-12T01:05:23.279849+0000) 2024-09-12T01:05:38.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:38 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9[65143]: 2024-09-12T01:05:38.649+0000 7f22d4538640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:06.681160+0000 front 2024-09-12T01:05:06.681061+0000 (oldest deadline 2024-09-12T01:05:28.981059+0000) 2024-09-12T01:05:39.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:38 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:38.939+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:39.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:38 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:38.939+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:39.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:38 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:38.939+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:39.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:38 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:38.939+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:39.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:38 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:38.939+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:39.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:39.685+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:39.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:39.685+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:39.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:39.685+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:39.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:39.685+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:39.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:39.685+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:39.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:39.685+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:39.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:39 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:39.685+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:40.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:39 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:39.912+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:40.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:39 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:39.912+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:40.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:39 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:39.912+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:40.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:39 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:39.912+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:40.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:39 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:39.912+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:40.495 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:40 smithi002 podman[131325]: 2024-09-12 01:05:40.181203885 +0000 UTC m=+5.666739517 container died bbca6256c34dc186c63e525177c3132c62e1df612fcce151a2d61c02c0d6d9ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T01:05:40.819 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:40 smithi002 podman[131325]: 2024-09-12 01:05:40.594701304 +0000 UTC m=+6.080236932 container cleanup bbca6256c34dc186c63e525177c3132c62e1df612fcce151a2d61c02c0d6d9ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T01:05:40.819 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:40 smithi002 bash[131325]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9 2024-09-12T01:05:40.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:40 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:40.687+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:40.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:40 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:40.687+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:40.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:40 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:40.687+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:40.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:40 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:40.687+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:40.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:40 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:40.687+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:40.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:40 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:40.687+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:40.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:40 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:40.687+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:41.227 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:40 smithi002 podman[131340]: 2024-09-12 01:05:40.82102826 +0000 UTC m=+0.637724750 container remove bbca6256c34dc186c63e525177c3132c62e1df612fcce151a2d61c02c0d6d9ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T01:05:41.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:40 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:40.946+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:41.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:40 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:40.946+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:41.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:40 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:40.946+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:41.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:40 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:40.946+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:41.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:40 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:40.946+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:41.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:40 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:40.946+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:41.495 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:41 smithi002 podman[131427]: 2024-09-12 01:05:41.131172459 +0000 UTC m=+0.016780855 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:05:41.495 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:41 smithi002 podman[131427]: 2024-09-12 01:05:41.229912028 +0000 UTC m=+0.115520452 container create 3a753cc65634d27c821ef393969da9e18298808f069b334e724e2029010a00fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:05:41.495 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:41 smithi002 podman[131427]: 2024-09-12 01:05:41.449077493 +0000 UTC m=+0.334685876 container init 3a753cc65634d27c821ef393969da9e18298808f069b334e724e2029010a00fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T01:05:41.495 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:41 smithi002 podman[131427]: 2024-09-12 01:05:41.452531626 +0000 UTC m=+0.338140011 container start 3a753cc65634d27c821ef393969da9e18298808f069b334e724e2029010a00fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T01:05:41.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:41 smithi002 podman[131427]: 2024-09-12 01:05:41.573981489 +0000 UTC m=+0.459589885 container attach 3a753cc65634d27c821ef393969da9e18298808f069b334e724e2029010a00fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T01:05:41.995 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 12 01:05:41 smithi002 podman[131427]: 2024-09-12 01:05:41.647025162 +0000 UTC m=+0.532633553 container died 3a753cc65634d27c821ef393969da9e18298808f069b334e724e2029010a00fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:05:42.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:41 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:41.722+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:42.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:41 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:41.722+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:42.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:41 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:41.722+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:42.192 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:41 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:41.722+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:42.193 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:41 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:41.722+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:42.193 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:41 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:41.722+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:42.193 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:41 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:41.722+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:42.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:41 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:41.916+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:42.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:41 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:41.916+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:42.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:41 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:41.916+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:42.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:41 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:41.916+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:42.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:41 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:41.916+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:42.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:41 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:41.916+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:42.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T01:05:42.395 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:05:42.395 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T01:05:42.395 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T01:05:42.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.10 2024-09-12T01:05:42.678 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 systemd[1]: Stopping Ceph osd.10 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:05:42.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:42.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:42.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:42.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:42.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:42.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:42.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.678+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:42.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.823+0000 7fa636df6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:05:42.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.823+0000 7fa636df6640 -1 osd.10 96 *** Got signal Terminated *** 2024-09-12T01:05:42.943 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:42 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:42.823+0000 7fa636df6640 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:05:43.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:42 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:42.931+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:43.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:42 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:42.931+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:43.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:42 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:42.931+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:43.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:42 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:42.931+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:43.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:42 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:42.931+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:43.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:42 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:42.931+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:43.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:43 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:43.662+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:43.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:43 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:43.662+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:43.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:43 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:43.662+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:43.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:43 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:43.662+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:43.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:43 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:43.662+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:43.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:43 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:43.662+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:43.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:43 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:43.662+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:44.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:43 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:43.921+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:44.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:43 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:43.921+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:44.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:43 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:43.921+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:44.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:43 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:43.921+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:44.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:43 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:43.921+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:44.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:43 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:43.921+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:44.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:44 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:44.626+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:44.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:44 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:44.626+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:44.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:44 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:44.626+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:44.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:44 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:44.626+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:44.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:44 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:44.626+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:44.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:44 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:44.626+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:44.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:44 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:44.626+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:45.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:44 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:44.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:45.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:44 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:44.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:45.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:44 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:44.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:45.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:44 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:44.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:45.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:44 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:44.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:45.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:44 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:44.969+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:45.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:45 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:45.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:45.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:45 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:45.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:45.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:45 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:45.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:45.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:45 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:45.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:45.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:45 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:45.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:45.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:45 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:45.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:45.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:45 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:45.632+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:46.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:45 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:45.935+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:46.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:45 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:45.935+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:46.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:45 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:45.935+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:46.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:45 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:45.935+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:46.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:45 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:45.935+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:46.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:45 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:45.935+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:46.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:46 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:46.639+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:46.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:46 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:46.639+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:46.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:46 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:46.639+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:46.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:46 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:46.639+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:46.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:46 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:46.639+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:46.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:46 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:46.639+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:46.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:46 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:46.639+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:47.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:46 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:46.917+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:47.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:46 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:46.917+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:47.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:46 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:46.917+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:47.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:46 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:46.917+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:47.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:46 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:46.917+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:47.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:46 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:46.917+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:47.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:46 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:46.917+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:47.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:47 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:47.606+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:27.614749+0000 front 2024-09-12T01:04:27.614729+0000 (oldest deadline 2024-09-12T01:04:50.514917+0000) 2024-09-12T01:05:47.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:47 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:47.606+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:32.816111+0000 front 2024-09-12T01:04:32.816272+0000 (oldest deadline 2024-09-12T01:04:58.116269+0000) 2024-09-12T01:05:47.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:47 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:47.606+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:43.917691+0000 front 2024-09-12T01:04:43.917797+0000 (oldest deadline 2024-09-12T01:05:06.118289+0000) 2024-09-12T01:05:47.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:47 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:47.606+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-12T01:04:52.019442+0000 front 2024-09-12T01:04:52.019468+0000 (oldest deadline 2024-09-12T01:05:15.519496+0000) 2024-09-12T01:05:47.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:47 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:47.606+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:57.820303+0000 front 2024-09-12T01:04:57.820262+0000 (oldest deadline 2024-09-12T01:05:23.120371+0000) 2024-09-12T01:05:47.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:47 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:47.606+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:07.121849+0000 front 2024-09-12T01:05:07.121745+0000 (oldest deadline 2024-09-12T01:05:28.821746+0000) 2024-09-12T01:05:47.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:47 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10[60327]: 2024-09-12T01:05:47.606+0000 7fa6333fb640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.223273+0000 front 2024-09-12T01:05:15.223374+0000 (oldest deadline 2024-09-12T01:05:36.923189+0000) 2024-09-12T01:05:48.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:47 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:47.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:48.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:47 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:47.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:48.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:47 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:47.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:48.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:47 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:47.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:48.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:47 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:47.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:48.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:47 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:47.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:48.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:47 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:47.965+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:48.638 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:48 smithi071 podman[72238]: 2024-09-12 01:05:48.370766175 +0000 UTC m=+5.776288807 container died 68f9f4bf5c7fc211b6d8aa6936c13df5174a87c53e4329fb4acf2779308241f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T01:05:48.941 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:48 smithi071 podman[72238]: 2024-09-12 01:05:48.738922436 +0000 UTC m=+6.144445062 container cleanup 68f9f4bf5c7fc211b6d8aa6936c13df5174a87c53e4329fb4acf2779308241f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:05:48.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:48 smithi071 bash[72238]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10 2024-09-12T01:05:49.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:49.010+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:49.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:49.010+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:49.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:49.010+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:49.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:49.010+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:49.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:49.010+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:49.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:49.010+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:49.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:49 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:49.010+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:49.399 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:49 smithi071 podman[72253]: 2024-09-12 01:05:49.04032081 +0000 UTC m=+0.664377868 container remove 68f9f4bf5c7fc211b6d8aa6936c13df5174a87c53e4329fb4acf2779308241f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:05:49.653 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:49 smithi071 podman[72340]: 2024-09-12 01:05:49.304038969 +0000 UTC m=+0.015824042 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:05:49.653 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:49 smithi071 podman[72340]: 2024-09-12 01:05:49.416075251 +0000 UTC m=+0.127860366 container create 151f00b446f2d101bebdaf3d08ee532bc132094602ef5c05da3627ecf068708e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:05:49.653 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:49 smithi071 podman[72340]: 2024-09-12 01:05:49.651474444 +0000 UTC m=+0.363259530 container init 151f00b446f2d101bebdaf3d08ee532bc132094602ef5c05da3627ecf068708e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:05:49.653 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:49 smithi071 podman[72340]: 2024-09-12 01:05:49.65466534 +0000 UTC m=+0.366450416 container start 151f00b446f2d101bebdaf3d08ee532bc132094602ef5c05da3627ecf068708e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T01:05:49.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:49 smithi071 podman[72340]: 2024-09-12 01:05:49.751535967 +0000 UTC m=+0.463321041 container attach 151f00b446f2d101bebdaf3d08ee532bc132094602ef5c05da3627ecf068708e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T01:05:49.942 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 01:05:49 smithi071 podman[72340]: 2024-09-12 01:05:49.843783605 +0000 UTC m=+0.555568682 container died 151f00b446f2d101bebdaf3d08ee532bc132094602ef5c05da3627ecf068708e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:05:50.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.014+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:50.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.014+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:50.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.014+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:50.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.014+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:50.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.014+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:50.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.014+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:50.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.014+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:50.457 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T01:05:50.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:05:50.496 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T01:05:50.496 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T01:05:50.496 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.11 2024-09-12T01:05:50.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 systemd[1]: Stopping Ceph osd.11 for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:05:51.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.823+0000 7f7c89451640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.823+0000 7f7c89451640 -1 osd.11 96 *** Got signal Terminated *** 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:50 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:50.823+0000 7f7c89451640 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:51.011+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:51.011+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:51.011+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:51.011+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:51.011+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:51.011+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:51.288 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:51 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:51.011+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:52.508 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:52.056+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:52.508 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:52.056+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:52.508 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:52.056+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:52.508 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:52.056+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:52.508 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:52.056+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:52.508 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:52.056+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:52.508 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:52 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:52.056+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:53.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:53.065+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:53.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:53.065+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:53.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:53.065+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:53.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:53.065+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:53.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:53.065+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:53.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:53.065+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:53.538 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:53.065+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:53.538 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:53 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:53.065+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2024-09-12T01:05:26.731717+0000 front 2024-09-12T01:05:26.731700+0000 (oldest deadline 2024-09-12T01:05:52.631785+0000) 2024-09-12T01:05:54.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:54.024+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:54.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:54.024+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:54.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:54.024+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:54.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:54.024+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:54.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:54.024+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:54.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:54.024+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:54.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:54.024+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:54.287 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:54 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:54.024+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2024-09-12T01:05:26.731717+0000 front 2024-09-12T01:05:26.731700+0000 (oldest deadline 2024-09-12T01:05:52.631785+0000) 2024-09-12T01:05:55.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:55.074+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-12T01:04:22.522452+0000 front 2024-09-12T01:04:22.522405+0000 (oldest deadline 2024-09-12T01:04:50.123169+0000) 2024-09-12T01:05:55.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:55.074+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T01:04:36.024428+0000 front 2024-09-12T01:04:36.024273+0000 (oldest deadline 2024-09-12T01:05:01.324137+0000) 2024-09-12T01:05:55.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:55.074+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-12T01:04:41.324530+0000 front 2024-09-12T01:04:41.324599+0000 (oldest deadline 2024-09-12T01:05:06.624530+0000) 2024-09-12T01:05:55.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:55.074+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T01:04:59.927589+0000 front 2024-09-12T01:04:59.927510+0000 (oldest deadline 2024-09-12T01:05:25.227450+0000) 2024-09-12T01:05:55.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:55.074+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-12T01:05:05.227894+0000 front 2024-09-12T01:05:05.227851+0000 (oldest deadline 2024-09-12T01:05:31.628647+0000) 2024-09-12T01:05:55.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:55.074+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-12T01:05:15.030556+0000 front 2024-09-12T01:05:15.030637+0000 (oldest deadline 2024-09-12T01:05:40.330458+0000) 2024-09-12T01:05:55.537 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:55.074+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T01:05:20.330861+0000 front 2024-09-12T01:05:20.330877+0000 (oldest deadline 2024-09-12T01:05:46.731367+0000) 2024-09-12T01:05:55.538 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:55 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11[60274]: 2024-09-12T01:05:55.074+0000 7f7c85a56640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2024-09-12T01:05:26.731717+0000 front 2024-09-12T01:05:26.731700+0000 (oldest deadline 2024-09-12T01:05:52.631785+0000) 2024-09-12T01:05:56.464 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:56 smithi167 podman[72194]: 2024-09-12 01:05:56.20396346 +0000 UTC m=+5.504304633 container died 299f55e74f9b44396ee1161893b2512ff608746acfdb113f220439f81802502e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T01:05:56.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:56 smithi167 podman[72194]: 2024-09-12 01:05:56.565312086 +0000 UTC m=+5.865653262 container cleanup 299f55e74f9b44396ee1161893b2512ff608746acfdb113f220439f81802502e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T01:05:56.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:56 smithi167 bash[72194]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11 2024-09-12T01:05:57.180 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:56 smithi167 podman[72224]: 2024-09-12 01:05:56.841745434 +0000 UTC m=+0.635102305 container remove 299f55e74f9b44396ee1161893b2512ff608746acfdb113f220439f81802502e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T01:05:57.485 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:57 smithi167 podman[72314]: 2024-09-12 01:05:57.084525183 +0000 UTC m=+0.015412975 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:05:57.485 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:57 smithi167 podman[72314]: 2024-09-12 01:05:57.192555392 +0000 UTC m=+0.123443171 container create 260478f985371ad839ac64032372a3142bccf1361849405dd14313deaac981c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T01:05:57.485 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:57 smithi167 podman[72314]: 2024-09-12 01:05:57.403307766 +0000 UTC m=+0.334195545 container init 260478f985371ad839ac64032372a3142bccf1361849405dd14313deaac981c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T01:05:57.485 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:57 smithi167 podman[72314]: 2024-09-12 01:05:57.406570552 +0000 UTC m=+0.337458332 container start 260478f985371ad839ac64032372a3142bccf1361849405dd14313deaac981c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:05:57.485 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:57 smithi167 podman[72314]: 2024-09-12 01:05:57.486654727 +0000 UTC m=+0.417542510 container attach 260478f985371ad839ac64032372a3142bccf1361849405dd14313deaac981c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:05:57.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 12 01:05:57 smithi167 podman[72314]: 2024-09-12 01:05:57.593712901 +0000 UTC m=+0.524600691 container died 260478f985371ad839ac64032372a3142bccf1361849405dd14313deaac981c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:05:58.201 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T01:05:58.241 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:05:58.241 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T01:05:58.242 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T01:05:58.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.a 2024-09-12T01:05:58.553 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 12 01:05:58 smithi002 systemd[1]: Stopping Ceph mds.a for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:05:58.995 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 12 01:05:58 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-a[72470]: 2024-09-12T01:05:58.552+0000 7f5cdb375640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:05:58.995 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 12 01:05:58 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-a[72470]: 2024-09-12T01:05:58.552+0000 7f5cdb375640 -1 mds.a *** got signal Terminated *** 2024-09-12T01:06:02.845 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 12 01:06:02 smithi002 podman[131529]: 2024-09-12 01:06:02.567650553 +0000 UTC m=+4.116937012 container died 3d080893d4d3728a928ba834415cd785b24a64cefa1453a6dafe7aea39020610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T01:06:03.245 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 12 01:06:03 smithi002 podman[131529]: 2024-09-12 01:06:03.020107227 +0000 UTC m=+4.569393686 container cleanup 3d080893d4d3728a928ba834415cd785b24a64cefa1453a6dafe7aea39020610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:06:03.245 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 12 01:06:03 smithi002 bash[131529]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-a 2024-09-12T01:06:03.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T01:06:03.498 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:03.498 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T01:06:03.499 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T01:06:03.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.d 2024-09-12T01:06:03.815 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:03 smithi002 systemd[1]: Stopping Ceph mds.d for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:04.244 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:03 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d[71286]: 2024-09-12T01:06:03.815+0000 7f02a2442640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:04.245 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:03 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d[71286]: 2024-09-12T01:06:03.815+0000 7f02a2442640 -1 mds.d *** got signal Terminated *** 2024-09-12T01:06:08.089 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:07 smithi002 podman[131664]: 2024-09-12 01:06:07.828735087 +0000 UTC m=+4.106478594 container died 12770a24cac8ed735509d3af3f382c8b382cf6611e41a19cb370cf91010d3166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T01:06:08.348 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:08 smithi002 podman[131664]: 2024-09-12 01:06:08.165544367 +0000 UTC m=+4.443287873 container cleanup 12770a24cac8ed735509d3af3f382c8b382cf6611e41a19cb370cf91010d3166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T01:06:08.348 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:08 smithi002 bash[131664]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d 2024-09-12T01:06:08.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T01:06:08.600 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:08 smithi002 podman[131676]: 2024-09-12 01:06:08.350043512 +0000 UTC m=+0.520665669 container remove 12770a24cac8ed735509d3af3f382c8b382cf6611e41a19cb370cf91010d3166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T01:06:08.600 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:08 smithi002 systemd[1]: ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-12T01:06:08.600 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:08 smithi002 systemd[1]: Stopped Ceph mds.d for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T01:06:08.600 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 12 01:06:08 smithi002 systemd[1]: ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.d.service: Consumed 1.075s CPU time. 2024-09-12T01:06:08.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:08.611 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T01:06:08.611 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T01:06:08.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.g 2024-09-12T01:06:08.951 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 01:06:08 smithi002 systemd[1]: Stopping Ceph mds.g for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:09.244 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 01:06:08 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g[72102]: 2024-09-12T01:06:08.951+0000 7f043e8f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:09.245 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 01:06:08 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g[72102]: 2024-09-12T01:06:08.951+0000 7f043e8f3640 -1 mds.g *** got signal Terminated *** 2024-09-12T01:06:11.627 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 01:06:11 smithi002 podman[131783]: 2024-09-12 01:06:11.360370233 +0000 UTC m=+2.516193310 container died 391f4f72709ec860332d2e426d6a2d211d1f2f7427c31ee78e222cb01f737c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:06:11.968 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 01:06:11 smithi002 podman[131783]: 2024-09-12 01:06:11.727550878 +0000 UTC m=+2.883373956 container cleanup 391f4f72709ec860332d2e426d6a2d211d1f2f7427c31ee78e222cb01f737c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T01:06:11.969 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 12 01:06:11 smithi002 bash[131783]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-g 2024-09-12T01:06:12.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T01:06:12.154 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:12.155 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T01:06:12.155 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T01:06:12.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.j 2024-09-12T01:06:12.495 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 12 01:06:12 smithi002 systemd[1]: Stopping Ceph mds.j for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:12.495 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 12 01:06:12 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-j[70866]: 2024-09-12T01:06:12.480+0000 7f72f3299640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:12.496 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 12 01:06:12 smithi002 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-j[70866]: 2024-09-12T01:06:12.480+0000 7f72f3299640 -1 mds.j *** got signal Terminated *** 2024-09-12T01:06:16.744 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 12 01:06:16 smithi002 podman[131903]: 2024-09-12 01:06:16.494694457 +0000 UTC m=+4.114447199 container died 565e23792ddf47ca7ce9dd58483ba0e091bef0b9eb7de6d31c750b6503ba338f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T01:06:17.228 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 12 01:06:16 smithi002 podman[131903]: 2024-09-12 01:06:16.839232051 +0000 UTC m=+4.458984792 container cleanup 565e23792ddf47ca7ce9dd58483ba0e091bef0b9eb7de6d31c750b6503ba338f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T01:06:17.228 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 12 01:06:16 smithi002 bash[131903]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-j 2024-09-12T01:06:17.228 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 12 01:06:17 smithi002 podman[131914]: 2024-09-12 01:06:17.031962254 +0000 UTC m=+0.537005936 container remove 565e23792ddf47ca7ce9dd58483ba0e091bef0b9eb7de6d31c750b6503ba338f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T01:06:17.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T01:06:17.282 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:17.283 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T01:06:17.283 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T01:06:17.283 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.b 2024-09-12T01:06:17.577 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:17 smithi071 systemd[1]: Stopping Ceph mds.b for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:17.838 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: 2024-09-12T01:06:17.578+0000 7f3010073640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:17.839 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:17 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b[65965]: 2024-09-12T01:06:17.578+0000 7f3010073640 -1 mds.b *** got signal Terminated *** 2024-09-12T01:06:19.692 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:19 smithi071 podman[72444]: 2024-09-12 01:06:19.249040329 +0000 UTC m=+1.777503054 container died d739c7e0398b056a52d2d4c22e48893c5eb90a6eea9ed4dafba6a407be0c46b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T01:06:20.069 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:19 smithi071 podman[72444]: 2024-09-12 01:06:19.869759547 +0000 UTC m=+2.398222274 container cleanup d739c7e0398b056a52d2d4c22e48893c5eb90a6eea9ed4dafba6a407be0c46b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True) 2024-09-12T01:06:20.069 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:19 smithi071 bash[72444]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b 2024-09-12T01:06:20.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T01:06:20.320 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:20 smithi071 podman[72468]: 2024-09-12 01:06:20.070954234 +0000 UTC m=+0.816842099 container remove d739c7e0398b056a52d2d4c22e48893c5eb90a6eea9ed4dafba6a407be0c46b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T01:06:20.321 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:20 smithi071 systemd[1]: ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-12T01:06:20.321 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:20 smithi071 systemd[1]: Stopped Ceph mds.b for c8315cee-709f-11ef-bcea-c7b262605968. 2024-09-12T01:06:20.321 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 01:06:20 smithi071 systemd[1]: ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.b.service: Consumed 2min 4.943s CPU time. 2024-09-12T01:06:20.332 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:20.332 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T01:06:20.332 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T01:06:20.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.e 2024-09-12T01:06:20.647 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:06:20 smithi071 systemd[1]: Stopping Ceph mds.e for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:20.941 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:06:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e[65361]: 2024-09-12T01:06:20.648+0000 7f33b5532640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:20.942 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:06:20 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e[65361]: 2024-09-12T01:06:20.648+0000 7f33b5532640 -1 mds.e *** got signal Terminated *** 2024-09-12T01:06:23.506 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:06:23 smithi071 podman[72577]: 2024-09-12 01:06:23.242397711 +0000 UTC m=+2.691368197 container died cebaae80313190f28687987c3e666a5504c010457a8696397dcea3935d668442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-12T01:06:23.898 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:06:23 smithi071 podman[72577]: 2024-09-12 01:06:23.607042275 +0000 UTC m=+3.056012747 container cleanup cebaae80313190f28687987c3e666a5504c010457a8696397dcea3935d668442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T01:06:23.898 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 01:06:23 smithi071 bash[72577]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-e 2024-09-12T01:06:24.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T01:06:24.070 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:24.070 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T01:06:24.070 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T01:06:24.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.h 2024-09-12T01:06:24.191 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:06:24 smithi071 systemd[1]: Stopping Ceph mds.h for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:24.692 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:06:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h[65662]: 2024-09-12T01:06:24.393+0000 7f1d59f66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:24.692 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:06:24 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h[65662]: 2024-09-12T01:06:24.393+0000 7f1d59f66640 -1 mds.h *** got signal Terminated *** 2024-09-12T01:06:27.592 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:06:27 smithi071 podman[72698]: 2024-09-12 01:06:27.242485391 +0000 UTC m=+2.957702854 container died e482ee7a27a0191bb4ae7ff85bdd9ea481ba965f4580363e2614a96c4c3216d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T01:06:27.843 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:06:27 smithi071 podman[72698]: 2024-09-12 01:06:27.67668031 +0000 UTC m=+3.391897772 container cleanup e482ee7a27a0191bb4ae7ff85bdd9ea481ba965f4580363e2614a96c4c3216d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:06:27.843 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:06:27 smithi071 bash[72698]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h 2024-09-12T01:06:28.095 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 01:06:27 smithi071 podman[72711]: 2024-09-12 01:06:27.844448618 +0000 UTC m=+0.604617211 container remove e482ee7a27a0191bb4ae7ff85bdd9ea481ba965f4580363e2614a96c4c3216d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T01:06:28.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T01:06:28.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:28.131 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T01:06:28.131 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T01:06:28.132 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.k 2024-09-12T01:06:28.442 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 01:06:28 smithi071 systemd[1]: Stopping Ceph mds.k for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:28.853 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 01:06:28 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k[65058]: 2024-09-12T01:06:28.466+0000 7f3c78fd8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:28.853 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 01:06:28 smithi071 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k[65058]: 2024-09-12T01:06:28.466+0000 7f3c78fd8640 -1 mds.k *** got signal Terminated *** 2024-09-12T01:06:30.079 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 01:06:29 smithi071 podman[72819]: 2024-09-12 01:06:29.826851817 +0000 UTC m=+1.473241390 container died e1228544ad81a484b7617d90509266df41e2fa5a3e0f854b1e56f9fca551082c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T01:06:30.442 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 01:06:30 smithi071 podman[72819]: 2024-09-12 01:06:30.180494349 +0000 UTC m=+1.826883918 container cleanup e1228544ad81a484b7617d90509266df41e2fa5a3e0f854b1e56f9fca551082c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T01:06:30.442 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 01:06:30 smithi071 bash[72819]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-k 2024-09-12T01:06:30.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T01:06:30.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:30.631 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T01:06:30.631 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T01:06:30.631 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.c 2024-09-12T01:06:30.931 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:06:30 smithi167 systemd[1]: Stopping Ceph mds.c for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:31.287 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:06:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c[65295]: 2024-09-12T01:06:30.931+0000 7f58bd21b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:31.287 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:06:30 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c[65295]: 2024-09-12T01:06:30.931+0000 7f58bd21b640 -1 mds.c *** got signal Terminated *** 2024-09-12T01:06:35.287 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:06:34 smithi167 podman[72415]: 2024-09-12 01:06:34.939001779 +0000 UTC m=+4.106761610 container died 88ed62cf89f6159203a3dd8d5964e182e7fee4066aa43e995e98c3b50d2543d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T01:06:35.582 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:06:35 smithi167 podman[72415]: 2024-09-12 01:06:35.373687551 +0000 UTC m=+4.541447391 container cleanup 88ed62cf89f6159203a3dd8d5964e182e7fee4066aa43e995e98c3b50d2543d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T01:06:35.582 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 12 01:06:35 smithi167 bash[72415]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-c 2024-09-12T01:06:35.806 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T01:06:35.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:35.842 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T01:06:35.842 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T01:06:35.842 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.f 2024-09-12T01:06:36.168 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:06:35 smithi167 systemd[1]: Stopping Ceph mds.f for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:36.537 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:06:36 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f[64993]: 2024-09-12T01:06:36.168+0000 7ff7840d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:36.537 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:06:36 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f[64993]: 2024-09-12T01:06:36.168+0000 7ff7840d1640 -1 mds.f *** got signal Terminated *** 2024-09-12T01:06:39.527 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:06:39 smithi167 podman[72549]: 2024-09-12 01:06:39.242711312 +0000 UTC m=+3.179052572 container died 375bd601d563c94298dc0cb43a94197edde8092588c26c523a4b50005bedc6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T01:06:39.787 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:06:39 smithi167 podman[72549]: 2024-09-12 01:06:39.627861634 +0000 UTC m=+3.564202894 container cleanup 375bd601d563c94298dc0cb43a94197edde8092588c26c523a4b50005bedc6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:06:39.787 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 12 01:06:39 smithi167 bash[72549]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-f 2024-09-12T01:06:40.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T01:06:40.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:40.101 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T01:06:40.101 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T01:06:40.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.i 2024-09-12T01:06:40.413 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:06:40 smithi167 systemd[1]: Stopping Ceph mds.i for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:40.787 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:06:40 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i[65605]: 2024-09-12T01:06:40.414+0000 7faf1f1b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:40.787 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:06:40 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i[65605]: 2024-09-12T01:06:40.414+0000 7faf1f1b2640 -1 mds.i *** got signal Terminated *** 2024-09-12T01:06:43.530 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:06:43 smithi167 podman[72671]: 2024-09-12 01:06:43.263671853 +0000 UTC m=+2.947043052 container died 25c0a1a4d5ac73a003675b95632405d6cafcf5ffa16eccdcf40dfe5a5d6798e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T01:06:43.787 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:06:43 smithi167 podman[72671]: 2024-09-12 01:06:43.640405228 +0000 UTC m=+3.323776425 container cleanup 25c0a1a4d5ac73a003675b95632405d6cafcf5ffa16eccdcf40dfe5a5d6798e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T01:06:43.787 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 12 01:06:43 smithi167 bash[72671]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-i 2024-09-12T01:06:44.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T01:06:44.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:44.106 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T01:06:44.106 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T01:06:44.106 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.l 2024-09-12T01:06:44.426 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 12 01:06:44 smithi167 systemd[1]: Stopping Ceph mds.l for c8315cee-709f-11ef-bcea-c7b262605968... 2024-09-12T01:06:44.787 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 12 01:06:44 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-l[64691]: 2024-09-12T01:06:44.427+0000 7f36f48c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:06:44.787 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 12 01:06:44 smithi167 ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-l[64691]: 2024-09-12T01:06:44.427+0000 7f36f48c6640 -1 mds.l *** got signal Terminated *** 2024-09-12T01:06:47.537 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 12 01:06:47 smithi167 podman[72792]: 2024-09-12 01:06:47.245770475 +0000 UTC m=+2.922313314 container died c48b16179465a9b91294fb02b712184f772ab0d3b6d377a54871ff666532c374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T01:06:47.869 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 12 01:06:47 smithi167 podman[72792]: 2024-09-12 01:06:47.627739608 +0000 UTC m=+3.304282447 container cleanup c48b16179465a9b91294fb02b712184f772ab0d3b6d377a54871ff666532c374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T01:06:47.869 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 12 01:06:47 smithi167 bash[72792]: ceph-c8315cee-709f-11ef-bcea-c7b262605968-mds-l 2024-09-12T01:06:47.987 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8315cee-709f-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T01:06:48.019 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:06:48.020 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T01:06:48.020 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8315cee-709f-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:06:48.232 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T01:06:50.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8315cee-709f-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:06:51.020 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T01:06:53.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8315cee-709f-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:06:53.673 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T01:06:56.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:06:56.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:06:56.149 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:06:56.176 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T01:06:56.178 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi002/crash 2024-09-12T01:06:56.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:06:56.223 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:06:56.223 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:06:56.224 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi071/crash 2024-09-12T01:06:56.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:06:56.267 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:06:56.267 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:06:56.269 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi167/crash 2024-09-12T01:06:56.270 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:06:56.308 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/c8315cee-709f-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:06:56.308 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:06:56.309 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T01:06:56.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T01:06:56.355 INFO:tasks.cephadm:Compressing logs... 2024-09-12T01:06:56.355 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:06:56.358 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:06:56.360 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:06:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T01:06:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-09-12T01:06:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T01:06:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:06:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:06:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T01:06:56.387 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:06:56.387 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T01:06:56.387 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T01:06:56.389 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T01:06:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:: No such file or directory 2024-09-12T01:06:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T01:06:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T01:06:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:06:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T01:06:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T01:06:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T01:06:56.393 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.a.log: 84.6% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:06:56.394 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T01:06:56.394 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:06:56.394 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:06:56.394 INFO:teuthology.orchestra.run.smithi002.stderr: 94.4% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T01:06:56.394 INFO:teuthology.orchestra.run.smithi002.stderr: 94.5% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T01:06:56.395 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:06:56.395 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:06:56.395 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T01:06:56.395 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:06:56.395 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log: 94.5% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T01:06:56.395 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:06:56.395 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:06:56.397 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:06:56.397 INFO:teuthology.orchestra.run.smithi167.stderr:: No such file or directory 2024-09-12T01:06:56.397 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:06:56.397 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T01:06:56.397 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip 82.2% -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr: 90.4% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log: 87.2% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T01:06:56.398 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T01:06:56.399 INFO:teuthology.orchestra.run.smithi002.stderr: 91.0% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:06:56.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T01:06:56.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log: 87.2% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:06:56.401 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:06:56.401 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T01:06:56.401 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T01:06:56.402 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T01:06:56.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:06:56.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T01:06:56.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T01:06:56.404 INFO:teuthology.orchestra.run.smithi071.stderr: 91.8% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T01:06:56.404 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T01:06:56.405 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:06:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T01:06:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.j.log: 87.2% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:06:56.406 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.c.log: 91.9% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T01:06:56.406 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:06:56.408 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:06:56.408 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.3.log: 94.6% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T01:06:56.408 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T01:06:56.415 INFO:teuthology.orchestra.run.smithi002.stderr: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:06:56.421 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:06:56.425 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:06:56.506 INFO:teuthology.orchestra.run.smithi167.stderr: 94.4% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T01:06:56.541 INFO:teuthology.orchestra.run.smithi071.stderr: 94.4% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T01:06:56.781 INFO:teuthology.orchestra.run.smithi002.stderr: 90.2% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T01:06:56.844 INFO:teuthology.orchestra.run.smithi167.stderr: 91.7% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T01:06:56.862 INFO:teuthology.orchestra.run.smithi071.stderr: 91.7% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T01:06:57.254 INFO:teuthology.orchestra.run.smithi002.stderr: 90.4% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T01:06:57.312 INFO:teuthology.orchestra.run.smithi167.stderr: 94.2% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T01:06:57.919 INFO:teuthology.orchestra.run.smithi071.stderr: 94.4% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T01:06:58.923 INFO:teuthology.orchestra.run.smithi167.stderr: 96.0% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T01:06:59.276 INFO:teuthology.orchestra.run.smithi002.stderr: 94.0% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T01:06:59.542 INFO:teuthology.orchestra.run.smithi002.stderr: 93.6% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T01:07:00.741 INFO:teuthology.orchestra.run.smithi167.stderr: 94.1% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T01:07:00.855 INFO:teuthology.orchestra.run.smithi167.stderr: 94.4% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T01:07:01.057 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T01:07:01.277 INFO:teuthology.orchestra.run.smithi002.stderr: 93.8% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T01:07:01.514 INFO:teuthology.orchestra.run.smithi167.stderr: 94.2% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T01:07:01.877 INFO:teuthology.orchestra.run.smithi002.stderr: 94.0% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T01:07:01.880 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-12T01:07:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m5.508s 2024-09-12T01:07:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m17.085s 2024-09-12T01:07:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.620s 2024-09-12T01:07:02.101 INFO:teuthology.orchestra.run.smithi167.stderr: 94.0% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T01:07:02.103 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-12T01:07:02.103 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m5.728s 2024-09-12T01:07:02.103 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m22.843s 2024-09-12T01:07:02.103 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m0.839s 2024-09-12T01:07:02.306 INFO:teuthology.orchestra.run.smithi071.stderr: 94.1% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T01:07:02.375 INFO:teuthology.orchestra.run.smithi071.stderr: 94.1% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T01:07:03.398 INFO:teuthology.orchestra.run.smithi071.stderr: 94.0% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T01:07:39.298 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/c8315cee-709f-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T01:07:39.300 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-12T01:07:39.300 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m42.925s 2024-09-12T01:07:39.300 INFO:teuthology.orchestra.run.smithi071.stderr:user 1m6.324s 2024-09-12T01:07:39.300 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m2.220s 2024-09-12T01:07:39.300 INFO:tasks.cephadm:Archiving logs... 2024-09-12T01:07:39.301 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi002/log 2024-09-12T01:07:39.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:07:41.737 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi071/log 2024-09-12T01:07:41.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:07:50.814 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi167/log 2024-09-12T01:07:50.815 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:07:53.576 INFO:tasks.cephadm:Removing cluster... 2024-09-12T01:07:53.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8315cee-709f-11ef-bcea-c7b262605968 --force 2024-09-12T01:07:53.791 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T01:07:54.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8315cee-709f-11ef-bcea-c7b262605968 --force 2024-09-12T01:07:54.276 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T01:07:54.604 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8315cee-709f-11ef-bcea-c7b262605968 --force 2024-09-12T01:07:54.807 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: c8315cee-709f-11ef-bcea-c7b262605968 2024-09-12T01:07:55.084 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T01:07:55.084 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:07:55.104 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:07:55.121 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:07:55.136 INFO:tasks.cephadm:Teardown complete 2024-09-12T01:07:55.137 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:07:55.151 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:07:55.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:07:55.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:07:55.163 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:07:55.299 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:07:55.312 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:07:55.312 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:07:55.315 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:07:55.317 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:07:55.329 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:07:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:07:55.331 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:07:55.333 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:07:55.333 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-12T01:07:55.334 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -511us[ -491us] +/- 51ms 2024-09-12T01:07:55.334 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -637us[ -637us] +/- 59ms 2024-09-12T01:07:55.334 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +1618us[+1618us] +/- 73ms 2024-09-12T01:07:55.334 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:07:55.335 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:07:55.335 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-12T01:07:55.335 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 -525us[ -488us] +/- 51ms 2024-09-12T01:07:55.335 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 -650us[ -614us] +/- 59ms 2024-09-12T01:07:55.335 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +1602us[+1638us] +/- 73ms 2024-09-12T01:07:55.335 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:07:55.337 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:07:55.337 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-12T01:07:55.337 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -547us[ -545us] +/- 51ms 2024-09-12T01:07:55.337 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -668us[ -666us] +/- 59ms 2024-09-12T01:07:55.337 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +1566us[+1568us] +/- 73ms 2024-09-12T01:07:55.337 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:07:55.337 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:07:55.364 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:07:55.364 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:07:55.403 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:07:55.495 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:07:55.563 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:07:55.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:07:55.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:07:55.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:07:55.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:07:55.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:07:55.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:07:55.719 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:07:55.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:07:55.778 INFO:teuthology.task.internal:Duration was 1926.698231 seconds 2024-09-12T01:07:55.778 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:07:55.809 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:07:55.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:07:55.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:07:55.815 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:07:55.851 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:07:55.853 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:07:55.853 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:07:56.323 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:07:56.324 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-12T01:07:56.324 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:07:56.355 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-12T01:07:56.356 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:07:56.378 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-12T01:07:56.378 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:07:56.421 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:07:56.421 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:07:56.424 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:07:56.426 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:07:56.489 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:07:56.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:07:56.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:07:56.495 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:07:57.733 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:07:57.745 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:07:57.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:07:57.773 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:07:57.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:07:57.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:07:57.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:07:57.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:07:57.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:07:57.868 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-12T01:07:57.873 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-12T01:07:57.900 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-12T01:07:58.097 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:07:58.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:07:58.113 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:07:58.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:07:58.155 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:07:58.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:07:58.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:07:58.188 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:07:58.189 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi002 2024-09-12T01:07:58.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:07:58.256 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi071 2024-09-12T01:07:58.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:07:58.295 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901503/remote/smithi167 2024-09-12T01:07:58.296 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:07:58.336 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:07:58.337 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:07:58.339 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:07:58.342 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:07:58.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:07:58.402 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:07:58.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:07:58.460 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:07:58.460 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:07:58.463 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:07:58.466 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:07:58.476 INFO:teuthology.orchestra.run.smithi002.stdout: 265392 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:07 /home/ubuntu/cephtest 2024-09-12T01:07:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:07 /home/ubuntu/cephtest 2024-09-12T01:07:58.483 INFO:teuthology.orchestra.run.smithi167.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:07 /home/ubuntu/cephtest 2024-09-12T01:07:58.484 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:07:58.502 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:07:58.588 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsx}} duration: 1926.6982305049896 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T01:07:58.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:07:58.691 INFO:teuthology.run:pass